Jul 06 00:57:21.960136 ip-10-0-131-116 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 06 00:57:21.960147 ip-10-0-131-116 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 06 00:57:21.960154 ip-10-0-131-116 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 06 00:57:21.960369 ip-10-0-131-116 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 06 00:57:32.005890 ip-10-0-131-116 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 06 00:57:32.005912 ip-10-0-131-116 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 31b5f6ecf4c0420caca40db001fd598f --
Jul 06 00:59:26.511649 ip-10-0-131-116 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 00:59:26.908294 ip-10-0-131-116 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 00:59:26.908294 ip-10-0-131-116 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 00:59:26.908294 ip-10-0-131-116 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 00:59:26.908294 ip-10-0-131-116 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 00:59:26.908294 ip-10-0-131-116 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 00:59:26.908294 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.880525    2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 00:59:26.908294 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887621    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 00:59:26.908294 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887637    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 00:59:26.908294 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887640    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 00:59:26.908294 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887643    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 00:59:26.908294 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887646    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 00:59:26.908294 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887650    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 00:59:26.908294 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887654    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 00:59:26.908294 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887657    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 00:59:26.909704 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887660    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 00:59:26.909704 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887665    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 00:59:26.909704 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887669    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 00:59:26.909704 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887672    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 00:59:26.909704 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887675    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 00:59:26.909704 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887677    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 00:59:26.909704 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887680    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 00:59:26.909704 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887683    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 00:59:26.909704 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887686    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 00:59:26.909704 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887688    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 00:59:26.909704 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887691    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 00:59:26.909704 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887693    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 00:59:26.909704 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887696    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 00:59:26.909704 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887701    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 00:59:26.909704 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887704    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 00:59:26.909704 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887707    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 00:59:26.909704 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887711    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 00:59:26.909704 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887714    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 00:59:26.909704 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887717    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 00:59:26.910585 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887720    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 00:59:26.910585 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887723    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 00:59:26.910585 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887725    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 00:59:26.910585 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887732    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 00:59:26.910585 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887735    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 00:59:26.910585 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887739    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 00:59:26.910585 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887741    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 00:59:26.910585 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887744    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 00:59:26.910585 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887746    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 00:59:26.910585 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887750    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 00:59:26.910585 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887753    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 00:59:26.910585 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887755    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 00:59:26.910585 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887758    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 00:59:26.910585 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887760    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 00:59:26.910585 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887763    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 00:59:26.910585 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887765    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 00:59:26.910585 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887768    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 00:59:26.910585 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887771    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 00:59:26.910585 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887773    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 00:59:26.910585 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887776    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 00:59:26.911533 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887778    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 00:59:26.911533 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887781    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 00:59:26.911533 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887783    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 00:59:26.911533 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887787    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 00:59:26.911533 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887789    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 00:59:26.911533 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887792    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 00:59:26.911533 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887794    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 00:59:26.911533 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887797    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 00:59:26.911533 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887800    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 00:59:26.911533 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887802    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 00:59:26.911533 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887805    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 00:59:26.911533 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887808    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 00:59:26.911533 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887811    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 00:59:26.911533 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887814    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 00:59:26.911533 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887819    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 00:59:26.911533 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887822    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 00:59:26.911533 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887825    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 00:59:26.911533 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887828    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 00:59:26.911533 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887831    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 00:59:26.912317 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887833    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 00:59:26.912317 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887836    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 00:59:26.912317 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887839    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 00:59:26.912317 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887841    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 00:59:26.912317 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887844    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 00:59:26.912317 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887847    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 00:59:26.912317 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887850    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 00:59:26.912317 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887852    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 00:59:26.912317 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887855    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 00:59:26.912317 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887858    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 00:59:26.912317 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887861    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 00:59:26.912317 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887863    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 00:59:26.912317 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887866    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 00:59:26.912317 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887868    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 00:59:26.912317 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887871    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 00:59:26.912317 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887873    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 00:59:26.912317 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887876    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 00:59:26.912317 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887879    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 00:59:26.912317 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887881    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 00:59:26.912317 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887884    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 00:59:26.914194 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887886    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 00:59:26.914194 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887889    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 00:59:26.914194 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887893    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 00:59:26.914194 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887896    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 00:59:26.914194 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887898    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 00:59:26.914194 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887901    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 00:59:26.914194 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887903    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 00:59:26.914194 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887906    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 00:59:26.914194 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887909    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 00:59:26.914194 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887912    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 00:59:26.914194 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887914    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 00:59:26.914194 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887917    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 00:59:26.914194 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.887920    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 00:59:26.914194 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888639    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 00:59:26.914194 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888646    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 00:59:26.914194 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888649    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 00:59:26.914194 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888652    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 00:59:26.914194 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888654    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 00:59:26.914194 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888657    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 00:59:26.914194 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888660    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 00:59:26.914853 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888663    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 00:59:26.914853 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888666    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 00:59:26.914853 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888670    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 00:59:26.914853 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888675    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 00:59:26.914853 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888677    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 00:59:26.914853 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888680    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 00:59:26.914853 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888683    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 00:59:26.914853 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888687    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 00:59:26.914853 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888689    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 00:59:26.914853 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888692    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 00:59:26.914853 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888695    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 00:59:26.914853 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888699    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 00:59:26.914853 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888702    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 00:59:26.914853 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888704    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 00:59:26.914853 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888707    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 00:59:26.914853 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888710    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 00:59:26.914853 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888712    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 00:59:26.914853 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888715    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 00:59:26.914853 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888717    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 00:59:26.914853 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888720    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 00:59:26.915676 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888723    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 00:59:26.915676 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888726    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 00:59:26.915676 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888728    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 00:59:26.915676 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888731    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 00:59:26.915676 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888734    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 00:59:26.915676 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888736    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 00:59:26.915676 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888740    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 00:59:26.915676 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888744    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 00:59:26.915676 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888746    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 00:59:26.915676 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888749    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 00:59:26.915676 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888752    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 00:59:26.915676 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888755    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 00:59:26.915676 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888757    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 00:59:26.915676 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888760    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 00:59:26.915676 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888763    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 00:59:26.915676 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888765    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 00:59:26.915676 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888768    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 00:59:26.915676 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888770    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 00:59:26.915676 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888773    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 00:59:26.915676 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888776    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 00:59:26.916383 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888779    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 00:59:26.916383 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888781    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 00:59:26.916383 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888784    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 00:59:26.916383 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888788    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 00:59:26.916383 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888790    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 00:59:26.916383 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888793    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 00:59:26.916383 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888795    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 00:59:26.916383 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888798    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 00:59:26.916383 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888800    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 00:59:26.916383 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888803    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 00:59:26.916383 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888805    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 00:59:26.916383 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888808    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 00:59:26.916383 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888810    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 00:59:26.916383 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888813    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 00:59:26.916383 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888815    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 00:59:26.916383 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888818    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 00:59:26.916383 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888820    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 00:59:26.916383 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888823    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 00:59:26.916383 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888825    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 00:59:26.917924 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888828    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 00:59:26.917924 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888830    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 00:59:26.917924 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888833    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 00:59:26.917924 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888835    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 00:59:26.917924 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888838    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 00:59:26.917924 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888841    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 00:59:26.917924 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888844    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 00:59:26.917924 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888846    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 00:59:26.917924 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888849    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 00:59:26.917924 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888851    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 00:59:26.917924 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888854    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 00:59:26.917924 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888857    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 00:59:26.917924 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888863    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 00:59:26.917924 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888866    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 00:59:26.917924 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888868    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 00:59:26.917924 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888874    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 00:59:26.917924 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888878    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 00:59:26.917924 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888882    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 00:59:26.917924 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888885    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 00:59:26.918499 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888888    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 00:59:26.918499 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888891    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 00:59:26.918499 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888893    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 00:59:26.918499 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888896    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 00:59:26.918499 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888899    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 00:59:26.918499 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888902    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 00:59:26.918499 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888905    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 00:59:26.918499 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888908    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 00:59:26.918499 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888910    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 00:59:26.918499 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888913    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 00:59:26.918499 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888915    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 00:59:26.918499 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888918    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 00:59:26.918499 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888921    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 00:59:26.918499 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.888923    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 00:59:26.918499 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889382    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 00:59:26.918499 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889388    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 00:59:26.918499 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889391    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 00:59:26.918499 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889394    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 00:59:26.918499 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889397    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 00:59:26.918499 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889399    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 00:59:26.919118 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889402    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 00:59:26.919118 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889405    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 00:59:26.919118 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889407    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 00:59:26.919118 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889410    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 00:59:26.919118 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889412    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 00:59:26.919118 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889417    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 00:59:26.919118 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889420    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 00:59:26.919118 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889423    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 00:59:26.919118 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889425    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 00:59:26.919118 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889428    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 00:59:26.919118 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889431    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 00:59:26.919118 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889434    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 00:59:26.919118 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889436    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 00:59:26.919118 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889439    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 00:59:26.919118 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889442    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 00:59:26.919118 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889444    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 00:59:26.919118 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889446    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 00:59:26.919118 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889449    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 00:59:26.919118 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889452    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 00:59:26.919118 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889454    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 00:59:26.919954 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889457    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 00:59:26.919954 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889460    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 00:59:26.919954 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889462    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 00:59:26.919954 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889465    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 00:59:26.919954 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889467    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 00:59:26.919954 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889470    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 00:59:26.919954 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889477    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 00:59:26.919954 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889480    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 00:59:26.919954 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889483    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 00:59:26.919954 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889486    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 00:59:26.919954 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889488    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 00:59:26.919954 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889491    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 00:59:26.919954 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889493    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 00:59:26.919954 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889496    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 00:59:26.919954 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889499    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 00:59:26.919954 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889501    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 00:59:26.919954 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889504    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 00:59:26.919954 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889507    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 00:59:26.919954 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889510    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 00:59:26.919954 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889513    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 00:59:26.921192 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889515    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 00:59:26.921192 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889518    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 00:59:26.921192 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889520    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 00:59:26.921192 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889524    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 00:59:26.921192 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889526    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 00:59:26.921192 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889531    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 00:59:26.921192 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889533    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 00:59:26.921192 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889536    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 00:59:26.921192 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889538    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 00:59:26.921192 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889541    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 00:59:26.921192 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889544    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 00:59:26.921192 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889546    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 00:59:26.921192 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889549    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 00:59:26.921192 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889551    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 00:59:26.921192 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889554    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 00:59:26.921192 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889556    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 00:59:26.921192 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889559    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 00:59:26.921192 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889561    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 00:59:26.921192 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889565    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 00:59:26.921192 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889568    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 00:59:27.032092 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889570    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 00:59:27.032092 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889574    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 00:59:27.032092 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889578    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 00:59:27.032092 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889581    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 00:59:27.032092 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889584    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 00:59:27.032092 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889587    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 00:59:27.032092 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889589    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 00:59:27.032092 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889593    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 00:59:27.032092 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889596    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 00:59:27.032092 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889601    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 00:59:27.032092 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889604    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 00:59:27.032092 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889606    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 00:59:27.032092 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889609    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 00:59:27.032092 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889611    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 00:59:27.032092 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889614    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 00:59:27.032092 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889618    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 00:59:27.032092 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889621    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 00:59:27.032092 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889625    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 00:59:27.032092 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889628    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 00:59:26.964920 ip-10-0-131-116 systemd[1]: Started Kubernetes Kubelet.
Jul 06 00:59:27.034143 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889631    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 00:59:27.034143 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889635    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 00:59:27.034143 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889638    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 00:59:27.034143 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889641    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 00:59:27.034143 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889643    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 00:59:27.034143 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889646    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 00:59:27.034143 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889648    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 00:59:27.034143 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889651    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 00:59:27.034143 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889653    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 00:59:27.034143 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889655    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 00:59:27.034143 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889658    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 00:59:27.034143 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889661    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 00:59:27.034143 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889664    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 00:59:27.034143 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.889666    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 00:59:27.034143 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889732    2562 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 00:59:27.034143 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889739    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 00:59:27.034143 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889745    2562 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 00:59:27.034143 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889749    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 00:59:27.034143 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889755    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 00:59:27.034143 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889758    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 00:59:27.034143 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889762    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 00:59:27.034958 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889766    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 00:59:27.034958 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889771    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 00:59:27.034958 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889774    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 00:59:27.034958 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889777    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 00:59:27.034958 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889781    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 00:59:27.034958 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889783    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 00:59:27.034958 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889786    2562 flags.go:64] FLAG: --cgroup-root=""
Jul 06 00:59:27.034958 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889789    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 00:59:27.034958 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889792    2562 flags.go:64] FLAG: --client-ca-file=""
Jul 06 00:59:27.034958 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889800    2562 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 00:59:27.034958 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889803    2562 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 00:59:27.034958 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889809    2562 flags.go:64] FLAG: --cluster-domain=""
Jul 06 00:59:27.034958 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889812    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 00:59:27.034958 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889815    2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 00:59:27.034958 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889818    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 00:59:27.034958 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889821    2562 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 00:59:27.034958 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889825    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 00:59:27.034958 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889828    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 00:59:27.034958 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889831    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 00:59:27.034958 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889834    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 00:59:27.034958 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889837    2562 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 00:59:27.034958 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889839    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 00:59:27.034958 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889845    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 00:59:27.034958 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889848    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 00:59:27.037267 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889851    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 00:59:27.037267 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889855    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 00:59:27.037267 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889858    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 00:59:27.037267 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889861    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 00:59:27.037267 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889864    2562 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 00:59:27.037267 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889867    2562 flags.go:64] FLAG: --enable-server="true"
Jul 06 00:59:27.037267 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889870    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 00:59:27.037267 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889874    2562 flags.go:64] FLAG: --event-burst="100"
Jul 06 00:59:27.037267 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889877    2562 flags.go:64] FLAG: --event-qps="50"
Jul 06 00:59:27.037267 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889881    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 00:59:27.037267 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889884    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 00:59:27.037267 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889887    2562 flags.go:64] FLAG: --eviction-hard=""
Jul 06 00:59:27.037267 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889891    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 00:59:27.037267 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889893    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 00:59:27.037267 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889897    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 00:59:27.037267 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889899    2562 flags.go:64] FLAG: --eviction-soft=""
Jul 06 00:59:27.037267 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889902    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 00:59:27.037267 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889905    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 00:59:27.037267 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889909    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 00:59:27.037267 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889912    2562 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 00:59:27.037267 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889915    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 00:59:27.037267 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889917    2562 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 00:59:27.037267 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889920    2562 flags.go:64] FLAG: --feature-gates=""
Jul 06 00:59:27.037267 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889924    2562 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 00:59:27.037267 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889927    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 00:59:27.038087 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889929    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 00:59:27.038087 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889932    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 00:59:27.038087 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889935    2562 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 00:59:27.038087 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889938    2562 flags.go:64] FLAG: --help="false"
Jul 06 00:59:27.038087 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889941    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-131-116.ec2.internal"
Jul 06 00:59:27.038087 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889945    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 00:59:27.038087 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889949    2562 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 00:59:27.038087 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889953    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 00:59:27.038087 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889958    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 00:59:27.038087 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889964    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 00:59:27.038087 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889967    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 00:59:27.038087 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889970    2562 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 00:59:27.038087 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889973    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 00:59:27.038087 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889976    2562 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 00:59:27.038087 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889979    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 00:59:27.038087 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889982    2562 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 00:59:27.038087 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889985    2562 flags.go:64] FLAG: --kube-reserved=""
Jul 06 00:59:27.038087 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889988    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 00:59:27.038087 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889991    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 00:59:27.038087 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889994    2562 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 00:59:27.038087 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.889997    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 00:59:27.038087 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890000    2562 flags.go:64] FLAG: --lock-file=""
Jul 06 00:59:27.038087 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890003    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 00:59:27.038087 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890006    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 00:59:27.040203 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890009    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 00:59:27.040203 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890014    2562 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 00:59:27.040203 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890017    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 00:59:27.040203 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890020    2562 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 00:59:27.040203 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890023    2562 flags.go:64] FLAG: --logging-format="text"
Jul 06 00:59:27.040203 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890026    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 00:59:27.040203 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890029    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 00:59:27.040203 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890032    2562 flags.go:64] FLAG: --manifest-url=""
Jul 06 00:59:27.040203 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890035    2562 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 00:59:27.040203 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890039    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 00:59:27.040203 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890042    2562 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 00:59:27.040203 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890046    2562 flags.go:64] FLAG: --max-pods="110"
Jul 06 00:59:27.040203 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890049    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 00:59:27.040203 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890053    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 00:59:27.040203 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890056    2562 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 00:59:27.040203 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890059    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 00:59:27.040203 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890062    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 00:59:27.040203 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890065    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 00:59:27.040203 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890068    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 00:59:27.040203 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890075    2562 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 00:59:27.040203 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890078    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 00:59:27.040203 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890081    2562 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 00:59:27.040203 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890084    2562 flags.go:64] FLAG: --pod-cidr=""
Jul 06 00:59:27.040919 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890087    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 00:59:27.040919 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890093    2562 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 00:59:27.040919 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890097    2562 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 00:59:27.040919 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890100    2562 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 00:59:27.040919 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890103    2562 flags.go:64] FLAG: --port="10250"
Jul 06 00:59:27.040919 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890106    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 00:59:27.040919 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890109    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f3049b339000ae81"
Jul 06 00:59:27.040919 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890112    2562 flags.go:64] FLAG: --qos-reserved=""
Jul 06 00:59:27.040919 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890115    2562 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 00:59:27.040919 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890118    2562 flags.go:64] FLAG: --register-node="true"
Jul 06 00:59:27.040919 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890121    2562 flags.go:64] FLAG: --register-with-taints=""
Jul 06 00:59:27.040919 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890125    2562 flags.go:64] FLAG: --registry-burst="10"
Jul 06 00:59:27.040919 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890128    2562 flags.go:64] FLAG: --registry-qps="5"
Jul 06 00:59:27.040919 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890131    2562 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 00:59:27.040919 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890134    2562 flags.go:64] FLAG: --reserved-memory=""
Jul 06 00:59:27.040919 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890137    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 00:59:27.040919 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890140    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 00:59:27.040919 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890143    2562 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 00:59:27.040919 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890145    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 00:59:27.040919 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890148    2562 flags.go:64] FLAG: --runonce="false"
Jul 06 00:59:27.040919 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890151    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 00:59:27.040919 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890154    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 00:59:27.040919 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890158    2562 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 00:59:27.040919 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890161    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 00:59:27.040919 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890163    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 00:59:27.041902 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890166    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 00:59:27.041902 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890169    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 00:59:27.041902 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890172    2562 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 00:59:27.041902 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890175    2562 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 00:59:27.041902 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890178    2562 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 00:59:27.041902 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890181    2562 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 00:59:27.041902 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890184    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 00:59:27.041902 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890187    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 00:59:27.041902 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890189    2562 flags.go:64] FLAG: --system-cgroups=""
Jul 06 00:59:27.041902 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890193    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 00:59:27.041902 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890198    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 00:59:27.041902 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890201    2562 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 00:59:27.041902 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890204    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 00:59:27.041902 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890208    2562 flags.go:64] FLAG: --tls-min-version=""
Jul 06 00:59:27.041902 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890211    2562 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 00:59:27.041902 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890214    2562 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 00:59:27.041902 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890217    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 00:59:27.041902 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890219    2562 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 00:59:27.041902 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890222    2562 flags.go:64] FLAG: --v="2"
Jul 06 00:59:27.041902 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890227    2562 flags.go:64] FLAG: --version="false"
Jul 06 00:59:27.041902 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890231    2562 flags.go:64] FLAG: --vmodule=""
Jul 06 00:59:27.041902 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890235    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 00:59:27.041902 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.890238    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 00:59:27.041902 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890363    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 00:59:27.041902 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890367    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 00:59:27.042649 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890370    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 00:59:27.042649 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890373    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 00:59:27.042649 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890377    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 00:59:27.042649 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890380    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 00:59:27.042649 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890384    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 00:59:27.042649 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890387    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 00:59:27.042649 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890389    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 00:59:27.042649 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890392    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 00:59:27.042649 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890394    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 00:59:27.042649 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890397    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 00:59:27.042649 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890400    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 00:59:27.042649 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890403    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 00:59:27.042649 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890405    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 00:59:27.042649 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890408    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 00:59:27.042649 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890411    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 00:59:27.042649 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890413    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 00:59:27.042649 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890417    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 00:59:27.042649 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890420    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 00:59:27.042649 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890422    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 00:59:27.042649 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890425    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 00:59:27.043526 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890428    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 00:59:27.043526 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890432    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 00:59:27.043526 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890437    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 00:59:27.043526 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890440    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 00:59:27.043526 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890443    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 00:59:27.043526 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890445    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 00:59:27.043526 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890449    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 00:59:27.043526 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890452    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 00:59:27.043526 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890455    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 00:59:27.043526 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890458    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 00:59:27.043526 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890461    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 00:59:27.043526 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890464    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 00:59:27.043526 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890467    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 00:59:27.043526 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890469    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 00:59:27.043526 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890472    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 00:59:27.043526 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890475    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 00:59:27.043526 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890478    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 00:59:27.043526 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890481    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 00:59:27.043526 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890484    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 00:59:27.044091 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890486    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 00:59:27.044091 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890489    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 00:59:27.044091 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890492    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 00:59:27.044091 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890494    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 00:59:27.044091 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890497    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 00:59:27.044091 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890500    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 00:59:27.044091 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890502    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 00:59:27.044091 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890505    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 00:59:27.044091 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890508    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 00:59:27.044091 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890511    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 00:59:27.044091 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890514    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 00:59:27.044091 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890517    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 00:59:27.044091 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890519    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 00:59:27.044091 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890522    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 00:59:27.044091 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890524    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 00:59:27.044091 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890527    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 00:59:27.044091 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890529    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 00:59:27.044091 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890532    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 00:59:27.044091 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890534    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 00:59:27.044091 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890537    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 00:59:27.044879 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890540    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 00:59:27.044879 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890542    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 00:59:27.044879 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890546    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 00:59:27.044879 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890548    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 00:59:27.044879 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890551    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 00:59:27.044879 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890554    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 00:59:27.044879 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890557    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 00:59:27.044879 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890561    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 00:59:27.044879 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890564    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 00:59:27.044879 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890568    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 00:59:27.044879 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890572    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 00:59:27.044879 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890575    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 00:59:27.044879 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890578    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 00:59:27.044879 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890580    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 00:59:27.044879 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890583    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 00:59:27.044879 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890586    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 00:59:27.044879 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890588    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 00:59:27.044879 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890591    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 00:59:27.044879 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890593    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 00:59:27.045507 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890596    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 00:59:27.045507 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890599    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 00:59:27.045507 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890602    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 00:59:27.045507 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890605    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 00:59:27.045507 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890608    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 00:59:27.045507 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890610    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 00:59:27.045507 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890613    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 00:59:27.045507 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890615    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 00:59:27.045507 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890618    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 00:59:27.045507 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890621    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 00:59:27.045507 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890623    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 00:59:27.045507 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890626    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 00:59:27.045507 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890628    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 00:59:27.045507 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890631    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 00:59:27.045507 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890634    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 00:59:27.045507 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890636    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 00:59:27.045507 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890639    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 00:59:27.045507 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890642    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 00:59:27.045507 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.890644    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 00:59:27.046222 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.891154    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 00:59:27.046222 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.897964    2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 00:59:27.046222 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.897980    2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 00:59:27.046222 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.898000    2562 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 00:59:27.046222 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.898006    2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 00:59:27.046222 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898072    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 00:59:27.046222 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898077    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 00:59:27.046222 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898081    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 00:59:27.046222 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898084    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 00:59:27.046222 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898087    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 00:59:27.046222 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898090    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 00:59:27.046222 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898093    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 00:59:27.046222 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898096    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 00:59:27.046222 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898099    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 00:59:27.046222 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898102    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 00:59:27.046716 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898106    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 00:59:27.046716 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898110    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 00:59:27.046716 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898113    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 00:59:27.046716 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898116    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 00:59:27.046716 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898120    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 00:59:27.046716 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898123    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 00:59:27.046716 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898126    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 00:59:27.046716 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898129    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 00:59:27.046716 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898131    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 00:59:27.046716 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898136    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 00:59:27.046716 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898139    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 00:59:27.046716 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898141    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 00:59:27.046716 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898144    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 00:59:27.046716 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898147    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 00:59:27.046716 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898150    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 00:59:27.046716 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898152    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 00:59:27.046716 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898155    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 00:59:27.046716 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898158    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 00:59:27.046716 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898160    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 00:59:28.767184 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898164    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 00:59:28.767184 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898167    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 00:59:28.767184 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898170    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 00:59:28.767184 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898172    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 00:59:28.767184 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898175    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 00:59:28.767184 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898178    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 00:59:28.767184 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898181    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 00:59:28.767184 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898183    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 00:59:28.767184 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898186    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 00:59:28.767184 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898188    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 00:59:28.767184 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898191    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 00:59:28.767184 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898194    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 00:59:28.767184 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898196    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 00:59:28.767184 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898199    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 00:59:28.767184 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898202    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 00:59:28.767184 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898204    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 00:59:28.767184 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898207    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 00:59:28.767184 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898210    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 00:59:28.767184 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898213    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 00:59:28.767184 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898216    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 00:59:28.790290 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898218    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 00:59:28.790290 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898221    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 00:59:28.790290 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898225    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 00:59:28.790290 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898227    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 00:59:28.790290 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898230    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 00:59:28.790290 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898232    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 00:59:28.790290 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898235    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 00:59:28.790290 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898237    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 00:59:28.790290 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898240    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 00:59:28.790290 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898243    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 00:59:28.790290 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898247    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 00:59:28.790290 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898251    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 00:59:28.790290 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898255    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 00:59:28.790290 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898258    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 00:59:28.790290 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898261    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 00:59:28.790290 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898264    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 00:59:28.790290 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898267    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 00:59:28.790290 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898270    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 00:59:28.790290 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898273    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 00:59:28.791195 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898275    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 00:59:28.791195 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898295    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 00:59:28.791195 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898298    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 00:59:28.791195 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898300    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 00:59:28.791195 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898303    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 00:59:28.791195 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898306    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 00:59:28.791195 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898308    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 00:59:28.791195 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898311    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 00:59:28.791195 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898313    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 00:59:28.791195 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898316    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 00:59:28.791195 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898319    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 00:59:28.791195 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898322    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 00:59:28.791195 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898325    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 00:59:28.791195 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898327    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 00:59:28.791195 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898330    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 00:59:28.791195 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898334    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 00:59:28.791195 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898337    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 00:59:28.791195 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898340    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 00:59:28.791195 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898343    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 00:59:28.791195 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898346    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 00:59:28.791835 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898349    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 00:59:28.791835 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898352    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 00:59:28.791835 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898354    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 00:59:28.791835 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898357    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 00:59:28.791835 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898359    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 00:59:28.791835 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898362    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 00:59:28.791835 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898364    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 00:59:28.791835 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898368    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 00:59:28.791835 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898370    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 00:59:28.791835 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898373    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 00:59:28.791835 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898376    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 00:59:28.791835 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.898381    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 00:59:28.791835 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898511    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 00:59:28.791835 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898517    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 00:59:28.791835 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898520    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 00:59:28.792570 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898523    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 00:59:28.792570 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898527    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 00:59:28.792570 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898532    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 00:59:28.792570 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898535    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 00:59:28.792570 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898537    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 00:59:28.792570 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898540    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 00:59:28.792570 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898542    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 00:59:28.792570 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898545    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 00:59:28.792570 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898548    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 00:59:28.792570 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898551    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 00:59:28.792570 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898553    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 00:59:28.792570 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898556    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 00:59:28.792570 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898560    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 00:59:28.792570 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898563    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 00:59:28.792570 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898565    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 00:59:28.792570 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898568    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 00:59:28.792570 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898571    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 00:59:28.792570 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898574    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 00:59:28.792570 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898576    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 00:59:28.792570 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898579    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 00:59:28.793189 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898582    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 00:59:28.793189 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898584    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 00:59:28.793189 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898587    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 00:59:28.793189 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898589    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 00:59:28.793189 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898591    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 00:59:28.793189 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898595    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 00:59:28.793189 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898597    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 00:59:28.793189 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898601    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 00:59:28.793189 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898603    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 00:59:28.793189 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898606    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 00:59:28.793189 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898608    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 00:59:28.793189 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898612    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 00:59:28.793189 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898615    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 00:59:28.793189 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898618    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 00:59:28.793189 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898620    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 00:59:28.793189 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898623    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 00:59:28.793189 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898626    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 00:59:28.793189 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898628    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 00:59:28.793189 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898631    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 00:59:28.793189 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898633    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 00:59:28.793926 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898637    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 00:59:28.793926 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898640    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 00:59:28.793926 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898643    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 00:59:28.793926 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898645    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 00:59:28.793926 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898649    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 00:59:28.793926 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898652    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 00:59:28.793926 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898654    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 00:59:28.793926 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898657    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 00:59:28.793926 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898660    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 00:59:28.793926 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898662    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 00:59:28.793926 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898665    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 00:59:28.793926 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898667    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 00:59:28.793926 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898670    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 00:59:28.793926 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898672    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 00:59:28.793926 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898675    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 00:59:28.793926 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898677    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 00:59:28.793926 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898680    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 00:59:28.793926 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898682    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 00:59:28.793926 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898686    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 00:59:28.793926 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898688    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 00:59:28.794579 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898691    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 00:59:28.794579 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898693    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 00:59:28.794579 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898696    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 00:59:28.794579 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898699    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 00:59:28.794579 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898701    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 00:59:28.794579 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898704    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 00:59:28.794579 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898706    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 00:59:28.794579 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898709    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 00:59:28.794579 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898711    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 00:59:28.794579 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898714    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 00:59:28.794579 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898716    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 00:59:28.794579 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898719    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 00:59:28.794579 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898723    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 00:59:28.794579 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898725    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 00:59:28.794579 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898728    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 00:59:28.794579 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898732    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 00:59:28.794579 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898737    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 00:59:28.794579 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898740    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 00:59:28.794579 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898742    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 00:59:28.795394 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898745    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 00:59:28.795394 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898748    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 00:59:28.795394 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898751    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 00:59:28.795394 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898753    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 00:59:28.795394 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898756    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 00:59:28.795394 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898758    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 00:59:28.795394 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898761    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 00:59:28.795394 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898764    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 00:59:28.795394 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898767    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 00:59:28.795394 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898769    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 00:59:28.795394 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898772    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 00:59:28.795394 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898774    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 00:59:28.795394 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898777    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 00:59:28.795394 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898780    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 00:59:28.795394 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898783    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 00:59:28.795394 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898785    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 00:59:28.795394 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:26.898787    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 00:59:28.795892 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.898793    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 00:59:28.795892 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.898899    2562 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 00:59:28.795892 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.900767    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 00:59:28.795892 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.901985    2562 server.go:1019] "Starting client certificate rotation"
Jul 06 00:59:28.795892 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.902081    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 00:59:28.795892 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.902117    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 00:59:28.795892 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.904205    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 00:59:28.795892 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.906959    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 00:59:28.795892 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.923714    2562 log.go:25] "Validated CRI v1 runtime API"
Jul 06 00:59:28.795892 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.926089    2562 log.go:25] "Validated CRI v1 image API"
Jul 06 00:59:28.795892 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.926998    2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 00:59:28.795892 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.931330    2562 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b92d2769-846c-4cfb-b616-6f888d25f804:/dev/nvme0n1p3 c90be816-77c7-4ee4-aa60-6f6c6ff9a74b:/dev/nvme0n1p4]
Jul 06 00:59:28.796601 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.931347    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 00:59:28.796601 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.932913    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 00:59:28.796813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.941082    2562 manager.go:216] Machine: {Timestamp:2026-07-06 00:59:26.940560303 +0000 UTC m=+0.321403635 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099246 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ad12c738548d1999aaed3ed95ec6b SystemUUID:ec2ad12c-7385-48d1-999a-aed3ed95ec6b BootID:31b5f6ec-f4c0-420c-aca4-0db001fd598f Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6b:b3:9a:43:e7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6b:b3:9a:43:e7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:32:f1:21:cc:3e:4d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 00:59:28.796813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.941188    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 00:59:28.796813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.941263    2562 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 00:59:28.796813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.943953    2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 00:59:28.796813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.943980    2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-116.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 00:59:28.796813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.944689    2562 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 00:59:28.796813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.944698    2562 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 00:59:28.796813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.944710    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 00:59:28.796813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.945211    2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 00:59:28.796813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.946236    2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 00:59:28.796813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.948606    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 00:59:28.796813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.948715    2562 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 00:59:28.796813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.948741    2562 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 00:59:28.796813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.948750    2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 00:59:28.796813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.948760    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 00:59:28.796813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.948772    2562 kubelet.go:398] "Adding apiserver pod source"
Jul 06 00:59:28.796813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.948785    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 00:59:28.796813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.949115    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.949129    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.950928    2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.951675    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-w46zg"
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:26.958667    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:26.958742    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-116.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.958890    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-w46zg"
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.959451    2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.959478    2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.960266    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.960294    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.960303    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.960309    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.960317    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.960323    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.960557    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.960564    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.960570    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.960576    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.960584    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.960592    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.960615    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.960622    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.963833    2562 server.go:1268] "Started kubelet"
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.963971    2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.964014    2562 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.964085    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.965068    2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:26.969825    2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.971947    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.971954    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:26.972072    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-116.ec2.internal\" not found"
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.972577    2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.972590    2562 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.972597    2562 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.972754    2562 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.972761    2562 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.980469    2562 factory.go:55] Registering systemd factory
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.980491    2562 factory.go:223] Registration of the systemd container factory successfully
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.980796    2562 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.980842    2562 factory.go:153] Registering CRI-O factory
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.981119    2562 factory.go:223] Registration of the crio container factory successfully
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.981171    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.981194    2562 factory.go:103] Registering Raw factory
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.981205    2562 manager.go:1196] Started watching for new ooms in manager
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.981552    2562 manager.go:349] Starting recovery of all containers
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.983175    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.988084    2562 manager.go:354] Recovery completed
Jul 06 00:59:28.941922 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:26.991811    2562 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-131-116.ec2.internal\" not found" node="ip-10-0-131-116.ec2.internal"
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.993802    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:26.994705    2562 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-131-116.ec2.internal" not found
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:27.002567    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-116.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:27.002601    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-116.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:27.002618    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-116.ec2.internal" event="NodeHasSufficientPID"
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:27.003833    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:27.003842    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:27.003857    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:27.004143    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:27.004847    2562 policy_none.go:49] "None policy: Start"
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:27.004862    2562 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:27.004877    2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:27.005153    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-116.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:27.005182    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-116.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:27.005201    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-116.ec2.internal" event="NodeHasSufficientPID"
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:27.005798    2562 policy_none.go:47] "Start"
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:27.009620    2562 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-131-116.ec2.internal" not found
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:27.046994    2562 manager.go:337] "Starting Device Plugin manager"
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:27.047025    2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:27.047035    2562 server.go:87] "Starting device plugin registration server"
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:27.047311    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:27.047325    2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:27.047592    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:27.047664    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:27.047673    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:27.048358    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:27.048405    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-116.ec2.internal\" not found"
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:27.071931    2562 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-131-116.ec2.internal" not found
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:28.717500    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:28.718646    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-116.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:28.718675    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-116.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:28.718689    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-116.ec2.internal" event="NodeHasSufficientPID"
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:28.718720    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-116.ec2.internal"
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:28.733214    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-116.ec2.internal"
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:28.733241    2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-116.ec2.internal\": node \"ip-10-0-131-116.ec2.internal\" not found"
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:28.744544    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:28.745795    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:28.745839    2562 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:28.745859    2562 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:28.745898    2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:28.747005    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-116.ec2.internal\" not found"
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:28.748053    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:28.846371    2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-116.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-116.ec2.internal"]
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:28.846459    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:28.847741    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-116.ec2.internal\" not found"
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:28.848064    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-116.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 00:59:28.943813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:28.848096    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-116.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 00:59:28.945192 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:28.848107    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-116.ec2.internal" event="NodeHasSufficientPID"
Jul 06 00:59:28.945192 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:28.850318    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 00:59:28.945192 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:28.850441    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-116.ec2.internal"
Jul 06 00:59:28.945192 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:28.850469    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 00:59:28.945192 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:28.851749    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-116.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 00:59:28.945192 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:28.851755    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-116.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 00:59:28.945192 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:28.851774    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-116.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 00:59:28.945192 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:28.851790    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-116.ec2.internal" event="NodeHasSufficientPID"
Jul 06 00:59:28.945192 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:28.851778    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-116.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 00:59:28.945192 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:28.851858    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-116.ec2.internal" event="NodeHasSufficientPID"
Jul 06 00:59:28.945192 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:28.854125    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-116.ec2.internal"
Jul 06 00:59:28.945192 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:28.854162    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 00:59:28.945192 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:28.854774    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-116.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 00:59:28.945192 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:28.854800    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-116.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 00:59:28.945192 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:28.854809    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-116.ec2.internal" event="NodeHasSufficientPID"
Jul 06 00:59:28.945192 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:28.886808    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-116.ec2.internal\" not found" node="ip-10-0-131-116.ec2.internal"
Jul 06 00:59:28.945192 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:28.891258    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-116.ec2.internal\" not found" node="ip-10-0-131-116.ec2.internal"
Jul 06 00:59:29.112939 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:28.948362    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-116.ec2.internal\" not found"
Jul 06 00:59:29.112939 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.043988    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2b0e7f033d28149e3cc1491a1bf5fe87-config\") pod \"kube-apiserver-proxy-ip-10-0-131-116.ec2.internal\" (UID: \"2b0e7f033d28149e3cc1491a1bf5fe87\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-116.ec2.internal"
Jul 06 00:59:29.112939 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.044021    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d8773ab7175117a866c88af6c1f78223-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-116.ec2.internal\" (UID: \"d8773ab7175117a866c88af6c1f78223\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-116.ec2.internal"
Jul 06 00:59:29.112939 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.044040    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8773ab7175117a866c88af6c1f78223-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-116.ec2.internal\" (UID: \"d8773ab7175117a866c88af6c1f78223\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-116.ec2.internal"
Jul 06 00:59:29.112939 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:29.049049    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-116.ec2.internal\" not found"
Jul 06 00:59:29.305403 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.144403    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8773ab7175117a866c88af6c1f78223-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-116.ec2.internal\" (UID: \"d8773ab7175117a866c88af6c1f78223\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-116.ec2.internal"
Jul 06 00:59:29.305403 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.144433    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2b0e7f033d28149e3cc1491a1bf5fe87-config\") pod \"kube-apiserver-proxy-ip-10-0-131-116.ec2.internal\" (UID: \"2b0e7f033d28149e3cc1491a1bf5fe87\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-116.ec2.internal"
Jul 06 00:59:29.305403 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.144464    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d8773ab7175117a866c88af6c1f78223-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-116.ec2.internal\" (UID: \"d8773ab7175117a866c88af6c1f78223\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-116.ec2.internal"
Jul 06 00:59:29.305403 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.144496    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8773ab7175117a866c88af6c1f78223-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-116.ec2.internal\" (UID: \"d8773ab7175117a866c88af6c1f78223\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-116.ec2.internal"
Jul 06 00:59:29.305403 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.144498    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d8773ab7175117a866c88af6c1f78223-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-116.ec2.internal\" (UID: \"d8773ab7175117a866c88af6c1f78223\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-116.ec2.internal"
Jul 06 00:59:29.305403 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.144505    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2b0e7f033d28149e3cc1491a1bf5fe87-config\") pod \"kube-apiserver-proxy-ip-10-0-131-116.ec2.internal\" (UID: \"2b0e7f033d28149e3cc1491a1bf5fe87\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-116.ec2.internal"
Jul 06 00:59:29.305403 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:29.149496    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-116.ec2.internal\" not found"
Jul 06 00:59:29.305403 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.189667    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-116.ec2.internal"
Jul 06 00:59:29.305403 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.194366    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-116.ec2.internal"
Jul 06 00:59:29.305403 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:29.250110    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-116.ec2.internal\" not found"
Jul 06 00:59:29.350623 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:29.350594    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-116.ec2.internal\" not found"
Jul 06 00:59:29.451132 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:29.451056    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-116.ec2.internal\" not found"
Jul 06 00:59:29.471227 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.471204    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 00:59:29.471356 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.471338    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 00:59:29.471410 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.471372    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 00:59:29.483475 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.483451    2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 00:59:29.519315 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.519286    2562 apiserver.go:52] "Watching apiserver"
Jul 06 00:59:29.528281 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.528259    2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 00:59:29.529373 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.529353    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4mw","openshift-cluster-node-tuning-operator/tuned-rhtvh","openshift-multus/multus-4tnqb","openshift-multus/multus-additional-cni-plugins-nph2n","openshift-multus/network-metrics-daemon-lw99t","openshift-ovn-kubernetes/ovnkube-node-txc22","kube-system/konnectivity-agent-db55n","openshift-dns/node-resolver-4fmfs","openshift-image-registry/node-ca-9b7nw","openshift-network-diagnostics/network-check-target-tw75s","openshift-network-operator/iptables-alerter-frb7f","kube-system/global-pull-secret-syncer-k5tl7"]
Jul 06 00:59:29.531906 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.531889    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4mw"
Jul 06 00:59:29.532242 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.532186    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 00:54:28 +0000 UTC" deadline="2027-12-11 09:59:38.438354939 +0000 UTC"
Jul 06 00:59:29.532335 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.532244    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12561h0m8.90611637s"
Jul 06 00:59:29.533929 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.533907    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.534108 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.534081    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 00:59:29.534277 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.534261    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 00:59:29.534368 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.534353    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-64dmr\""
Jul 06 00:59:29.534524 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.534504    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 00:59:29.535962 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.535933    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.536292 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.536104    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 00:59:29.536292 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.536197    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-r8z5x\""
Jul 06 00:59:29.536610 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.536594    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 00:59:29.537813 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.537798    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 00:59:29.537879 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.537800    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 00:59:29.538134 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.538111    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nph2n"
Jul 06 00:59:29.538303 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.538114    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 00:59:29.538303 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.538115    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 00:59:29.538303 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.538237    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ns6hx\""
Jul 06 00:59:29.540044 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.540022    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-v6fmb\""
Jul 06 00:59:29.540209 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.540084    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 00:59:29.540422 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.540111    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 00:59:29.542303 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.540532    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lw99t"
Jul 06 00:59:29.542303 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:29.540611    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lw99t" podUID="ccf84e13-ab75-4168-9cb8-9a21cb959224"
Jul 06 00:59:29.542440 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.542322    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 00:59:29.542486 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.542455    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-116.ec2.internal"
Jul 06 00:59:29.543836 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.543813    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.546009 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.545987    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-db55n"
Jul 06 00:59:29.546121 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.546096    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfgcq\" (UniqueName: \"kubernetes.io/projected/ccf84e13-ab75-4168-9cb8-9a21cb959224-kube-api-access-sfgcq\") pod \"network-metrics-daemon-lw99t\" (UID: \"ccf84e13-ab75-4168-9cb8-9a21cb959224\") " pod="openshift-multus/network-metrics-daemon-lw99t"
Jul 06 00:59:29.546267 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.546143    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3e804c5d-56b0-4cec-bcd9-cf18304cd8de-etc-modprobe-d\") pod \"tuned-rhtvh\" (UID: \"3e804c5d-56b0-4cec-bcd9-cf18304cd8de\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.546267 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.546182    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 00:59:29.546267 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.546194    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e804c5d-56b0-4cec-bcd9-cf18304cd8de-var-lib-kubelet\") pod \"tuned-rhtvh\" (UID: \"3e804c5d-56b0-4cec-bcd9-cf18304cd8de\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.546267 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.546218    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-host-cni-bin\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.546267 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.546251    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.546488 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.546281    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e2a04d5d-fa83-4240-9c9f-6257fd6f19fe-etc-selinux\") pod \"aws-ebs-csi-driver-node-8j4mw\" (UID: \"e2a04d5d-fa83-4240-9c9f-6257fd6f19fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4mw"
Jul 06 00:59:29.546488 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.546313    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s678b\" (UniqueName: \"kubernetes.io/projected/e2a04d5d-fa83-4240-9c9f-6257fd6f19fe-kube-api-access-s678b\") pod \"aws-ebs-csi-driver-node-8j4mw\" (UID: \"e2a04d5d-fa83-4240-9c9f-6257fd6f19fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4mw"
Jul 06 00:59:29.546488 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.546336    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e2a04d5d-fa83-4240-9c9f-6257fd6f19fe-device-dir\") pod \"aws-ebs-csi-driver-node-8j4mw\" (UID: \"e2a04d5d-fa83-4240-9c9f-6257fd6f19fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4mw"
Jul 06 00:59:29.546488 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.546362    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3e804c5d-56b0-4cec-bcd9-cf18304cd8de-etc-sysconfig\") pod \"tuned-rhtvh\" (UID: \"3e804c5d-56b0-4cec-bcd9-cf18304cd8de\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.546488 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.546421    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-z85xt\""
Jul 06 00:59:29.546488 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.546430    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 00:59:29.546488 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.546434    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3e804c5d-56b0-4cec-bcd9-cf18304cd8de-sys\") pod \"tuned-rhtvh\" (UID: \"3e804c5d-56b0-4cec-bcd9-cf18304cd8de\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.546488 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.546476    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3056d6fb-5441-40ff-a0f9-98dbedab0677-system-cni-dir\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.546488 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.546490    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 00:59:29.546761 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.546496    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-run-ovn\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.546761 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.546541    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eb642562-26ad-462a-b18c-24ce564e1c22-env-overrides\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.546761 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.546566    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3e804c5d-56b0-4cec-bcd9-cf18304cd8de-etc-tuned\") pod \"tuned-rhtvh\" (UID: \"3e804c5d-56b0-4cec-bcd9-cf18304cd8de\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.546761 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.546596    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq5jz\" (UniqueName: \"kubernetes.io/projected/3e804c5d-56b0-4cec-bcd9-cf18304cd8de-kube-api-access-vq5jz\") pod \"tuned-rhtvh\" (UID: \"3e804c5d-56b0-4cec-bcd9-cf18304cd8de\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.546761 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.546635    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccf84e13-ab75-4168-9cb8-9a21cb959224-metrics-certs\") pod \"network-metrics-daemon-lw99t\" (UID: \"ccf84e13-ab75-4168-9cb8-9a21cb959224\") " pod="openshift-multus/network-metrics-daemon-lw99t"
Jul 06 00:59:29.546761 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.546644    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 00:59:29.546761 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.546672    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-run-systemd\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.546761 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.546700    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 00:59:29.546761 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.546707    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-host-run-ovn-kubernetes\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.546761 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.546732    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3e804c5d-56b0-4cec-bcd9-cf18304cd8de-etc-systemd\") pod \"tuned-rhtvh\" (UID: \"3e804c5d-56b0-4cec-bcd9-cf18304cd8de\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.547119 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.546782    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3e804c5d-56b0-4cec-bcd9-cf18304cd8de-run\") pod \"tuned-rhtvh\" (UID: \"3e804c5d-56b0-4cec-bcd9-cf18304cd8de\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.547119 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.546812    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3056d6fb-5441-40ff-a0f9-98dbedab0677-host-run-multus-certs\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.547119 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.546834    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e0730ff2-6a66-4938-91d6-651e4cbdad5c-os-release\") pod \"multus-additional-cni-plugins-nph2n\" (UID: \"e0730ff2-6a66-4938-91d6-651e4cbdad5c\") " pod="openshift-multus/multus-additional-cni-plugins-nph2n"
Jul 06 00:59:29.547119 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.546858    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0730ff2-6a66-4938-91d6-651e4cbdad5c-cni-binary-copy\") pod \"multus-additional-cni-plugins-nph2n\" (UID: \"e0730ff2-6a66-4938-91d6-651e4cbdad5c\") " pod="openshift-multus/multus-additional-cni-plugins-nph2n"
Jul 06 00:59:29.547119 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.546877    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3e804c5d-56b0-4cec-bcd9-cf18304cd8de-lib-modules\") pod \"tuned-rhtvh\" (UID: \"3e804c5d-56b0-4cec-bcd9-cf18304cd8de\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.547119 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.546923    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3056d6fb-5441-40ff-a0f9-98dbedab0677-multus-cni-dir\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.547119 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.546971    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3056d6fb-5441-40ff-a0f9-98dbedab0677-etc-kubernetes\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.547119 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.546999    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0730ff2-6a66-4938-91d6-651e4cbdad5c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nph2n\" (UID: \"e0730ff2-6a66-4938-91d6-651e4cbdad5c\") " pod="openshift-multus/multus-additional-cni-plugins-nph2n"
Jul 06 00:59:29.547119 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.547022    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-log-socket\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.547119 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.547045    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eb642562-26ad-462a-b18c-24ce564e1c22-ovnkube-script-lib\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.547119 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.547076    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e2a04d5d-fa83-4240-9c9f-6257fd6f19fe-sys-fs\") pod \"aws-ebs-csi-driver-node-8j4mw\" (UID: \"e2a04d5d-fa83-4240-9c9f-6257fd6f19fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4mw"
Jul 06 00:59:29.547688 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.547121    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3056d6fb-5441-40ff-a0f9-98dbedab0677-os-release\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.547688 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.547171    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7dbm\" (UniqueName: \"kubernetes.io/projected/3056d6fb-5441-40ff-a0f9-98dbedab0677-kube-api-access-c7dbm\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.547688 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.547201    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0730ff2-6a66-4938-91d6-651e4cbdad5c-system-cni-dir\") pod \"multus-additional-cni-plugins-nph2n\" (UID: \"e0730ff2-6a66-4938-91d6-651e4cbdad5c\") " pod="openshift-multus/multus-additional-cni-plugins-nph2n"
Jul 06 00:59:29.547688 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.547227    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcj5c\" (UniqueName: \"kubernetes.io/projected/e0730ff2-6a66-4938-91d6-651e4cbdad5c-kube-api-access-qcj5c\") pod \"multus-additional-cni-plugins-nph2n\" (UID: \"e0730ff2-6a66-4938-91d6-651e4cbdad5c\") " pod="openshift-multus/multus-additional-cni-plugins-nph2n"
Jul 06 00:59:29.547688 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.547254    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 00:59:29.547688 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.547253    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-host-slash\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.547688 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.547309    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-var-lib-openvswitch\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.547688 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.547335    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzhdx\" (UniqueName: \"kubernetes.io/projected/eb642562-26ad-462a-b18c-24ce564e1c22-kube-api-access-jzhdx\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.547688 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.547357    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e804c5d-56b0-4cec-bcd9-cf18304cd8de-etc-kubernetes\") pod \"tuned-rhtvh\" (UID: \"3e804c5d-56b0-4cec-bcd9-cf18304cd8de\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.547688 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.547379    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e804c5d-56b0-4cec-bcd9-cf18304cd8de-tmp\") pod \"tuned-rhtvh\" (UID: \"3e804c5d-56b0-4cec-bcd9-cf18304cd8de\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.547688 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.547402    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3056d6fb-5441-40ff-a0f9-98dbedab0677-host-run-k8s-cni-cncf-io\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.547688 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.547433    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3056d6fb-5441-40ff-a0f9-98dbedab0677-multus-daemon-config\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.547688 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.547457    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-run-openvswitch\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.547688 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.547478    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3e804c5d-56b0-4cec-bcd9-cf18304cd8de-etc-sysctl-d\") pod \"tuned-rhtvh\" (UID: \"3e804c5d-56b0-4cec-bcd9-cf18304cd8de\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.547688 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.547510    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-systemd-units\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.547688 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.547538    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-etc-openvswitch\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.547688 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.547559    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-node-log\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.548420 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.547583    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eb642562-26ad-462a-b18c-24ce564e1c22-ovnkube-config\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.548420 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.547605    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3e804c5d-56b0-4cec-bcd9-cf18304cd8de-host\") pod \"tuned-rhtvh\" (UID: \"3e804c5d-56b0-4cec-bcd9-cf18304cd8de\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.548420 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.547625    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0730ff2-6a66-4938-91d6-651e4cbdad5c-cnibin\") pod \"multus-additional-cni-plugins-nph2n\" (UID: \"e0730ff2-6a66-4938-91d6-651e4cbdad5c\") " pod="openshift-multus/multus-additional-cni-plugins-nph2n"
Jul 06 00:59:29.548420 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.547646    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3056d6fb-5441-40ff-a0f9-98dbedab0677-multus-conf-dir\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.548420 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.547669    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e0730ff2-6a66-4938-91d6-651e4cbdad5c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nph2n\" (UID: \"e0730ff2-6a66-4938-91d6-651e4cbdad5c\") " pod="openshift-multus/multus-additional-cni-plugins-nph2n"
Jul 06 00:59:29.548420 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.547690    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3e804c5d-56b0-4cec-bcd9-cf18304cd8de-etc-sysctl-conf\") pod \"tuned-rhtvh\" (UID: \"3e804c5d-56b0-4cec-bcd9-cf18304cd8de\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.548420 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.547712    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3056d6fb-5441-40ff-a0f9-98dbedab0677-cni-binary-copy\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.548420 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.547733    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3056d6fb-5441-40ff-a0f9-98dbedab0677-host-var-lib-cni-multus\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.548420 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.547759    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-host-kubelet\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.548420 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.547793    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-host-run-netns\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.548420 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.547838    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3056d6fb-5441-40ff-a0f9-98dbedab0677-multus-socket-dir-parent\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.548420 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.547862    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3056d6fb-5441-40ff-a0f9-98dbedab0677-hostroot\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.548420 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.547884    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb642562-26ad-462a-b18c-24ce564e1c22-ovn-node-metrics-cert\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.548420 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.547906    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e2a04d5d-fa83-4240-9c9f-6257fd6f19fe-socket-dir\") pod \"aws-ebs-csi-driver-node-8j4mw\" (UID: \"e2a04d5d-fa83-4240-9c9f-6257fd6f19fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4mw"
Jul 06 00:59:29.548420 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.547927    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3056d6fb-5441-40ff-a0f9-98dbedab0677-host-run-netns\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.548420 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.547949    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3056d6fb-5441-40ff-a0f9-98dbedab0677-host-var-lib-kubelet\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.548886 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.547978    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e0730ff2-6a66-4938-91d6-651e4cbdad5c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nph2n\" (UID: \"e0730ff2-6a66-4938-91d6-651e4cbdad5c\") " pod="openshift-multus/multus-additional-cni-plugins-nph2n"
Jul 06 00:59:29.548886 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.548001    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-host-cni-netd\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.548886 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.548023    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e2a04d5d-fa83-4240-9c9f-6257fd6f19fe-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8j4mw\" (UID: \"e2a04d5d-fa83-4240-9c9f-6257fd6f19fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4mw"
Jul 06 00:59:29.548886 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.548045    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e2a04d5d-fa83-4240-9c9f-6257fd6f19fe-registration-dir\") pod \"aws-ebs-csi-driver-node-8j4mw\" (UID: \"e2a04d5d-fa83-4240-9c9f-6257fd6f19fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4mw"
Jul 06 00:59:29.548886 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.548069    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3056d6fb-5441-40ff-a0f9-98dbedab0677-cnibin\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.548886 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.548099    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3056d6fb-5441-40ff-a0f9-98dbedab0677-host-var-lib-cni-bin\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.548886 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.548245    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 00:59:29.548886 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.548298    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5hjt8\""
Jul 06 00:59:29.548886 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.548777    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4fmfs"
Jul 06 00:59:29.549264 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.549249    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 00:59:29.550670 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.550650    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 00:59:29.550748 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.550734    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 00:59:29.550935 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.550915    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-z7kjd\""
Jul 06 00:59:29.551003 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.550971    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9b7nw"
Jul 06 00:59:29.552725 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.552709    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 00:59:29.553083 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.553068    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-657nb\""
Jul 06 00:59:29.553143 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.553112    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 00:59:29.553230 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.553215    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 00:59:29.553369 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.553353    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 00:59:29.553458 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.553446    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-116.ec2.internal"
Jul 06 00:59:29.554021 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.554009    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw75s"
Jul 06 00:59:29.554087 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:29.554070    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw75s" podUID="72256072-5a1e-41fd-a664-ce1d82f2b3bf"
Jul 06 00:59:29.556126 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.556110    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-frb7f"
Jul 06 00:59:29.558277 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.558248    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 00:59:29.558411 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.558383    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-116.ec2.internal"]
Jul 06 00:59:29.558477 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.558427    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5tl7"
Jul 06 00:59:29.558477 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.558445    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nxg75\""
Jul 06 00:59:29.558477 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.558455    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 00:59:29.558620 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:29.558492    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5tl7" podUID="031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2"
Jul 06 00:59:29.558620 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.558519    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 00:59:29.558620 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.558590    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 00:59:29.561248 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.561232    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 00:59:29.561544 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.561526    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-116.ec2.internal"]
Jul 06 00:59:29.644104 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.644080    2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 00:59:29.648623 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.648607    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0730ff2-6a66-4938-91d6-651e4cbdad5c-cnibin\") pod \"multus-additional-cni-plugins-nph2n\" (UID: \"e0730ff2-6a66-4938-91d6-651e4cbdad5c\") " pod="openshift-multus/multus-additional-cni-plugins-nph2n"
Jul 06 00:59:29.648674 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.648630    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3056d6fb-5441-40ff-a0f9-98dbedab0677-multus-conf-dir\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.648674 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.648651    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/be609719-c174-46eb-bed0-e130fcd1a711-iptables-alerter-script\") pod \"iptables-alerter-frb7f\" (UID: \"be609719-c174-46eb-bed0-e130fcd1a711\") " pod="openshift-network-operator/iptables-alerter-frb7f"
Jul 06 00:59:29.648674 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.648670    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e0730ff2-6a66-4938-91d6-651e4cbdad5c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nph2n\" (UID: \"e0730ff2-6a66-4938-91d6-651e4cbdad5c\") " pod="openshift-multus/multus-additional-cni-plugins-nph2n"
Jul 06 00:59:29.648781 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.648715    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0730ff2-6a66-4938-91d6-651e4cbdad5c-cnibin\") pod \"multus-additional-cni-plugins-nph2n\" (UID: \"e0730ff2-6a66-4938-91d6-651e4cbdad5c\") " pod="openshift-multus/multus-additional-cni-plugins-nph2n"
Jul 06 00:59:29.648781 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.648727    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3056d6fb-5441-40ff-a0f9-98dbedab0677-multus-conf-dir\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.648781 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.648750    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3e804c5d-56b0-4cec-bcd9-cf18304cd8de-etc-sysctl-conf\") pod \"tuned-rhtvh\" (UID: \"3e804c5d-56b0-4cec-bcd9-cf18304cd8de\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.648781 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.648770    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3056d6fb-5441-40ff-a0f9-98dbedab0677-cni-binary-copy\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.648949 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.648786    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3056d6fb-5441-40ff-a0f9-98dbedab0677-host-var-lib-cni-multus\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.648949 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.648802    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-host-kubelet\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.648949 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.648816    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-host-run-netns\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.648949 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.648832    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3056d6fb-5441-40ff-a0f9-98dbedab0677-multus-socket-dir-parent\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.648949 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.648854    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3056d6fb-5441-40ff-a0f9-98dbedab0677-hostroot\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.648949 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.648875    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb642562-26ad-462a-b18c-24ce564e1c22-ovn-node-metrics-cert\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.648949 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.648887    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-host-kubelet\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.648949 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.648897    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e2a04d5d-fa83-4240-9c9f-6257fd6f19fe-socket-dir\") pod \"aws-ebs-csi-driver-node-8j4mw\" (UID: \"e2a04d5d-fa83-4240-9c9f-6257fd6f19fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4mw"
Jul 06 00:59:29.648949 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.648893    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3056d6fb-5441-40ff-a0f9-98dbedab0677-host-var-lib-cni-multus\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.648949 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.648930    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3056d6fb-5441-40ff-a0f9-98dbedab0677-host-run-netns\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.648949 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.648938    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3056d6fb-5441-40ff-a0f9-98dbedab0677-multus-socket-dir-parent\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.648949 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.648888    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3e804c5d-56b0-4cec-bcd9-cf18304cd8de-etc-sysctl-conf\") pod \"tuned-rhtvh\" (UID: \"3e804c5d-56b0-4cec-bcd9-cf18304cd8de\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.649535 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.648973    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3056d6fb-5441-40ff-a0f9-98dbedab0677-host-run-netns\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.649535 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.648940    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3056d6fb-5441-40ff-a0f9-98dbedab0677-hostroot\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.649535 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649007    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-host-run-netns\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.649535 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649035    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3056d6fb-5441-40ff-a0f9-98dbedab0677-host-var-lib-kubelet\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.649535 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649039    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e2a04d5d-fa83-4240-9c9f-6257fd6f19fe-socket-dir\") pod \"aws-ebs-csi-driver-node-8j4mw\" (UID: \"e2a04d5d-fa83-4240-9c9f-6257fd6f19fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4mw"
Jul 06 00:59:29.649535 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649061    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f19b579f-765e-455e-92c2-602da92d5bb2-tmp-dir\") pod \"node-resolver-4fmfs\" (UID: \"f19b579f-765e-455e-92c2-602da92d5bb2\") " pod="openshift-dns/node-resolver-4fmfs"
Jul 06 00:59:29.649535 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649087    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e0730ff2-6a66-4938-91d6-651e4cbdad5c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nph2n\" (UID: \"e0730ff2-6a66-4938-91d6-651e4cbdad5c\") " pod="openshift-multus/multus-additional-cni-plugins-nph2n"
Jul 06 00:59:29.649535 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649101    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3056d6fb-5441-40ff-a0f9-98dbedab0677-host-var-lib-kubelet\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.649535 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649185    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-host-cni-netd\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.649535 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649237    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e2a04d5d-fa83-4240-9c9f-6257fd6f19fe-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8j4mw\" (UID: \"e2a04d5d-fa83-4240-9c9f-6257fd6f19fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4mw"
Jul 06 00:59:29.649535 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649261    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e2a04d5d-fa83-4240-9c9f-6257fd6f19fe-registration-dir\") pod \"aws-ebs-csi-driver-node-8j4mw\" (UID: \"e2a04d5d-fa83-4240-9c9f-6257fd6f19fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4mw"
Jul 06 00:59:29.649535 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649283    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3056d6fb-5441-40ff-a0f9-98dbedab0677-cnibin\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.649535 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649278    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 00:59:29.649535 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649308    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3056d6fb-5441-40ff-a0f9-98dbedab0677-host-var-lib-cni-bin\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.649535 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649328    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e2a04d5d-fa83-4240-9c9f-6257fd6f19fe-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8j4mw\" (UID: \"e2a04d5d-fa83-4240-9c9f-6257fd6f19fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4mw"
Jul 06 00:59:29.649535 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649335    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t79lb\" (UniqueName: \"kubernetes.io/projected/f19b579f-765e-455e-92c2-602da92d5bb2-kube-api-access-t79lb\") pod \"node-resolver-4fmfs\" (UID: \"f19b579f-765e-455e-92c2-602da92d5bb2\") " pod="openshift-dns/node-resolver-4fmfs"
Jul 06 00:59:29.649535 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649363    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-host-cni-netd\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.649535 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649370    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3056d6fb-5441-40ff-a0f9-98dbedab0677-cni-binary-copy\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.650391 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649375    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2-original-pull-secret\") pod \"global-pull-secret-syncer-k5tl7\" (UID: \"031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2\") " pod="kube-system/global-pull-secret-syncer-k5tl7"
Jul 06 00:59:29.650391 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649390    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3056d6fb-5441-40ff-a0f9-98dbedab0677-cnibin\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.650391 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649404    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfgcq\" (UniqueName: \"kubernetes.io/projected/ccf84e13-ab75-4168-9cb8-9a21cb959224-kube-api-access-sfgcq\") pod \"network-metrics-daemon-lw99t\" (UID: \"ccf84e13-ab75-4168-9cb8-9a21cb959224\") " pod="openshift-multus/network-metrics-daemon-lw99t"
Jul 06 00:59:29.650391 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649414    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3056d6fb-5441-40ff-a0f9-98dbedab0677-host-var-lib-cni-bin\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.650391 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649309    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e0730ff2-6a66-4938-91d6-651e4cbdad5c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nph2n\" (UID: \"e0730ff2-6a66-4938-91d6-651e4cbdad5c\") " pod="openshift-multus/multus-additional-cni-plugins-nph2n"
Jul 06 00:59:29.650391 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649434    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e2a04d5d-fa83-4240-9c9f-6257fd6f19fe-registration-dir\") pod \"aws-ebs-csi-driver-node-8j4mw\" (UID: \"e2a04d5d-fa83-4240-9c9f-6257fd6f19fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4mw"
Jul 06 00:59:29.650391 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649428    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3e804c5d-56b0-4cec-bcd9-cf18304cd8de-etc-modprobe-d\") pod \"tuned-rhtvh\" (UID: \"3e804c5d-56b0-4cec-bcd9-cf18304cd8de\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.650391 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649470    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e804c5d-56b0-4cec-bcd9-cf18304cd8de-var-lib-kubelet\") pod \"tuned-rhtvh\" (UID: \"3e804c5d-56b0-4cec-bcd9-cf18304cd8de\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.650391 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649488    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7d19f25b-ac66-4e32-9ac9-2bccbbe89113-agent-certs\") pod \"konnectivity-agent-db55n\" (UID: \"7d19f25b-ac66-4e32-9ac9-2bccbbe89113\") " pod="kube-system/konnectivity-agent-db55n"
Jul 06 00:59:29.650391 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649506    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f19b579f-765e-455e-92c2-602da92d5bb2-hosts-file\") pod \"node-resolver-4fmfs\" (UID: \"f19b579f-765e-455e-92c2-602da92d5bb2\") " pod="openshift-dns/node-resolver-4fmfs"
Jul 06 00:59:29.650391 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649531    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-host-cni-bin\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.650391 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649539    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3e804c5d-56b0-4cec-bcd9-cf18304cd8de-etc-modprobe-d\") pod \"tuned-rhtvh\" (UID: \"3e804c5d-56b0-4cec-bcd9-cf18304cd8de\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.650391 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649562    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e804c5d-56b0-4cec-bcd9-cf18304cd8de-var-lib-kubelet\") pod \"tuned-rhtvh\" (UID: \"3e804c5d-56b0-4cec-bcd9-cf18304cd8de\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.650391 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649582    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e0730ff2-6a66-4938-91d6-651e4cbdad5c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nph2n\" (UID: \"e0730ff2-6a66-4938-91d6-651e4cbdad5c\") " pod="openshift-multus/multus-additional-cni-plugins-nph2n"
Jul 06 00:59:29.650391 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649591    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.650391 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649620    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e2a04d5d-fa83-4240-9c9f-6257fd6f19fe-etc-selinux\") pod \"aws-ebs-csi-driver-node-8j4mw\" (UID: \"e2a04d5d-fa83-4240-9c9f-6257fd6f19fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4mw"
Jul 06 00:59:29.650391 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649646    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s678b\" (UniqueName: \"kubernetes.io/projected/e2a04d5d-fa83-4240-9c9f-6257fd6f19fe-kube-api-access-s678b\") pod \"aws-ebs-csi-driver-node-8j4mw\" (UID: \"e2a04d5d-fa83-4240-9c9f-6257fd6f19fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4mw"
Jul 06 00:59:29.651313 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649649    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-host-cni-bin\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.651313 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649686    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2-dbus\") pod \"global-pull-secret-syncer-k5tl7\" (UID: \"031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2\") " pod="kube-system/global-pull-secret-syncer-k5tl7"
Jul 06 00:59:29.651313 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649695    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e2a04d5d-fa83-4240-9c9f-6257fd6f19fe-etc-selinux\") pod \"aws-ebs-csi-driver-node-8j4mw\" (UID: \"e2a04d5d-fa83-4240-9c9f-6257fd6f19fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4mw"
Jul 06 00:59:29.651313 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649700    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.651313 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649733    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e2a04d5d-fa83-4240-9c9f-6257fd6f19fe-device-dir\") pod \"aws-ebs-csi-driver-node-8j4mw\" (UID: \"e2a04d5d-fa83-4240-9c9f-6257fd6f19fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4mw"
Jul 06 00:59:29.651313 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649755    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3e804c5d-56b0-4cec-bcd9-cf18304cd8de-etc-sysconfig\") pod \"tuned-rhtvh\" (UID: \"3e804c5d-56b0-4cec-bcd9-cf18304cd8de\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.651313 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649774    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3e804c5d-56b0-4cec-bcd9-cf18304cd8de-sys\") pod \"tuned-rhtvh\" (UID: \"3e804c5d-56b0-4cec-bcd9-cf18304cd8de\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.651313 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649793    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3056d6fb-5441-40ff-a0f9-98dbedab0677-system-cni-dir\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.651313 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649816    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-run-ovn\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.651313 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649834    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3e804c5d-56b0-4cec-bcd9-cf18304cd8de-etc-sysconfig\") pod \"tuned-rhtvh\" (UID: \"3e804c5d-56b0-4cec-bcd9-cf18304cd8de\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.651313 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649839    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eb642562-26ad-462a-b18c-24ce564e1c22-env-overrides\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.651313 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649865    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3e804c5d-56b0-4cec-bcd9-cf18304cd8de-etc-tuned\") pod \"tuned-rhtvh\" (UID: \"3e804c5d-56b0-4cec-bcd9-cf18304cd8de\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.651313 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649879    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e2a04d5d-fa83-4240-9c9f-6257fd6f19fe-device-dir\") pod \"aws-ebs-csi-driver-node-8j4mw\" (UID: \"e2a04d5d-fa83-4240-9c9f-6257fd6f19fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4mw"
Jul 06 00:59:29.651313 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649887    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq5jz\" (UniqueName: \"kubernetes.io/projected/3e804c5d-56b0-4cec-bcd9-cf18304cd8de-kube-api-access-vq5jz\") pod \"tuned-rhtvh\" (UID: \"3e804c5d-56b0-4cec-bcd9-cf18304cd8de\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.651313 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649906    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3056d6fb-5441-40ff-a0f9-98dbedab0677-system-cni-dir\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.651313 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649925    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccf84e13-ab75-4168-9cb8-9a21cb959224-metrics-certs\") pod \"network-metrics-daemon-lw99t\" (UID: \"ccf84e13-ab75-4168-9cb8-9a21cb959224\") " pod="openshift-multus/network-metrics-daemon-lw99t"
Jul 06 00:59:29.651313 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649940    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-run-ovn\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.652326 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649960    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-run-systemd\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.652326 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649984    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-host-run-ovn-kubernetes\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.652326 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.650009    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3e804c5d-56b0-4cec-bcd9-cf18304cd8de-etc-systemd\") pod \"tuned-rhtvh\" (UID: \"3e804c5d-56b0-4cec-bcd9-cf18304cd8de\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.652326 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:29.650026    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 00:59:29.652326 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.650032    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3e804c5d-56b0-4cec-bcd9-cf18304cd8de-run\") pod \"tuned-rhtvh\" (UID: \"3e804c5d-56b0-4cec-bcd9-cf18304cd8de\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.652326 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.650054    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3056d6fb-5441-40ff-a0f9-98dbedab0677-host-run-multus-certs\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.652326 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.650080    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6k8k\" (UniqueName: \"kubernetes.io/projected/794399e2-dfe6-4b25-8879-858657cb407b-kube-api-access-w6k8k\") pod \"node-ca-9b7nw\" (UID: \"794399e2-dfe6-4b25-8879-858657cb407b\") " pod="openshift-image-registry/node-ca-9b7nw"
Jul 06 00:59:29.652326 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.649928    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3e804c5d-56b0-4cec-bcd9-cf18304cd8de-sys\") pod \"tuned-rhtvh\" (UID: \"3e804c5d-56b0-4cec-bcd9-cf18304cd8de\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.652326 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:29.650110    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccf84e13-ab75-4168-9cb8-9a21cb959224-metrics-certs podName:ccf84e13-ab75-4168-9cb8-9a21cb959224 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:30.150074684 +0000 UTC m=+1.961049925 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ccf84e13-ab75-4168-9cb8-9a21cb959224-metrics-certs") pod "network-metrics-daemon-lw99t" (UID: "ccf84e13-ab75-4168-9cb8-9a21cb959224") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 00:59:29.652326 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.650176    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3e804c5d-56b0-4cec-bcd9-cf18304cd8de-run\") pod \"tuned-rhtvh\" (UID: \"3e804c5d-56b0-4cec-bcd9-cf18304cd8de\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.652326 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.650175    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-run-systemd\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.652326 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.650212    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-host-run-ovn-kubernetes\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.652326 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.650228    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3056d6fb-5441-40ff-a0f9-98dbedab0677-host-run-multus-certs\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.652326 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.650265    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2-kubelet-config\") pod \"global-pull-secret-syncer-k5tl7\" (UID: \"031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2\") " pod="kube-system/global-pull-secret-syncer-k5tl7"
Jul 06 00:59:29.652326 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.650272    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3e804c5d-56b0-4cec-bcd9-cf18304cd8de-etc-systemd\") pod \"tuned-rhtvh\" (UID: \"3e804c5d-56b0-4cec-bcd9-cf18304cd8de\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.652326 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.650296    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e0730ff2-6a66-4938-91d6-651e4cbdad5c-os-release\") pod \"multus-additional-cni-plugins-nph2n\" (UID: \"e0730ff2-6a66-4938-91d6-651e4cbdad5c\") " pod="openshift-multus/multus-additional-cni-plugins-nph2n"
Jul 06 00:59:29.652326 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.650320    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0730ff2-6a66-4938-91d6-651e4cbdad5c-cni-binary-copy\") pod \"multus-additional-cni-plugins-nph2n\" (UID: \"e0730ff2-6a66-4938-91d6-651e4cbdad5c\") " pod="openshift-multus/multus-additional-cni-plugins-nph2n"
Jul 06 00:59:29.653218 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.650353    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3e804c5d-56b0-4cec-bcd9-cf18304cd8de-lib-modules\") pod \"tuned-rhtvh\" (UID: \"3e804c5d-56b0-4cec-bcd9-cf18304cd8de\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.653218 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.650374    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3056d6fb-5441-40ff-a0f9-98dbedab0677-multus-cni-dir\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.653218 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.650397    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3056d6fb-5441-40ff-a0f9-98dbedab0677-etc-kubernetes\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.653218 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.650422    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgw58\" (UniqueName: \"kubernetes.io/projected/72256072-5a1e-41fd-a664-ce1d82f2b3bf-kube-api-access-tgw58\") pod \"network-check-target-tw75s\" (UID: \"72256072-5a1e-41fd-a664-ce1d82f2b3bf\") " pod="openshift-network-diagnostics/network-check-target-tw75s"
Jul 06 00:59:29.653218 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.650452    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3e804c5d-56b0-4cec-bcd9-cf18304cd8de-lib-modules\") pod \"tuned-rhtvh\" (UID: \"3e804c5d-56b0-4cec-bcd9-cf18304cd8de\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.653218 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.650459    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/be609719-c174-46eb-bed0-e130fcd1a711-host-slash\") pod \"iptables-alerter-frb7f\" (UID: \"be609719-c174-46eb-bed0-e130fcd1a711\") " pod="openshift-network-operator/iptables-alerter-frb7f"
Jul 06 00:59:29.653218 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.650354    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/eb642562-26ad-462a-b18c-24ce564e1c22-env-overrides\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.653218 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.650352    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e0730ff2-6a66-4938-91d6-651e4cbdad5c-os-release\") pod \"multus-additional-cni-plugins-nph2n\" (UID: \"e0730ff2-6a66-4938-91d6-651e4cbdad5c\") " pod="openshift-multus/multus-additional-cni-plugins-nph2n"
Jul 06 00:59:29.653218 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.650519    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3056d6fb-5441-40ff-a0f9-98dbedab0677-multus-cni-dir\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.653218 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.650522    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3056d6fb-5441-40ff-a0f9-98dbedab0677-etc-kubernetes\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.653218 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.650549    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0730ff2-6a66-4938-91d6-651e4cbdad5c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nph2n\" (UID: \"e0730ff2-6a66-4938-91d6-651e4cbdad5c\") " pod="openshift-multus/multus-additional-cni-plugins-nph2n"
Jul 06 00:59:29.653218 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.650575    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-log-socket\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.653218 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.650597    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eb642562-26ad-462a-b18c-24ce564e1c22-ovnkube-script-lib\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.653218 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.650626    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-log-socket\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.653218 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.650629    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e2a04d5d-fa83-4240-9c9f-6257fd6f19fe-sys-fs\") pod \"aws-ebs-csi-driver-node-8j4mw\" (UID: \"e2a04d5d-fa83-4240-9c9f-6257fd6f19fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4mw"
Jul 06 00:59:29.653218 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.650655    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0730ff2-6a66-4938-91d6-651e4cbdad5c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nph2n\" (UID: \"e0730ff2-6a66-4938-91d6-651e4cbdad5c\") " pod="openshift-multus/multus-additional-cni-plugins-nph2n"
Jul 06 00:59:29.653218 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.650674    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e2a04d5d-fa83-4240-9c9f-6257fd6f19fe-sys-fs\") pod \"aws-ebs-csi-driver-node-8j4mw\" (UID: \"e2a04d5d-fa83-4240-9c9f-6257fd6f19fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4mw"
Jul 06 00:59:29.653897 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.650664    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3056d6fb-5441-40ff-a0f9-98dbedab0677-os-release\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.653897 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.650726    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3056d6fb-5441-40ff-a0f9-98dbedab0677-os-release\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.653897 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.650767    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7dbm\" (UniqueName: \"kubernetes.io/projected/3056d6fb-5441-40ff-a0f9-98dbedab0677-kube-api-access-c7dbm\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.653897 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.650793    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0730ff2-6a66-4938-91d6-651e4cbdad5c-system-cni-dir\") pod \"multus-additional-cni-plugins-nph2n\" (UID: \"e0730ff2-6a66-4938-91d6-651e4cbdad5c\") " pod="openshift-multus/multus-additional-cni-plugins-nph2n"
Jul 06 00:59:29.653897 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.650805    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0730ff2-6a66-4938-91d6-651e4cbdad5c-cni-binary-copy\") pod \"multus-additional-cni-plugins-nph2n\" (UID: \"e0730ff2-6a66-4938-91d6-651e4cbdad5c\") " pod="openshift-multus/multus-additional-cni-plugins-nph2n"
Jul 06 00:59:29.653897 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.650821    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcj5c\" (UniqueName: \"kubernetes.io/projected/e0730ff2-6a66-4938-91d6-651e4cbdad5c-kube-api-access-qcj5c\") pod \"multus-additional-cni-plugins-nph2n\" (UID: \"e0730ff2-6a66-4938-91d6-651e4cbdad5c\") " pod="openshift-multus/multus-additional-cni-plugins-nph2n"
Jul 06 00:59:29.653897 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.650843    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-host-slash\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.653897 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.650858    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0730ff2-6a66-4938-91d6-651e4cbdad5c-system-cni-dir\") pod \"multus-additional-cni-plugins-nph2n\" (UID: \"e0730ff2-6a66-4938-91d6-651e4cbdad5c\") " pod="openshift-multus/multus-additional-cni-plugins-nph2n"
Jul 06 00:59:29.653897 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.650894    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-host-slash\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.653897 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.650974    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-var-lib-openvswitch\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.653897 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.651009    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzhdx\" (UniqueName: \"kubernetes.io/projected/eb642562-26ad-462a-b18c-24ce564e1c22-kube-api-access-jzhdx\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.653897 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.651037    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e804c5d-56b0-4cec-bcd9-cf18304cd8de-etc-kubernetes\") pod \"tuned-rhtvh\" (UID: \"3e804c5d-56b0-4cec-bcd9-cf18304cd8de\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.653897 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.651061    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e804c5d-56b0-4cec-bcd9-cf18304cd8de-tmp\") pod \"tuned-rhtvh\" (UID: \"3e804c5d-56b0-4cec-bcd9-cf18304cd8de\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.653897 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.651085    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3056d6fb-5441-40ff-a0f9-98dbedab0677-host-run-k8s-cni-cncf-io\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.653897 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.651096    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e804c5d-56b0-4cec-bcd9-cf18304cd8de-etc-kubernetes\") pod \"tuned-rhtvh\" (UID: \"3e804c5d-56b0-4cec-bcd9-cf18304cd8de\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.653897 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.651105    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/eb642562-26ad-462a-b18c-24ce564e1c22-ovnkube-script-lib\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.653897 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.651114    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3056d6fb-5441-40ff-a0f9-98dbedab0677-multus-daemon-config\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.654571 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.651038    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-var-lib-openvswitch\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.654571 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.651140    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/794399e2-dfe6-4b25-8879-858657cb407b-serviceca\") pod \"node-ca-9b7nw\" (UID: \"794399e2-dfe6-4b25-8879-858657cb407b\") " pod="openshift-image-registry/node-ca-9b7nw"
Jul 06 00:59:29.654571 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.651216    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3056d6fb-5441-40ff-a0f9-98dbedab0677-host-run-k8s-cni-cncf-io\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.654571 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.651190    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-run-openvswitch\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.654571 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.651259    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3e804c5d-56b0-4cec-bcd9-cf18304cd8de-etc-sysctl-d\") pod \"tuned-rhtvh\" (UID: \"3e804c5d-56b0-4cec-bcd9-cf18304cd8de\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.654571 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.651283    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7d19f25b-ac66-4e32-9ac9-2bccbbe89113-konnectivity-ca\") pod \"konnectivity-agent-db55n\" (UID: \"7d19f25b-ac66-4e32-9ac9-2bccbbe89113\") " pod="kube-system/konnectivity-agent-db55n"
Jul 06 00:59:29.654571 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.651308    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7gmr\" (UniqueName: \"kubernetes.io/projected/be609719-c174-46eb-bed0-e130fcd1a711-kube-api-access-m7gmr\") pod \"iptables-alerter-frb7f\" (UID: \"be609719-c174-46eb-bed0-e130fcd1a711\") " pod="openshift-network-operator/iptables-alerter-frb7f"
Jul 06 00:59:29.654571 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.651260    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-run-openvswitch\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.654571 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.651357    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-systemd-units\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.654571 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.651379    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-etc-openvswitch\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.654571 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.651404    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3e804c5d-56b0-4cec-bcd9-cf18304cd8de-etc-sysctl-d\") pod \"tuned-rhtvh\" (UID: \"3e804c5d-56b0-4cec-bcd9-cf18304cd8de\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.654571 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.651414    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-node-log\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.654571 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.651439    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eb642562-26ad-462a-b18c-24ce564e1c22-ovnkube-config\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.654571 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.651443    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-etc-openvswitch\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.654571 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.651479    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3e804c5d-56b0-4cec-bcd9-cf18304cd8de-host\") pod \"tuned-rhtvh\" (UID: \"3e804c5d-56b0-4cec-bcd9-cf18304cd8de\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.654571 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.651511    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/794399e2-dfe6-4b25-8879-858657cb407b-host\") pod \"node-ca-9b7nw\" (UID: \"794399e2-dfe6-4b25-8879-858657cb407b\") " pod="openshift-image-registry/node-ca-9b7nw"
Jul 06 00:59:29.654571 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.651487    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-node-log\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.654571 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.651593    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3e804c5d-56b0-4cec-bcd9-cf18304cd8de-host\") pod \"tuned-rhtvh\" (UID: \"3e804c5d-56b0-4cec-bcd9-cf18304cd8de\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.655356 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.651609    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3056d6fb-5441-40ff-a0f9-98dbedab0677-multus-daemon-config\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.655356 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.651647    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/eb642562-26ad-462a-b18c-24ce564e1c22-systemd-units\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.655356 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.651918    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/eb642562-26ad-462a-b18c-24ce564e1c22-ovnkube-config\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.655356 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.653229    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3e804c5d-56b0-4cec-bcd9-cf18304cd8de-etc-tuned\") pod \"tuned-rhtvh\" (UID: \"3e804c5d-56b0-4cec-bcd9-cf18304cd8de\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.655356 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.653418    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/eb642562-26ad-462a-b18c-24ce564e1c22-ovn-node-metrics-cert\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.655356 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.653771    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e804c5d-56b0-4cec-bcd9-cf18304cd8de-tmp\") pod \"tuned-rhtvh\" (UID: \"3e804c5d-56b0-4cec-bcd9-cf18304cd8de\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.659480 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.659448    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s678b\" (UniqueName: \"kubernetes.io/projected/e2a04d5d-fa83-4240-9c9f-6257fd6f19fe-kube-api-access-s678b\") pod \"aws-ebs-csi-driver-node-8j4mw\" (UID: \"e2a04d5d-fa83-4240-9c9f-6257fd6f19fe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4mw"
Jul 06 00:59:29.659603 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.659448    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq5jz\" (UniqueName: \"kubernetes.io/projected/3e804c5d-56b0-4cec-bcd9-cf18304cd8de-kube-api-access-vq5jz\") pod \"tuned-rhtvh\" (UID: \"3e804c5d-56b0-4cec-bcd9-cf18304cd8de\") " pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.659710 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.659688    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7dbm\" (UniqueName: \"kubernetes.io/projected/3056d6fb-5441-40ff-a0f9-98dbedab0677-kube-api-access-c7dbm\") pod \"multus-4tnqb\" (UID: \"3056d6fb-5441-40ff-a0f9-98dbedab0677\") " pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.660082 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.660036    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcj5c\" (UniqueName: \"kubernetes.io/projected/e0730ff2-6a66-4938-91d6-651e4cbdad5c-kube-api-access-qcj5c\") pod \"multus-additional-cni-plugins-nph2n\" (UID: \"e0730ff2-6a66-4938-91d6-651e4cbdad5c\") " pod="openshift-multus/multus-additional-cni-plugins-nph2n"
Jul 06 00:59:29.660413 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.660392    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzhdx\" (UniqueName: \"kubernetes.io/projected/eb642562-26ad-462a-b18c-24ce564e1c22-kube-api-access-jzhdx\") pod \"ovnkube-node-txc22\" (UID: \"eb642562-26ad-462a-b18c-24ce564e1c22\") " pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.660547 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.660528    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfgcq\" (UniqueName: \"kubernetes.io/projected/ccf84e13-ab75-4168-9cb8-9a21cb959224-kube-api-access-sfgcq\") pod \"network-metrics-daemon-lw99t\" (UID: \"ccf84e13-ab75-4168-9cb8-9a21cb959224\") " pod="openshift-multus/network-metrics-daemon-lw99t"
Jul 06 00:59:29.662370 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.662351    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-lhbfg"
Jul 06 00:59:29.670039 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.670020    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lhbfg"
Jul 06 00:59:29.752339 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.752308    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f19b579f-765e-455e-92c2-602da92d5bb2-tmp-dir\") pod \"node-resolver-4fmfs\" (UID: \"f19b579f-765e-455e-92c2-602da92d5bb2\") " pod="openshift-dns/node-resolver-4fmfs"
Jul 06 00:59:29.752508 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.752350    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t79lb\" (UniqueName: \"kubernetes.io/projected/f19b579f-765e-455e-92c2-602da92d5bb2-kube-api-access-t79lb\") pod \"node-resolver-4fmfs\" (UID: \"f19b579f-765e-455e-92c2-602da92d5bb2\") " pod="openshift-dns/node-resolver-4fmfs"
Jul 06 00:59:29.752508 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.752366    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2-original-pull-secret\") pod \"global-pull-secret-syncer-k5tl7\" (UID: \"031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2\") " pod="kube-system/global-pull-secret-syncer-k5tl7"
Jul 06 00:59:29.752508 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.752454    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7d19f25b-ac66-4e32-9ac9-2bccbbe89113-agent-certs\") pod \"konnectivity-agent-db55n\" (UID: \"7d19f25b-ac66-4e32-9ac9-2bccbbe89113\") " pod="kube-system/konnectivity-agent-db55n"
Jul 06 00:59:29.752508 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.752469    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f19b579f-765e-455e-92c2-602da92d5bb2-hosts-file\") pod \"node-resolver-4fmfs\" (UID: \"f19b579f-765e-455e-92c2-602da92d5bb2\") " pod="openshift-dns/node-resolver-4fmfs"
Jul 06 00:59:29.752508 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.752486    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2-dbus\") pod \"global-pull-secret-syncer-k5tl7\" (UID: \"031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2\") " pod="kube-system/global-pull-secret-syncer-k5tl7"
Jul 06 00:59:29.752743 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:29.752544    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 00:59:29.752743 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:29.752606    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2-original-pull-secret podName:031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:30.252587517 +0000 UTC m=+2.063562752 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2-original-pull-secret") pod "global-pull-secret-syncer-k5tl7" (UID: "031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2") : object "kube-system"/"original-pull-secret" not registered
Jul 06 00:59:29.752743 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.752630    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f19b579f-765e-455e-92c2-602da92d5bb2-hosts-file\") pod \"node-resolver-4fmfs\" (UID: \"f19b579f-765e-455e-92c2-602da92d5bb2\") " pod="openshift-dns/node-resolver-4fmfs"
Jul 06 00:59:29.752743 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.752529    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6k8k\" (UniqueName: \"kubernetes.io/projected/794399e2-dfe6-4b25-8879-858657cb407b-kube-api-access-w6k8k\") pod \"node-ca-9b7nw\" (UID: \"794399e2-dfe6-4b25-8879-858657cb407b\") " pod="openshift-image-registry/node-ca-9b7nw"
Jul 06 00:59:29.752743 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.752656    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f19b579f-765e-455e-92c2-602da92d5bb2-tmp-dir\") pod \"node-resolver-4fmfs\" (UID: \"f19b579f-765e-455e-92c2-602da92d5bb2\") " pod="openshift-dns/node-resolver-4fmfs"
Jul 06 00:59:29.752743 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.752687    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2-kubelet-config\") pod \"global-pull-secret-syncer-k5tl7\" (UID: \"031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2\") " pod="kube-system/global-pull-secret-syncer-k5tl7"
Jul 06 00:59:29.752743 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.752717    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgw58\" (UniqueName: \"kubernetes.io/projected/72256072-5a1e-41fd-a664-ce1d82f2b3bf-kube-api-access-tgw58\") pod \"network-check-target-tw75s\" (UID: \"72256072-5a1e-41fd-a664-ce1d82f2b3bf\") " pod="openshift-network-diagnostics/network-check-target-tw75s"
Jul 06 00:59:29.752743 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.752743    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/be609719-c174-46eb-bed0-e130fcd1a711-host-slash\") pod \"iptables-alerter-frb7f\" (UID: \"be609719-c174-46eb-bed0-e130fcd1a711\") " pod="openshift-network-operator/iptables-alerter-frb7f"
Jul 06 00:59:29.753161 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.752752    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2-dbus\") pod \"global-pull-secret-syncer-k5tl7\" (UID: \"031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2\") " pod="kube-system/global-pull-secret-syncer-k5tl7"
Jul 06 00:59:29.753161 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.752797    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2-kubelet-config\") pod \"global-pull-secret-syncer-k5tl7\" (UID: \"031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2\") " pod="kube-system/global-pull-secret-syncer-k5tl7"
Jul 06 00:59:29.753161 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.752804    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/794399e2-dfe6-4b25-8879-858657cb407b-serviceca\") pod \"node-ca-9b7nw\" (UID: \"794399e2-dfe6-4b25-8879-858657cb407b\") " pod="openshift-image-registry/node-ca-9b7nw"
Jul 06 00:59:29.753161 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.752854    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7d19f25b-ac66-4e32-9ac9-2bccbbe89113-konnectivity-ca\") pod \"konnectivity-agent-db55n\" (UID: \"7d19f25b-ac66-4e32-9ac9-2bccbbe89113\") " pod="kube-system/konnectivity-agent-db55n"
Jul 06 00:59:29.753161 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.752861    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/be609719-c174-46eb-bed0-e130fcd1a711-host-slash\") pod \"iptables-alerter-frb7f\" (UID: \"be609719-c174-46eb-bed0-e130fcd1a711\") " pod="openshift-network-operator/iptables-alerter-frb7f"
Jul 06 00:59:29.753161 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.752921    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7gmr\" (UniqueName: \"kubernetes.io/projected/be609719-c174-46eb-bed0-e130fcd1a711-kube-api-access-m7gmr\") pod \"iptables-alerter-frb7f\" (UID: \"be609719-c174-46eb-bed0-e130fcd1a711\") " pod="openshift-network-operator/iptables-alerter-frb7f"
Jul 06 00:59:29.753161 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.752952    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/794399e2-dfe6-4b25-8879-858657cb407b-host\") pod \"node-ca-9b7nw\" (UID: \"794399e2-dfe6-4b25-8879-858657cb407b\") " pod="openshift-image-registry/node-ca-9b7nw"
Jul 06 00:59:29.753161 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.752979    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/be609719-c174-46eb-bed0-e130fcd1a711-iptables-alerter-script\") pod \"iptables-alerter-frb7f\" (UID: \"be609719-c174-46eb-bed0-e130fcd1a711\") " pod="openshift-network-operator/iptables-alerter-frb7f"
Jul 06 00:59:29.753161 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.753071    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/794399e2-dfe6-4b25-8879-858657cb407b-host\") pod \"node-ca-9b7nw\" (UID: \"794399e2-dfe6-4b25-8879-858657cb407b\") " pod="openshift-image-registry/node-ca-9b7nw"
Jul 06 00:59:29.753610 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.753267    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/794399e2-dfe6-4b25-8879-858657cb407b-serviceca\") pod \"node-ca-9b7nw\" (UID: \"794399e2-dfe6-4b25-8879-858657cb407b\") " pod="openshift-image-registry/node-ca-9b7nw"
Jul 06 00:59:29.753610 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.753376    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7d19f25b-ac66-4e32-9ac9-2bccbbe89113-konnectivity-ca\") pod \"konnectivity-agent-db55n\" (UID: \"7d19f25b-ac66-4e32-9ac9-2bccbbe89113\") " pod="kube-system/konnectivity-agent-db55n"
Jul 06 00:59:29.753973 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.753953    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/be609719-c174-46eb-bed0-e130fcd1a711-iptables-alerter-script\") pod \"iptables-alerter-frb7f\" (UID: \"be609719-c174-46eb-bed0-e130fcd1a711\") " pod="openshift-network-operator/iptables-alerter-frb7f"
Jul 06 00:59:29.754973 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.754947    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7d19f25b-ac66-4e32-9ac9-2bccbbe89113-agent-certs\") pod \"konnectivity-agent-db55n\" (UID: \"7d19f25b-ac66-4e32-9ac9-2bccbbe89113\") " pod="kube-system/konnectivity-agent-db55n"
Jul 06 00:59:29.766692 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:29.766670    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 00:59:29.766692 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:29.766690    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 00:59:29.766854 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:29.766699    2562 projected.go:196] Error preparing data for projected volume kube-api-access-tgw58 for pod openshift-network-diagnostics/network-check-target-tw75s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 00:59:29.766854 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:29.766762    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/72256072-5a1e-41fd-a664-ce1d82f2b3bf-kube-api-access-tgw58 podName:72256072-5a1e-41fd-a664-ce1d82f2b3bf nodeName:}" failed. No retries permitted until 2026-07-06 00:59:30.266749098 +0000 UTC m=+2.077724335 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tgw58" (UniqueName: "kubernetes.io/projected/72256072-5a1e-41fd-a664-ce1d82f2b3bf-kube-api-access-tgw58") pod "network-check-target-tw75s" (UID: "72256072-5a1e-41fd-a664-ce1d82f2b3bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 00:59:29.768246 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.768226    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t79lb\" (UniqueName: \"kubernetes.io/projected/f19b579f-765e-455e-92c2-602da92d5bb2-kube-api-access-t79lb\") pod \"node-resolver-4fmfs\" (UID: \"f19b579f-765e-455e-92c2-602da92d5bb2\") " pod="openshift-dns/node-resolver-4fmfs"
Jul 06 00:59:29.768744 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.768722    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6k8k\" (UniqueName: \"kubernetes.io/projected/794399e2-dfe6-4b25-8879-858657cb407b-kube-api-access-w6k8k\") pod \"node-ca-9b7nw\" (UID: \"794399e2-dfe6-4b25-8879-858657cb407b\") " pod="openshift-image-registry/node-ca-9b7nw"
Jul 06 00:59:29.768866 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.768844    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7gmr\" (UniqueName: \"kubernetes.io/projected/be609719-c174-46eb-bed0-e130fcd1a711-kube-api-access-m7gmr\") pod \"iptables-alerter-frb7f\" (UID: \"be609719-c174-46eb-bed0-e130fcd1a711\") " pod="openshift-network-operator/iptables-alerter-frb7f"
Jul 06 00:59:29.770327 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:29.770295    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8773ab7175117a866c88af6c1f78223.slice/crio-38a9444d6cdac7b751915c5655c6f13a0145350bedc8c1e1c2550695796caefe WatchSource:0}: Error finding container 38a9444d6cdac7b751915c5655c6f13a0145350bedc8c1e1c2550695796caefe: Status 404 returned error can't find the container with id 38a9444d6cdac7b751915c5655c6f13a0145350bedc8c1e1c2550695796caefe
Jul 06 00:59:29.770784 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:29.770769    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b0e7f033d28149e3cc1491a1bf5fe87.slice/crio-160f6928cc4573e49efea628f4cb3bfd7e42532989fb16d8bb853502bd2f6f5f WatchSource:0}: Error finding container 160f6928cc4573e49efea628f4cb3bfd7e42532989fb16d8bb853502bd2f6f5f: Status 404 returned error can't find the container with id 160f6928cc4573e49efea628f4cb3bfd7e42532989fb16d8bb853502bd2f6f5f
Jul 06 00:59:29.775462 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.775442    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 00:59:29.861756 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.861730    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4mw"
Jul 06 00:59:29.871692 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:29.871666    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2a04d5d_fa83_4240_9c9f_6257fd6f19fe.slice/crio-59ef696326be16424374d93f000ba883b7b9eb9838a536ee882bd15b18b28dd1 WatchSource:0}: Error finding container 59ef696326be16424374d93f000ba883b7b9eb9838a536ee882bd15b18b28dd1: Status 404 returned error can't find the container with id 59ef696326be16424374d93f000ba883b7b9eb9838a536ee882bd15b18b28dd1
Jul 06 00:59:29.884318 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.884294    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rhtvh"
Jul 06 00:59:29.892237 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:29.892205    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e804c5d_56b0_4cec_bcd9_cf18304cd8de.slice/crio-a38efe03a0c7db70573730d2cdda14eba8f399bc2f2a5e86380e58782dfc0941 WatchSource:0}: Error finding container a38efe03a0c7db70573730d2cdda14eba8f399bc2f2a5e86380e58782dfc0941: Status 404 returned error can't find the container with id a38efe03a0c7db70573730d2cdda14eba8f399bc2f2a5e86380e58782dfc0941
Jul 06 00:59:29.904262 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.904243    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4tnqb"
Jul 06 00:59:29.912398 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:29.912375    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3056d6fb_5441_40ff_a0f9_98dbedab0677.slice/crio-dbf9f5bda934a1ed0aec7c855f7fc0197b341113b6b45e6a8f9c04c19ae4e3e1 WatchSource:0}: Error finding container dbf9f5bda934a1ed0aec7c855f7fc0197b341113b6b45e6a8f9c04c19ae4e3e1: Status 404 returned error can't find the container with id dbf9f5bda934a1ed0aec7c855f7fc0197b341113b6b45e6a8f9c04c19ae4e3e1
Jul 06 00:59:29.919474 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.919454    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nph2n"
Jul 06 00:59:29.927165 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:29.927125    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0730ff2_6a66_4938_91d6_651e4cbdad5c.slice/crio-ae3b81403c0eaed843a937b9351a644d931c50892588013545255505b034b337 WatchSource:0}: Error finding container ae3b81403c0eaed843a937b9351a644d931c50892588013545255505b034b337: Status 404 returned error can't find the container with id ae3b81403c0eaed843a937b9351a644d931c50892588013545255505b034b337
Jul 06 00:59:29.940261 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.940242    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:29.948769 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:29.948748    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb642562_26ad_462a_b18c_24ce564e1c22.slice/crio-0096b8fa2a7b4601b262ce7502f55b56e8cb87f01cc0d5c5aed592b438b138b8 WatchSource:0}: Error finding container 0096b8fa2a7b4601b262ce7502f55b56e8cb87f01cc0d5c5aed592b438b138b8: Status 404 returned error can't find the container with id 0096b8fa2a7b4601b262ce7502f55b56e8cb87f01cc0d5c5aed592b438b138b8
Jul 06 00:59:29.969252 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.969226    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-db55n"
Jul 06 00:59:29.979175 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:29.979133    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d19f25b_ac66_4e32_9ac9_2bccbbe89113.slice/crio-44426327c4328ca32a19ff918e0c40372f9f28649e7d1d6d52667ff82eec000f WatchSource:0}: Error finding container 44426327c4328ca32a19ff918e0c40372f9f28649e7d1d6d52667ff82eec000f: Status 404 returned error can't find the container with id 44426327c4328ca32a19ff918e0c40372f9f28649e7d1d6d52667ff82eec000f
Jul 06 00:59:29.983084 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.983063    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4fmfs"
Jul 06 00:59:29.990939 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:29.990914    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf19b579f_765e_455e_92c2_602da92d5bb2.slice/crio-a766a269b6905ddc23e668f2406c5b7a7a3804b49a0dc5ba8d175ab18679a98b WatchSource:0}: Error finding container a766a269b6905ddc23e668f2406c5b7a7a3804b49a0dc5ba8d175ab18679a98b: Status 404 returned error can't find the container with id a766a269b6905ddc23e668f2406c5b7a7a3804b49a0dc5ba8d175ab18679a98b
Jul 06 00:59:29.999111 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:29.999095    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9b7nw"
Jul 06 00:59:30.004907 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:30.004879    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-frb7f"
Jul 06 00:59:30.007255 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:30.007233    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod794399e2_dfe6_4b25_8879_858657cb407b.slice/crio-cf6f016aedd8dd50dd35059922839bc150938079ae6213d64fdd627d43218bf4 WatchSource:0}: Error finding container cf6f016aedd8dd50dd35059922839bc150938079ae6213d64fdd627d43218bf4: Status 404 returned error can't find the container with id cf6f016aedd8dd50dd35059922839bc150938079ae6213d64fdd627d43218bf4
Jul 06 00:59:30.013202 ip-10-0-131-116 kubenswrapper[2562]: W0706 00:59:30.013183    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe609719_c174_46eb_bed0_e130fcd1a711.slice/crio-90edb2a7458d483303dcbae41c74b1852f94ad41294a9ff7806a128a064ede2d WatchSource:0}: Error finding container 90edb2a7458d483303dcbae41c74b1852f94ad41294a9ff7806a128a064ede2d: Status 404 returned error can't find the container with id 90edb2a7458d483303dcbae41c74b1852f94ad41294a9ff7806a128a064ede2d
Jul 06 00:59:30.053816 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:30.053792    2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 00:59:30.155808 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:30.155777    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccf84e13-ab75-4168-9cb8-9a21cb959224-metrics-certs\") pod \"network-metrics-daemon-lw99t\" (UID: \"ccf84e13-ab75-4168-9cb8-9a21cb959224\") " pod="openshift-multus/network-metrics-daemon-lw99t"
Jul 06 00:59:30.155965 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:30.155930    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 00:59:30.156015 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:30.155989    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccf84e13-ab75-4168-9cb8-9a21cb959224-metrics-certs podName:ccf84e13-ab75-4168-9cb8-9a21cb959224 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:31.155974527 +0000 UTC m=+2.966949749 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ccf84e13-ab75-4168-9cb8-9a21cb959224-metrics-certs") pod "network-metrics-daemon-lw99t" (UID: "ccf84e13-ab75-4168-9cb8-9a21cb959224") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 00:59:30.257331 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:30.256693    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2-original-pull-secret\") pod \"global-pull-secret-syncer-k5tl7\" (UID: \"031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2\") " pod="kube-system/global-pull-secret-syncer-k5tl7"
Jul 06 00:59:30.257331 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:30.256834    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 00:59:30.257331 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:30.256905    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2-original-pull-secret podName:031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:31.256886392 +0000 UTC m=+3.067861618 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2-original-pull-secret") pod "global-pull-secret-syncer-k5tl7" (UID: "031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2") : object "kube-system"/"original-pull-secret" not registered
Jul 06 00:59:30.357742 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:30.357703    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgw58\" (UniqueName: \"kubernetes.io/projected/72256072-5a1e-41fd-a664-ce1d82f2b3bf-kube-api-access-tgw58\") pod \"network-check-target-tw75s\" (UID: \"72256072-5a1e-41fd-a664-ce1d82f2b3bf\") " pod="openshift-network-diagnostics/network-check-target-tw75s"
Jul 06 00:59:30.358001 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:30.357923    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 00:59:30.358106 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:30.358006    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 00:59:30.358106 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:30.358032    2562 projected.go:196] Error preparing data for projected volume kube-api-access-tgw58 for pod openshift-network-diagnostics/network-check-target-tw75s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 00:59:30.358233 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:30.358183    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/72256072-5a1e-41fd-a664-ce1d82f2b3bf-kube-api-access-tgw58 podName:72256072-5a1e-41fd-a664-ce1d82f2b3bf nodeName:}" failed. No retries permitted until 2026-07-06 00:59:31.358111233 +0000 UTC m=+3.169086468 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tgw58" (UniqueName: "kubernetes.io/projected/72256072-5a1e-41fd-a664-ce1d82f2b3bf-kube-api-access-tgw58") pod "network-check-target-tw75s" (UID: "72256072-5a1e-41fd-a664-ce1d82f2b3bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 00:59:30.424138 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:30.424104    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 00:59:30.673980 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:30.673849    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 00:54:29 +0000 UTC" deadline="2028-04-03 18:15:02.506493312 +0000 UTC"
Jul 06 00:59:30.673980 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:30.673883    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15305h15m31.832614734s"
Jul 06 00:59:30.694628 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:30.694428    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 00:59:30.775302 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:30.775194    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4fmfs" event={"ID":"f19b579f-765e-455e-92c2-602da92d5bb2","Type":"ContainerStarted","Data":"a766a269b6905ddc23e668f2406c5b7a7a3804b49a0dc5ba8d175ab18679a98b"}
Jul 06 00:59:30.793237 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:30.791354    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-txc22" event={"ID":"eb642562-26ad-462a-b18c-24ce564e1c22","Type":"ContainerStarted","Data":"0096b8fa2a7b4601b262ce7502f55b56e8cb87f01cc0d5c5aed592b438b138b8"}
Jul 06 00:59:30.817291 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:30.817255    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4tnqb" event={"ID":"3056d6fb-5441-40ff-a0f9-98dbedab0677","Type":"ContainerStarted","Data":"dbf9f5bda934a1ed0aec7c855f7fc0197b341113b6b45e6a8f9c04c19ae4e3e1"}
Jul 06 00:59:30.843223 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:30.843164    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rhtvh" event={"ID":"3e804c5d-56b0-4cec-bcd9-cf18304cd8de","Type":"ContainerStarted","Data":"a38efe03a0c7db70573730d2cdda14eba8f399bc2f2a5e86380e58782dfc0941"}
Jul 06 00:59:30.854310 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:30.854278    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4mw" event={"ID":"e2a04d5d-fa83-4240-9c9f-6257fd6f19fe","Type":"ContainerStarted","Data":"59ef696326be16424374d93f000ba883b7b9eb9838a536ee882bd15b18b28dd1"}
Jul 06 00:59:30.861577 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:30.861528    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-frb7f" event={"ID":"be609719-c174-46eb-bed0-e130fcd1a711","Type":"ContainerStarted","Data":"90edb2a7458d483303dcbae41c74b1852f94ad41294a9ff7806a128a064ede2d"}
Jul 06 00:59:30.881195 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:30.881161    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9b7nw" event={"ID":"794399e2-dfe6-4b25-8879-858657cb407b","Type":"ContainerStarted","Data":"cf6f016aedd8dd50dd35059922839bc150938079ae6213d64fdd627d43218bf4"}
Jul 06 00:59:30.884207 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:30.884106    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-db55n" event={"ID":"7d19f25b-ac66-4e32-9ac9-2bccbbe89113","Type":"ContainerStarted","Data":"44426327c4328ca32a19ff918e0c40372f9f28649e7d1d6d52667ff82eec000f"}
Jul 06 00:59:30.889038 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:30.888955    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nph2n" event={"ID":"e0730ff2-6a66-4938-91d6-651e4cbdad5c","Type":"ContainerStarted","Data":"ae3b81403c0eaed843a937b9351a644d931c50892588013545255505b034b337"}
Jul 06 00:59:30.922261 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:30.922214    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-116.ec2.internal" event={"ID":"d8773ab7175117a866c88af6c1f78223","Type":"ContainerStarted","Data":"38a9444d6cdac7b751915c5655c6f13a0145350bedc8c1e1c2550695796caefe"}
Jul 06 00:59:30.934809 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:30.934733    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-116.ec2.internal" event={"ID":"2b0e7f033d28149e3cc1491a1bf5fe87","Type":"ContainerStarted","Data":"160f6928cc4573e49efea628f4cb3bfd7e42532989fb16d8bb853502bd2f6f5f"}
Jul 06 00:59:31.163725 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:31.163684    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccf84e13-ab75-4168-9cb8-9a21cb959224-metrics-certs\") pod \"network-metrics-daemon-lw99t\" (UID: \"ccf84e13-ab75-4168-9cb8-9a21cb959224\") " pod="openshift-multus/network-metrics-daemon-lw99t"
Jul 06 00:59:31.163908 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:31.163875    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 00:59:31.163972 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:31.163939    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccf84e13-ab75-4168-9cb8-9a21cb959224-metrics-certs podName:ccf84e13-ab75-4168-9cb8-9a21cb959224 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:33.163920759 +0000 UTC m=+4.974896003 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ccf84e13-ab75-4168-9cb8-9a21cb959224-metrics-certs") pod "network-metrics-daemon-lw99t" (UID: "ccf84e13-ab75-4168-9cb8-9a21cb959224") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 00:59:31.264362 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:31.264281    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2-original-pull-secret\") pod \"global-pull-secret-syncer-k5tl7\" (UID: \"031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2\") " pod="kube-system/global-pull-secret-syncer-k5tl7"
Jul 06 00:59:31.264518 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:31.264421    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 00:59:31.264518 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:31.264484    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2-original-pull-secret podName:031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:33.264466268 +0000 UTC m=+5.075441493 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2-original-pull-secret") pod "global-pull-secret-syncer-k5tl7" (UID: "031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2") : object "kube-system"/"original-pull-secret" not registered
Jul 06 00:59:31.365504 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:31.365469    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgw58\" (UniqueName: \"kubernetes.io/projected/72256072-5a1e-41fd-a664-ce1d82f2b3bf-kube-api-access-tgw58\") pod \"network-check-target-tw75s\" (UID: \"72256072-5a1e-41fd-a664-ce1d82f2b3bf\") " pod="openshift-network-diagnostics/network-check-target-tw75s"
Jul 06 00:59:31.365688 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:31.365673    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 00:59:31.365751 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:31.365692    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 00:59:31.365751 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:31.365704    2562 projected.go:196] Error preparing data for projected volume kube-api-access-tgw58 for pod openshift-network-diagnostics/network-check-target-tw75s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 00:59:31.365861 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:31.365760    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/72256072-5a1e-41fd-a664-ce1d82f2b3bf-kube-api-access-tgw58 podName:72256072-5a1e-41fd-a664-ce1d82f2b3bf nodeName:}" failed. No retries permitted until 2026-07-06 00:59:33.365742961 +0000 UTC m=+5.176718184 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tgw58" (UniqueName: "kubernetes.io/projected/72256072-5a1e-41fd-a664-ce1d82f2b3bf-kube-api-access-tgw58") pod "network-check-target-tw75s" (UID: "72256072-5a1e-41fd-a664-ce1d82f2b3bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 00:59:31.675126 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:31.674912    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 00:54:29 +0000 UTC" deadline="2028-02-08 19:14:53.189384447 +0000 UTC"
Jul 06 00:59:31.675126 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:31.674957    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13986h15m21.514431981s"
Jul 06 00:59:31.746314 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:31.746278    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lw99t"
Jul 06 00:59:31.746497 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:31.746432    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lw99t" podUID="ccf84e13-ab75-4168-9cb8-9a21cb959224"
Jul 06 00:59:31.746497 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:31.746482    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5tl7"
Jul 06 00:59:31.746623 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:31.746592    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5tl7" podUID="031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2"
Jul 06 00:59:31.746681 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:31.746646    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw75s"
Jul 06 00:59:31.746745 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:31.746714    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw75s" podUID="72256072-5a1e-41fd-a664-ce1d82f2b3bf"
Jul 06 00:59:33.185171 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:33.184495    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccf84e13-ab75-4168-9cb8-9a21cb959224-metrics-certs\") pod \"network-metrics-daemon-lw99t\" (UID: \"ccf84e13-ab75-4168-9cb8-9a21cb959224\") " pod="openshift-multus/network-metrics-daemon-lw99t"
Jul 06 00:59:33.185171 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:33.184675    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 00:59:33.185171 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:33.184740    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccf84e13-ab75-4168-9cb8-9a21cb959224-metrics-certs podName:ccf84e13-ab75-4168-9cb8-9a21cb959224 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:37.184721915 +0000 UTC m=+8.995697139 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ccf84e13-ab75-4168-9cb8-9a21cb959224-metrics-certs") pod "network-metrics-daemon-lw99t" (UID: "ccf84e13-ab75-4168-9cb8-9a21cb959224") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 00:59:33.285826 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:33.285732    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2-original-pull-secret\") pod \"global-pull-secret-syncer-k5tl7\" (UID: \"031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2\") " pod="kube-system/global-pull-secret-syncer-k5tl7"
Jul 06 00:59:33.285983 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:33.285917    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 00:59:33.286039 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:33.285993    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2-original-pull-secret podName:031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:37.285972519 +0000 UTC m=+9.096947756 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2-original-pull-secret") pod "global-pull-secret-syncer-k5tl7" (UID: "031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2") : object "kube-system"/"original-pull-secret" not registered
Jul 06 00:59:33.386412 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:33.386305    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgw58\" (UniqueName: \"kubernetes.io/projected/72256072-5a1e-41fd-a664-ce1d82f2b3bf-kube-api-access-tgw58\") pod \"network-check-target-tw75s\" (UID: \"72256072-5a1e-41fd-a664-ce1d82f2b3bf\") " pod="openshift-network-diagnostics/network-check-target-tw75s"
Jul 06 00:59:33.386577 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:33.386488    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 00:59:33.386577 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:33.386510    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 00:59:33.386577 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:33.386524    2562 projected.go:196] Error preparing data for projected volume kube-api-access-tgw58 for pod openshift-network-diagnostics/network-check-target-tw75s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 00:59:33.386767 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:33.386591    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/72256072-5a1e-41fd-a664-ce1d82f2b3bf-kube-api-access-tgw58 podName:72256072-5a1e-41fd-a664-ce1d82f2b3bf nodeName:}" failed. No retries permitted until 2026-07-06 00:59:37.386570347 +0000 UTC m=+9.197545568 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tgw58" (UniqueName: "kubernetes.io/projected/72256072-5a1e-41fd-a664-ce1d82f2b3bf-kube-api-access-tgw58") pod "network-check-target-tw75s" (UID: "72256072-5a1e-41fd-a664-ce1d82f2b3bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 00:59:33.746581 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:33.746546    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw75s"
Jul 06 00:59:33.746743 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:33.746547    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lw99t"
Jul 06 00:59:33.746743 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:33.746663    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw75s" podUID="72256072-5a1e-41fd-a664-ce1d82f2b3bf"
Jul 06 00:59:33.746743 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:33.746681    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5tl7"
Jul 06 00:59:33.746897 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:33.746777    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lw99t" podUID="ccf84e13-ab75-4168-9cb8-9a21cb959224"
Jul 06 00:59:33.746897 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:33.746854    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5tl7" podUID="031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2"
Jul 06 00:59:35.746552 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:35.746477    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lw99t"
Jul 06 00:59:35.746552 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:35.746501    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5tl7"
Jul 06 00:59:35.746552 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:35.746501    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw75s"
Jul 06 00:59:35.747094 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:35.746616    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lw99t" podUID="ccf84e13-ab75-4168-9cb8-9a21cb959224"
Jul 06 00:59:35.747094 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:35.746747    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5tl7" podUID="031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2"
Jul 06 00:59:35.747094 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:35.746812    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw75s" podUID="72256072-5a1e-41fd-a664-ce1d82f2b3bf"
Jul 06 00:59:37.224292 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:37.224259    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccf84e13-ab75-4168-9cb8-9a21cb959224-metrics-certs\") pod \"network-metrics-daemon-lw99t\" (UID: \"ccf84e13-ab75-4168-9cb8-9a21cb959224\") " pod="openshift-multus/network-metrics-daemon-lw99t"
Jul 06 00:59:37.224784 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:37.224405    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 00:59:37.224784 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:37.224470    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccf84e13-ab75-4168-9cb8-9a21cb959224-metrics-certs podName:ccf84e13-ab75-4168-9cb8-9a21cb959224 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:45.224451362 +0000 UTC m=+17.035426603 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ccf84e13-ab75-4168-9cb8-9a21cb959224-metrics-certs") pod "network-metrics-daemon-lw99t" (UID: "ccf84e13-ab75-4168-9cb8-9a21cb959224") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 00:59:37.325530 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:37.324786    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2-original-pull-secret\") pod \"global-pull-secret-syncer-k5tl7\" (UID: \"031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2\") " pod="kube-system/global-pull-secret-syncer-k5tl7"
Jul 06 00:59:37.325530 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:37.325029    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 00:59:37.325530 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:37.325095    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2-original-pull-secret podName:031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:45.325076607 +0000 UTC m=+17.136051842 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2-original-pull-secret") pod "global-pull-secret-syncer-k5tl7" (UID: "031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2") : object "kube-system"/"original-pull-secret" not registered
Jul 06 00:59:37.425518 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:37.425448    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgw58\" (UniqueName: \"kubernetes.io/projected/72256072-5a1e-41fd-a664-ce1d82f2b3bf-kube-api-access-tgw58\") pod \"network-check-target-tw75s\" (UID: \"72256072-5a1e-41fd-a664-ce1d82f2b3bf\") " pod="openshift-network-diagnostics/network-check-target-tw75s"
Jul 06 00:59:37.425693 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:37.425601    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 00:59:37.425693 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:37.425620    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 00:59:37.425693 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:37.425628    2562 projected.go:196] Error preparing data for projected volume kube-api-access-tgw58 for pod openshift-network-diagnostics/network-check-target-tw75s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 00:59:37.425693 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:37.425679    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/72256072-5a1e-41fd-a664-ce1d82f2b3bf-kube-api-access-tgw58 podName:72256072-5a1e-41fd-a664-ce1d82f2b3bf nodeName:}" failed. No retries permitted until 2026-07-06 00:59:45.425660748 +0000 UTC m=+17.236635972 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tgw58" (UniqueName: "kubernetes.io/projected/72256072-5a1e-41fd-a664-ce1d82f2b3bf-kube-api-access-tgw58") pod "network-check-target-tw75s" (UID: "72256072-5a1e-41fd-a664-ce1d82f2b3bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 00:59:37.746721 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:37.746689    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lw99t"
Jul 06 00:59:37.746907 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:37.746694    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5tl7"
Jul 06 00:59:37.746907 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:37.746814    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lw99t" podUID="ccf84e13-ab75-4168-9cb8-9a21cb959224"
Jul 06 00:59:37.746907 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:37.746706    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw75s"
Jul 06 00:59:37.746907 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:37.746889    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5tl7" podUID="031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2"
Jul 06 00:59:37.747136 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:37.746954    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw75s" podUID="72256072-5a1e-41fd-a664-ce1d82f2b3bf"
Jul 06 00:59:39.746904 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:39.746868    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lw99t"
Jul 06 00:59:39.747408 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:39.746884    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw75s"
Jul 06 00:59:39.747408 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:39.747009    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lw99t" podUID="ccf84e13-ab75-4168-9cb8-9a21cb959224"
Jul 06 00:59:39.747408 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:39.746890    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5tl7"
Jul 06 00:59:39.747408 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:39.747089    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw75s" podUID="72256072-5a1e-41fd-a664-ce1d82f2b3bf"
Jul 06 00:59:39.747408 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:39.747141    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5tl7" podUID="031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2"
Jul 06 00:59:41.747206 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:41.747090    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5tl7"
Jul 06 00:59:41.747644 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:41.747213    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw75s"
Jul 06 00:59:41.747644 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:41.747223    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lw99t"
Jul 06 00:59:41.747644 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:41.747221    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5tl7" podUID="031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2"
Jul 06 00:59:41.747644 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:41.747317    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw75s" podUID="72256072-5a1e-41fd-a664-ce1d82f2b3bf"
Jul 06 00:59:41.747644 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:41.747406    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lw99t" podUID="ccf84e13-ab75-4168-9cb8-9a21cb959224"
Jul 06 00:59:43.746367 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:43.746333    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lw99t"
Jul 06 00:59:43.746809 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:43.746375    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5tl7"
Jul 06 00:59:43.746809 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:43.746338    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw75s"
Jul 06 00:59:43.746809 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:43.746472    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lw99t" podUID="ccf84e13-ab75-4168-9cb8-9a21cb959224"
Jul 06 00:59:43.746809 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:43.746586    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw75s" podUID="72256072-5a1e-41fd-a664-ce1d82f2b3bf"
Jul 06 00:59:43.746809 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:43.746675    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5tl7" podUID="031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2"
Jul 06 00:59:45.288161 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:45.288117    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccf84e13-ab75-4168-9cb8-9a21cb959224-metrics-certs\") pod \"network-metrics-daemon-lw99t\" (UID: \"ccf84e13-ab75-4168-9cb8-9a21cb959224\") " pod="openshift-multus/network-metrics-daemon-lw99t"
Jul 06 00:59:45.288501 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:45.288268    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 00:59:45.288501 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:45.288329    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccf84e13-ab75-4168-9cb8-9a21cb959224-metrics-certs podName:ccf84e13-ab75-4168-9cb8-9a21cb959224 nodeName:}" failed. No retries permitted until 2026-07-06 01:00:01.288311848 +0000 UTC m=+33.099287069 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ccf84e13-ab75-4168-9cb8-9a21cb959224-metrics-certs") pod "network-metrics-daemon-lw99t" (UID: "ccf84e13-ab75-4168-9cb8-9a21cb959224") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 00:59:45.388900 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:45.388641    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2-original-pull-secret\") pod \"global-pull-secret-syncer-k5tl7\" (UID: \"031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2\") " pod="kube-system/global-pull-secret-syncer-k5tl7"
Jul 06 00:59:45.388900 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:45.388851    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 00:59:45.389135 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:45.388914    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2-original-pull-secret podName:031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2 nodeName:}" failed. No retries permitted until 2026-07-06 01:00:01.388896191 +0000 UTC m=+33.199871415 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2-original-pull-secret") pod "global-pull-secret-syncer-k5tl7" (UID: "031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2") : object "kube-system"/"original-pull-secret" not registered
Jul 06 00:59:45.489906 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:45.489866    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgw58\" (UniqueName: \"kubernetes.io/projected/72256072-5a1e-41fd-a664-ce1d82f2b3bf-kube-api-access-tgw58\") pod \"network-check-target-tw75s\" (UID: \"72256072-5a1e-41fd-a664-ce1d82f2b3bf\") " pod="openshift-network-diagnostics/network-check-target-tw75s"
Jul 06 00:59:45.490093 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:45.490058    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 00:59:45.490093 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:45.490081    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 00:59:45.490216 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:45.490096    2562 projected.go:196] Error preparing data for projected volume kube-api-access-tgw58 for pod openshift-network-diagnostics/network-check-target-tw75s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 00:59:45.490216 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:45.490170    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/72256072-5a1e-41fd-a664-ce1d82f2b3bf-kube-api-access-tgw58 podName:72256072-5a1e-41fd-a664-ce1d82f2b3bf nodeName:}" failed. No retries permitted until 2026-07-06 01:00:01.490137134 +0000 UTC m=+33.301112362 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tgw58" (UniqueName: "kubernetes.io/projected/72256072-5a1e-41fd-a664-ce1d82f2b3bf-kube-api-access-tgw58") pod "network-check-target-tw75s" (UID: "72256072-5a1e-41fd-a664-ce1d82f2b3bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 00:59:45.746251 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:45.746175    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw75s"
Jul 06 00:59:45.746404 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:45.746173    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5tl7"
Jul 06 00:59:45.746404 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:45.746301    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw75s" podUID="72256072-5a1e-41fd-a664-ce1d82f2b3bf"
Jul 06 00:59:45.746404 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:45.746175    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lw99t"
Jul 06 00:59:45.746404 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:45.746376    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5tl7" podUID="031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2"
Jul 06 00:59:45.746557 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:45.746436    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lw99t" podUID="ccf84e13-ab75-4168-9cb8-9a21cb959224"
Jul 06 00:59:47.746940 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:47.746903    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5tl7"
Jul 06 00:59:47.747524 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:47.746911    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lw99t"
Jul 06 00:59:47.747524 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:47.747028    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5tl7" podUID="031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2"
Jul 06 00:59:47.747524 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:47.746912    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw75s"
Jul 06 00:59:47.747524 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:47.747115    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lw99t" podUID="ccf84e13-ab75-4168-9cb8-9a21cb959224"
Jul 06 00:59:47.747524 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:47.747236    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw75s" podUID="72256072-5a1e-41fd-a664-ce1d82f2b3bf"
Jul 06 00:59:49.746453 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:49.746424    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw75s"
Jul 06 00:59:49.746716 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:49.746424    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5tl7"
Jul 06 00:59:49.746716 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:49.746524    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw75s" podUID="72256072-5a1e-41fd-a664-ce1d82f2b3bf"
Jul 06 00:59:49.746716 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:49.746431    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lw99t"
Jul 06 00:59:49.746716 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:49.746598    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5tl7" podUID="031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2"
Jul 06 00:59:49.746716 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:49.746695    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lw99t" podUID="ccf84e13-ab75-4168-9cb8-9a21cb959224"
Jul 06 00:59:50.988336 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:50.988004    2562 generic.go:356] "Generic (PLEG): container finished" podID="e0730ff2-6a66-4938-91d6-651e4cbdad5c" containerID="9f481b39bf1f4aff2ecc8a98057bf12746574b9ade7b5db3d3cf36a771fd2629" exitCode=0
Jul 06 00:59:50.989033 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:50.988087    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nph2n" event={"ID":"e0730ff2-6a66-4938-91d6-651e4cbdad5c","Type":"ContainerDied","Data":"9f481b39bf1f4aff2ecc8a98057bf12746574b9ade7b5db3d3cf36a771fd2629"}
Jul 06 00:59:50.989910 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:50.989891    2562 generic.go:356] "Generic (PLEG): container finished" podID="d8773ab7175117a866c88af6c1f78223" containerID="f6b27ea76037a50656b611d99cf0873ead6847a6adf5d698c2090a9f4bc30a58" exitCode=0
Jul 06 00:59:50.990005 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:50.989958    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-116.ec2.internal" event={"ID":"d8773ab7175117a866c88af6c1f78223","Type":"ContainerDied","Data":"f6b27ea76037a50656b611d99cf0873ead6847a6adf5d698c2090a9f4bc30a58"}
Jul 06 00:59:50.991388 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:50.991367    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-116.ec2.internal" event={"ID":"2b0e7f033d28149e3cc1491a1bf5fe87","Type":"ContainerStarted","Data":"c9fc4b1e07fa43e0584b63e9d0c2b077d69a3469e572cad0f93c7d73df4ebf32"}
Jul 06 00:59:50.992838 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:50.992814    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4fmfs" event={"ID":"f19b579f-765e-455e-92c2-602da92d5bb2","Type":"ContainerStarted","Data":"52c6e16ce1d539930e5a5a445aa6853605fe9bd83f7102751696f9cd50763176"}
Jul 06 00:59:50.995764 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:50.995745    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-txc22" event={"ID":"eb642562-26ad-462a-b18c-24ce564e1c22","Type":"ContainerStarted","Data":"b5057126c18519026eef1b3aaa9724c00af9da4568fa5761d2dc2dff690f6716"}
Jul 06 00:59:50.995876 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:50.995813    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-txc22" event={"ID":"eb642562-26ad-462a-b18c-24ce564e1c22","Type":"ContainerStarted","Data":"9a266557f616af7ab83cf2cb978e88c70537b081a282aa856b966600a1b526ed"}
Jul 06 00:59:50.995940 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:50.995876    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-txc22" event={"ID":"eb642562-26ad-462a-b18c-24ce564e1c22","Type":"ContainerStarted","Data":"465941df8c964158c72267f4170c9b61255747c2ecc7bcc37401c7028965e463"}
Jul 06 00:59:50.995940 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:50.995928    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-txc22" event={"ID":"eb642562-26ad-462a-b18c-24ce564e1c22","Type":"ContainerStarted","Data":"3e59d1e2a9b4af4a8310859174f7d9ff72656ebffdb31b2b55c518dd432ce0fa"}
Jul 06 00:59:50.996042 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:50.995975    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-txc22" event={"ID":"eb642562-26ad-462a-b18c-24ce564e1c22","Type":"ContainerStarted","Data":"8def73b269d99c884246dece85830310ede4e13500671e64c34c4b24627f21ba"}
Jul 06 00:59:50.996042 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:50.996024    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-txc22" event={"ID":"eb642562-26ad-462a-b18c-24ce564e1c22","Type":"ContainerStarted","Data":"2c42505908900e329ccd78bda95d5724d10c1b575654a9476b55e5acacbc07d6"}
Jul 06 00:59:50.997017 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:50.996988    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4tnqb" event={"ID":"3056d6fb-5441-40ff-a0f9-98dbedab0677","Type":"ContainerStarted","Data":"faef6f8c8cd6d0736515be2b50f88fcc664e7585c603083492c53d0fe112ad7c"}
Jul 06 00:59:50.998490 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:50.998468    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rhtvh" event={"ID":"3e804c5d-56b0-4cec-bcd9-cf18304cd8de","Type":"ContainerStarted","Data":"76f68e4cb25d5ab9d9d3af4c7df1b0e942880e1b033c8c037eea41af335a1d79"}
Jul 06 00:59:50.999830 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:50.999812    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4mw" event={"ID":"e2a04d5d-fa83-4240-9c9f-6257fd6f19fe","Type":"ContainerStarted","Data":"4c99eac0f0bd7a903a404cd625c8ce688b9a640bd6934ede4457f50c0056412a"}
Jul 06 00:59:51.001183 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:51.001141    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9b7nw" event={"ID":"794399e2-dfe6-4b25-8879-858657cb407b","Type":"ContainerStarted","Data":"a8eb40173514db40027d22464bb195d639745b35f5f77bae09a07160e7595d41"}
Jul 06 00:59:51.002429 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:51.002403    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-db55n" event={"ID":"7d19f25b-ac66-4e32-9ac9-2bccbbe89113","Type":"ContainerStarted","Data":"34bc9ce1836a7bf666fe296e8faab9d468640d22866d2760868c2625600b6aaa"}
Jul 06 00:59:51.051069 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:51.051017    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-116.ec2.internal" podStartSLOduration=22.051001482 podStartE2EDuration="22.051001482s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 00:59:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 00:59:51.034309342 +0000 UTC m=+22.845284585" watchObservedRunningTime="2026-07-06 00:59:51.051001482 +0000 UTC m=+22.861976725"
Jul 06 00:59:51.051264 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:51.051238    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rhtvh" podStartSLOduration=3.023900235 podStartE2EDuration="23.051232053s" totalImagesPullingTime="20.027331818s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 00:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 00:59:51.05057389 +0000 UTC m=+22.861549134" watchObservedRunningTime="2026-07-06 00:59:51.051232053 +0000 UTC m=+22.862207296"
Jul 06 00:59:51.064046 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:51.064005    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4fmfs" podStartSLOduration=3.1353313800000002 podStartE2EDuration="23.063989035s" totalImagesPullingTime="19.928657655s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 00:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 00:59:51.063946402 +0000 UTC m=+22.874921635" watchObservedRunningTime="2026-07-06 00:59:51.063989035 +0000 UTC m=+22.874964279"
Jul 06 00:59:51.078888 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:51.078849    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4tnqb" podStartSLOduration=3.056177276 podStartE2EDuration="23.078834959s" totalImagesPullingTime="20.022657683s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 00:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 00:59:51.078483183 +0000 UTC m=+22.889458447" watchObservedRunningTime="2026-07-06 00:59:51.078834959 +0000 UTC m=+22.889810205"
Jul 06 00:59:51.094475 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:51.094432    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9b7nw" podStartSLOduration=3.182136147 podStartE2EDuration="23.094418031s" totalImagesPullingTime="19.912281884s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 00:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 00:59:51.093908437 +0000 UTC m=+22.904883681" watchObservedRunningTime="2026-07-06 00:59:51.094418031 +0000 UTC m=+22.905393274"
Jul 06 00:59:51.106720 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:51.106682    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-db55n" podStartSLOduration=3.166246471 podStartE2EDuration="23.106668796s" totalImagesPullingTime="19.940422325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 00:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 00:59:51.106487948 +0000 UTC m=+22.917463191" watchObservedRunningTime="2026-07-06 00:59:51.106668796 +0000 UTC m=+22.917644038"
Jul 06 00:59:51.746576 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:51.746540    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lw99t"
Jul 06 00:59:51.746576 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:51.746570    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw75s"
Jul 06 00:59:51.746913 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:51.746572    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5tl7"
Jul 06 00:59:51.746913 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:51.746674    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lw99t" podUID="ccf84e13-ab75-4168-9cb8-9a21cb959224"
Jul 06 00:59:51.746913 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:51.746749    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw75s" podUID="72256072-5a1e-41fd-a664-ce1d82f2b3bf"
Jul 06 00:59:51.746913 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:51.746802    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5tl7" podUID="031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2"
Jul 06 00:59:52.006128 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:52.006043    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-frb7f" event={"ID":"be609719-c174-46eb-bed0-e130fcd1a711","Type":"ContainerStarted","Data":"d849251603cd39c2c8c0b2874a30f6723c44f5362c1d9ed1af3489a9e3ba0d63"}
Jul 06 00:59:52.008092 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:52.008046    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-116.ec2.internal" event={"ID":"d8773ab7175117a866c88af6c1f78223","Type":"ContainerStarted","Data":"7223b87a1e55b03ab38bbc96b632ac292efdb9829868e2bf263bbc53e1f4e024"}
Jul 06 00:59:52.019841 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:52.019781    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-frb7f" podStartSLOduration=4.113337297 podStartE2EDuration="24.019767026s" totalImagesPullingTime="19.906429729s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 00:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 00:59:52.019318855 +0000 UTC m=+23.830294100" watchObservedRunningTime="2026-07-06 00:59:52.019767026 +0000 UTC m=+23.830742269"
Jul 06 00:59:52.032745 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:52.032702    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-116.ec2.internal" podStartSLOduration=23.032686396 podStartE2EDuration="23.032686396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 00:59:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 00:59:52.032383452 +0000 UTC m=+23.843358695" watchObservedRunningTime="2026-07-06 00:59:52.032686396 +0000 UTC m=+23.843661640"
Jul 06 00:59:52.194467 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:52.194436    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 00:59:52.631063 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:52.630926    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T00:59:52.194459208Z","UUID":"c871d28c-8b7f-4786-b6c7-b2e15cf4c310","Handler":null,"Name":"","Endpoint":""}
Jul 06 00:59:52.635135 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:52.635112    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 00:59:52.635284 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:52.635162    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 00:59:53.015286 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:53.015253    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4mw" event={"ID":"e2a04d5d-fa83-4240-9c9f-6257fd6f19fe","Type":"ContainerStarted","Data":"1e5d6cf1ce356d5f9eee16c9e31998cf760ebc876fb1dd88acfb8407d5735c4d"}
Jul 06 00:59:53.020479 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:53.020398    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-txc22" event={"ID":"eb642562-26ad-462a-b18c-24ce564e1c22","Type":"ContainerStarted","Data":"7d1c1f070d2e86588cb9e6e97b470ec2938de45b7c37bd81af8eee81779d6713"}
Jul 06 00:59:53.746790 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:53.746712    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lw99t"
Jul 06 00:59:53.746959 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:53.746708    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5tl7"
Jul 06 00:59:53.746959 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:53.746875    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lw99t" podUID="ccf84e13-ab75-4168-9cb8-9a21cb959224"
Jul 06 00:59:53.746959 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:53.746723    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw75s"
Jul 06 00:59:53.746959 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:53.746933    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5tl7" podUID="031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2"
Jul 06 00:59:53.747192 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:53.747001    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw75s" podUID="72256072-5a1e-41fd-a664-ce1d82f2b3bf"
Jul 06 00:59:54.024648 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:54.024360    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4mw" event={"ID":"e2a04d5d-fa83-4240-9c9f-6257fd6f19fe","Type":"ContainerStarted","Data":"00376eb3c97e8bd71b7c8a5eb2e4517dd7bfa409c5ac24f9addeaae71c5a37d8"}
Jul 06 00:59:55.707952 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:55.707916    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-db55n"
Jul 06 00:59:55.708578 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:55.708559    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-db55n"
Jul 06 00:59:55.722718 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:55.722668    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8j4mw" podStartSLOduration=5.190408645 podStartE2EDuration="27.722650176s" totalImagesPullingTime="22.532241531s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 00:59:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 00:59:54.04019274 +0000 UTC m=+25.851167980" watchObservedRunningTime="2026-07-06 00:59:55.722650176 +0000 UTC m=+27.533625423"
Jul 06 00:59:55.746749 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:55.746719    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lw99t"
Jul 06 00:59:55.746920 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:55.746758    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw75s"
Jul 06 00:59:55.746920 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:55.746848    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lw99t" podUID="ccf84e13-ab75-4168-9cb8-9a21cb959224"
Jul 06 00:59:55.747040 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:55.746928    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw75s" podUID="72256072-5a1e-41fd-a664-ce1d82f2b3bf"
Jul 06 00:59:55.747040 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:55.746956    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5tl7"
Jul 06 00:59:55.747142 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:55.747054    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5tl7" podUID="031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2"
Jul 06 00:59:56.029037 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:56.028949    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-db55n"
Jul 06 00:59:56.029592 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:56.029572    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-db55n"
Jul 06 00:59:57.032482 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:57.032282    2562 generic.go:356] "Generic (PLEG): container finished" podID="e0730ff2-6a66-4938-91d6-651e4cbdad5c" containerID="0dbf838e45fb77bb0f84ddf97314b862cfefd98bf8e4f8bb5d6e6aad2d1e3462" exitCode=0
Jul 06 00:59:57.033210 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:57.032353    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nph2n" event={"ID":"e0730ff2-6a66-4938-91d6-651e4cbdad5c","Type":"ContainerDied","Data":"0dbf838e45fb77bb0f84ddf97314b862cfefd98bf8e4f8bb5d6e6aad2d1e3462"}
Jul 06 00:59:57.036396 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:57.036375    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-txc22" event={"ID":"eb642562-26ad-462a-b18c-24ce564e1c22","Type":"ContainerStarted","Data":"fdfc85a96432611163f0d95590aa94c2f07076ee5eaad27198085d84fa571fba"}
Jul 06 00:59:57.036660 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:57.036641    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:57.036797 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:57.036699    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:57.052254 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:57.052225    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:57.071636 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:57.071596    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-txc22" podStartSLOduration=8.963495809 podStartE2EDuration="29.071581966s" totalImagesPullingTime="20.108086157s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 00:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 00:59:57.071204401 +0000 UTC m=+28.882179644" watchObservedRunningTime="2026-07-06 00:59:57.071581966 +0000 UTC m=+28.882557210"
Jul 06 00:59:57.746501 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:57.746469    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw75s"
Jul 06 00:59:57.746732 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:57.746470    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5tl7"
Jul 06 00:59:57.746732 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:57.746577    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw75s" podUID="72256072-5a1e-41fd-a664-ce1d82f2b3bf"
Jul 06 00:59:57.746732 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:57.746482    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lw99t"
Jul 06 00:59:57.746732 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:57.746652    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5tl7" podUID="031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2"
Jul 06 00:59:57.746868 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:57.746737    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lw99t" podUID="ccf84e13-ab75-4168-9cb8-9a21cb959224"
Jul 06 00:59:58.041236 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:58.041209    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:58.054475 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:58.054446    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tw75s"]
Jul 06 00:59:58.054591 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:58.054552    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw75s"
Jul 06 00:59:58.054748 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:58.054652    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw75s" podUID="72256072-5a1e-41fd-a664-ce1d82f2b3bf"
Jul 06 00:59:58.058168 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:58.058127    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k5tl7"]
Jul 06 00:59:58.058285 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:58.058202    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lw99t"]
Jul 06 00:59:58.058285 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:58.058274    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lw99t"
Jul 06 00:59:58.058378 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:58.058296    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5tl7"
Jul 06 00:59:58.058378 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:58.058369    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lw99t" podUID="ccf84e13-ab75-4168-9cb8-9a21cb959224"
Jul 06 00:59:58.058450 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:58.058439    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5tl7" podUID="031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2"
Jul 06 00:59:58.058817 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:58.058709    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 00:59:59.045585 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:59.045325    2562 generic.go:356] "Generic (PLEG): container finished" podID="e0730ff2-6a66-4938-91d6-651e4cbdad5c" containerID="c8ca25a42cb7d607c668b9b5bfc5d13a1da4cada3227d2c4184e4b9ee5f33052" exitCode=0
Jul 06 00:59:59.045962 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:59.045360    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nph2n" event={"ID":"e0730ff2-6a66-4938-91d6-651e4cbdad5c","Type":"ContainerDied","Data":"c8ca25a42cb7d607c668b9b5bfc5d13a1da4cada3227d2c4184e4b9ee5f33052"}
Jul 06 00:59:59.746727 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:59.746698    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw75s"
Jul 06 00:59:59.746889 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:59.746699    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lw99t"
Jul 06 00:59:59.746889 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:59.746814    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw75s" podUID="72256072-5a1e-41fd-a664-ce1d82f2b3bf"
Jul 06 00:59:59.746889 ip-10-0-131-116 kubenswrapper[2562]: I0706 00:59:59.746699    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5tl7"
Jul 06 00:59:59.747002 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:59.746931    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lw99t" podUID="ccf84e13-ab75-4168-9cb8-9a21cb959224"
Jul 06 00:59:59.747093 ip-10-0-131-116 kubenswrapper[2562]: E0706 00:59:59.747062    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5tl7" podUID="031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2"
Jul 06 01:00:01.054420 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:01.054382    2562 generic.go:356] "Generic (PLEG): container finished" podID="e0730ff2-6a66-4938-91d6-651e4cbdad5c" containerID="93554e76106ad64bd0bfbc122261231babf2fe6b9cd2b981300b20cdf5ebc4df" exitCode=0
Jul 06 01:00:01.055000 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:01.054433    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nph2n" event={"ID":"e0730ff2-6a66-4938-91d6-651e4cbdad5c","Type":"ContainerDied","Data":"93554e76106ad64bd0bfbc122261231babf2fe6b9cd2b981300b20cdf5ebc4df"}
Jul 06 01:00:01.307475 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:01.307389    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccf84e13-ab75-4168-9cb8-9a21cb959224-metrics-certs\") pod \"network-metrics-daemon-lw99t\" (UID: \"ccf84e13-ab75-4168-9cb8-9a21cb959224\") " pod="openshift-multus/network-metrics-daemon-lw99t"
Jul 06 01:00:01.307618 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:00:01.307542    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 01:00:01.307618 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:00:01.307608    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccf84e13-ab75-4168-9cb8-9a21cb959224-metrics-certs podName:ccf84e13-ab75-4168-9cb8-9a21cb959224 nodeName:}" failed. No retries permitted until 2026-07-06 01:00:33.307592719 +0000 UTC m=+65.118567940 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ccf84e13-ab75-4168-9cb8-9a21cb959224-metrics-certs") pod "network-metrics-daemon-lw99t" (UID: "ccf84e13-ab75-4168-9cb8-9a21cb959224") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 01:00:01.408582 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:01.408545    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2-original-pull-secret\") pod \"global-pull-secret-syncer-k5tl7\" (UID: \"031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2\") " pod="kube-system/global-pull-secret-syncer-k5tl7"
Jul 06 01:00:01.408759 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:00:01.408701    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 01:00:01.408805 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:00:01.408767    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2-original-pull-secret podName:031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2 nodeName:}" failed. No retries permitted until 2026-07-06 01:00:33.408752514 +0000 UTC m=+65.219727735 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2-original-pull-secret") pod "global-pull-secret-syncer-k5tl7" (UID: "031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2") : object "kube-system"/"original-pull-secret" not registered
Jul 06 01:00:01.509441 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:01.509400    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgw58\" (UniqueName: \"kubernetes.io/projected/72256072-5a1e-41fd-a664-ce1d82f2b3bf-kube-api-access-tgw58\") pod \"network-check-target-tw75s\" (UID: \"72256072-5a1e-41fd-a664-ce1d82f2b3bf\") " pod="openshift-network-diagnostics/network-check-target-tw75s"
Jul 06 01:00:01.509626 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:00:01.509530    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 01:00:01.509626 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:00:01.509544    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 01:00:01.509626 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:00:01.509553    2562 projected.go:196] Error preparing data for projected volume kube-api-access-tgw58 for pod openshift-network-diagnostics/network-check-target-tw75s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 01:00:01.509626 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:00:01.509601    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/72256072-5a1e-41fd-a664-ce1d82f2b3bf-kube-api-access-tgw58 podName:72256072-5a1e-41fd-a664-ce1d82f2b3bf nodeName:}" failed. No retries permitted until 2026-07-06 01:00:33.509588508 +0000 UTC m=+65.320563729 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tgw58" (UniqueName: "kubernetes.io/projected/72256072-5a1e-41fd-a664-ce1d82f2b3bf-kube-api-access-tgw58") pod "network-check-target-tw75s" (UID: "72256072-5a1e-41fd-a664-ce1d82f2b3bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 01:00:01.746994 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:01.746899    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5tl7"
Jul 06 01:00:01.747140 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:01.747004    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lw99t"
Jul 06 01:00:01.747140 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:00:01.747011    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k5tl7" podUID="031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2"
Jul 06 01:00:01.747140 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:01.747034    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw75s"
Jul 06 01:00:01.747140 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:00:01.747109    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lw99t" podUID="ccf84e13-ab75-4168-9cb8-9a21cb959224"
Jul 06 01:00:01.747303 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:00:01.747194    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tw75s" podUID="72256072-5a1e-41fd-a664-ce1d82f2b3bf"
Jul 06 01:00:02.941492 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:02.941422    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-116.ec2.internal" event="NodeReady"
Jul 06 01:00:02.941901 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:02.941591    2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 01:00:02.984581 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:02.984545    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wzts5"]
Jul 06 01:00:02.988395 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:02.988370    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vv5dh"]
Jul 06 01:00:02.988533 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:02.988518    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wzts5"
Jul 06 01:00:02.990877 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:02.990844    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 01:00:02.990992 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:02.990892    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 01:00:02.990992 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:02.990942    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lh7x6\""
Jul 06 01:00:02.991931 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:02.991915    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vv5dh"
Jul 06 01:00:02.994475 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:02.994104    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 01:00:02.994475 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:02.994240    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8lk2l\""
Jul 06 01:00:02.994475 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:02.994248    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 01:00:02.994475 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:02.994349    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 01:00:02.996611 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:02.996477    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vv5dh"]
Jul 06 01:00:02.997479 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:02.997447    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wzts5"]
Jul 06 01:00:03.120537 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:03.120502    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/826bcf71-9bfe-418b-9d64-410edfad23df-cert\") pod \"ingress-canary-vv5dh\" (UID: \"826bcf71-9bfe-418b-9d64-410edfad23df\") " pod="openshift-ingress-canary/ingress-canary-vv5dh"
Jul 06 01:00:03.120703 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:03.120568    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ed4b54f1-1212-4ce2-b731-13bca488ecb3-config-volume\") pod \"dns-default-wzts5\" (UID: \"ed4b54f1-1212-4ce2-b731-13bca488ecb3\") " pod="openshift-dns/dns-default-wzts5"
Jul 06 01:00:03.120703 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:03.120603    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed4b54f1-1212-4ce2-b731-13bca488ecb3-metrics-tls\") pod \"dns-default-wzts5\" (UID: \"ed4b54f1-1212-4ce2-b731-13bca488ecb3\") " pod="openshift-dns/dns-default-wzts5"
Jul 06 01:00:03.120703 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:03.120663    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed4b54f1-1212-4ce2-b731-13bca488ecb3-tmp-dir\") pod \"dns-default-wzts5\" (UID: \"ed4b54f1-1212-4ce2-b731-13bca488ecb3\") " pod="openshift-dns/dns-default-wzts5"
Jul 06 01:00:03.120703 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:03.120697    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqkx6\" (UniqueName: \"kubernetes.io/projected/826bcf71-9bfe-418b-9d64-410edfad23df-kube-api-access-bqkx6\") pod \"ingress-canary-vv5dh\" (UID: \"826bcf71-9bfe-418b-9d64-410edfad23df\") " pod="openshift-ingress-canary/ingress-canary-vv5dh"
Jul 06 01:00:03.120874 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:03.120724    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mplsg\" (UniqueName: \"kubernetes.io/projected/ed4b54f1-1212-4ce2-b731-13bca488ecb3-kube-api-access-mplsg\") pod \"dns-default-wzts5\" (UID: \"ed4b54f1-1212-4ce2-b731-13bca488ecb3\") " pod="openshift-dns/dns-default-wzts5"
Jul 06 01:00:03.221926 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:03.221839    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqkx6\" (UniqueName: \"kubernetes.io/projected/826bcf71-9bfe-418b-9d64-410edfad23df-kube-api-access-bqkx6\") pod \"ingress-canary-vv5dh\" (UID: \"826bcf71-9bfe-418b-9d64-410edfad23df\") " pod="openshift-ingress-canary/ingress-canary-vv5dh"
Jul 06 01:00:03.221926 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:03.221877    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mplsg\" (UniqueName: \"kubernetes.io/projected/ed4b54f1-1212-4ce2-b731-13bca488ecb3-kube-api-access-mplsg\") pod \"dns-default-wzts5\" (UID: \"ed4b54f1-1212-4ce2-b731-13bca488ecb3\") " pod="openshift-dns/dns-default-wzts5"
Jul 06 01:00:03.221926 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:03.221911    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/826bcf71-9bfe-418b-9d64-410edfad23df-cert\") pod \"ingress-canary-vv5dh\" (UID: \"826bcf71-9bfe-418b-9d64-410edfad23df\") " pod="openshift-ingress-canary/ingress-canary-vv5dh"
Jul 06 01:00:03.222218 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:03.221965    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ed4b54f1-1212-4ce2-b731-13bca488ecb3-config-volume\") pod \"dns-default-wzts5\" (UID: \"ed4b54f1-1212-4ce2-b731-13bca488ecb3\") " pod="openshift-dns/dns-default-wzts5"
Jul 06 01:00:03.222218 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:03.221985    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed4b54f1-1212-4ce2-b731-13bca488ecb3-metrics-tls\") pod \"dns-default-wzts5\" (UID: \"ed4b54f1-1212-4ce2-b731-13bca488ecb3\") " pod="openshift-dns/dns-default-wzts5"
Jul 06 01:00:03.222218 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:03.222041    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed4b54f1-1212-4ce2-b731-13bca488ecb3-tmp-dir\") pod \"dns-default-wzts5\" (UID: \"ed4b54f1-1212-4ce2-b731-13bca488ecb3\") " pod="openshift-dns/dns-default-wzts5"
Jul 06 01:00:03.222218 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:00:03.222107    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 01:00:03.222218 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:00:03.222191    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed4b54f1-1212-4ce2-b731-13bca488ecb3-metrics-tls podName:ed4b54f1-1212-4ce2-b731-13bca488ecb3 nodeName:}" failed. No retries permitted until 2026-07-06 01:00:03.722170015 +0000 UTC m=+35.533145236 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ed4b54f1-1212-4ce2-b731-13bca488ecb3-metrics-tls") pod "dns-default-wzts5" (UID: "ed4b54f1-1212-4ce2-b731-13bca488ecb3") : secret "dns-default-metrics-tls" not found
Jul 06 01:00:03.222474 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:03.222413    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed4b54f1-1212-4ce2-b731-13bca488ecb3-tmp-dir\") pod \"dns-default-wzts5\" (UID: \"ed4b54f1-1212-4ce2-b731-13bca488ecb3\") " pod="openshift-dns/dns-default-wzts5"
Jul 06 01:00:03.222572 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:03.222552    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ed4b54f1-1212-4ce2-b731-13bca488ecb3-config-volume\") pod \"dns-default-wzts5\" (UID: \"ed4b54f1-1212-4ce2-b731-13bca488ecb3\") " pod="openshift-dns/dns-default-wzts5"
Jul 06 01:00:03.226789 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:03.226769    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/826bcf71-9bfe-418b-9d64-410edfad23df-cert\") pod \"ingress-canary-vv5dh\" (UID: \"826bcf71-9bfe-418b-9d64-410edfad23df\") " pod="openshift-ingress-canary/ingress-canary-vv5dh"
Jul 06 01:00:03.231829 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:03.231801    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqkx6\" (UniqueName: \"kubernetes.io/projected/826bcf71-9bfe-418b-9d64-410edfad23df-kube-api-access-bqkx6\") pod \"ingress-canary-vv5dh\" (UID: \"826bcf71-9bfe-418b-9d64-410edfad23df\") " pod="openshift-ingress-canary/ingress-canary-vv5dh"
Jul 06 01:00:03.234643 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:03.234621    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mplsg\" (UniqueName: \"kubernetes.io/projected/ed4b54f1-1212-4ce2-b731-13bca488ecb3-kube-api-access-mplsg\") pod \"dns-default-wzts5\" (UID: \"ed4b54f1-1212-4ce2-b731-13bca488ecb3\") " pod="openshift-dns/dns-default-wzts5"
Jul 06 01:00:03.308899 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:03.308845    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vv5dh"
Jul 06 01:00:03.473516 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:03.473253    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vv5dh"]
Jul 06 01:00:03.478138 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:00:03.478109    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod826bcf71_9bfe_418b_9d64_410edfad23df.slice/crio-bca07ea60f7eed0f546b0d66f995c31faf599f19c5eb1f2c6dc46ba0a6ff4ab3 WatchSource:0}: Error finding container bca07ea60f7eed0f546b0d66f995c31faf599f19c5eb1f2c6dc46ba0a6ff4ab3: Status 404 returned error can't find the container with id bca07ea60f7eed0f546b0d66f995c31faf599f19c5eb1f2c6dc46ba0a6ff4ab3
Jul 06 01:00:03.726514 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:03.726419    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed4b54f1-1212-4ce2-b731-13bca488ecb3-metrics-tls\") pod \"dns-default-wzts5\" (UID: \"ed4b54f1-1212-4ce2-b731-13bca488ecb3\") " pod="openshift-dns/dns-default-wzts5"
Jul 06 01:00:03.726669 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:00:03.726609    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 01:00:03.726716 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:00:03.726688    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed4b54f1-1212-4ce2-b731-13bca488ecb3-metrics-tls podName:ed4b54f1-1212-4ce2-b731-13bca488ecb3 nodeName:}" failed. No retries permitted until 2026-07-06 01:00:04.726667189 +0000 UTC m=+36.537642414 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ed4b54f1-1212-4ce2-b731-13bca488ecb3-metrics-tls") pod "dns-default-wzts5" (UID: "ed4b54f1-1212-4ce2-b731-13bca488ecb3") : secret "dns-default-metrics-tls" not found
Jul 06 01:00:03.746672 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:03.746636    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5tl7"
Jul 06 01:00:03.746672 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:03.746677    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lw99t"
Jul 06 01:00:03.746873 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:03.746678    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw75s"
Jul 06 01:00:03.749418 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:03.749395    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 01:00:03.749784 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:03.749763    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 01:00:03.750348 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:03.749894    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-98z5h\""
Jul 06 01:00:03.750348 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:03.749931    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 01:00:03.750348 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:03.750027    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 01:00:03.750348 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:03.750164    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fwj5x\""
Jul 06 01:00:04.062184 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:04.062078    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vv5dh" event={"ID":"826bcf71-9bfe-418b-9d64-410edfad23df","Type":"ContainerStarted","Data":"bca07ea60f7eed0f546b0d66f995c31faf599f19c5eb1f2c6dc46ba0a6ff4ab3"}
Jul 06 01:00:04.736993 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:04.736949    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed4b54f1-1212-4ce2-b731-13bca488ecb3-metrics-tls\") pod \"dns-default-wzts5\" (UID: \"ed4b54f1-1212-4ce2-b731-13bca488ecb3\") " pod="openshift-dns/dns-default-wzts5"
Jul 06 01:00:04.737204 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:00:04.737160    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 01:00:04.737300 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:00:04.737246    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed4b54f1-1212-4ce2-b731-13bca488ecb3-metrics-tls podName:ed4b54f1-1212-4ce2-b731-13bca488ecb3 nodeName:}" failed. No retries permitted until 2026-07-06 01:00:06.737227595 +0000 UTC m=+38.548202818 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ed4b54f1-1212-4ce2-b731-13bca488ecb3-metrics-tls") pod "dns-default-wzts5" (UID: "ed4b54f1-1212-4ce2-b731-13bca488ecb3") : secret "dns-default-metrics-tls" not found
Jul 06 01:00:06.755107 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:06.755081    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed4b54f1-1212-4ce2-b731-13bca488ecb3-metrics-tls\") pod \"dns-default-wzts5\" (UID: \"ed4b54f1-1212-4ce2-b731-13bca488ecb3\") " pod="openshift-dns/dns-default-wzts5"
Jul 06 01:00:06.755508 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:00:06.755211    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 01:00:06.755508 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:00:06.755264    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed4b54f1-1212-4ce2-b731-13bca488ecb3-metrics-tls podName:ed4b54f1-1212-4ce2-b731-13bca488ecb3 nodeName:}" failed. No retries permitted until 2026-07-06 01:00:10.75524727 +0000 UTC m=+42.566222490 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ed4b54f1-1212-4ce2-b731-13bca488ecb3-metrics-tls") pod "dns-default-wzts5" (UID: "ed4b54f1-1212-4ce2-b731-13bca488ecb3") : secret "dns-default-metrics-tls" not found
Jul 06 01:00:07.071264 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:07.071180    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vv5dh" event={"ID":"826bcf71-9bfe-418b-9d64-410edfad23df","Type":"ContainerStarted","Data":"5bff5e5a92ebb4c54cf6cd9ab68e814f1c92474e0c194f16717a0552bb6c38ad"}
Jul 06 01:00:07.073896 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:07.073866    2562 generic.go:356] "Generic (PLEG): container finished" podID="e0730ff2-6a66-4938-91d6-651e4cbdad5c" containerID="38fc49bfcc555587bee4694d920553fd1b33b5485cf9ef4fa9bd567c1c747df7" exitCode=0
Jul 06 01:00:07.074005 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:07.073904    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nph2n" event={"ID":"e0730ff2-6a66-4938-91d6-651e4cbdad5c","Type":"ContainerDied","Data":"38fc49bfcc555587bee4694d920553fd1b33b5485cf9ef4fa9bd567c1c747df7"}
Jul 06 01:00:07.085930 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:07.085892    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vv5dh" podStartSLOduration=1.85607261 podStartE2EDuration="5.085877542s" totalImagesPullingTime="3.229804932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:00:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:00:07.08525192 +0000 UTC m=+38.896227167" watchObservedRunningTime="2026-07-06 01:00:07.085877542 +0000 UTC m=+38.896852804"
Jul 06 01:00:08.079096 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:08.078863    2562 generic.go:356] "Generic (PLEG): container finished" podID="e0730ff2-6a66-4938-91d6-651e4cbdad5c" containerID="e54317fd54a6beb2de68d843e713a0a5386ace6b4cfd0257ff6ab576b472a591" exitCode=0
Jul 06 01:00:08.079459 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:08.078945    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nph2n" event={"ID":"e0730ff2-6a66-4938-91d6-651e4cbdad5c","Type":"ContainerDied","Data":"e54317fd54a6beb2de68d843e713a0a5386ace6b4cfd0257ff6ab576b472a591"}
Jul 06 01:00:09.084575 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:09.084545    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nph2n" event={"ID":"e0730ff2-6a66-4938-91d6-651e4cbdad5c","Type":"ContainerStarted","Data":"1c579bdea834303bc371797905f2e8152fefeb6c4641942be7c90efcb8dd7c73"}
Jul 06 01:00:09.105576 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:09.105530    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nph2n" podStartSLOduration=8.245116736 podStartE2EDuration="41.105514512s" totalImagesPullingTime="32.860397776s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 00:59:28 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:00:09.104003544 +0000 UTC m=+40.914978787" watchObservedRunningTime="2026-07-06 01:00:09.105514512 +0000 UTC m=+40.916489755"
Jul 06 01:00:10.784443 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:10.784408    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed4b54f1-1212-4ce2-b731-13bca488ecb3-metrics-tls\") pod \"dns-default-wzts5\" (UID: \"ed4b54f1-1212-4ce2-b731-13bca488ecb3\") " pod="openshift-dns/dns-default-wzts5"
Jul 06 01:00:10.784811 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:00:10.784569    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 01:00:10.784811 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:00:10.784629    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed4b54f1-1212-4ce2-b731-13bca488ecb3-metrics-tls podName:ed4b54f1-1212-4ce2-b731-13bca488ecb3 nodeName:}" failed. No retries permitted until 2026-07-06 01:00:18.784611492 +0000 UTC m=+50.595586713 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ed4b54f1-1212-4ce2-b731-13bca488ecb3-metrics-tls") pod "dns-default-wzts5" (UID: "ed4b54f1-1212-4ce2-b731-13bca488ecb3") : secret "dns-default-metrics-tls" not found
Jul 06 01:00:18.841872 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:18.841831    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed4b54f1-1212-4ce2-b731-13bca488ecb3-metrics-tls\") pod \"dns-default-wzts5\" (UID: \"ed4b54f1-1212-4ce2-b731-13bca488ecb3\") " pod="openshift-dns/dns-default-wzts5"
Jul 06 01:00:18.842353 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:00:18.841984    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 01:00:18.842353 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:00:18.842048    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed4b54f1-1212-4ce2-b731-13bca488ecb3-metrics-tls podName:ed4b54f1-1212-4ce2-b731-13bca488ecb3 nodeName:}" failed. No retries permitted until 2026-07-06 01:00:34.84203256 +0000 UTC m=+66.653007781 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ed4b54f1-1212-4ce2-b731-13bca488ecb3-metrics-tls") pod "dns-default-wzts5" (UID: "ed4b54f1-1212-4ce2-b731-13bca488ecb3") : secret "dns-default-metrics-tls" not found
Jul 06 01:00:30.060266 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:30.060238    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-txc22"
Jul 06 01:00:30.398332 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:30.398302    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc479d768-4nf7b"]
Jul 06 01:00:30.400663 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:30.400648    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc479d768-4nf7b"
Jul 06 01:00:30.403262 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:30.403234    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 06 01:00:30.403427 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:30.403405    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 06 01:00:30.403756 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:30.403334    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 06 01:00:30.403860 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:30.403761    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 06 01:00:30.411466 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:30.411439    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc479d768-4nf7b"]
Jul 06 01:00:30.424072 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:30.424043    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/53adf7f7-04ee-477e-ae8d-f277fc3186f8-klusterlet-config\") pod \"klusterlet-addon-workmgr-dc479d768-4nf7b\" (UID: \"53adf7f7-04ee-477e-ae8d-f277fc3186f8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc479d768-4nf7b"
Jul 06 01:00:30.424221 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:30.424081    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fch4x\" (UniqueName: \"kubernetes.io/projected/53adf7f7-04ee-477e-ae8d-f277fc3186f8-kube-api-access-fch4x\") pod \"klusterlet-addon-workmgr-dc479d768-4nf7b\" (UID: \"53adf7f7-04ee-477e-ae8d-f277fc3186f8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc479d768-4nf7b"
Jul 06 01:00:30.424221 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:30.424194    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53adf7f7-04ee-477e-ae8d-f277fc3186f8-tmp\") pod \"klusterlet-addon-workmgr-dc479d768-4nf7b\" (UID: \"53adf7f7-04ee-477e-ae8d-f277fc3186f8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc479d768-4nf7b"
Jul 06 01:00:30.525563 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:30.525517    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53adf7f7-04ee-477e-ae8d-f277fc3186f8-tmp\") pod \"klusterlet-addon-workmgr-dc479d768-4nf7b\" (UID: \"53adf7f7-04ee-477e-ae8d-f277fc3186f8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc479d768-4nf7b"
Jul 06 01:00:30.525708 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:30.525630    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/53adf7f7-04ee-477e-ae8d-f277fc3186f8-klusterlet-config\") pod \"klusterlet-addon-workmgr-dc479d768-4nf7b\" (UID: \"53adf7f7-04ee-477e-ae8d-f277fc3186f8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc479d768-4nf7b"
Jul 06 01:00:30.525708 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:30.525664    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fch4x\" (UniqueName: \"kubernetes.io/projected/53adf7f7-04ee-477e-ae8d-f277fc3186f8-kube-api-access-fch4x\") pod \"klusterlet-addon-workmgr-dc479d768-4nf7b\" (UID: \"53adf7f7-04ee-477e-ae8d-f277fc3186f8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc479d768-4nf7b"
Jul 06 01:00:30.525929 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:30.525908    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53adf7f7-04ee-477e-ae8d-f277fc3186f8-tmp\") pod \"klusterlet-addon-workmgr-dc479d768-4nf7b\" (UID: \"53adf7f7-04ee-477e-ae8d-f277fc3186f8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc479d768-4nf7b"
Jul 06 01:00:30.529420 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:30.529391    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/53adf7f7-04ee-477e-ae8d-f277fc3186f8-klusterlet-config\") pod \"klusterlet-addon-workmgr-dc479d768-4nf7b\" (UID: \"53adf7f7-04ee-477e-ae8d-f277fc3186f8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc479d768-4nf7b"
Jul 06 01:00:30.533331 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:30.533312    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fch4x\" (UniqueName: \"kubernetes.io/projected/53adf7f7-04ee-477e-ae8d-f277fc3186f8-kube-api-access-fch4x\") pod \"klusterlet-addon-workmgr-dc479d768-4nf7b\" (UID: \"53adf7f7-04ee-477e-ae8d-f277fc3186f8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc479d768-4nf7b"
Jul 06 01:00:30.711597 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:30.711513    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc479d768-4nf7b"
Jul 06 01:00:30.830922 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:30.830865    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc479d768-4nf7b"]
Jul 06 01:00:30.835393 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:00:30.835370    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53adf7f7_04ee_477e_ae8d_f277fc3186f8.slice/crio-46dfe44c49a44b705f47051c023efc9e271bc86aa9af461cbe2444b544fb9419 WatchSource:0}: Error finding container 46dfe44c49a44b705f47051c023efc9e271bc86aa9af461cbe2444b544fb9419: Status 404 returned error can't find the container with id 46dfe44c49a44b705f47051c023efc9e271bc86aa9af461cbe2444b544fb9419
Jul 06 01:00:31.136649 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:31.136611    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc479d768-4nf7b" event={"ID":"53adf7f7-04ee-477e-ae8d-f277fc3186f8","Type":"ContainerStarted","Data":"46dfe44c49a44b705f47051c023efc9e271bc86aa9af461cbe2444b544fb9419"}
Jul 06 01:00:33.347938 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:33.347903    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccf84e13-ab75-4168-9cb8-9a21cb959224-metrics-certs\") pod \"network-metrics-daemon-lw99t\" (UID: \"ccf84e13-ab75-4168-9cb8-9a21cb959224\") " pod="openshift-multus/network-metrics-daemon-lw99t"
Jul 06 01:00:33.350741 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:33.350711    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 01:00:33.358765 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:00:33.358681    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 06 01:00:33.358888 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:00:33.358778    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccf84e13-ab75-4168-9cb8-9a21cb959224-metrics-certs podName:ccf84e13-ab75-4168-9cb8-9a21cb959224 nodeName:}" failed. No retries permitted until 2026-07-06 01:01:37.358754746 +0000 UTC m=+129.169729966 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ccf84e13-ab75-4168-9cb8-9a21cb959224-metrics-certs") pod "network-metrics-daemon-lw99t" (UID: "ccf84e13-ab75-4168-9cb8-9a21cb959224") : secret "metrics-daemon-secret" not found
Jul 06 01:00:33.448481 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:33.448445    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2-original-pull-secret\") pod \"global-pull-secret-syncer-k5tl7\" (UID: \"031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2\") " pod="kube-system/global-pull-secret-syncer-k5tl7"
Jul 06 01:00:33.450901 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:33.450881    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 01:00:33.461744 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:33.461717    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2-original-pull-secret\") pod \"global-pull-secret-syncer-k5tl7\" (UID: \"031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2\") " pod="kube-system/global-pull-secret-syncer-k5tl7"
Jul 06 01:00:33.549336 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:33.549298    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgw58\" (UniqueName: \"kubernetes.io/projected/72256072-5a1e-41fd-a664-ce1d82f2b3bf-kube-api-access-tgw58\") pod \"network-check-target-tw75s\" (UID: \"72256072-5a1e-41fd-a664-ce1d82f2b3bf\") " pod="openshift-network-diagnostics/network-check-target-tw75s"
Jul 06 01:00:33.551925 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:33.551902    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 01:00:33.561659 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:33.561633    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 01:00:33.573023 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:33.572998    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgw58\" (UniqueName: \"kubernetes.io/projected/72256072-5a1e-41fd-a664-ce1d82f2b3bf-kube-api-access-tgw58\") pod \"network-check-target-tw75s\" (UID: \"72256072-5a1e-41fd-a664-ce1d82f2b3bf\") " pod="openshift-network-diagnostics/network-check-target-tw75s"
Jul 06 01:00:33.758776 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:33.758740    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k5tl7"
Jul 06 01:00:33.775257 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:33.775227    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-98z5h\""
Jul 06 01:00:33.783143 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:33.783111    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tw75s"
Jul 06 01:00:33.921553 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:33.921475    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k5tl7"]
Jul 06 01:00:33.925462 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:00:33.925436    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod031c56b1_8f37_41d8_b7a3_0b9ab95ca0e2.slice/crio-86125a39a7e5eb0d46abed5fd9fb566c5a65009225fd48667770cf9b3b6a1251 WatchSource:0}: Error finding container 86125a39a7e5eb0d46abed5fd9fb566c5a65009225fd48667770cf9b3b6a1251: Status 404 returned error can't find the container with id 86125a39a7e5eb0d46abed5fd9fb566c5a65009225fd48667770cf9b3b6a1251
Jul 06 01:00:33.956077 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:33.956051    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tw75s"]
Jul 06 01:00:33.959604 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:00:33.959578    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72256072_5a1e_41fd_a664_ce1d82f2b3bf.slice/crio-dcd6ed549c98e1e9b0718ff0715e4f2a87216652f5ee9431a2f9876c8aa25cfd WatchSource:0}: Error finding container dcd6ed549c98e1e9b0718ff0715e4f2a87216652f5ee9431a2f9876c8aa25cfd: Status 404 returned error can't find the container with id dcd6ed549c98e1e9b0718ff0715e4f2a87216652f5ee9431a2f9876c8aa25cfd
Jul 06 01:00:34.146473 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:34.146433    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tw75s" event={"ID":"72256072-5a1e-41fd-a664-ce1d82f2b3bf","Type":"ContainerStarted","Data":"dcd6ed549c98e1e9b0718ff0715e4f2a87216652f5ee9431a2f9876c8aa25cfd"}
Jul 06 01:00:34.147644 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:34.147621    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k5tl7" event={"ID":"031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2","Type":"ContainerStarted","Data":"86125a39a7e5eb0d46abed5fd9fb566c5a65009225fd48667770cf9b3b6a1251"}
Jul 06 01:00:34.859834 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:34.859798    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed4b54f1-1212-4ce2-b731-13bca488ecb3-metrics-tls\") pod \"dns-default-wzts5\" (UID: \"ed4b54f1-1212-4ce2-b731-13bca488ecb3\") " pod="openshift-dns/dns-default-wzts5"
Jul 06 01:00:34.860323 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:00:34.859972    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 01:00:34.860323 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:00:34.860046    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed4b54f1-1212-4ce2-b731-13bca488ecb3-metrics-tls podName:ed4b54f1-1212-4ce2-b731-13bca488ecb3 nodeName:}" failed. No retries permitted until 2026-07-06 01:01:06.8600236 +0000 UTC m=+98.670998821 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ed4b54f1-1212-4ce2-b731-13bca488ecb3-metrics-tls") pod "dns-default-wzts5" (UID: "ed4b54f1-1212-4ce2-b731-13bca488ecb3") : secret "dns-default-metrics-tls" not found
Jul 06 01:00:39.162003 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:39.161960    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k5tl7" event={"ID":"031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2","Type":"ContainerStarted","Data":"c310ec720cf46a5c62c986b0e4a0c70aa948a31ca5ba6f8704fbe3b565b85a99"}
Jul 06 01:00:39.163383 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:39.163358    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc479d768-4nf7b" event={"ID":"53adf7f7-04ee-477e-ae8d-f277fc3186f8","Type":"ContainerStarted","Data":"4ce469a9047b16b57fb774690b7e48b7161072d1172024a9cb4f2d9e41676f26"}
Jul 06 01:00:39.163506 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:39.163491    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc479d768-4nf7b"
Jul 06 01:00:39.164855 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:39.164831    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tw75s" event={"ID":"72256072-5a1e-41fd-a664-ce1d82f2b3bf","Type":"ContainerStarted","Data":"f105d7e375ccbb212abf9802dc788bdc4d2b71f165f0caffece7c0e6726d2fa7"}
Jul 06 01:00:39.164969 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:39.164955    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tw75s"
Jul 06 01:00:39.165505 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:39.165490    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc479d768-4nf7b"
Jul 06 01:00:39.174851 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:39.174816    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-k5tl7" podStartSLOduration=66.385970841 podStartE2EDuration="1m11.174803724s" totalImagesPullingTime="4.788832883s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 00:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:00:39.174380819 +0000 UTC m=+70.985356061" watchObservedRunningTime="2026-07-06 01:00:39.174803724 +0000 UTC m=+70.985778967"
Jul 06 01:00:39.186860 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:39.186813    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tw75s" podStartSLOduration=66.436060037 podStartE2EDuration="1m11.186797513s" totalImagesPullingTime="4.750737476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 00:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:00:39.186496157 +0000 UTC m=+70.997471411" watchObservedRunningTime="2026-07-06 01:00:39.186797513 +0000 UTC m=+70.997772756"
Jul 06 01:00:39.201435 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:00:39.201391    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc479d768-4nf7b" podStartSLOduration=1.337970826 podStartE2EDuration="9.201375153s" totalImagesPullingTime="7.863404327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:00:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:00:39.20006951 +0000 UTC m=+71.011044765" watchObservedRunningTime="2026-07-06 01:00:39.201375153 +0000 UTC m=+71.012350396"
Jul 06 01:01:06.884519 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:01:06.884388    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed4b54f1-1212-4ce2-b731-13bca488ecb3-metrics-tls\") pod \"dns-default-wzts5\" (UID: \"ed4b54f1-1212-4ce2-b731-13bca488ecb3\") " pod="openshift-dns/dns-default-wzts5"
Jul 06 01:01:06.885057 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:01:06.884539    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 01:01:06.885057 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:01:06.884623    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed4b54f1-1212-4ce2-b731-13bca488ecb3-metrics-tls podName:ed4b54f1-1212-4ce2-b731-13bca488ecb3 nodeName:}" failed. No retries permitted until 2026-07-06 01:02:10.884601082 +0000 UTC m=+162.695576314 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ed4b54f1-1212-4ce2-b731-13bca488ecb3-metrics-tls") pod "dns-default-wzts5" (UID: "ed4b54f1-1212-4ce2-b731-13bca488ecb3") : secret "dns-default-metrics-tls" not found
Jul 06 01:01:10.169571 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:01:10.169544    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tw75s"
Jul 06 01:01:37.389402 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:01:37.389360    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccf84e13-ab75-4168-9cb8-9a21cb959224-metrics-certs\") pod \"network-metrics-daemon-lw99t\" (UID: \"ccf84e13-ab75-4168-9cb8-9a21cb959224\") " pod="openshift-multus/network-metrics-daemon-lw99t"
Jul 06 01:01:37.389874 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:01:37.389520    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 06 01:01:37.389874 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:01:37.389588    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccf84e13-ab75-4168-9cb8-9a21cb959224-metrics-certs podName:ccf84e13-ab75-4168-9cb8-9a21cb959224 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:39.389571905 +0000 UTC m=+251.200547126 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ccf84e13-ab75-4168-9cb8-9a21cb959224-metrics-certs") pod "network-metrics-daemon-lw99t" (UID: "ccf84e13-ab75-4168-9cb8-9a21cb959224") : secret "metrics-daemon-secret" not found
Jul 06 01:02:06.003773 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:02:06.003717    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-wzts5" podUID="ed4b54f1-1212-4ce2-b731-13bca488ecb3"
Jul 06 01:02:06.367819 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:02:06.367790    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wzts5"
Jul 06 01:02:06.766461 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:02:06.766382    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-lw99t" podUID="ccf84e13-ab75-4168-9cb8-9a21cb959224"
Jul 06 01:02:10.917628 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:02:10.917590    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed4b54f1-1212-4ce2-b731-13bca488ecb3-metrics-tls\") pod \"dns-default-wzts5\" (UID: \"ed4b54f1-1212-4ce2-b731-13bca488ecb3\") " pod="openshift-dns/dns-default-wzts5"
Jul 06 01:02:10.918015 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:02:10.917716    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 01:02:10.918015 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:02:10.917769    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed4b54f1-1212-4ce2-b731-13bca488ecb3-metrics-tls podName:ed4b54f1-1212-4ce2-b731-13bca488ecb3 nodeName:}" failed. No retries permitted until 2026-07-06 01:04:12.91775573 +0000 UTC m=+284.728730952 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ed4b54f1-1212-4ce2-b731-13bca488ecb3-metrics-tls") pod "dns-default-wzts5" (UID: "ed4b54f1-1212-4ce2-b731-13bca488ecb3") : secret "dns-default-metrics-tls" not found
Jul 06 01:02:17.747062 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:02:17.747030    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lw99t"
Jul 06 01:02:39.164726 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:02:39.164680    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc479d768-4nf7b" podUID="53adf7f7-04ee-477e-ae8d-f277fc3186f8" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.8:8000/readyz\": dial tcp 10.134.0.8:8000: connect: connection refused"
Jul 06 01:02:39.445294 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:02:39.445210    2562 generic.go:356] "Generic (PLEG): container finished" podID="53adf7f7-04ee-477e-ae8d-f277fc3186f8" containerID="4ce469a9047b16b57fb774690b7e48b7161072d1172024a9cb4f2d9e41676f26" exitCode=1
Jul 06 01:02:39.445294 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:02:39.445256    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc479d768-4nf7b" event={"ID":"53adf7f7-04ee-477e-ae8d-f277fc3186f8","Type":"ContainerDied","Data":"4ce469a9047b16b57fb774690b7e48b7161072d1172024a9cb4f2d9e41676f26"}
Jul 06 01:02:39.445561 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:02:39.445549    2562 scope.go:117] "RemoveContainer" containerID="4ce469a9047b16b57fb774690b7e48b7161072d1172024a9cb4f2d9e41676f26"
Jul 06 01:02:40.449814 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:02:40.449776    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc479d768-4nf7b" event={"ID":"53adf7f7-04ee-477e-ae8d-f277fc3186f8","Type":"ContainerStarted","Data":"5de930fa5dc8cbc27e59a7c0f4215b7cdb935b4c3e99b1d553d7f2b75e184fc3"}
Jul 06 01:02:40.450208 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:02:40.450057    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc479d768-4nf7b"
Jul 06 01:02:40.450644 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:02:40.450626    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dc479d768-4nf7b"
Jul 06 01:03:10.079663 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.079633    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fq752"]
Jul 06 01:03:10.081571 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.081520    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fq752"
Jul 06 01:03:10.082682 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.082659    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8hbp5"]
Jul 06 01:03:10.083882 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.083863    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 06 01:03:10.083952 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.083863    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 06 01:03:10.083952 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.083914    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-58x4z\""
Jul 06 01:03:10.084115 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.084099    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8hbp5"
Jul 06 01:03:10.087117 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.087093    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 06 01:03:10.087117 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.087112    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-8p4ww\""
Jul 06 01:03:10.087287 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.087119    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 06 01:03:10.087287 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.087138    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 06 01:03:10.094686 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.094544    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fq752"]
Jul 06 01:03:10.102287 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.102262    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8hbp5"]
Jul 06 01:03:10.176426 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.176396    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-wf4nz"]
Jul 06 01:03:10.178116 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.178100    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-wf4nz"
Jul 06 01:03:10.180239 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.180215    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 06 01:03:10.180352 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.180291    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 06 01:03:10.180352 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.180325    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7sm25\""
Jul 06 01:03:10.182967 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.182936    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-ndpnj"]
Jul 06 01:03:10.184938 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.184916    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rlqrz"]
Jul 06 01:03:10.185017 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.184987    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-ndpnj"
Jul 06 01:03:10.186445 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.186430    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rlqrz"
Jul 06 01:03:10.187467 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.187452    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-54fjz\""
Jul 06 01:03:10.188666 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.188645    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 06 01:03:10.188988 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.188969    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 06 01:03:10.189078 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.189029    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 06 01:03:10.189447 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.189431    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-v84hn\""
Jul 06 01:03:10.189999 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.189981    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-wf4nz"]
Jul 06 01:03:10.190084 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.190066    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 06 01:03:10.196131 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.196113    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-ndpnj"]
Jul 06 01:03:10.198403 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.198387    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rlqrz"]
Jul 06 01:03:10.209578 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.209549    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe855984-bd75-41c1-ae9c-15de4b505dbb-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-8hbp5\" (UID: \"fe855984-bd75-41c1-ae9c-15de4b505dbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8hbp5"
Jul 06 01:03:10.209699 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.209633    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xmsf\" (UniqueName: \"kubernetes.io/projected/09df05c1-c9be-4006-aed4-6d113691034a-kube-api-access-5xmsf\") pod \"volume-data-source-validator-5d456fdbcd-fq752\" (UID: \"09df05c1-c9be-4006-aed4-6d113691034a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fq752"
Jul 06 01:03:10.209699 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.209662    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj6z7\" (UniqueName: \"kubernetes.io/projected/fe855984-bd75-41c1-ae9c-15de4b505dbb-kube-api-access-rj6z7\") pod \"cluster-samples-operator-56fcf86bf-8hbp5\" (UID: \"fe855984-bd75-41c1-ae9c-15de4b505dbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8hbp5"
Jul 06 01:03:10.280602 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.280568    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7df78dc57b-6tjqw"]
Jul 06 01:03:10.282453 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.282439    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7df78dc57b-6tjqw"
Jul 06 01:03:10.284839 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.284818    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 06 01:03:10.284943 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.284819    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-s9mpr\""
Jul 06 01:03:10.285097 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.285083    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 06 01:03:10.285262 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.285243    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 06 01:03:10.291157 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.291129    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 06 01:03:10.297194 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.297177    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7df78dc57b-6tjqw"]
Jul 06 01:03:10.310242 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.310214    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/34ddfe44-f552-4ad2-b62f-bc46c1e9ba21-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-rlqrz\" (UID: \"34ddfe44-f552-4ad2-b62f-bc46c1e9ba21\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rlqrz"
Jul 06 01:03:10.310354 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.310253    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5edeab24-165c-43b4-99bc-78ec365f9053-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-wf4nz\" (UID: \"5edeab24-165c-43b4-99bc-78ec365f9053\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-wf4nz"
Jul 06 01:03:10.310354 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.310281    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5edeab24-165c-43b4-99bc-78ec365f9053-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-wf4nz\" (UID: \"5edeab24-165c-43b4-99bc-78ec365f9053\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-wf4nz"
Jul 06 01:03:10.310354 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.310341    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xmsf\" (UniqueName: \"kubernetes.io/projected/09df05c1-c9be-4006-aed4-6d113691034a-kube-api-access-5xmsf\") pod \"volume-data-source-validator-5d456fdbcd-fq752\" (UID: \"09df05c1-c9be-4006-aed4-6d113691034a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fq752"
Jul 06 01:03:10.310467 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.310360    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj6z7\" (UniqueName: \"kubernetes.io/projected/fe855984-bd75-41c1-ae9c-15de4b505dbb-kube-api-access-rj6z7\") pod \"cluster-samples-operator-56fcf86bf-8hbp5\" (UID: \"fe855984-bd75-41c1-ae9c-15de4b505dbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8hbp5"
Jul 06 01:03:10.310467 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.310410    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe855984-bd75-41c1-ae9c-15de4b505dbb-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-8hbp5\" (UID: \"fe855984-bd75-41c1-ae9c-15de4b505dbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8hbp5"
Jul 06 01:03:10.310467 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.310432    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9pmj\" (UniqueName: \"kubernetes.io/projected/ba19fafd-1182-4a6c-8622-f5c45ab583cd-kube-api-access-b9pmj\") pod \"network-check-source-989f8b8dc-ndpnj\" (UID: \"ba19fafd-1182-4a6c-8622-f5c45ab583cd\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-ndpnj"
Jul 06 01:03:10.310467 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.310457    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lx87\" (UniqueName: \"kubernetes.io/projected/34ddfe44-f552-4ad2-b62f-bc46c1e9ba21-kube-api-access-4lx87\") pod \"service-ca-operator-5d46d9ffd4-rlqrz\" (UID: \"34ddfe44-f552-4ad2-b62f-bc46c1e9ba21\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rlqrz"
Jul 06 01:03:10.310659 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.310580    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/34ddfe44-f552-4ad2-b62f-bc46c1e9ba21-config\") pod \"service-ca-operator-5d46d9ffd4-rlqrz\" (UID: \"34ddfe44-f552-4ad2-b62f-bc46c1e9ba21\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rlqrz"
Jul 06 01:03:10.310659 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:10.310599    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 01:03:10.310761 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:10.310676    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe855984-bd75-41c1-ae9c-15de4b505dbb-samples-operator-tls podName:fe855984-bd75-41c1-ae9c-15de4b505dbb nodeName:}" failed. No retries permitted until 2026-07-06 01:03:10.810655209 +0000 UTC m=+222.621630443 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fe855984-bd75-41c1-ae9c-15de4b505dbb-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-8hbp5" (UID: "fe855984-bd75-41c1-ae9c-15de4b505dbb") : secret "samples-operator-tls" not found
Jul 06 01:03:10.322299 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.322277    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xmsf\" (UniqueName: \"kubernetes.io/projected/09df05c1-c9be-4006-aed4-6d113691034a-kube-api-access-5xmsf\") pod \"volume-data-source-validator-5d456fdbcd-fq752\" (UID: \"09df05c1-c9be-4006-aed4-6d113691034a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fq752"
Jul 06 01:03:10.322403 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.322324    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj6z7\" (UniqueName: \"kubernetes.io/projected/fe855984-bd75-41c1-ae9c-15de4b505dbb-kube-api-access-rj6z7\") pod \"cluster-samples-operator-56fcf86bf-8hbp5\" (UID: \"fe855984-bd75-41c1-ae9c-15de4b505dbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8hbp5"
Jul 06 01:03:10.392299 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.392253    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fq752"
Jul 06 01:03:10.411497 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.411470    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/34ddfe44-f552-4ad2-b62f-bc46c1e9ba21-config\") pod \"service-ca-operator-5d46d9ffd4-rlqrz\" (UID: \"34ddfe44-f552-4ad2-b62f-bc46c1e9ba21\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rlqrz"
Jul 06 01:03:10.411625 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.411512    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrbg2\" (UniqueName: \"kubernetes.io/projected/b600de6e-1fed-4b68-bcd9-8939f55eca0a-kube-api-access-mrbg2\") pod \"image-registry-7df78dc57b-6tjqw\" (UID: \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\") " pod="openshift-image-registry/image-registry-7df78dc57b-6tjqw"
Jul 06 01:03:10.411625 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.411567    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/34ddfe44-f552-4ad2-b62f-bc46c1e9ba21-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-rlqrz\" (UID: \"34ddfe44-f552-4ad2-b62f-bc46c1e9ba21\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rlqrz"
Jul 06 01:03:10.411625 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.411591    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b600de6e-1fed-4b68-bcd9-8939f55eca0a-bound-sa-token\") pod \"image-registry-7df78dc57b-6tjqw\" (UID: \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\") " pod="openshift-image-registry/image-registry-7df78dc57b-6tjqw"
Jul 06 01:03:10.411746 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.411623    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5edeab24-165c-43b4-99bc-78ec365f9053-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-wf4nz\" (UID: \"5edeab24-165c-43b4-99bc-78ec365f9053\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-wf4nz"
Jul 06 01:03:10.411746 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.411695    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b600de6e-1fed-4b68-bcd9-8939f55eca0a-trusted-ca\") pod \"image-registry-7df78dc57b-6tjqw\" (UID: \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\") " pod="openshift-image-registry/image-registry-7df78dc57b-6tjqw"
Jul 06 01:03:10.411746 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:10.411738    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 01:03:10.411864 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:10.411800    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5edeab24-165c-43b4-99bc-78ec365f9053-networking-console-plugin-cert podName:5edeab24-165c-43b4-99bc-78ec365f9053 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:10.911780451 +0000 UTC m=+222.722755672 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5edeab24-165c-43b4-99bc-78ec365f9053-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-wf4nz" (UID: "5edeab24-165c-43b4-99bc-78ec365f9053") : secret "networking-console-plugin-cert" not found
Jul 06 01:03:10.411864 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.411834    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5edeab24-165c-43b4-99bc-78ec365f9053-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-wf4nz\" (UID: \"5edeab24-165c-43b4-99bc-78ec365f9053\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-wf4nz"
Jul 06 01:03:10.411864 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.411860    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b600de6e-1fed-4b68-bcd9-8939f55eca0a-registry-tls\") pod \"image-registry-7df78dc57b-6tjqw\" (UID: \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\") " pod="openshift-image-registry/image-registry-7df78dc57b-6tjqw"
Jul 06 01:03:10.412020 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.411884    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b600de6e-1fed-4b68-bcd9-8939f55eca0a-installation-pull-secrets\") pod \"image-registry-7df78dc57b-6tjqw\" (UID: \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\") " pod="openshift-image-registry/image-registry-7df78dc57b-6tjqw"
Jul 06 01:03:10.412020 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.411926    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b600de6e-1fed-4b68-bcd9-8939f55eca0a-registry-certificates\") pod \"image-registry-7df78dc57b-6tjqw\" (UID: \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\") " pod="openshift-image-registry/image-registry-7df78dc57b-6tjqw"
Jul 06 01:03:10.412020 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.411995    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b600de6e-1fed-4b68-bcd9-8939f55eca0a-ca-trust-extracted\") pod \"image-registry-7df78dc57b-6tjqw\" (UID: \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\") " pod="openshift-image-registry/image-registry-7df78dc57b-6tjqw"
Jul 06 01:03:10.412187 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.412023    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9pmj\" (UniqueName: \"kubernetes.io/projected/ba19fafd-1182-4a6c-8622-f5c45ab583cd-kube-api-access-b9pmj\") pod \"network-check-source-989f8b8dc-ndpnj\" (UID: \"ba19fafd-1182-4a6c-8622-f5c45ab583cd\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-ndpnj"
Jul 06 01:03:10.412187 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.412050    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lx87\" (UniqueName: \"kubernetes.io/projected/34ddfe44-f552-4ad2-b62f-bc46c1e9ba21-kube-api-access-4lx87\") pod \"service-ca-operator-5d46d9ffd4-rlqrz\" (UID: \"34ddfe44-f552-4ad2-b62f-bc46c1e9ba21\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rlqrz"
Jul 06 01:03:10.412187 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.412067    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/34ddfe44-f552-4ad2-b62f-bc46c1e9ba21-config\") pod \"service-ca-operator-5d46d9ffd4-rlqrz\" (UID: \"34ddfe44-f552-4ad2-b62f-bc46c1e9ba21\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rlqrz"
Jul 06 01:03:10.412187 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.412073    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b600de6e-1fed-4b68-bcd9-8939f55eca0a-image-registry-private-configuration\") pod \"image-registry-7df78dc57b-6tjqw\" (UID: \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\") " pod="openshift-image-registry/image-registry-7df78dc57b-6tjqw"
Jul 06 01:03:10.412678 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.412654    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5edeab24-165c-43b4-99bc-78ec365f9053-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-wf4nz\" (UID: \"5edeab24-165c-43b4-99bc-78ec365f9053\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-wf4nz"
Jul 06 01:03:10.413992 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.413972    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/34ddfe44-f552-4ad2-b62f-bc46c1e9ba21-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-rlqrz\" (UID: \"34ddfe44-f552-4ad2-b62f-bc46c1e9ba21\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rlqrz"
Jul 06 01:03:10.420388 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.420361    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lx87\" (UniqueName: \"kubernetes.io/projected/34ddfe44-f552-4ad2-b62f-bc46c1e9ba21-kube-api-access-4lx87\") pod \"service-ca-operator-5d46d9ffd4-rlqrz\" (UID: \"34ddfe44-f552-4ad2-b62f-bc46c1e9ba21\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rlqrz"
Jul 06 01:03:10.420602 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.420583    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9pmj\" (UniqueName: \"kubernetes.io/projected/ba19fafd-1182-4a6c-8622-f5c45ab583cd-kube-api-access-b9pmj\") pod \"network-check-source-989f8b8dc-ndpnj\" (UID: \"ba19fafd-1182-4a6c-8622-f5c45ab583cd\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-ndpnj"
Jul 06 01:03:10.496722 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.496692    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-ndpnj"
Jul 06 01:03:10.502171 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.502132    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rlqrz"
Jul 06 01:03:10.512617 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.512545    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b600de6e-1fed-4b68-bcd9-8939f55eca0a-registry-tls\") pod \"image-registry-7df78dc57b-6tjqw\" (UID: \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\") " pod="openshift-image-registry/image-registry-7df78dc57b-6tjqw"
Jul 06 01:03:10.512786 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:10.512761    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 01:03:10.512786 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:10.512786    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df78dc57b-6tjqw: secret "image-registry-tls" not found
Jul 06 01:03:10.512949 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:10.512864    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b600de6e-1fed-4b68-bcd9-8939f55eca0a-registry-tls podName:b600de6e-1fed-4b68-bcd9-8939f55eca0a nodeName:}" failed. No retries permitted until 2026-07-06 01:03:11.012837158 +0000 UTC m=+222.823812396 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b600de6e-1fed-4b68-bcd9-8939f55eca0a-registry-tls") pod "image-registry-7df78dc57b-6tjqw" (UID: "b600de6e-1fed-4b68-bcd9-8939f55eca0a") : secret "image-registry-tls" not found
Jul 06 01:03:10.513620 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.513594    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b600de6e-1fed-4b68-bcd9-8939f55eca0a-installation-pull-secrets\") pod \"image-registry-7df78dc57b-6tjqw\" (UID: \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\") " pod="openshift-image-registry/image-registry-7df78dc57b-6tjqw"
Jul 06 01:03:10.513726 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.513659    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b600de6e-1fed-4b68-bcd9-8939f55eca0a-registry-certificates\") pod \"image-registry-7df78dc57b-6tjqw\" (UID: \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\") " pod="openshift-image-registry/image-registry-7df78dc57b-6tjqw"
Jul 06 01:03:10.513783 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.513736    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b600de6e-1fed-4b68-bcd9-8939f55eca0a-ca-trust-extracted\") pod \"image-registry-7df78dc57b-6tjqw\" (UID: \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\") " pod="openshift-image-registry/image-registry-7df78dc57b-6tjqw"
Jul 06 01:03:10.513783 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.513772    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b600de6e-1fed-4b68-bcd9-8939f55eca0a-image-registry-private-configuration\") pod \"image-registry-7df78dc57b-6tjqw\" (UID: \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\") " pod="openshift-image-registry/image-registry-7df78dc57b-6tjqw"
Jul 06 01:03:10.513878 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.513789    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fq752"]
Jul 06 01:03:10.513878 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.513802    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrbg2\" (UniqueName: \"kubernetes.io/projected/b600de6e-1fed-4b68-bcd9-8939f55eca0a-kube-api-access-mrbg2\") pod \"image-registry-7df78dc57b-6tjqw\" (UID: \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\") " pod="openshift-image-registry/image-registry-7df78dc57b-6tjqw"
Jul 06 01:03:10.513878 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.513854    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b600de6e-1fed-4b68-bcd9-8939f55eca0a-bound-sa-token\") pod \"image-registry-7df78dc57b-6tjqw\" (UID: \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\") " pod="openshift-image-registry/image-registry-7df78dc57b-6tjqw"
Jul 06 01:03:10.514026 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.513906    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b600de6e-1fed-4b68-bcd9-8939f55eca0a-trusted-ca\") pod \"image-registry-7df78dc57b-6tjqw\" (UID: \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\") " pod="openshift-image-registry/image-registry-7df78dc57b-6tjqw"
Jul 06 01:03:10.514428 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.514192    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b600de6e-1fed-4b68-bcd9-8939f55eca0a-ca-trust-extracted\") pod \"image-registry-7df78dc57b-6tjqw\" (UID: \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\") " pod="openshift-image-registry/image-registry-7df78dc57b-6tjqw"
Jul 06 01:03:10.514428 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.514355    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b600de6e-1fed-4b68-bcd9-8939f55eca0a-registry-certificates\") pod \"image-registry-7df78dc57b-6tjqw\" (UID: \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\") " pod="openshift-image-registry/image-registry-7df78dc57b-6tjqw"
Jul 06 01:03:10.515104 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.514807    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b600de6e-1fed-4b68-bcd9-8939f55eca0a-trusted-ca\") pod \"image-registry-7df78dc57b-6tjqw\" (UID: \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\") " pod="openshift-image-registry/image-registry-7df78dc57b-6tjqw"
Jul 06 01:03:10.516680 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.516657    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b600de6e-1fed-4b68-bcd9-8939f55eca0a-image-registry-private-configuration\") pod \"image-registry-7df78dc57b-6tjqw\" (UID: \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\") " pod="openshift-image-registry/image-registry-7df78dc57b-6tjqw"
Jul 06 01:03:10.516886 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.516868    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b600de6e-1fed-4b68-bcd9-8939f55eca0a-installation-pull-secrets\") pod \"image-registry-7df78dc57b-6tjqw\" (UID: \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\") " pod="openshift-image-registry/image-registry-7df78dc57b-6tjqw"
Jul 06 01:03:10.518114 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:03:10.518093    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09df05c1_c9be_4006_aed4_6d113691034a.slice/crio-eb4b59c7f64b06388a729f22dfa8dfba4494e7f6cc51f2463327e91cbc00fd33 WatchSource:0}: Error finding container eb4b59c7f64b06388a729f22dfa8dfba4494e7f6cc51f2463327e91cbc00fd33: Status 404 returned error can't find the container with id eb4b59c7f64b06388a729f22dfa8dfba4494e7f6cc51f2463327e91cbc00fd33
Jul 06 01:03:10.521963 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.521944    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b600de6e-1fed-4b68-bcd9-8939f55eca0a-bound-sa-token\") pod \"image-registry-7df78dc57b-6tjqw\" (UID: \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\") " pod="openshift-image-registry/image-registry-7df78dc57b-6tjqw"
Jul 06 01:03:10.522362 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.522338    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrbg2\" (UniqueName: \"kubernetes.io/projected/b600de6e-1fed-4b68-bcd9-8939f55eca0a-kube-api-access-mrbg2\") pod \"image-registry-7df78dc57b-6tjqw\" (UID: \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\") " pod="openshift-image-registry/image-registry-7df78dc57b-6tjqw"
Jul 06 01:03:10.624837 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.624806    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-ndpnj"]
Jul 06 01:03:10.627716 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:03:10.627693    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba19fafd_1182_4a6c_8622_f5c45ab583cd.slice/crio-eba348077bce265b383de46622da2af3fe40c6c1b3c5dafa998c3e83110ea2d2 WatchSource:0}: Error finding container eba348077bce265b383de46622da2af3fe40c6c1b3c5dafa998c3e83110ea2d2: Status 404 returned error can't find the container with id eba348077bce265b383de46622da2af3fe40c6c1b3c5dafa998c3e83110ea2d2
Jul 06 01:03:10.638878 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.638857    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rlqrz"]
Jul 06 01:03:10.641766 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:03:10.641741    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34ddfe44_f552_4ad2_b62f_bc46c1e9ba21.slice/crio-c75f60afd32e17c373a4483547e5fb38f78d1979c6520056c597e0f20e71ad50 WatchSource:0}: Error finding container c75f60afd32e17c373a4483547e5fb38f78d1979c6520056c597e0f20e71ad50: Status 404 returned error can't find the container with id c75f60afd32e17c373a4483547e5fb38f78d1979c6520056c597e0f20e71ad50
Jul 06 01:03:10.816582 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.816542    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe855984-bd75-41c1-ae9c-15de4b505dbb-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-8hbp5\" (UID: \"fe855984-bd75-41c1-ae9c-15de4b505dbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8hbp5"
Jul 06 01:03:10.816771 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:10.816699    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 01:03:10.816771 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:10.816765    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe855984-bd75-41c1-ae9c-15de4b505dbb-samples-operator-tls podName:fe855984-bd75-41c1-ae9c-15de4b505dbb nodeName:}" failed. No retries permitted until 2026-07-06 01:03:11.816749862 +0000 UTC m=+223.627725082 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fe855984-bd75-41c1-ae9c-15de4b505dbb-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-8hbp5" (UID: "fe855984-bd75-41c1-ae9c-15de4b505dbb") : secret "samples-operator-tls" not found
Jul 06 01:03:10.917651 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:10.917562    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5edeab24-165c-43b4-99bc-78ec365f9053-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-wf4nz\" (UID: \"5edeab24-165c-43b4-99bc-78ec365f9053\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-wf4nz"
Jul 06 01:03:10.917792 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:10.917720    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 01:03:10.917792 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:10.917774    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5edeab24-165c-43b4-99bc-78ec365f9053-networking-console-plugin-cert podName:5edeab24-165c-43b4-99bc-78ec365f9053 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:11.917761044 +0000 UTC m=+223.728736268 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5edeab24-165c-43b4-99bc-78ec365f9053-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-wf4nz" (UID: "5edeab24-165c-43b4-99bc-78ec365f9053") : secret "networking-console-plugin-cert" not found
Jul 06 01:03:11.018881 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:11.018844    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b600de6e-1fed-4b68-bcd9-8939f55eca0a-registry-tls\") pod \"image-registry-7df78dc57b-6tjqw\" (UID: \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\") " pod="openshift-image-registry/image-registry-7df78dc57b-6tjqw"
Jul 06 01:03:11.019049 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:11.018950    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 01:03:11.019049 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:11.018962    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df78dc57b-6tjqw: secret "image-registry-tls" not found
Jul 06 01:03:11.019049 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:11.019011    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b600de6e-1fed-4b68-bcd9-8939f55eca0a-registry-tls podName:b600de6e-1fed-4b68-bcd9-8939f55eca0a nodeName:}" failed. No retries permitted until 2026-07-06 01:03:12.018997835 +0000 UTC m=+223.829973055 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b600de6e-1fed-4b68-bcd9-8939f55eca0a-registry-tls") pod "image-registry-7df78dc57b-6tjqw" (UID: "b600de6e-1fed-4b68-bcd9-8939f55eca0a") : secret "image-registry-tls" not found
Jul 06 01:03:11.522274 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:11.522235    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rlqrz" event={"ID":"34ddfe44-f552-4ad2-b62f-bc46c1e9ba21","Type":"ContainerStarted","Data":"c75f60afd32e17c373a4483547e5fb38f78d1979c6520056c597e0f20e71ad50"}
Jul 06 01:03:11.524237 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:11.524187    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-ndpnj" event={"ID":"ba19fafd-1182-4a6c-8622-f5c45ab583cd","Type":"ContainerStarted","Data":"96ebcf51acde960b7b3f8bd9ae7e76bd1ea90bdad67abbde0f764fa3ebb5416e"}
Jul 06 01:03:11.524399 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:11.524240    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-ndpnj" event={"ID":"ba19fafd-1182-4a6c-8622-f5c45ab583cd","Type":"ContainerStarted","Data":"eba348077bce265b383de46622da2af3fe40c6c1b3c5dafa998c3e83110ea2d2"}
Jul 06 01:03:11.525581 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:11.525558    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fq752" event={"ID":"09df05c1-c9be-4006-aed4-6d113691034a","Type":"ContainerStarted","Data":"eb4b59c7f64b06388a729f22dfa8dfba4494e7f6cc51f2463327e91cbc00fd33"}
Jul 06 01:03:11.537949 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:11.537884    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-ndpnj" podStartSLOduration=1.537866874 podStartE2EDuration="1.537866874s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:03:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:03:11.537427847 +0000 UTC m=+223.348403090" watchObservedRunningTime="2026-07-06 01:03:11.537866874 +0000 UTC m=+223.348842118"
Jul 06 01:03:11.824726 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:11.824635    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe855984-bd75-41c1-ae9c-15de4b505dbb-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-8hbp5\" (UID: \"fe855984-bd75-41c1-ae9c-15de4b505dbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8hbp5"
Jul 06 01:03:11.824912 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:11.824802    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 01:03:11.824912 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:11.824886    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe855984-bd75-41c1-ae9c-15de4b505dbb-samples-operator-tls podName:fe855984-bd75-41c1-ae9c-15de4b505dbb nodeName:}" failed. No retries permitted until 2026-07-06 01:03:13.824864814 +0000 UTC m=+225.635840035 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fe855984-bd75-41c1-ae9c-15de4b505dbb-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-8hbp5" (UID: "fe855984-bd75-41c1-ae9c-15de4b505dbb") : secret "samples-operator-tls" not found
Jul 06 01:03:11.925563 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:11.925517    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5edeab24-165c-43b4-99bc-78ec365f9053-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-wf4nz\" (UID: \"5edeab24-165c-43b4-99bc-78ec365f9053\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-wf4nz"
Jul 06 01:03:11.925767 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:11.925665    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 01:03:11.925767 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:11.925720    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5edeab24-165c-43b4-99bc-78ec365f9053-networking-console-plugin-cert podName:5edeab24-165c-43b4-99bc-78ec365f9053 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:13.925706399 +0000 UTC m=+225.736681624 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5edeab24-165c-43b4-99bc-78ec365f9053-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-wf4nz" (UID: "5edeab24-165c-43b4-99bc-78ec365f9053") : secret "networking-console-plugin-cert" not found
Jul 06 01:03:12.025893 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:12.025856    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b600de6e-1fed-4b68-bcd9-8939f55eca0a-registry-tls\") pod \"image-registry-7df78dc57b-6tjqw\" (UID: \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\") " pod="openshift-image-registry/image-registry-7df78dc57b-6tjqw"
Jul 06 01:03:12.026051 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:12.026016    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 01:03:12.026051 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:12.026035    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df78dc57b-6tjqw: secret "image-registry-tls" not found
Jul 06 01:03:12.026144 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:12.026101    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b600de6e-1fed-4b68-bcd9-8939f55eca0a-registry-tls podName:b600de6e-1fed-4b68-bcd9-8939f55eca0a nodeName:}" failed. No retries permitted until 2026-07-06 01:03:14.02608698 +0000 UTC m=+225.837062202 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b600de6e-1fed-4b68-bcd9-8939f55eca0a-registry-tls") pod "image-registry-7df78dc57b-6tjqw" (UID: "b600de6e-1fed-4b68-bcd9-8939f55eca0a") : secret "image-registry-tls" not found
Jul 06 01:03:12.529755 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:12.529719    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fq752" event={"ID":"09df05c1-c9be-4006-aed4-6d113691034a","Type":"ContainerStarted","Data":"70d5ea4df9b855d5f0d360082ff3b16ab394fc3e9f29b72e19addce5c167ca55"}
Jul 06 01:03:12.543659 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:12.543613    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-fq752" podStartSLOduration=1.436210989 podStartE2EDuration="2.543598532s" totalImagesPullingTime="1.107387543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:03:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:03:12.54299404 +0000 UTC m=+224.353969282" watchObservedRunningTime="2026-07-06 01:03:12.543598532 +0000 UTC m=+224.354573775"
Jul 06 01:03:13.534723 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:13.534633    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rlqrz" event={"ID":"34ddfe44-f552-4ad2-b62f-bc46c1e9ba21","Type":"ContainerStarted","Data":"94cd289029a2f8b37663049f94af6f03bf7bfb4e73df9e251a9c88a0aef640a9"}
Jul 06 01:03:13.549795 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:13.549742    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rlqrz" podStartSLOduration=1.054848766 podStartE2EDuration="3.549726488s" totalImagesPullingTime="2.494877722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:03:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:03:13.548730439 +0000 UTC m=+225.359705681" watchObservedRunningTime="2026-07-06 01:03:13.549726488 +0000 UTC m=+225.360701731"
Jul 06 01:03:13.840078 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:13.839987    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe855984-bd75-41c1-ae9c-15de4b505dbb-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-8hbp5\" (UID: \"fe855984-bd75-41c1-ae9c-15de4b505dbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8hbp5"
Jul 06 01:03:13.840244 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:13.840119    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 01:03:13.840244 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:13.840207    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe855984-bd75-41c1-ae9c-15de4b505dbb-samples-operator-tls podName:fe855984-bd75-41c1-ae9c-15de4b505dbb nodeName:}" failed. No retries permitted until 2026-07-06 01:03:17.840188368 +0000 UTC m=+229.651163592 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fe855984-bd75-41c1-ae9c-15de4b505dbb-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-8hbp5" (UID: "fe855984-bd75-41c1-ae9c-15de4b505dbb") : secret "samples-operator-tls" not found
Jul 06 01:03:13.941409 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:13.941364    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5edeab24-165c-43b4-99bc-78ec365f9053-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-wf4nz\" (UID: \"5edeab24-165c-43b4-99bc-78ec365f9053\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-wf4nz"
Jul 06 01:03:13.941591 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:13.941537    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 01:03:13.941656 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:13.941623    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5edeab24-165c-43b4-99bc-78ec365f9053-networking-console-plugin-cert podName:5edeab24-165c-43b4-99bc-78ec365f9053 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:17.941600463 +0000 UTC m=+229.752575686 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5edeab24-165c-43b4-99bc-78ec365f9053-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-wf4nz" (UID: "5edeab24-165c-43b4-99bc-78ec365f9053") : secret "networking-console-plugin-cert" not found
Jul 06 01:03:14.041911 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:14.041880    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b600de6e-1fed-4b68-bcd9-8939f55eca0a-registry-tls\") pod \"image-registry-7df78dc57b-6tjqw\" (UID: \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\") " pod="openshift-image-registry/image-registry-7df78dc57b-6tjqw"
Jul 06 01:03:14.042076 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:14.042018    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 01:03:14.042076 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:14.042033    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df78dc57b-6tjqw: secret "image-registry-tls" not found
Jul 06 01:03:14.042171 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:14.042093    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b600de6e-1fed-4b68-bcd9-8939f55eca0a-registry-tls podName:b600de6e-1fed-4b68-bcd9-8939f55eca0a nodeName:}" failed. No retries permitted until 2026-07-06 01:03:18.042075071 +0000 UTC m=+229.853050294 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b600de6e-1fed-4b68-bcd9-8939f55eca0a-registry-tls") pod "image-registry-7df78dc57b-6tjqw" (UID: "b600de6e-1fed-4b68-bcd9-8939f55eca0a") : secret "image-registry-tls" not found
Jul 06 01:03:14.443893 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:14.443861    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-97znw"]
Jul 06 01:03:14.446296 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:14.446276    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-97znw"
Jul 06 01:03:14.448501 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:14.448478    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 01:03:14.448669 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:14.448651    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 01:03:14.448749 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:14.448738    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jv6lr\""
Jul 06 01:03:14.449652 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:14.449634    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 01:03:14.449749 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:14.449708    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 01:03:14.459164 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:14.459129    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-97znw"]
Jul 06 01:03:14.545057 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:14.545012    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/71387668-1da1-4db2-9861-0fb451b78703-crio-socket\") pod \"insights-runtime-extractor-97znw\" (UID: \"71387668-1da1-4db2-9861-0fb451b78703\") " pod="openshift-insights/insights-runtime-extractor-97znw"
Jul 06 01:03:14.545443 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:14.545094    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/71387668-1da1-4db2-9861-0fb451b78703-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-97znw\" (UID: \"71387668-1da1-4db2-9861-0fb451b78703\") " pod="openshift-insights/insights-runtime-extractor-97znw"
Jul 06 01:03:14.545443 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:14.545140    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/71387668-1da1-4db2-9861-0fb451b78703-data-volume\") pod \"insights-runtime-extractor-97znw\" (UID: \"71387668-1da1-4db2-9861-0fb451b78703\") " pod="openshift-insights/insights-runtime-extractor-97znw"
Jul 06 01:03:14.545443 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:14.545179    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/71387668-1da1-4db2-9861-0fb451b78703-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-97znw\" (UID: \"71387668-1da1-4db2-9861-0fb451b78703\") " pod="openshift-insights/insights-runtime-extractor-97znw"
Jul 06 01:03:14.545443 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:14.545208    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z422j\" (UniqueName: \"kubernetes.io/projected/71387668-1da1-4db2-9861-0fb451b78703-kube-api-access-z422j\") pod \"insights-runtime-extractor-97znw\" (UID: \"71387668-1da1-4db2-9861-0fb451b78703\") " pod="openshift-insights/insights-runtime-extractor-97znw"
Jul 06 01:03:14.646186 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:14.646121    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/71387668-1da1-4db2-9861-0fb451b78703-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-97znw\" (UID: \"71387668-1da1-4db2-9861-0fb451b78703\") " pod="openshift-insights/insights-runtime-extractor-97znw"
Jul 06 01:03:14.646354 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:14.646227    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/71387668-1da1-4db2-9861-0fb451b78703-data-volume\") pod \"insights-runtime-extractor-97znw\" (UID: \"71387668-1da1-4db2-9861-0fb451b78703\") " pod="openshift-insights/insights-runtime-extractor-97znw"
Jul 06 01:03:14.646354 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:14.646242    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 01:03:14.646354 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:14.646257    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/71387668-1da1-4db2-9861-0fb451b78703-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-97znw\" (UID: \"71387668-1da1-4db2-9861-0fb451b78703\") " pod="openshift-insights/insights-runtime-extractor-97znw"
Jul 06 01:03:14.646354 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:14.646305    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71387668-1da1-4db2-9861-0fb451b78703-insights-runtime-extractor-tls podName:71387668-1da1-4db2-9861-0fb451b78703 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:15.146286654 +0000 UTC m=+226.957261887 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/71387668-1da1-4db2-9861-0fb451b78703-insights-runtime-extractor-tls") pod "insights-runtime-extractor-97znw" (UID: "71387668-1da1-4db2-9861-0fb451b78703") : secret "insights-runtime-extractor-tls" not found
Jul 06 01:03:14.646354 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:14.646324    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z422j\" (UniqueName: \"kubernetes.io/projected/71387668-1da1-4db2-9861-0fb451b78703-kube-api-access-z422j\") pod \"insights-runtime-extractor-97znw\" (UID: \"71387668-1da1-4db2-9861-0fb451b78703\") " pod="openshift-insights/insights-runtime-extractor-97znw"
Jul 06 01:03:14.646354 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:14.646331    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 01:03:14.646597 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:14.646376    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/71387668-1da1-4db2-9861-0fb451b78703-kube-rbac-proxy-cm podName:71387668-1da1-4db2-9861-0fb451b78703 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:15.146362727 +0000 UTC m=+226.957337966 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/71387668-1da1-4db2-9861-0fb451b78703-kube-rbac-proxy-cm") pod "insights-runtime-extractor-97znw" (UID: "71387668-1da1-4db2-9861-0fb451b78703") : configmap "kube-rbac-proxy" not found
Jul 06 01:03:14.646597 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:14.646455    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/71387668-1da1-4db2-9861-0fb451b78703-crio-socket\") pod \"insights-runtime-extractor-97znw\" (UID: \"71387668-1da1-4db2-9861-0fb451b78703\") " pod="openshift-insights/insights-runtime-extractor-97znw"
Jul 06 01:03:14.646597 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:14.646576    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/71387668-1da1-4db2-9861-0fb451b78703-crio-socket\") pod \"insights-runtime-extractor-97znw\" (UID: \"71387668-1da1-4db2-9861-0fb451b78703\") " pod="openshift-insights/insights-runtime-extractor-97znw"
Jul 06 01:03:14.646736 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:14.646597    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/71387668-1da1-4db2-9861-0fb451b78703-data-volume\") pod \"insights-runtime-extractor-97znw\" (UID: \"71387668-1da1-4db2-9861-0fb451b78703\") " pod="openshift-insights/insights-runtime-extractor-97znw"
Jul 06 01:03:14.654099 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:14.654074    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z422j\" (UniqueName: \"kubernetes.io/projected/71387668-1da1-4db2-9861-0fb451b78703-kube-api-access-z422j\") pod \"insights-runtime-extractor-97znw\" (UID: \"71387668-1da1-4db2-9861-0fb451b78703\") " pod="openshift-insights/insights-runtime-extractor-97znw"
Jul 06 01:03:15.149669 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:15.149629    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/71387668-1da1-4db2-9861-0fb451b78703-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-97znw\" (UID: \"71387668-1da1-4db2-9861-0fb451b78703\") " pod="openshift-insights/insights-runtime-extractor-97znw"
Jul 06 01:03:15.149867 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:15.149684    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/71387668-1da1-4db2-9861-0fb451b78703-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-97znw\" (UID: \"71387668-1da1-4db2-9861-0fb451b78703\") " pod="openshift-insights/insights-runtime-extractor-97znw"
Jul 06 01:03:15.149867 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:15.149760    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 01:03:15.149867 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:15.149800    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 01:03:15.149867 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:15.149815    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/71387668-1da1-4db2-9861-0fb451b78703-kube-rbac-proxy-cm podName:71387668-1da1-4db2-9861-0fb451b78703 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:16.149800636 +0000 UTC m=+227.960775858 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/71387668-1da1-4db2-9861-0fb451b78703-kube-rbac-proxy-cm") pod "insights-runtime-extractor-97znw" (UID: "71387668-1da1-4db2-9861-0fb451b78703") : configmap "kube-rbac-proxy" not found
Jul 06 01:03:15.149867 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:15.149865    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71387668-1da1-4db2-9861-0fb451b78703-insights-runtime-extractor-tls podName:71387668-1da1-4db2-9861-0fb451b78703 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:16.149848008 +0000 UTC m=+227.960823234 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/71387668-1da1-4db2-9861-0fb451b78703-insights-runtime-extractor-tls") pod "insights-runtime-extractor-97znw" (UID: "71387668-1da1-4db2-9861-0fb451b78703") : secret "insights-runtime-extractor-tls" not found
Jul 06 01:03:16.156770 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:16.156731    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/71387668-1da1-4db2-9861-0fb451b78703-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-97znw\" (UID: \"71387668-1da1-4db2-9861-0fb451b78703\") " pod="openshift-insights/insights-runtime-extractor-97znw"
Jul 06 01:03:16.157266 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:16.156789    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/71387668-1da1-4db2-9861-0fb451b78703-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-97znw\" (UID: \"71387668-1da1-4db2-9861-0fb451b78703\") " pod="openshift-insights/insights-runtime-extractor-97znw"
Jul 06 01:03:16.157266 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:16.156898    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 01:03:16.157266 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:16.156913    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 01:03:16.157266 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:16.156969    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71387668-1da1-4db2-9861-0fb451b78703-insights-runtime-extractor-tls podName:71387668-1da1-4db2-9861-0fb451b78703 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:18.156953652 +0000 UTC m=+229.967928874 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/71387668-1da1-4db2-9861-0fb451b78703-insights-runtime-extractor-tls") pod "insights-runtime-extractor-97znw" (UID: "71387668-1da1-4db2-9861-0fb451b78703") : secret "insights-runtime-extractor-tls" not found
Jul 06 01:03:16.157266 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:16.156986    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/71387668-1da1-4db2-9861-0fb451b78703-kube-rbac-proxy-cm podName:71387668-1da1-4db2-9861-0fb451b78703 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:18.156979352 +0000 UTC m=+229.967954573 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/71387668-1da1-4db2-9861-0fb451b78703-kube-rbac-proxy-cm") pod "insights-runtime-extractor-97znw" (UID: "71387668-1da1-4db2-9861-0fb451b78703") : configmap "kube-rbac-proxy" not found
Jul 06 01:03:16.195125 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:16.195099    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4fmfs_f19b579f-765e-455e-92c2-602da92d5bb2/dns-node-resolver/0.log"
Jul 06 01:03:16.567520 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:16.567445    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-cj7mh"]
Jul 06 01:03:16.570835 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:16.570821    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-cj7mh"
Jul 06 01:03:16.573017 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:16.572990    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 06 01:03:16.573833 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:16.573817    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 06 01:03:16.573926 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:16.573829    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-wkdph\""
Jul 06 01:03:16.573926 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:16.573847    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 06 01:03:16.573926 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:16.573880    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 06 01:03:16.581599 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:16.581573    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-cj7mh"]
Jul 06 01:03:16.661567 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:16.661530    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/60c39fb5-63dd-4b37-87bb-d3c064f9a183-signing-cabundle\") pod \"service-ca-758f599c5-cj7mh\" (UID: \"60c39fb5-63dd-4b37-87bb-d3c064f9a183\") " pod="openshift-service-ca/service-ca-758f599c5-cj7mh"
Jul 06 01:03:16.661567 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:16.661577    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/60c39fb5-63dd-4b37-87bb-d3c064f9a183-signing-key\") pod \"service-ca-758f599c5-cj7mh\" (UID: \"60c39fb5-63dd-4b37-87bb-d3c064f9a183\") " pod="openshift-service-ca/service-ca-758f599c5-cj7mh"
Jul 06 01:03:16.661782 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:16.661673    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt2fv\" (UniqueName: \"kubernetes.io/projected/60c39fb5-63dd-4b37-87bb-d3c064f9a183-kube-api-access-wt2fv\") pod \"service-ca-758f599c5-cj7mh\" (UID: \"60c39fb5-63dd-4b37-87bb-d3c064f9a183\") " pod="openshift-service-ca/service-ca-758f599c5-cj7mh"
Jul 06 01:03:16.762207 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:16.762173    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt2fv\" (UniqueName: \"kubernetes.io/projected/60c39fb5-63dd-4b37-87bb-d3c064f9a183-kube-api-access-wt2fv\") pod \"service-ca-758f599c5-cj7mh\" (UID: \"60c39fb5-63dd-4b37-87bb-d3c064f9a183\") " pod="openshift-service-ca/service-ca-758f599c5-cj7mh"
Jul 06 01:03:16.762381 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:16.762230    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/60c39fb5-63dd-4b37-87bb-d3c064f9a183-signing-cabundle\") pod \"service-ca-758f599c5-cj7mh\" (UID: \"60c39fb5-63dd-4b37-87bb-d3c064f9a183\") " pod="openshift-service-ca/service-ca-758f599c5-cj7mh"
Jul 06 01:03:16.762381 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:16.762265    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/60c39fb5-63dd-4b37-87bb-d3c064f9a183-signing-key\") pod \"service-ca-758f599c5-cj7mh\" (UID: \"60c39fb5-63dd-4b37-87bb-d3c064f9a183\") " pod="openshift-service-ca/service-ca-758f599c5-cj7mh"
Jul 06 01:03:16.762920 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:16.762895    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/60c39fb5-63dd-4b37-87bb-d3c064f9a183-signing-cabundle\") pod \"service-ca-758f599c5-cj7mh\" (UID: \"60c39fb5-63dd-4b37-87bb-d3c064f9a183\") " pod="openshift-service-ca/service-ca-758f599c5-cj7mh"
Jul 06 01:03:16.764616 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:16.764596    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/60c39fb5-63dd-4b37-87bb-d3c064f9a183-signing-key\") pod \"service-ca-758f599c5-cj7mh\" (UID: \"60c39fb5-63dd-4b37-87bb-d3c064f9a183\") " pod="openshift-service-ca/service-ca-758f599c5-cj7mh"
Jul 06 01:03:16.770183 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:16.770144    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt2fv\" (UniqueName: \"kubernetes.io/projected/60c39fb5-63dd-4b37-87bb-d3c064f9a183-kube-api-access-wt2fv\") pod \"service-ca-758f599c5-cj7mh\" (UID: \"60c39fb5-63dd-4b37-87bb-d3c064f9a183\") " pod="openshift-service-ca/service-ca-758f599c5-cj7mh"
Jul 06 01:03:16.879879 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:16.879850    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-cj7mh"
Jul 06 01:03:17.002970 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:17.002943    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-cj7mh"]
Jul 06 01:03:17.005790 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:03:17.005764    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60c39fb5_63dd_4b37_87bb_d3c064f9a183.slice/crio-a1cc0f6c6040050741244b6d059384ad79e5a4d6bc258e9fd95ae08e028424c0 WatchSource:0}: Error finding container a1cc0f6c6040050741244b6d059384ad79e5a4d6bc258e9fd95ae08e028424c0: Status 404 returned error can't find the container with id a1cc0f6c6040050741244b6d059384ad79e5a4d6bc258e9fd95ae08e028424c0
Jul 06 01:03:17.548688 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:17.548654    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-cj7mh" event={"ID":"60c39fb5-63dd-4b37-87bb-d3c064f9a183","Type":"ContainerStarted","Data":"9fbd828a183727fa64c5aa5eae376cb8fba0ffe801cfdceb369b1508da51b464"}
Jul 06 01:03:17.549065 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:17.548703    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-cj7mh" event={"ID":"60c39fb5-63dd-4b37-87bb-d3c064f9a183","Type":"ContainerStarted","Data":"a1cc0f6c6040050741244b6d059384ad79e5a4d6bc258e9fd95ae08e028424c0"}
Jul 06 01:03:17.563139 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:17.563099    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-cj7mh" podStartSLOduration=1.5630812920000001 podStartE2EDuration="1.563081292s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:03:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:03:17.562808086 +0000 UTC m=+229.373783330" watchObservedRunningTime="2026-07-06 01:03:17.563081292 +0000 UTC m=+229.374056535"
Jul 06 01:03:17.596380 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:17.596358    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9b7nw_794399e2-dfe6-4b25-8879-858657cb407b/node-ca/0.log"
Jul 06 01:03:17.871207 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:17.871169    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe855984-bd75-41c1-ae9c-15de4b505dbb-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-8hbp5\" (UID: \"fe855984-bd75-41c1-ae9c-15de4b505dbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8hbp5"
Jul 06 01:03:17.871400 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:17.871259    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 01:03:17.871400 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:17.871325    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe855984-bd75-41c1-ae9c-15de4b505dbb-samples-operator-tls podName:fe855984-bd75-41c1-ae9c-15de4b505dbb nodeName:}" failed. No retries permitted until 2026-07-06 01:03:25.871306107 +0000 UTC m=+237.682281332 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fe855984-bd75-41c1-ae9c-15de4b505dbb-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-8hbp5" (UID: "fe855984-bd75-41c1-ae9c-15de4b505dbb") : secret "samples-operator-tls" not found
Jul 06 01:03:17.972854 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:17.972814    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5edeab24-165c-43b4-99bc-78ec365f9053-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-wf4nz\" (UID: \"5edeab24-165c-43b4-99bc-78ec365f9053\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-wf4nz"
Jul 06 01:03:17.973039 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:17.972977    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 01:03:17.973094 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:17.973050    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5edeab24-165c-43b4-99bc-78ec365f9053-networking-console-plugin-cert podName:5edeab24-165c-43b4-99bc-78ec365f9053 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:25.97302927 +0000 UTC m=+237.784004512 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5edeab24-165c-43b4-99bc-78ec365f9053-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-wf4nz" (UID: "5edeab24-165c-43b4-99bc-78ec365f9053") : secret "networking-console-plugin-cert" not found
Jul 06 01:03:18.073946 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:18.073910    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b600de6e-1fed-4b68-bcd9-8939f55eca0a-registry-tls\") pod \"image-registry-7df78dc57b-6tjqw\" (UID: \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\") " pod="openshift-image-registry/image-registry-7df78dc57b-6tjqw"
Jul 06 01:03:18.074194 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:18.074068    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 01:03:18.074194 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:18.074092    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df78dc57b-6tjqw: secret "image-registry-tls" not found
Jul 06 01:03:18.074194 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:18.074182    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b600de6e-1fed-4b68-bcd9-8939f55eca0a-registry-tls podName:b600de6e-1fed-4b68-bcd9-8939f55eca0a nodeName:}" failed. No retries permitted until 2026-07-06 01:03:26.074139948 +0000 UTC m=+237.885115183 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b600de6e-1fed-4b68-bcd9-8939f55eca0a-registry-tls") pod "image-registry-7df78dc57b-6tjqw" (UID: "b600de6e-1fed-4b68-bcd9-8939f55eca0a") : secret "image-registry-tls" not found
Jul 06 01:03:18.174974 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:18.174893    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 01:03:18.175220 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:18.174795    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/71387668-1da1-4db2-9861-0fb451b78703-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-97znw\" (UID: \"71387668-1da1-4db2-9861-0fb451b78703\") " pod="openshift-insights/insights-runtime-extractor-97znw"
Jul 06 01:03:18.175316 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:18.175254    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/71387668-1da1-4db2-9861-0fb451b78703-kube-rbac-proxy-cm podName:71387668-1da1-4db2-9861-0fb451b78703 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:22.17521118 +0000 UTC m=+233.986186420 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/71387668-1da1-4db2-9861-0fb451b78703-kube-rbac-proxy-cm") pod "insights-runtime-extractor-97znw" (UID: "71387668-1da1-4db2-9861-0fb451b78703") : configmap "kube-rbac-proxy" not found
Jul 06 01:03:18.175446 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:18.175425    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/71387668-1da1-4db2-9861-0fb451b78703-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-97znw\" (UID: \"71387668-1da1-4db2-9861-0fb451b78703\") " pod="openshift-insights/insights-runtime-extractor-97znw"
Jul 06 01:03:18.175570 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:18.175555    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 01:03:18.175636 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:18.175610    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71387668-1da1-4db2-9861-0fb451b78703-insights-runtime-extractor-tls podName:71387668-1da1-4db2-9861-0fb451b78703 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:22.175593653 +0000 UTC m=+233.986568875 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/71387668-1da1-4db2-9861-0fb451b78703-insights-runtime-extractor-tls") pod "insights-runtime-extractor-97znw" (UID: "71387668-1da1-4db2-9861-0fb451b78703") : secret "insights-runtime-extractor-tls" not found
Jul 06 01:03:18.195898 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:18.195867    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vv5dh_826bcf71-9bfe-418b-9d64-410edfad23df/serve-healthcheck-canary/0.log"
Jul 06 01:03:22.211902 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:22.211863    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/71387668-1da1-4db2-9861-0fb451b78703-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-97znw\" (UID: \"71387668-1da1-4db2-9861-0fb451b78703\") " pod="openshift-insights/insights-runtime-extractor-97znw"
Jul 06 01:03:22.212308 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:22.211990    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 01:03:22.212308 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:22.211994    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/71387668-1da1-4db2-9861-0fb451b78703-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-97znw\" (UID: \"71387668-1da1-4db2-9861-0fb451b78703\") " pod="openshift-insights/insights-runtime-extractor-97znw"
Jul 06 01:03:22.212308 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:22.212048    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71387668-1da1-4db2-9861-0fb451b78703-insights-runtime-extractor-tls podName:71387668-1da1-4db2-9861-0fb451b78703 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:30.212031314 +0000 UTC m=+242.023006535 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/71387668-1da1-4db2-9861-0fb451b78703-insights-runtime-extractor-tls") pod "insights-runtime-extractor-97znw" (UID: "71387668-1da1-4db2-9861-0fb451b78703") : secret "insights-runtime-extractor-tls" not found
Jul 06 01:03:22.212308 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:22.212079    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 01:03:22.212308 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:22.212134    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/71387668-1da1-4db2-9861-0fb451b78703-kube-rbac-proxy-cm podName:71387668-1da1-4db2-9861-0fb451b78703 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:30.212121193 +0000 UTC m=+242.023096415 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/71387668-1da1-4db2-9861-0fb451b78703-kube-rbac-proxy-cm") pod "insights-runtime-extractor-97znw" (UID: "71387668-1da1-4db2-9861-0fb451b78703") : configmap "kube-rbac-proxy" not found
Jul 06 01:03:25.942687 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:25.942649    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe855984-bd75-41c1-ae9c-15de4b505dbb-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-8hbp5\" (UID: \"fe855984-bd75-41c1-ae9c-15de4b505dbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8hbp5"
Jul 06 01:03:25.945072 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:25.945050    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe855984-bd75-41c1-ae9c-15de4b505dbb-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-8hbp5\" (UID: \"fe855984-bd75-41c1-ae9c-15de4b505dbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8hbp5"
Jul 06 01:03:25.997321 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:25.997279    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8hbp5"
Jul 06 01:03:26.043596 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:26.043553    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5edeab24-165c-43b4-99bc-78ec365f9053-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-wf4nz\" (UID: \"5edeab24-165c-43b4-99bc-78ec365f9053\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-wf4nz"
Jul 06 01:03:26.046164 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:26.046122    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5edeab24-165c-43b4-99bc-78ec365f9053-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-wf4nz\" (UID: \"5edeab24-165c-43b4-99bc-78ec365f9053\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-wf4nz"
Jul 06 01:03:26.087452 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:26.087424    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-wf4nz"
Jul 06 01:03:26.135036 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:26.134998    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8hbp5"]
Jul 06 01:03:26.145848 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:26.144384    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b600de6e-1fed-4b68-bcd9-8939f55eca0a-registry-tls\") pod \"image-registry-7df78dc57b-6tjqw\" (UID: \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\") " pod="openshift-image-registry/image-registry-7df78dc57b-6tjqw"
Jul 06 01:03:26.151283 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:26.151216    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b600de6e-1fed-4b68-bcd9-8939f55eca0a-registry-tls\") pod \"image-registry-7df78dc57b-6tjqw\" (UID: \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\") " pod="openshift-image-registry/image-registry-7df78dc57b-6tjqw"
Jul 06 01:03:26.191848 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:26.191815    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7df78dc57b-6tjqw"
Jul 06 01:03:26.227063 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:26.226983    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-wf4nz"]
Jul 06 01:03:26.230704 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:03:26.230670    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5edeab24_165c_43b4_99bc_78ec365f9053.slice/crio-ade8f7b40ab210687baae4176feda2d24a643361fc0b1030a8f43b781c43fc59 WatchSource:0}: Error finding container ade8f7b40ab210687baae4176feda2d24a643361fc0b1030a8f43b781c43fc59: Status 404 returned error can't find the container with id ade8f7b40ab210687baae4176feda2d24a643361fc0b1030a8f43b781c43fc59
Jul 06 01:03:26.332959 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:26.332927    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7df78dc57b-6tjqw"]
Jul 06 01:03:26.336080 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:03:26.336055    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb600de6e_1fed_4b68_bcd9_8939f55eca0a.slice/crio-da620739ee01c45d3413196610cb6d7a2aac47cb2b81f14a9eda4806fe3f9987 WatchSource:0}: Error finding container da620739ee01c45d3413196610cb6d7a2aac47cb2b81f14a9eda4806fe3f9987: Status 404 returned error can't find the container with id da620739ee01c45d3413196610cb6d7a2aac47cb2b81f14a9eda4806fe3f9987
Jul 06 01:03:26.579584 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:26.579476    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7df78dc57b-6tjqw" event={"ID":"b600de6e-1fed-4b68-bcd9-8939f55eca0a","Type":"ContainerStarted","Data":"65189a4bc2835a0d8c8439ddb4adc2ebf8fa6c14b334f122885fd4729b8d8e04"}
Jul 06 01:03:26.579584 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:26.579541    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7df78dc57b-6tjqw" event={"ID":"b600de6e-1fed-4b68-bcd9-8939f55eca0a","Type":"ContainerStarted","Data":"da620739ee01c45d3413196610cb6d7a2aac47cb2b81f14a9eda4806fe3f9987"}
Jul 06 01:03:26.579584 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:26.579569    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7df78dc57b-6tjqw"
Jul 06 01:03:26.580915 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:26.580879    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8hbp5" event={"ID":"fe855984-bd75-41c1-ae9c-15de4b505dbb","Type":"ContainerStarted","Data":"ad3c23757e0a4edcb1add4a27b38474edba82d91c44d87ef57440873c1004115"}
Jul 06 01:03:26.582053 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:26.582020    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-wf4nz" event={"ID":"5edeab24-165c-43b4-99bc-78ec365f9053","Type":"ContainerStarted","Data":"ade8f7b40ab210687baae4176feda2d24a643361fc0b1030a8f43b781c43fc59"}
Jul 06 01:03:26.598093 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:26.598047    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7df78dc57b-6tjqw" podStartSLOduration=16.598030203 podStartE2EDuration="16.598030203s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:03:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:03:26.59664988 +0000 UTC m=+238.407625135" watchObservedRunningTime="2026-07-06 01:03:26.598030203 +0000 UTC m=+238.409005445"
Jul 06 01:03:28.590015 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:28.589925    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-wf4nz" event={"ID":"5edeab24-165c-43b4-99bc-78ec365f9053","Type":"ContainerStarted","Data":"a02c6189eb221f636c77111b758b11f487f69bdfd08fe2faaf7b537efe197775"}
Jul 06 01:03:28.591559 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:28.591533    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8hbp5" event={"ID":"fe855984-bd75-41c1-ae9c-15de4b505dbb","Type":"ContainerStarted","Data":"2c5f0d1d9e5f6342376589f0314daf549b5864276892ea3e547dcc4d588d713e"}
Jul 06 01:03:28.591669 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:28.591574    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8hbp5" event={"ID":"fe855984-bd75-41c1-ae9c-15de4b505dbb","Type":"ContainerStarted","Data":"a7a4ea2c94cf8489f64be2fa7d2ccf22f56d90f60a5658531eb459c254ac5467"}
Jul 06 01:03:28.610310 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:28.610269    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-wf4nz" podStartSLOduration=17.236424479 podStartE2EDuration="18.610250147s" totalImagesPullingTime="1.373825668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:03:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:03:28.609259608 +0000 UTC m=+240.420234853" watchObservedRunningTime="2026-07-06 01:03:28.610250147 +0000 UTC m=+240.421225388"
Jul 06 01:03:28.627511 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:28.627468    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-8hbp5" podStartSLOduration=16.67315823 podStartE2EDuration="18.627451888s" totalImagesPullingTime="1.954293658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:03:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:03:28.626349934 +0000 UTC m=+240.437325179" watchObservedRunningTime="2026-07-06 01:03:28.627451888 +0000 UTC m=+240.438427148"
Jul 06 01:03:30.281451 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:30.281415    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/71387668-1da1-4db2-9861-0fb451b78703-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-97znw\" (UID: \"71387668-1da1-4db2-9861-0fb451b78703\") " pod="openshift-insights/insights-runtime-extractor-97znw"
Jul 06 01:03:30.281910 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:30.281462    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/71387668-1da1-4db2-9861-0fb451b78703-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-97znw\" (UID: \"71387668-1da1-4db2-9861-0fb451b78703\") " pod="openshift-insights/insights-runtime-extractor-97znw"
Jul 06 01:03:30.281974 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:30.281919    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/71387668-1da1-4db2-9861-0fb451b78703-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-97znw\" (UID: \"71387668-1da1-4db2-9861-0fb451b78703\") " pod="openshift-insights/insights-runtime-extractor-97znw"
Jul 06 01:03:30.283797 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:30.283774    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/71387668-1da1-4db2-9861-0fb451b78703-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-97znw\" (UID: \"71387668-1da1-4db2-9861-0fb451b78703\") " pod="openshift-insights/insights-runtime-extractor-97znw"
Jul 06 01:03:30.357365 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:30.357332    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jv6lr\""
Jul 06 01:03:30.365156 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:30.365100    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-97znw"
Jul 06 01:03:30.490030 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:30.490000    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-97znw"]
Jul 06 01:03:30.492994 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:03:30.492968    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71387668_1da1_4db2_9861_0fb451b78703.slice/crio-6d10bf8666da74c5dd9880dd96820e47193596ab21027a810190f574591782ca WatchSource:0}: Error finding container 6d10bf8666da74c5dd9880dd96820e47193596ab21027a810190f574591782ca: Status 404 returned error can't find the container with id 6d10bf8666da74c5dd9880dd96820e47193596ab21027a810190f574591782ca
Jul 06 01:03:30.599461 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:30.599366    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-97znw" event={"ID":"71387668-1da1-4db2-9861-0fb451b78703","Type":"ContainerStarted","Data":"6d10bf8666da74c5dd9880dd96820e47193596ab21027a810190f574591782ca"}
Jul 06 01:03:34.616359 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:34.616319    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-97znw" event={"ID":"71387668-1da1-4db2-9861-0fb451b78703","Type":"ContainerStarted","Data":"e2937c4019f51fa053d9123432d2f610ba62adde462d4a7358b2cdf12d0c5f87"}
Jul 06 01:03:35.623353 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:35.623318    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-97znw" event={"ID":"71387668-1da1-4db2-9861-0fb451b78703","Type":"ContainerStarted","Data":"a0b599afa84c296959a36cff0b8ed4db556cd7b498d221a82aad0803a1dcff87"}
Jul 06 01:03:38.636408 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:38.636375    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-97znw" event={"ID":"71387668-1da1-4db2-9861-0fb451b78703","Type":"ContainerStarted","Data":"cc199d1dd428fccb7013b1a879800cd908aa19fac0ff88e5b2d30f9ab6086843"}
Jul 06 01:03:38.712166 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:38.712112    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lpdxf"]
Jul 06 01:03:38.712618 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:38.712576    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-97znw" podStartSLOduration=17.657974347 podStartE2EDuration="24.712561165s" totalImagesPullingTime="7.054586818s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 01:03:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:03:38.707011223 +0000 UTC m=+250.517986465" watchObservedRunningTime="2026-07-06 01:03:38.712561165 +0000 UTC m=+250.523536408"
Jul 06 01:03:38.715091 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:38.715073    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-kwskq"]
Jul 06 01:03:38.715231 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:38.715214    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lpdxf"
Jul 06 01:03:38.717775 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:38.717755    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-kwskq"
Jul 06 01:03:38.718851 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:38.718831    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 06 01:03:38.720634 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:38.720618    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-65mjs\""
Jul 06 01:03:38.722016 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:38.721739    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 06 01:03:38.722142 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:38.722125    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 06 01:03:38.729365 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:38.729340    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-p98mb\""
Jul 06 01:03:38.729707 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:38.729691    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lpdxf"]
Jul 06 01:03:38.736999 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:38.736977    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-kwskq"]
Jul 06 01:03:38.745344 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:38.745324    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ths9\" (UniqueName: \"kubernetes.io/projected/694f3a2a-bb7d-4089-8fd0-2810ac412f4a-kube-api-access-8ths9\") pod \"downloads-685bfb5f64-kwskq\" (UID: \"694f3a2a-bb7d-4089-8fd0-2810ac412f4a\") " pod="openshift-console/downloads-685bfb5f64-kwskq"
Jul 06 01:03:38.745426 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:38.745395    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2dadc431-36da-4e6e-bd52-366da0f4624c-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-lpdxf\" (UID: \"2dadc431-36da-4e6e-bd52-366da0f4624c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lpdxf"
Jul 06 01:03:38.772040 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:38.772017    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7df78dc57b-6tjqw"]
Jul 06 01:03:38.845957 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:38.845925    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ths9\" (UniqueName: \"kubernetes.io/projected/694f3a2a-bb7d-4089-8fd0-2810ac412f4a-kube-api-access-8ths9\") pod \"downloads-685bfb5f64-kwskq\" (UID: \"694f3a2a-bb7d-4089-8fd0-2810ac412f4a\") " pod="openshift-console/downloads-685bfb5f64-kwskq"
Jul 06 01:03:38.846118 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:38.845989    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2dadc431-36da-4e6e-bd52-366da0f4624c-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-lpdxf\" (UID: \"2dadc431-36da-4e6e-bd52-366da0f4624c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lpdxf"
Jul 06 01:03:38.848340 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:38.848320    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2dadc431-36da-4e6e-bd52-366da0f4624c-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-lpdxf\" (UID: \"2dadc431-36da-4e6e-bd52-366da0f4624c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lpdxf"
Jul 06 01:03:38.857618 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:38.857587    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ths9\" (UniqueName: \"kubernetes.io/projected/694f3a2a-bb7d-4089-8fd0-2810ac412f4a-kube-api-access-8ths9\") pod \"downloads-685bfb5f64-kwskq\" (UID: \"694f3a2a-bb7d-4089-8fd0-2810ac412f4a\") " pod="openshift-console/downloads-685bfb5f64-kwskq"
Jul 06 01:03:39.024798 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:39.024714    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lpdxf"
Jul 06 01:03:39.029634 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:39.029612    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-kwskq"
Jul 06 01:03:39.187746 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:39.187716    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lpdxf"]
Jul 06 01:03:39.190822 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:03:39.190790    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dadc431_36da_4e6e_bd52_366da0f4624c.slice/crio-f2b7bd0952e08d760d6b89e52becf4644b25113fa38745e9fcba09df5811c887 WatchSource:0}: Error finding container f2b7bd0952e08d760d6b89e52becf4644b25113fa38745e9fcba09df5811c887: Status 404 returned error can't find the container with id f2b7bd0952e08d760d6b89e52becf4644b25113fa38745e9fcba09df5811c887
Jul 06 01:03:39.207483 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:39.207453    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-kwskq"]
Jul 06 01:03:39.211373 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:03:39.211346    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod694f3a2a_bb7d_4089_8fd0_2810ac412f4a.slice/crio-36a2c6df6bd675f736a309aa0511787a7fd9550c41c3c4ee40f7841a8d6dbbe5 WatchSource:0}: Error finding container 36a2c6df6bd675f736a309aa0511787a7fd9550c41c3c4ee40f7841a8d6dbbe5: Status 404 returned error can't find the container with id 36a2c6df6bd675f736a309aa0511787a7fd9550c41c3c4ee40f7841a8d6dbbe5
Jul 06 01:03:39.450638 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:39.450607    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccf84e13-ab75-4168-9cb8-9a21cb959224-metrics-certs\") pod \"network-metrics-daemon-lw99t\" (UID: \"ccf84e13-ab75-4168-9cb8-9a21cb959224\") " pod="openshift-multus/network-metrics-daemon-lw99t"
Jul 06 01:03:39.452932 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:39.452904    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccf84e13-ab75-4168-9cb8-9a21cb959224-metrics-certs\") pod \"network-metrics-daemon-lw99t\" (UID: \"ccf84e13-ab75-4168-9cb8-9a21cb959224\") " pod="openshift-multus/network-metrics-daemon-lw99t"
Jul 06 01:03:39.641046 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:39.641004    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lpdxf" event={"ID":"2dadc431-36da-4e6e-bd52-366da0f4624c","Type":"ContainerStarted","Data":"f2b7bd0952e08d760d6b89e52becf4644b25113fa38745e9fcba09df5811c887"}
Jul 06 01:03:39.642135 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:39.642110    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-kwskq" event={"ID":"694f3a2a-bb7d-4089-8fd0-2810ac412f4a","Type":"ContainerStarted","Data":"36a2c6df6bd675f736a309aa0511787a7fd9550c41c3c4ee40f7841a8d6dbbe5"}
Jul 06 01:03:39.650115 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:39.650093    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fwj5x\""
Jul 06 01:03:39.658191 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:39.658174    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lw99t"
Jul 06 01:03:39.807788 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:39.807755    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lw99t"]
Jul 06 01:03:39.810029 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:03:39.810004    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccf84e13_ab75_4168_9cb8_9a21cb959224.slice/crio-5339eecfe41ddec95d9a05b7a05d30ce54bde80d15e03ec428cd257c1e3d3040 WatchSource:0}: Error finding container 5339eecfe41ddec95d9a05b7a05d30ce54bde80d15e03ec428cd257c1e3d3040: Status 404 returned error can't find the container with id 5339eecfe41ddec95d9a05b7a05d30ce54bde80d15e03ec428cd257c1e3d3040
Jul 06 01:03:40.647403 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:40.647362    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lw99t" event={"ID":"ccf84e13-ab75-4168-9cb8-9a21cb959224","Type":"ContainerStarted","Data":"5339eecfe41ddec95d9a05b7a05d30ce54bde80d15e03ec428cd257c1e3d3040"}
Jul 06 01:03:41.653377 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:41.653337    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lw99t" event={"ID":"ccf84e13-ab75-4168-9cb8-9a21cb959224","Type":"ContainerStarted","Data":"cff1325540aaa8c0159603e20cde58c5b417a8aa3ee9c3a666731635280f5885"}
Jul 06 01:03:41.653922 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:41.653402    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lw99t" event={"ID":"ccf84e13-ab75-4168-9cb8-9a21cb959224","Type":"ContainerStarted","Data":"e6a5ee77c306400a4628c43e35ded0369438fb6c7cd7cb946e8f15e7f9f6bbf4"}
Jul 06 01:03:41.654888 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:41.654855    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lpdxf" event={"ID":"2dadc431-36da-4e6e-bd52-366da0f4624c","Type":"ContainerStarted","Data":"f0b5fa9a0541b632736fec6c546e049e5d800f81f63d4b02b2887e93d4680e59"}
Jul 06 01:03:41.655075 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:41.655057    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lpdxf"
Jul 06 01:03:41.660333 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:41.660307    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lpdxf"
Jul 06 01:03:41.678459 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:41.678382    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lw99t" podStartSLOduration=252.480176041 podStartE2EDuration="4m13.678363415s" totalImagesPullingTime="1.198187374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 00:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:03:41.677245001 +0000 UTC m=+253.488220339" watchObservedRunningTime="2026-07-06 01:03:41.678363415 +0000 UTC m=+253.489338659"
Jul 06 01:03:41.703604 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:41.703539    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lpdxf" podStartSLOduration=1.8807807539999999 podStartE2EDuration="3.703522613s" totalImagesPullingTime="1.822741859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:03:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:03:41.701627369 +0000 UTC m=+253.512602612" watchObservedRunningTime="2026-07-06 01:03:41.703522613 +0000 UTC m=+253.514497855"
Jul 06 01:03:46.250712 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.250464    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h99km"]
Jul 06 01:03:46.254005 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.253976    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h99km"
Jul 06 01:03:46.258647 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.258463    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 06 01:03:46.258852 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.258747    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 06 01:03:46.259564 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.259453    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 06 01:03:46.259564 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.259489    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 01:03:46.261197 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.261031    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 01:03:46.261585 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.261437    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 01:03:46.261585 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.261453    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-djvxm\""
Jul 06 01:03:46.273269 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.273196    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h99km"]
Jul 06 01:03:46.273757 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.273736    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-g8m44"]
Jul 06 01:03:46.276567 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.276546    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-g8m44"
Jul 06 01:03:46.280492 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.280027    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2dfmm\""
Jul 06 01:03:46.280492 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.280210    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 01:03:46.280492 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.280323    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 01:03:46.280698 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.280654    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 01:03:46.303336 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.303304    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5654f63c-8a47-47e6-8432-ead067ca8e57-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-h99km\" (UID: \"5654f63c-8a47-47e6-8432-ead067ca8e57\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h99km"
Jul 06 01:03:46.303450 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.303356    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e499a182-9627-48dd-847c-5c141d2fc798-sys\") pod \"node-exporter-g8m44\" (UID: \"e499a182-9627-48dd-847c-5c141d2fc798\") " pod="openshift-monitoring/node-exporter-g8m44"
Jul 06 01:03:46.303450 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.303414    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e499a182-9627-48dd-847c-5c141d2fc798-root\") pod \"node-exporter-g8m44\" (UID: \"e499a182-9627-48dd-847c-5c141d2fc798\") " pod="openshift-monitoring/node-exporter-g8m44"
Jul 06 01:03:46.303561 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.303455    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5654f63c-8a47-47e6-8432-ead067ca8e57-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-h99km\" (UID: \"5654f63c-8a47-47e6-8432-ead067ca8e57\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h99km"
Jul 06 01:03:46.303561 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.303485    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e499a182-9627-48dd-847c-5c141d2fc798-node-exporter-textfile\") pod \"node-exporter-g8m44\" (UID: \"e499a182-9627-48dd-847c-5c141d2fc798\") " pod="openshift-monitoring/node-exporter-g8m44"
Jul 06 01:03:46.303561 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.303510    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e499a182-9627-48dd-847c-5c141d2fc798-node-exporter-wtmp\") pod \"node-exporter-g8m44\" (UID: \"e499a182-9627-48dd-847c-5c141d2fc798\") " pod="openshift-monitoring/node-exporter-g8m44"
Jul 06 01:03:46.303756 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.303570    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5654f63c-8a47-47e6-8432-ead067ca8e57-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-h99km\" (UID: \"5654f63c-8a47-47e6-8432-ead067ca8e57\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h99km"
Jul 06 01:03:46.303756 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.303601    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e499a182-9627-48dd-847c-5c141d2fc798-node-exporter-accelerators-collector-config\") pod \"node-exporter-g8m44\" (UID: \"e499a182-9627-48dd-847c-5c141d2fc798\") " pod="openshift-monitoring/node-exporter-g8m44"
Jul 06 01:03:46.303756 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.303684    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbkxk\" (UniqueName: \"kubernetes.io/projected/5654f63c-8a47-47e6-8432-ead067ca8e57-kube-api-access-cbkxk\") pod \"kube-state-metrics-7c9dbb8b7d-h99km\" (UID: \"5654f63c-8a47-47e6-8432-ead067ca8e57\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h99km"
Jul 06 01:03:46.303756 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.303729    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5654f63c-8a47-47e6-8432-ead067ca8e57-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-h99km\" (UID: \"5654f63c-8a47-47e6-8432-ead067ca8e57\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h99km"
Jul 06 01:03:46.303937 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.303756    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e499a182-9627-48dd-847c-5c141d2fc798-node-exporter-tls\") pod \"node-exporter-g8m44\" (UID: \"e499a182-9627-48dd-847c-5c141d2fc798\") " pod="openshift-monitoring/node-exporter-g8m44"
Jul 06 01:03:46.303937 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.303793    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdbjr\" (UniqueName: \"kubernetes.io/projected/e499a182-9627-48dd-847c-5c141d2fc798-kube-api-access-wdbjr\") pod \"node-exporter-g8m44\" (UID: \"e499a182-9627-48dd-847c-5c141d2fc798\") " pod="openshift-monitoring/node-exporter-g8m44"
Jul 06 01:03:46.303937 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.303821    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5654f63c-8a47-47e6-8432-ead067ca8e57-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-h99km\" (UID: \"5654f63c-8a47-47e6-8432-ead067ca8e57\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h99km"
Jul 06 01:03:46.303937 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.303853    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e499a182-9627-48dd-847c-5c141d2fc798-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g8m44\" (UID: \"e499a182-9627-48dd-847c-5c141d2fc798\") " pod="openshift-monitoring/node-exporter-g8m44"
Jul 06 01:03:46.303937 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.303887    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e499a182-9627-48dd-847c-5c141d2fc798-metrics-client-ca\") pod \"node-exporter-g8m44\" (UID: \"e499a182-9627-48dd-847c-5c141d2fc798\") " pod="openshift-monitoring/node-exporter-g8m44"
Jul 06 01:03:46.405478 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.405240    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5654f63c-8a47-47e6-8432-ead067ca8e57-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-h99km\" (UID: \"5654f63c-8a47-47e6-8432-ead067ca8e57\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h99km"
Jul 06 01:03:46.405478 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.405311    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e499a182-9627-48dd-847c-5c141d2fc798-sys\") pod \"node-exporter-g8m44\" (UID: \"e499a182-9627-48dd-847c-5c141d2fc798\") " pod="openshift-monitoring/node-exporter-g8m44"
Jul 06 01:03:46.405478 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.405338    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e499a182-9627-48dd-847c-5c141d2fc798-root\") pod \"node-exporter-g8m44\" (UID: \"e499a182-9627-48dd-847c-5c141d2fc798\") " pod="openshift-monitoring/node-exporter-g8m44"
Jul 06 01:03:46.405478 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.405365    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5654f63c-8a47-47e6-8432-ead067ca8e57-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-h99km\" (UID: \"5654f63c-8a47-47e6-8432-ead067ca8e57\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h99km"
Jul 06 01:03:46.405478 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.405465    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e499a182-9627-48dd-847c-5c141d2fc798-root\") pod \"node-exporter-g8m44\" (UID: \"e499a182-9627-48dd-847c-5c141d2fc798\") " pod="openshift-monitoring/node-exporter-g8m44"
Jul 06 01:03:46.405853 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.405524    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e499a182-9627-48dd-847c-5c141d2fc798-node-exporter-textfile\") pod \"node-exporter-g8m44\" (UID: \"e499a182-9627-48dd-847c-5c141d2fc798\") " pod="openshift-monitoring/node-exporter-g8m44"
Jul 06 01:03:46.405853 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.405538    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e499a182-9627-48dd-847c-5c141d2fc798-sys\") pod \"node-exporter-g8m44\" (UID: \"e499a182-9627-48dd-847c-5c141d2fc798\") " pod="openshift-monitoring/node-exporter-g8m44"
Jul 06 01:03:46.405853 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.405557    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e499a182-9627-48dd-847c-5c141d2fc798-node-exporter-wtmp\") pod \"node-exporter-g8m44\" (UID: \"e499a182-9627-48dd-847c-5c141d2fc798\") " pod="openshift-monitoring/node-exporter-g8m44"
Jul 06 01:03:46.405853 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.405592    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5654f63c-8a47-47e6-8432-ead067ca8e57-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-h99km\" (UID: \"5654f63c-8a47-47e6-8432-ead067ca8e57\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h99km"
Jul 06 01:03:46.405853 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.405627    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e499a182-9627-48dd-847c-5c141d2fc798-node-exporter-accelerators-collector-config\") pod \"node-exporter-g8m44\" (UID: \"e499a182-9627-48dd-847c-5c141d2fc798\") " pod="openshift-monitoring/node-exporter-g8m44"
Jul 06 01:03:46.405853 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.405669    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbkxk\" (UniqueName: \"kubernetes.io/projected/5654f63c-8a47-47e6-8432-ead067ca8e57-kube-api-access-cbkxk\") pod \"kube-state-metrics-7c9dbb8b7d-h99km\" (UID: \"5654f63c-8a47-47e6-8432-ead067ca8e57\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h99km"
Jul 06 01:03:46.405853 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.405695    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5654f63c-8a47-47e6-8432-ead067ca8e57-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-h99km\" (UID: \"5654f63c-8a47-47e6-8432-ead067ca8e57\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h99km"
Jul 06 01:03:46.405853 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.405718    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e499a182-9627-48dd-847c-5c141d2fc798-node-exporter-tls\") pod \"node-exporter-g8m44\" (UID: \"e499a182-9627-48dd-847c-5c141d2fc798\") " pod="openshift-monitoring/node-exporter-g8m44"
Jul 06 01:03:46.405853 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.405758    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdbjr\" (UniqueName: \"kubernetes.io/projected/e499a182-9627-48dd-847c-5c141d2fc798-kube-api-access-wdbjr\") pod \"node-exporter-g8m44\" (UID: \"e499a182-9627-48dd-847c-5c141d2fc798\") " pod="openshift-monitoring/node-exporter-g8m44"
Jul 06 01:03:46.405853 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.405784    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5654f63c-8a47-47e6-8432-ead067ca8e57-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-h99km\" (UID: \"5654f63c-8a47-47e6-8432-ead067ca8e57\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h99km"
Jul 06 01:03:46.405853 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.405805    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e499a182-9627-48dd-847c-5c141d2fc798-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g8m44\" (UID: \"e499a182-9627-48dd-847c-5c141d2fc798\") " pod="openshift-monitoring/node-exporter-g8m44"
Jul 06 01:03:46.405853 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.405834    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e499a182-9627-48dd-847c-5c141d2fc798-metrics-client-ca\") pod \"node-exporter-g8m44\" (UID: \"e499a182-9627-48dd-847c-5c141d2fc798\") " pod="openshift-monitoring/node-exporter-g8m44"
Jul 06 01:03:46.406428 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.405885    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e499a182-9627-48dd-847c-5c141d2fc798-node-exporter-textfile\") pod \"node-exporter-g8m44\" (UID: \"e499a182-9627-48dd-847c-5c141d2fc798\") " pod="openshift-monitoring/node-exporter-g8m44"
Jul 06 01:03:46.406428 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.406061    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5654f63c-8a47-47e6-8432-ead067ca8e57-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-h99km\" (UID: \"5654f63c-8a47-47e6-8432-ead067ca8e57\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h99km"
Jul 06 01:03:46.406428 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:46.406187    2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 06 01:03:46.406428 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:03:46.406255    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e499a182-9627-48dd-847c-5c141d2fc798-node-exporter-tls podName:e499a182-9627-48dd-847c-5c141d2fc798 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:46.9062365 +0000 UTC m=+258.717211722 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e499a182-9627-48dd-847c-5c141d2fc798-node-exporter-tls") pod "node-exporter-g8m44" (UID: "e499a182-9627-48dd-847c-5c141d2fc798") : secret "node-exporter-tls" not found
Jul 06 01:03:46.406428 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.406296    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e499a182-9627-48dd-847c-5c141d2fc798-node-exporter-wtmp\") pod \"node-exporter-g8m44\" (UID: \"e499a182-9627-48dd-847c-5c141d2fc798\") " pod="openshift-monitoring/node-exporter-g8m44"
Jul 06 01:03:46.406673 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.406441    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5654f63c-8a47-47e6-8432-ead067ca8e57-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-h99km\" (UID: \"5654f63c-8a47-47e6-8432-ead067ca8e57\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h99km"
Jul 06 01:03:46.406673 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.406458    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e499a182-9627-48dd-847c-5c141d2fc798-metrics-client-ca\") pod \"node-exporter-g8m44\" (UID: \"e499a182-9627-48dd-847c-5c141d2fc798\") " pod="openshift-monitoring/node-exporter-g8m44"
Jul 06 01:03:46.407055 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.407029    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5654f63c-8a47-47e6-8432-ead067ca8e57-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-h99km\" (UID: \"5654f63c-8a47-47e6-8432-ead067ca8e57\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h99km"
Jul 06 01:03:46.407192 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.407108    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e499a182-9627-48dd-847c-5c141d2fc798-node-exporter-accelerators-collector-config\") pod \"node-exporter-g8m44\" (UID: \"e499a182-9627-48dd-847c-5c141d2fc798\") " pod="openshift-monitoring/node-exporter-g8m44"
Jul 06 01:03:46.409202 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.408598    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5654f63c-8a47-47e6-8432-ead067ca8e57-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-h99km\" (UID: \"5654f63c-8a47-47e6-8432-ead067ca8e57\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h99km"
Jul 06 01:03:46.409202 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.409069    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5654f63c-8a47-47e6-8432-ead067ca8e57-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-h99km\" (UID: \"5654f63c-8a47-47e6-8432-ead067ca8e57\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h99km"
Jul 06 01:03:46.409696 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.409674    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e499a182-9627-48dd-847c-5c141d2fc798-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g8m44\" (UID: \"e499a182-9627-48dd-847c-5c141d2fc798\") " pod="openshift-monitoring/node-exporter-g8m44"
Jul 06 01:03:46.415947 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.415923    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbkxk\" (UniqueName: \"kubernetes.io/projected/5654f63c-8a47-47e6-8432-ead067ca8e57-kube-api-access-cbkxk\") pod \"kube-state-metrics-7c9dbb8b7d-h99km\" (UID: \"5654f63c-8a47-47e6-8432-ead067ca8e57\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h99km"
Jul 06 01:03:46.416332 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.416287    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdbjr\" (UniqueName: \"kubernetes.io/projected/e499a182-9627-48dd-847c-5c141d2fc798-kube-api-access-wdbjr\") pod \"node-exporter-g8m44\" (UID: \"e499a182-9627-48dd-847c-5c141d2fc798\") " pod="openshift-monitoring/node-exporter-g8m44"
Jul 06 01:03:46.566348 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.566257    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h99km"
Jul 06 01:03:46.737637 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.737606    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h99km"]
Jul 06 01:03:46.741875 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:03:46.741846    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5654f63c_8a47_47e6_8432_ead067ca8e57.slice/crio-beb7545e459c0f28d1730343f6b3e75ab5aa7e4a40f17b23565bb79cb1e91fb2 WatchSource:0}: Error finding container beb7545e459c0f28d1730343f6b3e75ab5aa7e4a40f17b23565bb79cb1e91fb2: Status 404 returned error can't find the container with id beb7545e459c0f28d1730343f6b3e75ab5aa7e4a40f17b23565bb79cb1e91fb2
Jul 06 01:03:46.910620 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.910576    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e499a182-9627-48dd-847c-5c141d2fc798-node-exporter-tls\") pod \"node-exporter-g8m44\" (UID: \"e499a182-9627-48dd-847c-5c141d2fc798\") " pod="openshift-monitoring/node-exporter-g8m44"
Jul 06 01:03:46.912870 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:46.912849    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e499a182-9627-48dd-847c-5c141d2fc798-node-exporter-tls\") pod \"node-exporter-g8m44\" (UID: \"e499a182-9627-48dd-847c-5c141d2fc798\") " pod="openshift-monitoring/node-exporter-g8m44"
Jul 06 01:03:47.188285 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.188196    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-g8m44"
Jul 06 01:03:47.203021 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:03:47.202985    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode499a182_9627_48dd_847c_5c141d2fc798.slice/crio-7e953eb1b54f93d05d8fe8edc18286a7686e7376f4ea467774aacc8772f1e00d WatchSource:0}: Error finding container 7e953eb1b54f93d05d8fe8edc18286a7686e7376f4ea467774aacc8772f1e00d: Status 404 returned error can't find the container with id 7e953eb1b54f93d05d8fe8edc18286a7686e7376f4ea467774aacc8772f1e00d
Jul 06 01:03:47.325061 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.325030    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 01:03:47.330365 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.330332    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:03:47.335200 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.335178    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 06 01:03:47.335319 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.335221    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 06 01:03:47.336047 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.336022    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 06 01:03:47.336253 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.336236    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 06 01:03:47.336874 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.336858    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 06 01:03:47.337046 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.337027    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-w8dc8\""
Jul 06 01:03:47.337463 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.337434    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 06 01:03:47.344273 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.344250    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 06 01:03:47.344376 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.344271    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 06 01:03:47.344634 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.344506    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 06 01:03:47.346478 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.346461    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 01:03:47.414984 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.414945    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/509447eb-05c0-449a-9838-c05abf7e2f96-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:03:47.415136 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.415031    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/509447eb-05c0-449a-9838-c05abf7e2f96-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:03:47.415136 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.415095    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/509447eb-05c0-449a-9838-c05abf7e2f96-config-volume\") pod \"alertmanager-main-0\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:03:47.415136 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.415129    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dndqr\" (UniqueName: \"kubernetes.io/projected/509447eb-05c0-449a-9838-c05abf7e2f96-kube-api-access-dndqr\") pod \"alertmanager-main-0\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:03:47.415339 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.415172    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/509447eb-05c0-449a-9838-c05abf7e2f96-config-out\") pod \"alertmanager-main-0\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:03:47.415339 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.415199    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/509447eb-05c0-449a-9838-c05abf7e2f96-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:03:47.415339 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.415227    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/509447eb-05c0-449a-9838-c05abf7e2f96-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:03:47.415339 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.415276    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/509447eb-05c0-449a-9838-c05abf7e2f96-tls-assets\") pod \"alertmanager-main-0\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:03:47.415339 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.415327    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/509447eb-05c0-449a-9838-c05abf7e2f96-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:03:47.415588 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.415354    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/509447eb-05c0-449a-9838-c05abf7e2f96-web-config\") pod \"alertmanager-main-0\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:03:47.415588 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.415399    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/509447eb-05c0-449a-9838-c05abf7e2f96-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:03:47.415588 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.415453    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/509447eb-05c0-449a-9838-c05abf7e2f96-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:03:47.415588 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.415509    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/509447eb-05c0-449a-9838-c05abf7e2f96-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:03:47.516366 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.516283    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/509447eb-05c0-449a-9838-c05abf7e2f96-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:03:47.516366 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.516323    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/509447eb-05c0-449a-9838-c05abf7e2f96-web-config\") pod \"alertmanager-main-0\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:03:47.516564 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.516451    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/509447eb-05c0-449a-9838-c05abf7e2f96-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:03:47.516564 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.516488    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/509447eb-05c0-449a-9838-c05abf7e2f96-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:03:47.516564 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.516536    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/509447eb-05c0-449a-9838-c05abf7e2f96-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:03:47.516717 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.516578    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/509447eb-05c0-449a-9838-c05abf7e2f96-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:03:47.516855 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.516828    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/509447eb-05c0-449a-9838-c05abf7e2f96-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:03:47.516942 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.516885    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/509447eb-05c0-449a-9838-c05abf7e2f96-config-volume\") pod \"alertmanager-main-0\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:03:47.516942 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.516925    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dndqr\" (UniqueName: \"kubernetes.io/projected/509447eb-05c0-449a-9838-c05abf7e2f96-kube-api-access-dndqr\") pod \"alertmanager-main-0\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:03:47.517115 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.516953    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/509447eb-05c0-449a-9838-c05abf7e2f96-config-out\") pod \"alertmanager-main-0\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:03:47.517115 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.516983    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/509447eb-05c0-449a-9838-c05abf7e2f96-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:03:47.517115 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.517014    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/509447eb-05c0-449a-9838-c05abf7e2f96-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:03:47.517115 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.517040    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/509447eb-05c0-449a-9838-c05abf7e2f96-tls-assets\") pod \"alertmanager-main-0\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:03:47.517675 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.517361    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/509447eb-05c0-449a-9838-c05abf7e2f96-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:03:47.518499 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.518477    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/509447eb-05c0-449a-9838-c05abf7e2f96-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:03:47.519024 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.518963    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/509447eb-05c0-449a-9838-c05abf7e2f96-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:03:47.521486 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.520689    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/509447eb-05c0-449a-9838-c05abf7e2f96-config-out\") pod \"alertmanager-main-0\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:03:47.521486 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.520972    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/509447eb-05c0-449a-9838-c05abf7e2f96-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:03:47.521486 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.521063    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/509447eb-05c0-449a-9838-c05abf7e2f96-tls-assets\") pod \"alertmanager-main-0\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:03:47.521486 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.521135    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/509447eb-05c0-449a-9838-c05abf7e2f96-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:03:47.521486 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.521378    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/509447eb-05c0-449a-9838-c05abf7e2f96-web-config\") pod \"alertmanager-main-0\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:03:47.521486 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.521451    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/509447eb-05c0-449a-9838-c05abf7e2f96-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:03:47.521848 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.521568    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/509447eb-05c0-449a-9838-c05abf7e2f96-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:03:47.521848 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.521763    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/509447eb-05c0-449a-9838-c05abf7e2f96-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:03:47.522426 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.522408    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/509447eb-05c0-449a-9838-c05abf7e2f96-config-volume\") pod \"alertmanager-main-0\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:03:47.529742 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.529719    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dndqr\" (UniqueName: \"kubernetes.io/projected/509447eb-05c0-449a-9838-c05abf7e2f96-kube-api-access-dndqr\") pod \"alertmanager-main-0\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:03:47.642492 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.642461    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:03:47.683647 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.683577    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g8m44" event={"ID":"e499a182-9627-48dd-847c-5c141d2fc798","Type":"ContainerStarted","Data":"7e953eb1b54f93d05d8fe8edc18286a7686e7376f4ea467774aacc8772f1e00d"}
Jul 06 01:03:47.685166 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.685111    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h99km" event={"ID":"5654f63c-8a47-47e6-8432-ead067ca8e57","Type":"ContainerStarted","Data":"beb7545e459c0f28d1730343f6b3e75ab5aa7e4a40f17b23565bb79cb1e91fb2"}
Jul 06 01:03:47.808531 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:47.808380    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 01:03:47.812580 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:03:47.812551    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod509447eb_05c0_449a_9838_c05abf7e2f96.slice/crio-2f9e2205fc3ba7d893b2127ee698884bf4bf7494405937ba54550cef089047cb WatchSource:0}: Error finding container 2f9e2205fc3ba7d893b2127ee698884bf4bf7494405937ba54550cef089047cb: Status 404 returned error can't find the container with id 2f9e2205fc3ba7d893b2127ee698884bf4bf7494405937ba54550cef089047cb
Jul 06 01:03:48.690319 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:48.690288    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"509447eb-05c0-449a-9838-c05abf7e2f96","Type":"ContainerStarted","Data":"2f9e2205fc3ba7d893b2127ee698884bf4bf7494405937ba54550cef089047cb"}
Jul 06 01:03:48.779414 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:48.779301    2562 patch_prober.go:28] interesting pod/image-registry-7df78dc57b-6tjqw container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 06 01:03:48.779414 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:48.779356    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7df78dc57b-6tjqw" podUID="b600de6e-1fed-4b68-bcd9-8939f55eca0a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 01:03:49.702902 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:49.702859    2562 generic.go:356] "Generic (PLEG): container finished" podID="e499a182-9627-48dd-847c-5c141d2fc798" containerID="bc295760a648d8d736b285cbdf9fc0783d1cb2e10504a812e1e0d41827fce188" exitCode=0
Jul 06 01:03:49.703378 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:49.702942    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g8m44" event={"ID":"e499a182-9627-48dd-847c-5c141d2fc798","Type":"ContainerDied","Data":"bc295760a648d8d736b285cbdf9fc0783d1cb2e10504a812e1e0d41827fce188"}
Jul 06 01:03:49.705459 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:49.705429    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h99km" event={"ID":"5654f63c-8a47-47e6-8432-ead067ca8e57","Type":"ContainerStarted","Data":"e34d67befbbc400ce182fb6516cd064a558673bbccd17bebc118507e97f420b4"}
Jul 06 01:03:49.705538 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:49.705479    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h99km" event={"ID":"5654f63c-8a47-47e6-8432-ead067ca8e57","Type":"ContainerStarted","Data":"3da9ac7399485b8ee9587540996675858e0f7af08194501e46b8bcd8178f1e2b"}
Jul 06 01:03:49.705538 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:49.705499    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h99km" event={"ID":"5654f63c-8a47-47e6-8432-ead067ca8e57","Type":"ContainerStarted","Data":"e2d6e7979f23a9b4f8c3583611430a370e9b5db278b6aed344535e4cfbe41bf1"}
Jul 06 01:03:50.687774 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:50.687655    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-h99km" podStartSLOduration=2.764769881 podStartE2EDuration="4.687629008s" totalImagesPullingTime="1.922859127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:03:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:03:49.744828384 +0000 UTC m=+261.555803628" watchObservedRunningTime="2026-07-06 01:03:50.687629008 +0000 UTC m=+262.498604251"
Jul 06 01:03:50.688542 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:50.688523    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7d67fb6459-k6wnr"]
Jul 06 01:03:50.691769 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:50.691750    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d67fb6459-k6wnr"
Jul 06 01:03:50.694360 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:50.694337    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 06 01:03:50.694473 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:50.694338    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 06 01:03:50.695386 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:50.695265    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 06 01:03:50.695386 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:50.695280    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 06 01:03:50.695386 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:50.695302    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8fmnhp03ei360\""
Jul 06 01:03:50.695386 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:50.695340    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-h4mln\""
Jul 06 01:03:50.700414 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:50.700383    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d67fb6459-k6wnr"]
Jul 06 01:03:50.749531 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:50.749494    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ded48176-1bb7-47cb-b939-14e34bbd5aec-metrics-server-audit-profiles\") pod \"metrics-server-7d67fb6459-k6wnr\" (UID: \"ded48176-1bb7-47cb-b939-14e34bbd5aec\") " pod="openshift-monitoring/metrics-server-7d67fb6459-k6wnr"
Jul 06 01:03:50.750001 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:50.749602    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ded48176-1bb7-47cb-b939-14e34bbd5aec-secret-metrics-server-tls\") pod \"metrics-server-7d67fb6459-k6wnr\" (UID: \"ded48176-1bb7-47cb-b939-14e34bbd5aec\") " pod="openshift-monitoring/metrics-server-7d67fb6459-k6wnr"
Jul 06 01:03:50.750001 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:50.749650    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ded48176-1bb7-47cb-b939-14e34bbd5aec-audit-log\") pod \"metrics-server-7d67fb6459-k6wnr\" (UID: \"ded48176-1bb7-47cb-b939-14e34bbd5aec\") " pod="openshift-monitoring/metrics-server-7d67fb6459-k6wnr"
Jul 06 01:03:50.750001 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:50.749679    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ded48176-1bb7-47cb-b939-14e34bbd5aec-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d67fb6459-k6wnr\" (UID: \"ded48176-1bb7-47cb-b939-14e34bbd5aec\") " pod="openshift-monitoring/metrics-server-7d67fb6459-k6wnr"
Jul 06 01:03:50.750001 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:50.749763    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hgd6\" (UniqueName: \"kubernetes.io/projected/ded48176-1bb7-47cb-b939-14e34bbd5aec-kube-api-access-8hgd6\") pod \"metrics-server-7d67fb6459-k6wnr\" (UID: \"ded48176-1bb7-47cb-b939-14e34bbd5aec\") " pod="openshift-monitoring/metrics-server-7d67fb6459-k6wnr"
Jul 06 01:03:50.750001 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:50.749825    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ded48176-1bb7-47cb-b939-14e34bbd5aec-secret-metrics-server-client-certs\") pod \"metrics-server-7d67fb6459-k6wnr\" (UID: \"ded48176-1bb7-47cb-b939-14e34bbd5aec\") " pod="openshift-monitoring/metrics-server-7d67fb6459-k6wnr"
Jul 06 01:03:50.750001 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:50.749927    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ded48176-1bb7-47cb-b939-14e34bbd5aec-client-ca-bundle\") pod \"metrics-server-7d67fb6459-k6wnr\" (UID: \"ded48176-1bb7-47cb-b939-14e34bbd5aec\") " pod="openshift-monitoring/metrics-server-7d67fb6459-k6wnr"
Jul 06 01:03:50.851061 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:50.851023    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ded48176-1bb7-47cb-b939-14e34bbd5aec-metrics-server-audit-profiles\") pod \"metrics-server-7d67fb6459-k6wnr\" (UID: \"ded48176-1bb7-47cb-b939-14e34bbd5aec\") " pod="openshift-monitoring/metrics-server-7d67fb6459-k6wnr"
Jul 06 01:03:50.851268 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:50.851102    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ded48176-1bb7-47cb-b939-14e34bbd5aec-secret-metrics-server-tls\") pod \"metrics-server-7d67fb6459-k6wnr\" (UID: \"ded48176-1bb7-47cb-b939-14e34bbd5aec\") " pod="openshift-monitoring/metrics-server-7d67fb6459-k6wnr"
Jul 06 01:03:50.851268 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:50.851136    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ded48176-1bb7-47cb-b939-14e34bbd5aec-audit-log\") pod \"metrics-server-7d67fb6459-k6wnr\" (UID: \"ded48176-1bb7-47cb-b939-14e34bbd5aec\") " pod="openshift-monitoring/metrics-server-7d67fb6459-k6wnr"
Jul 06 01:03:50.851268 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:50.851181    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ded48176-1bb7-47cb-b939-14e34bbd5aec-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d67fb6459-k6wnr\" (UID: \"ded48176-1bb7-47cb-b939-14e34bbd5aec\") " pod="openshift-monitoring/metrics-server-7d67fb6459-k6wnr"
Jul 06 01:03:50.851268 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:50.851225    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hgd6\" (UniqueName: \"kubernetes.io/projected/ded48176-1bb7-47cb-b939-14e34bbd5aec-kube-api-access-8hgd6\") pod \"metrics-server-7d67fb6459-k6wnr\" (UID: \"ded48176-1bb7-47cb-b939-14e34bbd5aec\") " pod="openshift-monitoring/metrics-server-7d67fb6459-k6wnr"
Jul 06 01:03:50.851469 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:50.851271    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ded48176-1bb7-47cb-b939-14e34bbd5aec-secret-metrics-server-client-certs\") pod \"metrics-server-7d67fb6459-k6wnr\" (UID: \"ded48176-1bb7-47cb-b939-14e34bbd5aec\") " pod="openshift-monitoring/metrics-server-7d67fb6459-k6wnr"
Jul 06 01:03:50.851469 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:50.851328    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ded48176-1bb7-47cb-b939-14e34bbd5aec-client-ca-bundle\") pod \"metrics-server-7d67fb6459-k6wnr\" (UID: \"ded48176-1bb7-47cb-b939-14e34bbd5aec\") " pod="openshift-monitoring/metrics-server-7d67fb6459-k6wnr"
Jul 06 01:03:50.851817 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:50.851790    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ded48176-1bb7-47cb-b939-14e34bbd5aec-audit-log\") pod \"metrics-server-7d67fb6459-k6wnr\" (UID: \"ded48176-1bb7-47cb-b939-14e34bbd5aec\") " pod="openshift-monitoring/metrics-server-7d67fb6459-k6wnr"
Jul 06 01:03:50.851974 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:50.851950    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ded48176-1bb7-47cb-b939-14e34bbd5aec-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d67fb6459-k6wnr\" (UID: \"ded48176-1bb7-47cb-b939-14e34bbd5aec\") " pod="openshift-monitoring/metrics-server-7d67fb6459-k6wnr"
Jul 06 01:03:50.852249 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:50.852222    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ded48176-1bb7-47cb-b939-14e34bbd5aec-metrics-server-audit-profiles\") pod \"metrics-server-7d67fb6459-k6wnr\" (UID: \"ded48176-1bb7-47cb-b939-14e34bbd5aec\") " pod="openshift-monitoring/metrics-server-7d67fb6459-k6wnr"
Jul 06 01:03:50.854478 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:50.854446    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ded48176-1bb7-47cb-b939-14e34bbd5aec-client-ca-bundle\") pod \"metrics-server-7d67fb6459-k6wnr\" (UID: \"ded48176-1bb7-47cb-b939-14e34bbd5aec\") " pod="openshift-monitoring/metrics-server-7d67fb6459-k6wnr"
Jul 06 01:03:50.854593 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:50.854555    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ded48176-1bb7-47cb-b939-14e34bbd5aec-secret-metrics-server-client-certs\") pod \"metrics-server-7d67fb6459-k6wnr\" (UID: \"ded48176-1bb7-47cb-b939-14e34bbd5aec\") " pod="openshift-monitoring/metrics-server-7d67fb6459-k6wnr"
Jul 06 01:03:50.854593 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:50.854581    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ded48176-1bb7-47cb-b939-14e34bbd5aec-secret-metrics-server-tls\") pod \"metrics-server-7d67fb6459-k6wnr\" (UID: \"ded48176-1bb7-47cb-b939-14e34bbd5aec\") " pod="openshift-monitoring/metrics-server-7d67fb6459-k6wnr"
Jul 06 01:03:50.860220 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:50.860195    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hgd6\" (UniqueName: \"kubernetes.io/projected/ded48176-1bb7-47cb-b939-14e34bbd5aec-kube-api-access-8hgd6\") pod \"metrics-server-7d67fb6459-k6wnr\" (UID: \"ded48176-1bb7-47cb-b939-14e34bbd5aec\") " pod="openshift-monitoring/metrics-server-7d67fb6459-k6wnr"
Jul 06 01:03:51.003195 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:51.003035    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d67fb6459-k6wnr"
Jul 06 01:03:52.478204 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.478163    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 01:03:52.482359 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.482337    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.486034 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.485990    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 06 01:03:52.486287 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.486135    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 06 01:03:52.486606 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.486585    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 06 01:03:52.486685 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.486591    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 06 01:03:52.487032 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.487013    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 06 01:03:52.487116 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.487067    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 06 01:03:52.487116 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.487082    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 06 01:03:52.487274 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.487182    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 06 01:03:52.487457 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.487439    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-31a38qv3cgjp7\""
Jul 06 01:03:52.487651 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.487632    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 06 01:03:52.487733 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.487699    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 06 01:03:52.488015 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.487944    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-dj4m9\""
Jul 06 01:03:52.488015 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.487957    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 06 01:03:52.488203 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.488061    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 06 01:03:52.490459 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.490263    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 06 01:03:52.494306 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.494288    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 06 01:03:52.505409 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.505384    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 01:03:52.565273 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.565239    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.565448 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.565312    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3cd43843-469c-40f8-871e-0d30dc302dc2-config-out\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.565448 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.565357    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-config\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.565448 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.565393    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.565448 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.565437    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.565652 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.565455    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-web-config\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.565652 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.565480    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3cd43843-469c-40f8-871e-0d30dc302dc2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.565652 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.565494    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cd43843-469c-40f8-871e-0d30dc302dc2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.565652 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.565565    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.565652 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.565614    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cd43843-469c-40f8-871e-0d30dc302dc2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.565652 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.565639    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3cd43843-469c-40f8-871e-0d30dc302dc2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.565945 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.565662    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3cd43843-469c-40f8-871e-0d30dc302dc2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.565945 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.565692    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3cd43843-469c-40f8-871e-0d30dc302dc2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.565945 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.565723    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3cd43843-469c-40f8-871e-0d30dc302dc2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.565945 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.565761    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.565945 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.565813    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cd43843-469c-40f8-871e-0d30dc302dc2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.565945 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.565844    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.565945 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.565873    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lznkm\" (UniqueName: \"kubernetes.io/projected/3cd43843-469c-40f8-871e-0d30dc302dc2-kube-api-access-lznkm\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.565945 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.565901    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cd43843-469c-40f8-871e-0d30dc302dc2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.565945 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.565929    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.667084 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.667049    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.667317 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.667106    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cd43843-469c-40f8-871e-0d30dc302dc2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.667317 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.667164    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.667317 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.667189    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lznkm\" (UniqueName: \"kubernetes.io/projected/3cd43843-469c-40f8-871e-0d30dc302dc2-kube-api-access-lznkm\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.667317 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.667218    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cd43843-469c-40f8-871e-0d30dc302dc2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.667317 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.667243    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.667317 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.667297    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.667616 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.667324    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3cd43843-469c-40f8-871e-0d30dc302dc2-config-out\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.667616 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.667364    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-config\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.667616 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.667397    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.668176 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.668125    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cd43843-469c-40f8-871e-0d30dc302dc2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.668286 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.668261    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.668347 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.668309    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-web-config\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.668397 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.668350    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3cd43843-469c-40f8-871e-0d30dc302dc2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.668397 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.668376    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cd43843-469c-40f8-871e-0d30dc302dc2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.668505 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.668401    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cd43843-469c-40f8-871e-0d30dc302dc2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.668505 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.668412    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.668505 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.668471    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cd43843-469c-40f8-871e-0d30dc302dc2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.668505 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.668500    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3cd43843-469c-40f8-871e-0d30dc302dc2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.668716 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.668535    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3cd43843-469c-40f8-871e-0d30dc302dc2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.668716 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.668566    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3cd43843-469c-40f8-871e-0d30dc302dc2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.668716 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.668602    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3cd43843-469c-40f8-871e-0d30dc302dc2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.669225 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.669200    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3cd43843-469c-40f8-871e-0d30dc302dc2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.669850 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.669818    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3cd43843-469c-40f8-871e-0d30dc302dc2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.669935 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.669833    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cd43843-469c-40f8-871e-0d30dc302dc2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.672759 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.672728    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.673249 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.673182    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-config\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.673628 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.673514    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.673933 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.673790    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3cd43843-469c-40f8-871e-0d30dc302dc2-config-out\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.674034 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.674005    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cd43843-469c-40f8-871e-0d30dc302dc2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.674405 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.674381    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.674758 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.674645    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.675393 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.675371    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3cd43843-469c-40f8-871e-0d30dc302dc2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.675540 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.675498    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.678026 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.676281    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.678026 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.676687    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.678026 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.677119    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3cd43843-469c-40f8-871e-0d30dc302dc2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.678026 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.677996    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-web-config\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.679066 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.678954    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lznkm\" (UniqueName: \"kubernetes.io/projected/3cd43843-469c-40f8-871e-0d30dc302dc2-kube-api-access-lznkm\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.681084 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.681062    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3cd43843-469c-40f8-871e-0d30dc302dc2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:52.795052 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:52.794957    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:03:56.451256 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:56.451225    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 01:03:56.457346 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:03:56.457309    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cd43843_469c_40f8_871e_0d30dc302dc2.slice/crio-8b6c75917a51fa401782b4a06be83bd9d8dd066f07b9ed910391a5cc1687462a WatchSource:0}: Error finding container 8b6c75917a51fa401782b4a06be83bd9d8dd066f07b9ed910391a5cc1687462a: Status 404 returned error can't find the container with id 8b6c75917a51fa401782b4a06be83bd9d8dd066f07b9ed910391a5cc1687462a
Jul 06 01:03:56.464927 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:56.464893    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d67fb6459-k6wnr"]
Jul 06 01:03:56.474272 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:03:56.474246    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podded48176_1bb7_47cb_b939_14e34bbd5aec.slice/crio-bd86c90ce13cf6ec300c1fdcb98ffa7720503c913622e22452ecdb96d7c35174 WatchSource:0}: Error finding container bd86c90ce13cf6ec300c1fdcb98ffa7720503c913622e22452ecdb96d7c35174: Status 404 returned error can't find the container with id bd86c90ce13cf6ec300c1fdcb98ffa7720503c913622e22452ecdb96d7c35174
Jul 06 01:03:56.738444 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:56.738385    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-kwskq" event={"ID":"694f3a2a-bb7d-4089-8fd0-2810ac412f4a","Type":"ContainerStarted","Data":"c01c14adfa0ea93e33fa6208a4d59bbb2e4cd9f557ba86ef37f3b6df4e69a191"}
Jul 06 01:03:56.738628 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:56.738564    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-kwskq"
Jul 06 01:03:56.741205 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:56.741179    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g8m44" event={"ID":"e499a182-9627-48dd-847c-5c141d2fc798","Type":"ContainerStarted","Data":"d39560842f3ed3df0e33e58426af12b2cb21a1c8e02733c252ddfe527d1b1143"}
Jul 06 01:03:56.741314 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:56.741226    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g8m44" event={"ID":"e499a182-9627-48dd-847c-5c141d2fc798","Type":"ContainerStarted","Data":"afdaa33f3a9dd62b5f73c46bd5802aecb15f43a94a1b5c594f6ba47ee481d9bb"}
Jul 06 01:03:56.743036 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:56.743010    2562 generic.go:356] "Generic (PLEG): container finished" podID="509447eb-05c0-449a-9838-c05abf7e2f96" containerID="2eb2ffc18ae7c5a4b50b0084a97183117bc9fe82bac05fa15a0ade32f6898622" exitCode=0
Jul 06 01:03:56.743178 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:56.743091    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"509447eb-05c0-449a-9838-c05abf7e2f96","Type":"ContainerDied","Data":"2eb2ffc18ae7c5a4b50b0084a97183117bc9fe82bac05fa15a0ade32f6898622"}
Jul 06 01:03:56.745080 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:56.745058    2562 generic.go:356] "Generic (PLEG): container finished" podID="3cd43843-469c-40f8-871e-0d30dc302dc2" containerID="a748857f26ee0046908a9cef36b763bb42f0dff870b5f10f64bfbcfac1cdc892" exitCode=0
Jul 06 01:03:56.745198 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:56.745169    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3cd43843-469c-40f8-871e-0d30dc302dc2","Type":"ContainerDied","Data":"a748857f26ee0046908a9cef36b763bb42f0dff870b5f10f64bfbcfac1cdc892"}
Jul 06 01:03:56.745270 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:56.745235    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3cd43843-469c-40f8-871e-0d30dc302dc2","Type":"ContainerStarted","Data":"8b6c75917a51fa401782b4a06be83bd9d8dd066f07b9ed910391a5cc1687462a"}
Jul 06 01:03:56.751994 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:56.751970    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d67fb6459-k6wnr" event={"ID":"ded48176-1bb7-47cb-b939-14e34bbd5aec","Type":"ContainerStarted","Data":"bd86c90ce13cf6ec300c1fdcb98ffa7720503c913622e22452ecdb96d7c35174"}
Jul 06 01:03:56.753301 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:56.753261    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-kwskq"
Jul 06 01:03:56.754166 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:56.754030    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-kwskq" podStartSLOduration=1.633436942 podStartE2EDuration="18.754013066s" totalImagesPullingTime="17.120576124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:03:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:03:56.752791143 +0000 UTC m=+268.563766386" watchObservedRunningTime="2026-07-06 01:03:56.754013066 +0000 UTC m=+268.564988315"
Jul 06 01:03:56.770109 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:56.770054    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-g8m44" podStartSLOduration=9.224790769 podStartE2EDuration="10.77003993s" totalImagesPullingTime="1.459692509s" totalInitContainerRuntime="85.556652ms" isStatefulPod=true podCreationTimestamp="2026-07-06 01:03:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:03:56.769332396 +0000 UTC m=+268.580307676" watchObservedRunningTime="2026-07-06 01:03:56.77003993 +0000 UTC m=+268.581015173"
Jul 06 01:03:58.779996 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:58.779955    2562 patch_prober.go:28] interesting pod/image-registry-7df78dc57b-6tjqw container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 06 01:03:58.780990 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:03:58.780027    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7df78dc57b-6tjqw" podUID="b600de6e-1fed-4b68-bcd9-8939f55eca0a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 01:04:01.776235 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:01.775941    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"509447eb-05c0-449a-9838-c05abf7e2f96","Type":"ContainerStarted","Data":"a4ea00569a7d2a99be930db9d81d892d0b97817b29d20050a15417b89d6446b1"}
Jul 06 01:04:01.776235 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:01.776064    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"509447eb-05c0-449a-9838-c05abf7e2f96","Type":"ContainerStarted","Data":"5c51a5be444841cd0237939446d265105a8d691276b8959559b0f43dc7e07d4a"}
Jul 06 01:04:01.776235 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:01.776106    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"509447eb-05c0-449a-9838-c05abf7e2f96","Type":"ContainerStarted","Data":"a156f1ae32843b85216d1654f776c7e36a9dbb643c3eb0943f0def3e187c3aac"}
Jul 06 01:04:01.778639 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:01.778559    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3cd43843-469c-40f8-871e-0d30dc302dc2","Type":"ContainerStarted","Data":"fcf9863aab33285198a0d67375bfb073c6cf7414fbd57102b1b88fce0dc02b51"}
Jul 06 01:04:01.780430 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:01.780379    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d67fb6459-k6wnr" event={"ID":"ded48176-1bb7-47cb-b939-14e34bbd5aec","Type":"ContainerStarted","Data":"d3f2821731e452cc34d85cc2223960d82bcc605dc7edd938ddc3980ba03a2052"}
Jul 06 01:04:01.801039 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:01.799317    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7d67fb6459-k6wnr" podStartSLOduration=7.166389164 podStartE2EDuration="11.799295021s" totalImagesPullingTime="4.632905857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:03:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:04:01.79794815 +0000 UTC m=+273.608923394" watchObservedRunningTime="2026-07-06 01:04:01.799295021 +0000 UTC m=+273.610270264"
Jul 06 01:04:02.790720 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:02.790677    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"509447eb-05c0-449a-9838-c05abf7e2f96","Type":"ContainerStarted","Data":"df2d8eec26c1f06b796c1a88b3b55c1710cc23923263853c6bc47cbf056ce642"}
Jul 06 01:04:02.791212 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:02.790771    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"509447eb-05c0-449a-9838-c05abf7e2f96","Type":"ContainerStarted","Data":"446461e8eb37086b295befcda7902da8aee500de4621ee80ac18b49c081ecb82"}
Jul 06 01:04:02.799032 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:02.798993    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3cd43843-469c-40f8-871e-0d30dc302dc2","Type":"ContainerStarted","Data":"d6ef45da5b41d3d0c8d9e9905ac4ab613ceb72630938bc31558530e8b2bc80e1"}
Jul 06 01:04:03.791879 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:03.791610    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7df78dc57b-6tjqw" podUID="b600de6e-1fed-4b68-bcd9-8939f55eca0a" containerName="registry" containerID="cri-o://65189a4bc2835a0d8c8439ddb4adc2ebf8fa6c14b334f122885fd4729b8d8e04" gracePeriod=30
Jul 06 01:04:03.808529 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:03.808407    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"509447eb-05c0-449a-9838-c05abf7e2f96","Type":"ContainerStarted","Data":"7c58d347ce616cd7d5dbb5e263f23a30dfaaa9f99080f9983b84c8ea37b687dc"}
Jul 06 01:04:03.850141 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:03.849509    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.422473491 podStartE2EDuration="16.849483717s" totalImagesPullingTime="14.404435852s" totalInitContainerRuntime="22.574374ms" isStatefulPod=false podCreationTimestamp="2026-07-06 01:03:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:04:03.847226997 +0000 UTC m=+275.658202242" watchObservedRunningTime="2026-07-06 01:04:03.849483717 +0000 UTC m=+275.660458961"
Jul 06 01:04:04.474216 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:04.474183    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7df78dc57b-6tjqw"
Jul 06 01:04:04.597235 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:04.597138    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b600de6e-1fed-4b68-bcd9-8939f55eca0a-installation-pull-secrets\") pod \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\" (UID: \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\") "
Jul 06 01:04:04.597235 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:04.597204    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b600de6e-1fed-4b68-bcd9-8939f55eca0a-image-registry-private-configuration\") pod \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\" (UID: \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\") "
Jul 06 01:04:04.597470 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:04.597270    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b600de6e-1fed-4b68-bcd9-8939f55eca0a-trusted-ca\") pod \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\" (UID: \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\") "
Jul 06 01:04:04.597470 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:04.597312    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrbg2\" (UniqueName: \"kubernetes.io/projected/b600de6e-1fed-4b68-bcd9-8939f55eca0a-kube-api-access-mrbg2\") pod \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\" (UID: \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\") "
Jul 06 01:04:04.597470 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:04.597333    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b600de6e-1fed-4b68-bcd9-8939f55eca0a-registry-tls\") pod \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\" (UID: \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\") "
Jul 06 01:04:04.597470 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:04.597363    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b600de6e-1fed-4b68-bcd9-8939f55eca0a-registry-certificates\") pod \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\" (UID: \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\") "
Jul 06 01:04:04.597470 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:04.597393    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b600de6e-1fed-4b68-bcd9-8939f55eca0a-bound-sa-token\") pod \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\" (UID: \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\") "
Jul 06 01:04:04.597470 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:04.597450    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b600de6e-1fed-4b68-bcd9-8939f55eca0a-ca-trust-extracted\") pod \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\" (UID: \"b600de6e-1fed-4b68-bcd9-8939f55eca0a\") "
Jul 06 01:04:04.597789 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:04.597718    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b600de6e-1fed-4b68-bcd9-8939f55eca0a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b600de6e-1fed-4b68-bcd9-8939f55eca0a" (UID: "b600de6e-1fed-4b68-bcd9-8939f55eca0a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:04:04.598013 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:04.597831    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b600de6e-1fed-4b68-bcd9-8939f55eca0a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b600de6e-1fed-4b68-bcd9-8939f55eca0a" (UID: "b600de6e-1fed-4b68-bcd9-8939f55eca0a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:04:04.600106 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:04.600055    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b600de6e-1fed-4b68-bcd9-8939f55eca0a-kube-api-access-mrbg2" (OuterVolumeSpecName: "kube-api-access-mrbg2") pod "b600de6e-1fed-4b68-bcd9-8939f55eca0a" (UID: "b600de6e-1fed-4b68-bcd9-8939f55eca0a"). InnerVolumeSpecName "kube-api-access-mrbg2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:04:04.600372 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:04.600336    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b600de6e-1fed-4b68-bcd9-8939f55eca0a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b600de6e-1fed-4b68-bcd9-8939f55eca0a" (UID: "b600de6e-1fed-4b68-bcd9-8939f55eca0a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:04:04.600475 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:04.600336    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b600de6e-1fed-4b68-bcd9-8939f55eca0a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b600de6e-1fed-4b68-bcd9-8939f55eca0a" (UID: "b600de6e-1fed-4b68-bcd9-8939f55eca0a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:04:04.600607 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:04.600579    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b600de6e-1fed-4b68-bcd9-8939f55eca0a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b600de6e-1fed-4b68-bcd9-8939f55eca0a" (UID: "b600de6e-1fed-4b68-bcd9-8939f55eca0a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:04:04.601177 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:04.601131    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b600de6e-1fed-4b68-bcd9-8939f55eca0a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b600de6e-1fed-4b68-bcd9-8939f55eca0a" (UID: "b600de6e-1fed-4b68-bcd9-8939f55eca0a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:04:04.609211 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:04.609185    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b600de6e-1fed-4b68-bcd9-8939f55eca0a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b600de6e-1fed-4b68-bcd9-8939f55eca0a" (UID: "b600de6e-1fed-4b68-bcd9-8939f55eca0a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:04:04.698593 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:04.698552    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b600de6e-1fed-4b68-bcd9-8939f55eca0a-trusted-ca\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:04:04.698593 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:04.698585    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrbg2\" (UniqueName: \"kubernetes.io/projected/b600de6e-1fed-4b68-bcd9-8939f55eca0a-kube-api-access-mrbg2\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:04:04.698593 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:04.698594    2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b600de6e-1fed-4b68-bcd9-8939f55eca0a-registry-tls\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:04:04.698837 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:04.698606    2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b600de6e-1fed-4b68-bcd9-8939f55eca0a-registry-certificates\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:04:04.698837 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:04.698619    2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b600de6e-1fed-4b68-bcd9-8939f55eca0a-bound-sa-token\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:04:04.698837 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:04.698634    2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b600de6e-1fed-4b68-bcd9-8939f55eca0a-ca-trust-extracted\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:04:04.698837 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:04.698645    2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b600de6e-1fed-4b68-bcd9-8939f55eca0a-installation-pull-secrets\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:04:04.698837 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:04.698660    2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b600de6e-1fed-4b68-bcd9-8939f55eca0a-image-registry-private-configuration\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:04:04.814501 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:04.814466    2562 generic.go:356] "Generic (PLEG): container finished" podID="b600de6e-1fed-4b68-bcd9-8939f55eca0a" containerID="65189a4bc2835a0d8c8439ddb4adc2ebf8fa6c14b334f122885fd4729b8d8e04" exitCode=0
Jul 06 01:04:04.814897 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:04.814527    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7df78dc57b-6tjqw"
Jul 06 01:04:04.814897 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:04.814549    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7df78dc57b-6tjqw" event={"ID":"b600de6e-1fed-4b68-bcd9-8939f55eca0a","Type":"ContainerDied","Data":"65189a4bc2835a0d8c8439ddb4adc2ebf8fa6c14b334f122885fd4729b8d8e04"}
Jul 06 01:04:04.814897 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:04.814605    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7df78dc57b-6tjqw" event={"ID":"b600de6e-1fed-4b68-bcd9-8939f55eca0a","Type":"ContainerDied","Data":"da620739ee01c45d3413196610cb6d7a2aac47cb2b81f14a9eda4806fe3f9987"}
Jul 06 01:04:04.814897 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:04.814635    2562 scope.go:117] "RemoveContainer" containerID="65189a4bc2835a0d8c8439ddb4adc2ebf8fa6c14b334f122885fd4729b8d8e04"
Jul 06 01:04:04.824315 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:04.824292    2562 scope.go:117] "RemoveContainer" containerID="65189a4bc2835a0d8c8439ddb4adc2ebf8fa6c14b334f122885fd4729b8d8e04"
Jul 06 01:04:04.824656 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:04:04.824628    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65189a4bc2835a0d8c8439ddb4adc2ebf8fa6c14b334f122885fd4729b8d8e04\": container with ID starting with 65189a4bc2835a0d8c8439ddb4adc2ebf8fa6c14b334f122885fd4729b8d8e04 not found: ID does not exist" containerID="65189a4bc2835a0d8c8439ddb4adc2ebf8fa6c14b334f122885fd4729b8d8e04"
Jul 06 01:04:04.824769 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:04.824660    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65189a4bc2835a0d8c8439ddb4adc2ebf8fa6c14b334f122885fd4729b8d8e04"} err="failed to get container status \"65189a4bc2835a0d8c8439ddb4adc2ebf8fa6c14b334f122885fd4729b8d8e04\": rpc error: code = NotFound desc = could not find container \"65189a4bc2835a0d8c8439ddb4adc2ebf8fa6c14b334f122885fd4729b8d8e04\": container with ID starting with 65189a4bc2835a0d8c8439ddb4adc2ebf8fa6c14b334f122885fd4729b8d8e04 not found: ID does not exist"
Jul 06 01:04:04.834218 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:04.834194    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7df78dc57b-6tjqw"]
Jul 06 01:04:04.838781 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:04.838761    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7df78dc57b-6tjqw"]
Jul 06 01:04:05.822048 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:05.822002    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3cd43843-469c-40f8-871e-0d30dc302dc2","Type":"ContainerStarted","Data":"1806a82347136cee3351bd9c226b554519e735a33732ba50ba30f44b04f4a4af"}
Jul 06 01:04:05.822636 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:05.822127    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3cd43843-469c-40f8-871e-0d30dc302dc2","Type":"ContainerStarted","Data":"f8824ec1995bd74bb31065a31a64380c7664604984dd2a924ec2f5506e767c6e"}
Jul 06 01:04:05.822636 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:05.822193    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3cd43843-469c-40f8-871e-0d30dc302dc2","Type":"ContainerStarted","Data":"2db9a99c1a60e3782a8624bc8a6eb8058d3ff9c9607404c686bc9916a7e4b6a7"}
Jul 06 01:04:05.822636 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:05.822232    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3cd43843-469c-40f8-871e-0d30dc302dc2","Type":"ContainerStarted","Data":"9777e0fbb8f2ed0799572354cb8355a3cfe9b7e04b20aafa5e65baba10628347"}
Jul 06 01:04:05.861868 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:05.861812    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=6.111567263 podStartE2EDuration="13.861793851s" totalImagesPullingTime="7.726712421s" totalInitContainerRuntime="23.514167ms" isStatefulPod=false podCreationTimestamp="2026-07-06 01:03:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:04:05.858132163 +0000 UTC m=+277.669107405" watchObservedRunningTime="2026-07-06 01:04:05.861793851 +0000 UTC m=+277.672769093"
Jul 06 01:04:06.751028 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:06.750993    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b600de6e-1fed-4b68-bcd9-8939f55eca0a" path="/var/lib/kubelet/pods/b600de6e-1fed-4b68-bcd9-8939f55eca0a/volumes"
Jul 06 01:04:07.796007 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:07.795970    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:04:09.368385 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:04:09.368346    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-wzts5" podUID="ed4b54f1-1212-4ce2-b731-13bca488ecb3"
Jul 06 01:04:09.837723 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:09.837643    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wzts5"
Jul 06 01:04:11.003706 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:11.003666    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7d67fb6459-k6wnr"
Jul 06 01:04:11.004117 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:11.003733    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7d67fb6459-k6wnr"
Jul 06 01:04:12.975642 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:12.975597    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed4b54f1-1212-4ce2-b731-13bca488ecb3-metrics-tls\") pod \"dns-default-wzts5\" (UID: \"ed4b54f1-1212-4ce2-b731-13bca488ecb3\") " pod="openshift-dns/dns-default-wzts5"
Jul 06 01:04:12.977872 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:12.977852    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed4b54f1-1212-4ce2-b731-13bca488ecb3-metrics-tls\") pod \"dns-default-wzts5\" (UID: \"ed4b54f1-1212-4ce2-b731-13bca488ecb3\") " pod="openshift-dns/dns-default-wzts5"
Jul 06 01:04:13.141579 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:13.141544    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lh7x6\""
Jul 06 01:04:13.149011 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:13.148989    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wzts5"
Jul 06 01:04:13.319963 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:13.319942    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wzts5"]
Jul 06 01:04:13.322481 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:04:13.322445    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded4b54f1_1212_4ce2_b731_13bca488ecb3.slice/crio-26de0480faceffe31dbe750e2a121d2bfa4a60c1d9b89dfbcd23adb9b19087f1 WatchSource:0}: Error finding container 26de0480faceffe31dbe750e2a121d2bfa4a60c1d9b89dfbcd23adb9b19087f1: Status 404 returned error can't find the container with id 26de0480faceffe31dbe750e2a121d2bfa4a60c1d9b89dfbcd23adb9b19087f1
Jul 06 01:04:13.859105 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:13.859070    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wzts5" event={"ID":"ed4b54f1-1212-4ce2-b731-13bca488ecb3","Type":"ContainerStarted","Data":"26de0480faceffe31dbe750e2a121d2bfa4a60c1d9b89dfbcd23adb9b19087f1"}
Jul 06 01:04:15.869967 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:15.869930    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wzts5" event={"ID":"ed4b54f1-1212-4ce2-b731-13bca488ecb3","Type":"ContainerStarted","Data":"6cae8c58c4e9c3b3807860118651c764696c4f20bf854114883984e7321a2224"}
Jul 06 01:04:15.870346 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:15.869985    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wzts5" event={"ID":"ed4b54f1-1212-4ce2-b731-13bca488ecb3","Type":"ContainerStarted","Data":"8464529762b22c266fb968727894f7b379511b217040924dbc798a433cf9e4cd"}
Jul 06 01:04:15.870346 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:15.870030    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wzts5"
Jul 06 01:04:15.893526 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:15.893477    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wzts5" podStartSLOduration=251.722404567 podStartE2EDuration="4m13.893461596s" totalImagesPullingTime="2.171057029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:00:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:04:15.8925814 +0000 UTC m=+287.703556656" watchObservedRunningTime="2026-07-06 01:04:15.893461596 +0000 UTC m=+287.704436850"
Jul 06 01:04:25.875965 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:25.875937    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wzts5"
Jul 06 01:04:28.580415 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:28.580392    2562 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 01:04:28.926374 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:28.926340    2562 generic.go:356] "Generic (PLEG): container finished" podID="34ddfe44-f552-4ad2-b62f-bc46c1e9ba21" containerID="94cd289029a2f8b37663049f94af6f03bf7bfb4e73df9e251a9c88a0aef640a9" exitCode=0
Jul 06 01:04:28.926578 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:28.926382    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rlqrz" event={"ID":"34ddfe44-f552-4ad2-b62f-bc46c1e9ba21","Type":"ContainerDied","Data":"94cd289029a2f8b37663049f94af6f03bf7bfb4e73df9e251a9c88a0aef640a9"}
Jul 06 01:04:28.926704 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:28.926692    2562 scope.go:117] "RemoveContainer" containerID="94cd289029a2f8b37663049f94af6f03bf7bfb4e73df9e251a9c88a0aef640a9"
Jul 06 01:04:29.931563 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:29.931527    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-rlqrz" event={"ID":"34ddfe44-f552-4ad2-b62f-bc46c1e9ba21","Type":"ContainerStarted","Data":"9273a122613b1917a6acd3177710eb6e1cc4f8f602fe44413110c6ad04499e5f"}
Jul 06 01:04:31.008601 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:31.008572    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7d67fb6459-k6wnr"
Jul 06 01:04:31.012398 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:31.012374    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7d67fb6459-k6wnr"
Jul 06 01:04:31.156017 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:31.155987    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wzts5_ed4b54f1-1212-4ce2-b731-13bca488ecb3/dns/0.log"
Jul 06 01:04:31.355854 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:31.355823    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wzts5_ed4b54f1-1212-4ce2-b731-13bca488ecb3/kube-rbac-proxy/0.log"
Jul 06 01:04:31.558129 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:31.558094    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4fmfs_f19b579f-765e-455e-92c2-602da92d5bb2/dns-node-resolver/0.log"
Jul 06 01:04:32.556676 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:32.556636    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vv5dh_826bcf71-9bfe-418b-9d64-410edfad23df/serve-healthcheck-canary/0.log"
Jul 06 01:04:52.795274 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:52.795239    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:04:52.813940 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:52.813910    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:04:53.049928 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:04:53.049861    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:06.560900 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:06.560857    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 01:05:06.561527 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:06.561294    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="509447eb-05c0-449a-9838-c05abf7e2f96" containerName="alertmanager" containerID="cri-o://a156f1ae32843b85216d1654f776c7e36a9dbb643c3eb0943f0def3e187c3aac" gracePeriod=120
Jul 06 01:05:06.561527 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:06.561371    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="509447eb-05c0-449a-9838-c05abf7e2f96" containerName="kube-rbac-proxy-metric" containerID="cri-o://df2d8eec26c1f06b796c1a88b3b55c1710cc23923263853c6bc47cbf056ce642" gracePeriod=120
Jul 06 01:05:06.561527 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:06.561406    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="509447eb-05c0-449a-9838-c05abf7e2f96" containerName="prom-label-proxy" containerID="cri-o://7c58d347ce616cd7d5dbb5e263f23a30dfaaa9f99080f9983b84c8ea37b687dc" gracePeriod=120
Jul 06 01:05:06.561527 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:06.561447    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="509447eb-05c0-449a-9838-c05abf7e2f96" containerName="kube-rbac-proxy" containerID="cri-o://446461e8eb37086b295befcda7902da8aee500de4621ee80ac18b49c081ecb82" gracePeriod=120
Jul 06 01:05:06.561527 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:06.561450    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="509447eb-05c0-449a-9838-c05abf7e2f96" containerName="kube-rbac-proxy-web" containerID="cri-o://a4ea00569a7d2a99be930db9d81d892d0b97817b29d20050a15417b89d6446b1" gracePeriod=120
Jul 06 01:05:06.561527 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:06.561483    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="509447eb-05c0-449a-9838-c05abf7e2f96" containerName="config-reloader" containerID="cri-o://5c51a5be444841cd0237939446d265105a8d691276b8959559b0f43dc7e07d4a" gracePeriod=120
Jul 06 01:05:07.088595 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.088565    2562 generic.go:356] "Generic (PLEG): container finished" podID="509447eb-05c0-449a-9838-c05abf7e2f96" containerID="7c58d347ce616cd7d5dbb5e263f23a30dfaaa9f99080f9983b84c8ea37b687dc" exitCode=0
Jul 06 01:05:07.088595 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.088589    2562 generic.go:356] "Generic (PLEG): container finished" podID="509447eb-05c0-449a-9838-c05abf7e2f96" containerID="446461e8eb37086b295befcda7902da8aee500de4621ee80ac18b49c081ecb82" exitCode=0
Jul 06 01:05:07.088595 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.088595    2562 generic.go:356] "Generic (PLEG): container finished" podID="509447eb-05c0-449a-9838-c05abf7e2f96" containerID="5c51a5be444841cd0237939446d265105a8d691276b8959559b0f43dc7e07d4a" exitCode=0
Jul 06 01:05:07.088595 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.088601    2562 generic.go:356] "Generic (PLEG): container finished" podID="509447eb-05c0-449a-9838-c05abf7e2f96" containerID="a156f1ae32843b85216d1654f776c7e36a9dbb643c3eb0943f0def3e187c3aac" exitCode=0
Jul 06 01:05:07.088856 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.088631    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"509447eb-05c0-449a-9838-c05abf7e2f96","Type":"ContainerDied","Data":"7c58d347ce616cd7d5dbb5e263f23a30dfaaa9f99080f9983b84c8ea37b687dc"}
Jul 06 01:05:07.088856 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.088702    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"509447eb-05c0-449a-9838-c05abf7e2f96","Type":"ContainerDied","Data":"446461e8eb37086b295befcda7902da8aee500de4621ee80ac18b49c081ecb82"}
Jul 06 01:05:07.088856 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.088734    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"509447eb-05c0-449a-9838-c05abf7e2f96","Type":"ContainerDied","Data":"5c51a5be444841cd0237939446d265105a8d691276b8959559b0f43dc7e07d4a"}
Jul 06 01:05:07.088856 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.088761    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"509447eb-05c0-449a-9838-c05abf7e2f96","Type":"ContainerDied","Data":"a156f1ae32843b85216d1654f776c7e36a9dbb643c3eb0943f0def3e187c3aac"}
Jul 06 01:05:07.812047 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.812023    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:07.862703 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.862673    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/509447eb-05c0-449a-9838-c05abf7e2f96-cluster-tls-config\") pod \"509447eb-05c0-449a-9838-c05abf7e2f96\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") "
Jul 06 01:05:07.862881 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.862726    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/509447eb-05c0-449a-9838-c05abf7e2f96-config-volume\") pod \"509447eb-05c0-449a-9838-c05abf7e2f96\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") "
Jul 06 01:05:07.862881 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.862754    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/509447eb-05c0-449a-9838-c05abf7e2f96-secret-alertmanager-kube-rbac-proxy-web\") pod \"509447eb-05c0-449a-9838-c05abf7e2f96\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") "
Jul 06 01:05:07.862881 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.862785    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/509447eb-05c0-449a-9838-c05abf7e2f96-secret-alertmanager-main-tls\") pod \"509447eb-05c0-449a-9838-c05abf7e2f96\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") "
Jul 06 01:05:07.862881 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.862810    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/509447eb-05c0-449a-9838-c05abf7e2f96-web-config\") pod \"509447eb-05c0-449a-9838-c05abf7e2f96\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") "
Jul 06 01:05:07.862881 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.862839    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/509447eb-05c0-449a-9838-c05abf7e2f96-alertmanager-main-db\") pod \"509447eb-05c0-449a-9838-c05abf7e2f96\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") "
Jul 06 01:05:07.862881 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.862869    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/509447eb-05c0-449a-9838-c05abf7e2f96-config-out\") pod \"509447eb-05c0-449a-9838-c05abf7e2f96\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") "
Jul 06 01:05:07.863254 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.862899    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/509447eb-05c0-449a-9838-c05abf7e2f96-metrics-client-ca\") pod \"509447eb-05c0-449a-9838-c05abf7e2f96\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") "
Jul 06 01:05:07.863254 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.862941    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/509447eb-05c0-449a-9838-c05abf7e2f96-secret-alertmanager-kube-rbac-proxy\") pod \"509447eb-05c0-449a-9838-c05abf7e2f96\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") "
Jul 06 01:05:07.863254 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.862972    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/509447eb-05c0-449a-9838-c05abf7e2f96-alertmanager-trusted-ca-bundle\") pod \"509447eb-05c0-449a-9838-c05abf7e2f96\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") "
Jul 06 01:05:07.863254 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.863050    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/509447eb-05c0-449a-9838-c05abf7e2f96-tls-assets\") pod \"509447eb-05c0-449a-9838-c05abf7e2f96\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") "
Jul 06 01:05:07.863254 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.863079    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dndqr\" (UniqueName: \"kubernetes.io/projected/509447eb-05c0-449a-9838-c05abf7e2f96-kube-api-access-dndqr\") pod \"509447eb-05c0-449a-9838-c05abf7e2f96\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") "
Jul 06 01:05:07.863254 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.863133    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/509447eb-05c0-449a-9838-c05abf7e2f96-secret-alertmanager-kube-rbac-proxy-metric\") pod \"509447eb-05c0-449a-9838-c05abf7e2f96\" (UID: \"509447eb-05c0-449a-9838-c05abf7e2f96\") "
Jul 06 01:05:07.863553 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.863519    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/509447eb-05c0-449a-9838-c05abf7e2f96-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "509447eb-05c0-449a-9838-c05abf7e2f96" (UID: "509447eb-05c0-449a-9838-c05abf7e2f96"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:05:07.864770 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.864338    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/509447eb-05c0-449a-9838-c05abf7e2f96-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "509447eb-05c0-449a-9838-c05abf7e2f96" (UID: "509447eb-05c0-449a-9838-c05abf7e2f96"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:05:07.864959 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.864896    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/509447eb-05c0-449a-9838-c05abf7e2f96-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "509447eb-05c0-449a-9838-c05abf7e2f96" (UID: "509447eb-05c0-449a-9838-c05abf7e2f96"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:05:07.865905 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.865879    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/509447eb-05c0-449a-9838-c05abf7e2f96-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "509447eb-05c0-449a-9838-c05abf7e2f96" (UID: "509447eb-05c0-449a-9838-c05abf7e2f96"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:05:07.868272 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.867618    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/509447eb-05c0-449a-9838-c05abf7e2f96-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "509447eb-05c0-449a-9838-c05abf7e2f96" (UID: "509447eb-05c0-449a-9838-c05abf7e2f96"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:05:07.868272 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.867897    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/509447eb-05c0-449a-9838-c05abf7e2f96-kube-api-access-dndqr" (OuterVolumeSpecName: "kube-api-access-dndqr") pod "509447eb-05c0-449a-9838-c05abf7e2f96" (UID: "509447eb-05c0-449a-9838-c05abf7e2f96"). InnerVolumeSpecName "kube-api-access-dndqr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:05:07.868432 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.868321    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/509447eb-05c0-449a-9838-c05abf7e2f96-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "509447eb-05c0-449a-9838-c05abf7e2f96" (UID: "509447eb-05c0-449a-9838-c05abf7e2f96"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:05:07.868720 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.868685    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/509447eb-05c0-449a-9838-c05abf7e2f96-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "509447eb-05c0-449a-9838-c05abf7e2f96" (UID: "509447eb-05c0-449a-9838-c05abf7e2f96"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:05:07.868979 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.868936    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/509447eb-05c0-449a-9838-c05abf7e2f96-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "509447eb-05c0-449a-9838-c05abf7e2f96" (UID: "509447eb-05c0-449a-9838-c05abf7e2f96"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:05:07.869144 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.869113    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/509447eb-05c0-449a-9838-c05abf7e2f96-config-volume" (OuterVolumeSpecName: "config-volume") pod "509447eb-05c0-449a-9838-c05abf7e2f96" (UID: "509447eb-05c0-449a-9838-c05abf7e2f96"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:05:07.869393 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.869360    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/509447eb-05c0-449a-9838-c05abf7e2f96-config-out" (OuterVolumeSpecName: "config-out") pod "509447eb-05c0-449a-9838-c05abf7e2f96" (UID: "509447eb-05c0-449a-9838-c05abf7e2f96"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:05:07.873123 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.873100    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/509447eb-05c0-449a-9838-c05abf7e2f96-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "509447eb-05c0-449a-9838-c05abf7e2f96" (UID: "509447eb-05c0-449a-9838-c05abf7e2f96"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:05:07.878641 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.878620    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/509447eb-05c0-449a-9838-c05abf7e2f96-web-config" (OuterVolumeSpecName: "web-config") pod "509447eb-05c0-449a-9838-c05abf7e2f96" (UID: "509447eb-05c0-449a-9838-c05abf7e2f96"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:05:07.964189 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.964093    2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/509447eb-05c0-449a-9838-c05abf7e2f96-tls-assets\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:05:07.964189 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.964121    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dndqr\" (UniqueName: \"kubernetes.io/projected/509447eb-05c0-449a-9838-c05abf7e2f96-kube-api-access-dndqr\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:05:07.964189 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.964133    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/509447eb-05c0-449a-9838-c05abf7e2f96-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:05:07.964189 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.964145    2562 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/509447eb-05c0-449a-9838-c05abf7e2f96-cluster-tls-config\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:05:07.964189 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.964177    2562 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/509447eb-05c0-449a-9838-c05abf7e2f96-config-volume\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:05:07.964189 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.964186    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/509447eb-05c0-449a-9838-c05abf7e2f96-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:05:07.964189 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.964197    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/509447eb-05c0-449a-9838-c05abf7e2f96-secret-alertmanager-main-tls\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:05:07.964503 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.964223    2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/509447eb-05c0-449a-9838-c05abf7e2f96-web-config\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:05:07.964503 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.964232    2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/509447eb-05c0-449a-9838-c05abf7e2f96-alertmanager-main-db\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:05:07.964503 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.964241    2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/509447eb-05c0-449a-9838-c05abf7e2f96-config-out\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:05:07.964503 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.964250    2562 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/509447eb-05c0-449a-9838-c05abf7e2f96-metrics-client-ca\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:05:07.964503 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.964257    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/509447eb-05c0-449a-9838-c05abf7e2f96-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:05:07.964503 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:07.964266    2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/509447eb-05c0-449a-9838-c05abf7e2f96-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:05:08.095320 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.095288    2562 generic.go:356] "Generic (PLEG): container finished" podID="509447eb-05c0-449a-9838-c05abf7e2f96" containerID="df2d8eec26c1f06b796c1a88b3b55c1710cc23923263853c6bc47cbf056ce642" exitCode=0
Jul 06 01:05:08.095320 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.095312    2562 generic.go:356] "Generic (PLEG): container finished" podID="509447eb-05c0-449a-9838-c05abf7e2f96" containerID="a4ea00569a7d2a99be930db9d81d892d0b97817b29d20050a15417b89d6446b1" exitCode=0
Jul 06 01:05:08.095536 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.095349    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"509447eb-05c0-449a-9838-c05abf7e2f96","Type":"ContainerDied","Data":"df2d8eec26c1f06b796c1a88b3b55c1710cc23923263853c6bc47cbf056ce642"}
Jul 06 01:05:08.095536 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.095376    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:08.095536 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.095406    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"509447eb-05c0-449a-9838-c05abf7e2f96","Type":"ContainerDied","Data":"a4ea00569a7d2a99be930db9d81d892d0b97817b29d20050a15417b89d6446b1"}
Jul 06 01:05:08.095536 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.095432    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"509447eb-05c0-449a-9838-c05abf7e2f96","Type":"ContainerDied","Data":"2f9e2205fc3ba7d893b2127ee698884bf4bf7494405937ba54550cef089047cb"}
Jul 06 01:05:08.095536 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.095464    2562 scope.go:117] "RemoveContainer" containerID="7c58d347ce616cd7d5dbb5e263f23a30dfaaa9f99080f9983b84c8ea37b687dc"
Jul 06 01:05:08.105563 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.105535    2562 scope.go:117] "RemoveContainer" containerID="df2d8eec26c1f06b796c1a88b3b55c1710cc23923263853c6bc47cbf056ce642"
Jul 06 01:05:08.113017 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.113000    2562 scope.go:117] "RemoveContainer" containerID="446461e8eb37086b295befcda7902da8aee500de4621ee80ac18b49c081ecb82"
Jul 06 01:05:08.120980 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.120956    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 01:05:08.121524 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.121507    2562 scope.go:117] "RemoveContainer" containerID="a4ea00569a7d2a99be930db9d81d892d0b97817b29d20050a15417b89d6446b1"
Jul 06 01:05:08.124638 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.124613    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 01:05:08.129758 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.129740    2562 scope.go:117] "RemoveContainer" containerID="5c51a5be444841cd0237939446d265105a8d691276b8959559b0f43dc7e07d4a"
Jul 06 01:05:08.136914 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.136885    2562 scope.go:117] "RemoveContainer" containerID="a156f1ae32843b85216d1654f776c7e36a9dbb643c3eb0943f0def3e187c3aac"
Jul 06 01:05:08.144584 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.144564    2562 scope.go:117] "RemoveContainer" containerID="2eb2ffc18ae7c5a4b50b0084a97183117bc9fe82bac05fa15a0ade32f6898622"
Jul 06 01:05:08.150456 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.150434    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 01:05:08.150779 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.150763    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="509447eb-05c0-449a-9838-c05abf7e2f96" containerName="kube-rbac-proxy"
Jul 06 01:05:08.150845 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.150784    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="509447eb-05c0-449a-9838-c05abf7e2f96" containerName="kube-rbac-proxy"
Jul 06 01:05:08.150845 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.150796    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="509447eb-05c0-449a-9838-c05abf7e2f96" containerName="kube-rbac-proxy-metric"
Jul 06 01:05:08.150845 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.150805    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="509447eb-05c0-449a-9838-c05abf7e2f96" containerName="kube-rbac-proxy-metric"
Jul 06 01:05:08.150845 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.150818    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="509447eb-05c0-449a-9838-c05abf7e2f96" containerName="kube-rbac-proxy-web"
Jul 06 01:05:08.150845 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.150827    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="509447eb-05c0-449a-9838-c05abf7e2f96" containerName="kube-rbac-proxy-web"
Jul 06 01:05:08.150845 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.150846    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="509447eb-05c0-449a-9838-c05abf7e2f96" containerName="init-config-reloader"
Jul 06 01:05:08.151143 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.150854    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="509447eb-05c0-449a-9838-c05abf7e2f96" containerName="init-config-reloader"
Jul 06 01:05:08.151143 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.150864    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b600de6e-1fed-4b68-bcd9-8939f55eca0a" containerName="registry"
Jul 06 01:05:08.151143 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.150872    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b600de6e-1fed-4b68-bcd9-8939f55eca0a" containerName="registry"
Jul 06 01:05:08.151143 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.150883    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="509447eb-05c0-449a-9838-c05abf7e2f96" containerName="alertmanager"
Jul 06 01:05:08.151143 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.150891    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="509447eb-05c0-449a-9838-c05abf7e2f96" containerName="alertmanager"
Jul 06 01:05:08.151143 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.150904    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="509447eb-05c0-449a-9838-c05abf7e2f96" containerName="prom-label-proxy"
Jul 06 01:05:08.151143 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.150912    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="509447eb-05c0-449a-9838-c05abf7e2f96" containerName="prom-label-proxy"
Jul 06 01:05:08.151143 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.150927    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="509447eb-05c0-449a-9838-c05abf7e2f96" containerName="config-reloader"
Jul 06 01:05:08.151143 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.150936    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="509447eb-05c0-449a-9838-c05abf7e2f96" containerName="config-reloader"
Jul 06 01:05:08.151143 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.151012    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="509447eb-05c0-449a-9838-c05abf7e2f96" containerName="kube-rbac-proxy-web"
Jul 06 01:05:08.151143 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.151026    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="509447eb-05c0-449a-9838-c05abf7e2f96" containerName="alertmanager"
Jul 06 01:05:08.151143 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.151036    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="509447eb-05c0-449a-9838-c05abf7e2f96" containerName="kube-rbac-proxy-metric"
Jul 06 01:05:08.151143 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.151046    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b600de6e-1fed-4b68-bcd9-8939f55eca0a" containerName="registry"
Jul 06 01:05:08.151143 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.151056    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="509447eb-05c0-449a-9838-c05abf7e2f96" containerName="config-reloader"
Jul 06 01:05:08.151143 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.151065    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="509447eb-05c0-449a-9838-c05abf7e2f96" containerName="prom-label-proxy"
Jul 06 01:05:08.151143 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.151075    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="509447eb-05c0-449a-9838-c05abf7e2f96" containerName="kube-rbac-proxy"
Jul 06 01:05:08.152340 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.152323    2562 scope.go:117] "RemoveContainer" containerID="7c58d347ce616cd7d5dbb5e263f23a30dfaaa9f99080f9983b84c8ea37b687dc"
Jul 06 01:05:08.152661 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:05:08.152635    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c58d347ce616cd7d5dbb5e263f23a30dfaaa9f99080f9983b84c8ea37b687dc\": container with ID starting with 7c58d347ce616cd7d5dbb5e263f23a30dfaaa9f99080f9983b84c8ea37b687dc not found: ID does not exist" containerID="7c58d347ce616cd7d5dbb5e263f23a30dfaaa9f99080f9983b84c8ea37b687dc"
Jul 06 01:05:08.152738 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.152668    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c58d347ce616cd7d5dbb5e263f23a30dfaaa9f99080f9983b84c8ea37b687dc"} err="failed to get container status \"7c58d347ce616cd7d5dbb5e263f23a30dfaaa9f99080f9983b84c8ea37b687dc\": rpc error: code = NotFound desc = could not find container \"7c58d347ce616cd7d5dbb5e263f23a30dfaaa9f99080f9983b84c8ea37b687dc\": container with ID starting with 7c58d347ce616cd7d5dbb5e263f23a30dfaaa9f99080f9983b84c8ea37b687dc not found: ID does not exist"
Jul 06 01:05:08.152738 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.152687    2562 scope.go:117] "RemoveContainer" containerID="df2d8eec26c1f06b796c1a88b3b55c1710cc23923263853c6bc47cbf056ce642"
Jul 06 01:05:08.152959 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:05:08.152941    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df2d8eec26c1f06b796c1a88b3b55c1710cc23923263853c6bc47cbf056ce642\": container with ID starting with df2d8eec26c1f06b796c1a88b3b55c1710cc23923263853c6bc47cbf056ce642 not found: ID does not exist" containerID="df2d8eec26c1f06b796c1a88b3b55c1710cc23923263853c6bc47cbf056ce642"
Jul 06 01:05:08.153004 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.152971    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df2d8eec26c1f06b796c1a88b3b55c1710cc23923263853c6bc47cbf056ce642"} err="failed to get container status \"df2d8eec26c1f06b796c1a88b3b55c1710cc23923263853c6bc47cbf056ce642\": rpc error: code = NotFound desc = could not find container \"df2d8eec26c1f06b796c1a88b3b55c1710cc23923263853c6bc47cbf056ce642\": container with ID starting with df2d8eec26c1f06b796c1a88b3b55c1710cc23923263853c6bc47cbf056ce642 not found: ID does not exist"
Jul 06 01:05:08.153004 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.152989    2562 scope.go:117] "RemoveContainer" containerID="446461e8eb37086b295befcda7902da8aee500de4621ee80ac18b49c081ecb82"
Jul 06 01:05:08.153225 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:05:08.153205    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"446461e8eb37086b295befcda7902da8aee500de4621ee80ac18b49c081ecb82\": container with ID starting with 446461e8eb37086b295befcda7902da8aee500de4621ee80ac18b49c081ecb82 not found: ID does not exist" containerID="446461e8eb37086b295befcda7902da8aee500de4621ee80ac18b49c081ecb82"
Jul 06 01:05:08.153328 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.153225    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"446461e8eb37086b295befcda7902da8aee500de4621ee80ac18b49c081ecb82"} err="failed to get container status \"446461e8eb37086b295befcda7902da8aee500de4621ee80ac18b49c081ecb82\": rpc error: code = NotFound desc = could not find container \"446461e8eb37086b295befcda7902da8aee500de4621ee80ac18b49c081ecb82\": container with ID starting with 446461e8eb37086b295befcda7902da8aee500de4621ee80ac18b49c081ecb82 not found: ID does not exist"
Jul 06 01:05:08.153328 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.153237    2562 scope.go:117] "RemoveContainer" containerID="a4ea00569a7d2a99be930db9d81d892d0b97817b29d20050a15417b89d6446b1"
Jul 06 01:05:08.153475 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:05:08.153458    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4ea00569a7d2a99be930db9d81d892d0b97817b29d20050a15417b89d6446b1\": container with ID starting with a4ea00569a7d2a99be930db9d81d892d0b97817b29d20050a15417b89d6446b1 not found: ID does not exist" containerID="a4ea00569a7d2a99be930db9d81d892d0b97817b29d20050a15417b89d6446b1"
Jul 06 01:05:08.153518 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.153479    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4ea00569a7d2a99be930db9d81d892d0b97817b29d20050a15417b89d6446b1"} err="failed to get container status \"a4ea00569a7d2a99be930db9d81d892d0b97817b29d20050a15417b89d6446b1\": rpc error: code = NotFound desc = could not find container \"a4ea00569a7d2a99be930db9d81d892d0b97817b29d20050a15417b89d6446b1\": container with ID starting with a4ea00569a7d2a99be930db9d81d892d0b97817b29d20050a15417b89d6446b1 not found: ID does not exist"
Jul 06 01:05:08.153518 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.153493    2562 scope.go:117] "RemoveContainer" containerID="5c51a5be444841cd0237939446d265105a8d691276b8959559b0f43dc7e07d4a"
Jul 06 01:05:08.153707 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:05:08.153693    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c51a5be444841cd0237939446d265105a8d691276b8959559b0f43dc7e07d4a\": container with ID starting with 5c51a5be444841cd0237939446d265105a8d691276b8959559b0f43dc7e07d4a not found: ID does not exist" containerID="5c51a5be444841cd0237939446d265105a8d691276b8959559b0f43dc7e07d4a"
Jul 06 01:05:08.153707 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.153708    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c51a5be444841cd0237939446d265105a8d691276b8959559b0f43dc7e07d4a"} err="failed to get container status \"5c51a5be444841cd0237939446d265105a8d691276b8959559b0f43dc7e07d4a\": rpc error: code = NotFound desc = could not find container \"5c51a5be444841cd0237939446d265105a8d691276b8959559b0f43dc7e07d4a\": container with ID starting with 5c51a5be444841cd0237939446d265105a8d691276b8959559b0f43dc7e07d4a not found: ID does not exist"
Jul 06 01:05:08.153707 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.153719    2562 scope.go:117] "RemoveContainer" containerID="a156f1ae32843b85216d1654f776c7e36a9dbb643c3eb0943f0def3e187c3aac"
Jul 06 01:05:08.153924 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:05:08.153906    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a156f1ae32843b85216d1654f776c7e36a9dbb643c3eb0943f0def3e187c3aac\": container with ID starting with a156f1ae32843b85216d1654f776c7e36a9dbb643c3eb0943f0def3e187c3aac not found: ID does not exist" containerID="a156f1ae32843b85216d1654f776c7e36a9dbb643c3eb0943f0def3e187c3aac"
Jul 06 01:05:08.153969 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.153927    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a156f1ae32843b85216d1654f776c7e36a9dbb643c3eb0943f0def3e187c3aac"} err="failed to get container status \"a156f1ae32843b85216d1654f776c7e36a9dbb643c3eb0943f0def3e187c3aac\": rpc error: code = NotFound desc = could not find container \"a156f1ae32843b85216d1654f776c7e36a9dbb643c3eb0943f0def3e187c3aac\": container with ID starting with a156f1ae32843b85216d1654f776c7e36a9dbb643c3eb0943f0def3e187c3aac not found: ID does not exist"
Jul 06 01:05:08.153969 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.153938    2562 scope.go:117] "RemoveContainer" containerID="2eb2ffc18ae7c5a4b50b0084a97183117bc9fe82bac05fa15a0ade32f6898622"
Jul 06 01:05:08.154184 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:05:08.154166    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2eb2ffc18ae7c5a4b50b0084a97183117bc9fe82bac05fa15a0ade32f6898622\": container with ID starting with 2eb2ffc18ae7c5a4b50b0084a97183117bc9fe82bac05fa15a0ade32f6898622 not found: ID does not exist" containerID="2eb2ffc18ae7c5a4b50b0084a97183117bc9fe82bac05fa15a0ade32f6898622"
Jul 06 01:05:08.154234 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.154187    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eb2ffc18ae7c5a4b50b0084a97183117bc9fe82bac05fa15a0ade32f6898622"} err="failed to get container status \"2eb2ffc18ae7c5a4b50b0084a97183117bc9fe82bac05fa15a0ade32f6898622\": rpc error: code = NotFound desc = could not find container \"2eb2ffc18ae7c5a4b50b0084a97183117bc9fe82bac05fa15a0ade32f6898622\": container with ID starting with 2eb2ffc18ae7c5a4b50b0084a97183117bc9fe82bac05fa15a0ade32f6898622 not found: ID does not exist"
Jul 06 01:05:08.154234 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.154199    2562 scope.go:117] "RemoveContainer" containerID="7c58d347ce616cd7d5dbb5e263f23a30dfaaa9f99080f9983b84c8ea37b687dc"
Jul 06 01:05:08.154423 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.154406    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c58d347ce616cd7d5dbb5e263f23a30dfaaa9f99080f9983b84c8ea37b687dc"} err="failed to get container status \"7c58d347ce616cd7d5dbb5e263f23a30dfaaa9f99080f9983b84c8ea37b687dc\": rpc error: code = NotFound desc = could not find container \"7c58d347ce616cd7d5dbb5e263f23a30dfaaa9f99080f9983b84c8ea37b687dc\": container with ID starting with 7c58d347ce616cd7d5dbb5e263f23a30dfaaa9f99080f9983b84c8ea37b687dc not found: ID does not exist"
Jul 06 01:05:08.154467 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.154424    2562 scope.go:117] "RemoveContainer" containerID="df2d8eec26c1f06b796c1a88b3b55c1710cc23923263853c6bc47cbf056ce642"
Jul 06 01:05:08.154670 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.154648    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df2d8eec26c1f06b796c1a88b3b55c1710cc23923263853c6bc47cbf056ce642"} err="failed to get container status \"df2d8eec26c1f06b796c1a88b3b55c1710cc23923263853c6bc47cbf056ce642\": rpc error: code = NotFound desc = could not find container \"df2d8eec26c1f06b796c1a88b3b55c1710cc23923263853c6bc47cbf056ce642\": container with ID starting with df2d8eec26c1f06b796c1a88b3b55c1710cc23923263853c6bc47cbf056ce642 not found: ID does not exist"
Jul 06 01:05:08.154713 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.154673    2562 scope.go:117] "RemoveContainer" containerID="446461e8eb37086b295befcda7902da8aee500de4621ee80ac18b49c081ecb82"
Jul 06 01:05:08.154751 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.154727    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:08.155040 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.154916    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"446461e8eb37086b295befcda7902da8aee500de4621ee80ac18b49c081ecb82"} err="failed to get container status \"446461e8eb37086b295befcda7902da8aee500de4621ee80ac18b49c081ecb82\": rpc error: code = NotFound desc = could not find container \"446461e8eb37086b295befcda7902da8aee500de4621ee80ac18b49c081ecb82\": container with ID starting with 446461e8eb37086b295befcda7902da8aee500de4621ee80ac18b49c081ecb82 not found: ID does not exist"
Jul 06 01:05:08.155040 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.154937    2562 scope.go:117] "RemoveContainer" containerID="a4ea00569a7d2a99be930db9d81d892d0b97817b29d20050a15417b89d6446b1"
Jul 06 01:05:08.155216 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.155189    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4ea00569a7d2a99be930db9d81d892d0b97817b29d20050a15417b89d6446b1"} err="failed to get container status \"a4ea00569a7d2a99be930db9d81d892d0b97817b29d20050a15417b89d6446b1\": rpc error: code = NotFound desc = could not find container \"a4ea00569a7d2a99be930db9d81d892d0b97817b29d20050a15417b89d6446b1\": container with ID starting with a4ea00569a7d2a99be930db9d81d892d0b97817b29d20050a15417b89d6446b1 not found: ID does not exist"
Jul 06 01:05:08.155293 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.155220    2562 scope.go:117] "RemoveContainer" containerID="5c51a5be444841cd0237939446d265105a8d691276b8959559b0f43dc7e07d4a"
Jul 06 01:05:08.155491 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.155472    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c51a5be444841cd0237939446d265105a8d691276b8959559b0f43dc7e07d4a"} err="failed to get container status \"5c51a5be444841cd0237939446d265105a8d691276b8959559b0f43dc7e07d4a\": rpc error: code = NotFound desc = could not find container \"5c51a5be444841cd0237939446d265105a8d691276b8959559b0f43dc7e07d4a\": container with ID starting with 5c51a5be444841cd0237939446d265105a8d691276b8959559b0f43dc7e07d4a not found: ID does not exist"
Jul 06 01:05:08.155549 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.155492    2562 scope.go:117] "RemoveContainer" containerID="a156f1ae32843b85216d1654f776c7e36a9dbb643c3eb0943f0def3e187c3aac"
Jul 06 01:05:08.155715 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.155697    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a156f1ae32843b85216d1654f776c7e36a9dbb643c3eb0943f0def3e187c3aac"} err="failed to get container status \"a156f1ae32843b85216d1654f776c7e36a9dbb643c3eb0943f0def3e187c3aac\": rpc error: code = NotFound desc = could not find container \"a156f1ae32843b85216d1654f776c7e36a9dbb643c3eb0943f0def3e187c3aac\": container with ID starting with a156f1ae32843b85216d1654f776c7e36a9dbb643c3eb0943f0def3e187c3aac not found: ID does not exist"
Jul 06 01:05:08.155715 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.155714    2562 scope.go:117] "RemoveContainer" containerID="2eb2ffc18ae7c5a4b50b0084a97183117bc9fe82bac05fa15a0ade32f6898622"
Jul 06 01:05:08.155940 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.155921    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eb2ffc18ae7c5a4b50b0084a97183117bc9fe82bac05fa15a0ade32f6898622"} err="failed to get container status \"2eb2ffc18ae7c5a4b50b0084a97183117bc9fe82bac05fa15a0ade32f6898622\": rpc error: code = NotFound desc = could not find container \"2eb2ffc18ae7c5a4b50b0084a97183117bc9fe82bac05fa15a0ade32f6898622\": container with ID starting with 2eb2ffc18ae7c5a4b50b0084a97183117bc9fe82bac05fa15a0ade32f6898622 not found: ID does not exist"
Jul 06 01:05:08.157554 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.157376    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 06 01:05:08.157554 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.157399    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 06 01:05:08.157554 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.157425    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 06 01:05:08.157554 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.157446    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 06 01:05:08.157554 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.157400    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-w8dc8\""
Jul 06 01:05:08.157554 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.157459    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 06 01:05:08.157554 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.157446    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 06 01:05:08.157554 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.157432    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 06 01:05:08.157891 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.157536    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 06 01:05:08.162983 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.162962    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 06 01:05:08.168140 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.168121    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 01:05:08.266738 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.266643    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/70c5457e-be63-488d-994a-41a4795e7084-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"70c5457e-be63-488d-994a-41a4795e7084\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:08.266738 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.266679    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/70c5457e-be63-488d-994a-41a4795e7084-config-volume\") pod \"alertmanager-main-0\" (UID: \"70c5457e-be63-488d-994a-41a4795e7084\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:08.266738 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.266708    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/70c5457e-be63-488d-994a-41a4795e7084-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"70c5457e-be63-488d-994a-41a4795e7084\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:08.267006 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.266747    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/70c5457e-be63-488d-994a-41a4795e7084-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"70c5457e-be63-488d-994a-41a4795e7084\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:08.267006 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.266774    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/70c5457e-be63-488d-994a-41a4795e7084-tls-assets\") pod \"alertmanager-main-0\" (UID: \"70c5457e-be63-488d-994a-41a4795e7084\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:08.267006 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.266792    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70c5457e-be63-488d-994a-41a4795e7084-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"70c5457e-be63-488d-994a-41a4795e7084\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:08.267006 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.266853    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/70c5457e-be63-488d-994a-41a4795e7084-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"70c5457e-be63-488d-994a-41a4795e7084\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:08.267006 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.266884    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/70c5457e-be63-488d-994a-41a4795e7084-web-config\") pod \"alertmanager-main-0\" (UID: \"70c5457e-be63-488d-994a-41a4795e7084\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:08.267006 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.266906    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/70c5457e-be63-488d-994a-41a4795e7084-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"70c5457e-be63-488d-994a-41a4795e7084\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:08.267006 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.266939    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/70c5457e-be63-488d-994a-41a4795e7084-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"70c5457e-be63-488d-994a-41a4795e7084\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:08.267006 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.266976    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/70c5457e-be63-488d-994a-41a4795e7084-config-out\") pod \"alertmanager-main-0\" (UID: \"70c5457e-be63-488d-994a-41a4795e7084\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:08.267006 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.266996    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70c5457e-be63-488d-994a-41a4795e7084-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"70c5457e-be63-488d-994a-41a4795e7084\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:08.267320 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.267013    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tl72\" (UniqueName: \"kubernetes.io/projected/70c5457e-be63-488d-994a-41a4795e7084-kube-api-access-9tl72\") pod \"alertmanager-main-0\" (UID: \"70c5457e-be63-488d-994a-41a4795e7084\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:08.367687 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.367651    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/70c5457e-be63-488d-994a-41a4795e7084-config-out\") pod \"alertmanager-main-0\" (UID: \"70c5457e-be63-488d-994a-41a4795e7084\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:08.367687 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.367690    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70c5457e-be63-488d-994a-41a4795e7084-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"70c5457e-be63-488d-994a-41a4795e7084\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:08.367932 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.367708    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tl72\" (UniqueName: \"kubernetes.io/projected/70c5457e-be63-488d-994a-41a4795e7084-kube-api-access-9tl72\") pod \"alertmanager-main-0\" (UID: \"70c5457e-be63-488d-994a-41a4795e7084\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:08.367932 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.367734    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/70c5457e-be63-488d-994a-41a4795e7084-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"70c5457e-be63-488d-994a-41a4795e7084\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:08.367932 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.367751    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/70c5457e-be63-488d-994a-41a4795e7084-config-volume\") pod \"alertmanager-main-0\" (UID: \"70c5457e-be63-488d-994a-41a4795e7084\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:08.367932 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.367778    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/70c5457e-be63-488d-994a-41a4795e7084-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"70c5457e-be63-488d-994a-41a4795e7084\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:08.367932 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.367797    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/70c5457e-be63-488d-994a-41a4795e7084-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"70c5457e-be63-488d-994a-41a4795e7084\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:08.367932 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.367815    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/70c5457e-be63-488d-994a-41a4795e7084-tls-assets\") pod \"alertmanager-main-0\" (UID: \"70c5457e-be63-488d-994a-41a4795e7084\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:08.367932 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.367838    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70c5457e-be63-488d-994a-41a4795e7084-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"70c5457e-be63-488d-994a-41a4795e7084\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:08.367932 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.367871    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/70c5457e-be63-488d-994a-41a4795e7084-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"70c5457e-be63-488d-994a-41a4795e7084\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:08.367932 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.367905    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/70c5457e-be63-488d-994a-41a4795e7084-web-config\") pod \"alertmanager-main-0\" (UID: \"70c5457e-be63-488d-994a-41a4795e7084\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:08.367932 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.367933    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/70c5457e-be63-488d-994a-41a4795e7084-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"70c5457e-be63-488d-994a-41a4795e7084\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:08.368439 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.367974    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/70c5457e-be63-488d-994a-41a4795e7084-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"70c5457e-be63-488d-994a-41a4795e7084\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:08.368439 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.368191    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/70c5457e-be63-488d-994a-41a4795e7084-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"70c5457e-be63-488d-994a-41a4795e7084\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:08.368643 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.368589    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70c5457e-be63-488d-994a-41a4795e7084-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"70c5457e-be63-488d-994a-41a4795e7084\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:08.370967 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.370922    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/70c5457e-be63-488d-994a-41a4795e7084-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"70c5457e-be63-488d-994a-41a4795e7084\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:08.370967 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.370958    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/70c5457e-be63-488d-994a-41a4795e7084-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"70c5457e-be63-488d-994a-41a4795e7084\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:08.371131 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.371115    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/70c5457e-be63-488d-994a-41a4795e7084-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"70c5457e-be63-488d-994a-41a4795e7084\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:08.371360 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.371337    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/70c5457e-be63-488d-994a-41a4795e7084-config-out\") pod \"alertmanager-main-0\" (UID: \"70c5457e-be63-488d-994a-41a4795e7084\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:08.371463 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.371400    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70c5457e-be63-488d-994a-41a4795e7084-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"70c5457e-be63-488d-994a-41a4795e7084\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:08.371463 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.371428    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/70c5457e-be63-488d-994a-41a4795e7084-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"70c5457e-be63-488d-994a-41a4795e7084\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:08.371463 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.371431    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/70c5457e-be63-488d-994a-41a4795e7084-web-config\") pod \"alertmanager-main-0\" (UID: \"70c5457e-be63-488d-994a-41a4795e7084\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:08.371570 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.371533    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/70c5457e-be63-488d-994a-41a4795e7084-tls-assets\") pod \"alertmanager-main-0\" (UID: \"70c5457e-be63-488d-994a-41a4795e7084\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:08.372191 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.372173    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/70c5457e-be63-488d-994a-41a4795e7084-config-volume\") pod \"alertmanager-main-0\" (UID: \"70c5457e-be63-488d-994a-41a4795e7084\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:08.372591 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.372575    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/70c5457e-be63-488d-994a-41a4795e7084-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"70c5457e-be63-488d-994a-41a4795e7084\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:08.374997 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.374980    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tl72\" (UniqueName: \"kubernetes.io/projected/70c5457e-be63-488d-994a-41a4795e7084-kube-api-access-9tl72\") pod \"alertmanager-main-0\" (UID: \"70c5457e-be63-488d-994a-41a4795e7084\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:08.464795 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.464768    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 01:05:08.602853 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.602817    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 01:05:08.606490 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:05:08.606461    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70c5457e_be63_488d_994a_41a4795e7084.slice/crio-5f9186f2dcfd9a053615f9bd1f689db5abf3ae85b761c1a14e51a47415372692 WatchSource:0}: Error finding container 5f9186f2dcfd9a053615f9bd1f689db5abf3ae85b761c1a14e51a47415372692: Status 404 returned error can't find the container with id 5f9186f2dcfd9a053615f9bd1f689db5abf3ae85b761c1a14e51a47415372692
Jul 06 01:05:08.751602 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:08.751572    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="509447eb-05c0-449a-9838-c05abf7e2f96" path="/var/lib/kubelet/pods/509447eb-05c0-449a-9838-c05abf7e2f96/volumes"
Jul 06 01:05:09.100167 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:09.100112    2562 generic.go:356] "Generic (PLEG): container finished" podID="70c5457e-be63-488d-994a-41a4795e7084" containerID="bfb5a77ccd12dc10cad9f3a54ad49052b3cd4aafd6b59a233babc7ec05642510" exitCode=0
Jul 06 01:05:09.100570 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:09.100207    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"70c5457e-be63-488d-994a-41a4795e7084","Type":"ContainerDied","Data":"bfb5a77ccd12dc10cad9f3a54ad49052b3cd4aafd6b59a233babc7ec05642510"}
Jul 06 01:05:09.100570 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:09.100345    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"70c5457e-be63-488d-994a-41a4795e7084","Type":"ContainerStarted","Data":"5f9186f2dcfd9a053615f9bd1f689db5abf3ae85b761c1a14e51a47415372692"}
Jul 06 01:05:10.109100 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.109066    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"70c5457e-be63-488d-994a-41a4795e7084","Type":"ContainerStarted","Data":"038fbdea149c99496fa90c822450ec9781b459365244a21732bf1c1fd59f4024"}
Jul 06 01:05:10.109511 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.109132    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"70c5457e-be63-488d-994a-41a4795e7084","Type":"ContainerStarted","Data":"2426a3b5e5043d59bb23135bdf7ddb1fe99ee7a9b1049cdf9661b3749ce7cadf"}
Jul 06 01:05:10.109511 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.109183    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"70c5457e-be63-488d-994a-41a4795e7084","Type":"ContainerStarted","Data":"11680f00b2c60c1231962f3c4a1875dd6ad0dab6a0aa7bd3a099681510c197a4"}
Jul 06 01:05:10.109511 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.109208    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"70c5457e-be63-488d-994a-41a4795e7084","Type":"ContainerStarted","Data":"7244c93033226bb914e848c447a7d7e6c9630fa04e29e9830db812c2a368520e"}
Jul 06 01:05:10.109511 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.109236    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"70c5457e-be63-488d-994a-41a4795e7084","Type":"ContainerStarted","Data":"28b50a3c0cbe3eb55027db1ba14b042c11123fd352f263bc967545b84004422d"}
Jul 06 01:05:10.109511 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.109270    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"70c5457e-be63-488d-994a-41a4795e7084","Type":"ContainerStarted","Data":"84709d409d3b553f97f0bec43d2175fc60811456b8c683f24070d5253b9880cd"}
Jul 06 01:05:10.133898 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.133839    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.114234863 podStartE2EDuration="2.133819443s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.58458ms" isStatefulPod=false podCreationTimestamp="2026-07-06 01:05:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:05:10.13182908 +0000 UTC m=+341.942804324" watchObservedRunningTime="2026-07-06 01:05:10.133819443 +0000 UTC m=+341.944794688"
Jul 06 01:05:10.589425 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.589347    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-8575d6f685-xtcth"]
Jul 06 01:05:10.591681 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.591662    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8575d6f685-xtcth"
Jul 06 01:05:10.593970 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.593948    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 06 01:05:10.594140 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.594014    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 06 01:05:10.594140 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.594067    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 06 01:05:10.594289 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.594273    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 06 01:05:10.594383 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.594367    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-mqrr4\""
Jul 06 01:05:10.594430 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.594369    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 06 01:05:10.598830 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.598808    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 06 01:05:10.608001 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.607523    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8575d6f685-xtcth"]
Jul 06 01:05:10.690414 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.690382    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5f9e1df5-7c67-4761-955e-0219c2029393-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8575d6f685-xtcth\" (UID: \"5f9e1df5-7c67-4761-955e-0219c2029393\") " pod="openshift-monitoring/telemeter-client-8575d6f685-xtcth"
Jul 06 01:05:10.690414 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.690426    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5f9e1df5-7c67-4761-955e-0219c2029393-secret-telemeter-client\") pod \"telemeter-client-8575d6f685-xtcth\" (UID: \"5f9e1df5-7c67-4761-955e-0219c2029393\") " pod="openshift-monitoring/telemeter-client-8575d6f685-xtcth"
Jul 06 01:05:10.690674 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.690455    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9e1df5-7c67-4761-955e-0219c2029393-serving-certs-ca-bundle\") pod \"telemeter-client-8575d6f685-xtcth\" (UID: \"5f9e1df5-7c67-4761-955e-0219c2029393\") " pod="openshift-monitoring/telemeter-client-8575d6f685-xtcth"
Jul 06 01:05:10.690674 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.690472    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lrj9\" (UniqueName: \"kubernetes.io/projected/5f9e1df5-7c67-4761-955e-0219c2029393-kube-api-access-8lrj9\") pod \"telemeter-client-8575d6f685-xtcth\" (UID: \"5f9e1df5-7c67-4761-955e-0219c2029393\") " pod="openshift-monitoring/telemeter-client-8575d6f685-xtcth"
Jul 06 01:05:10.690674 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.690489    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9e1df5-7c67-4761-955e-0219c2029393-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8575d6f685-xtcth\" (UID: \"5f9e1df5-7c67-4761-955e-0219c2029393\") " pod="openshift-monitoring/telemeter-client-8575d6f685-xtcth"
Jul 06 01:05:10.690674 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.690510    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f9e1df5-7c67-4761-955e-0219c2029393-metrics-client-ca\") pod \"telemeter-client-8575d6f685-xtcth\" (UID: \"5f9e1df5-7c67-4761-955e-0219c2029393\") " pod="openshift-monitoring/telemeter-client-8575d6f685-xtcth"
Jul 06 01:05:10.690674 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.690531    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5f9e1df5-7c67-4761-955e-0219c2029393-telemeter-client-tls\") pod \"telemeter-client-8575d6f685-xtcth\" (UID: \"5f9e1df5-7c67-4761-955e-0219c2029393\") " pod="openshift-monitoring/telemeter-client-8575d6f685-xtcth"
Jul 06 01:05:10.690674 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.690549    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5f9e1df5-7c67-4761-955e-0219c2029393-federate-client-tls\") pod \"telemeter-client-8575d6f685-xtcth\" (UID: \"5f9e1df5-7c67-4761-955e-0219c2029393\") " pod="openshift-monitoring/telemeter-client-8575d6f685-xtcth"
Jul 06 01:05:10.791466 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.791430    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f9e1df5-7c67-4761-955e-0219c2029393-metrics-client-ca\") pod \"telemeter-client-8575d6f685-xtcth\" (UID: \"5f9e1df5-7c67-4761-955e-0219c2029393\") " pod="openshift-monitoring/telemeter-client-8575d6f685-xtcth"
Jul 06 01:05:10.791466 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.791471    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5f9e1df5-7c67-4761-955e-0219c2029393-telemeter-client-tls\") pod \"telemeter-client-8575d6f685-xtcth\" (UID: \"5f9e1df5-7c67-4761-955e-0219c2029393\") " pod="openshift-monitoring/telemeter-client-8575d6f685-xtcth"
Jul 06 01:05:10.791716 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.791489    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5f9e1df5-7c67-4761-955e-0219c2029393-federate-client-tls\") pod \"telemeter-client-8575d6f685-xtcth\" (UID: \"5f9e1df5-7c67-4761-955e-0219c2029393\") " pod="openshift-monitoring/telemeter-client-8575d6f685-xtcth"
Jul 06 01:05:10.791716 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.791548    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5f9e1df5-7c67-4761-955e-0219c2029393-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8575d6f685-xtcth\" (UID: \"5f9e1df5-7c67-4761-955e-0219c2029393\") " pod="openshift-monitoring/telemeter-client-8575d6f685-xtcth"
Jul 06 01:05:10.791716 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.791591    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5f9e1df5-7c67-4761-955e-0219c2029393-secret-telemeter-client\") pod \"telemeter-client-8575d6f685-xtcth\" (UID: \"5f9e1df5-7c67-4761-955e-0219c2029393\") " pod="openshift-monitoring/telemeter-client-8575d6f685-xtcth"
Jul 06 01:05:10.791716 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.791632    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9e1df5-7c67-4761-955e-0219c2029393-serving-certs-ca-bundle\") pod \"telemeter-client-8575d6f685-xtcth\" (UID: \"5f9e1df5-7c67-4761-955e-0219c2029393\") " pod="openshift-monitoring/telemeter-client-8575d6f685-xtcth"
Jul 06 01:05:10.791716 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.791649    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lrj9\" (UniqueName: \"kubernetes.io/projected/5f9e1df5-7c67-4761-955e-0219c2029393-kube-api-access-8lrj9\") pod \"telemeter-client-8575d6f685-xtcth\" (UID: \"5f9e1df5-7c67-4761-955e-0219c2029393\") " pod="openshift-monitoring/telemeter-client-8575d6f685-xtcth"
Jul 06 01:05:10.791716 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.791668    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9e1df5-7c67-4761-955e-0219c2029393-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8575d6f685-xtcth\" (UID: \"5f9e1df5-7c67-4761-955e-0219c2029393\") " pod="openshift-monitoring/telemeter-client-8575d6f685-xtcth"
Jul 06 01:05:10.792351 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.792321    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9e1df5-7c67-4761-955e-0219c2029393-serving-certs-ca-bundle\") pod \"telemeter-client-8575d6f685-xtcth\" (UID: \"5f9e1df5-7c67-4761-955e-0219c2029393\") " pod="openshift-monitoring/telemeter-client-8575d6f685-xtcth"
Jul 06 01:05:10.792467 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.792322    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f9e1df5-7c67-4761-955e-0219c2029393-metrics-client-ca\") pod \"telemeter-client-8575d6f685-xtcth\" (UID: \"5f9e1df5-7c67-4761-955e-0219c2029393\") " pod="openshift-monitoring/telemeter-client-8575d6f685-xtcth"
Jul 06 01:05:10.792532 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.792493    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9e1df5-7c67-4761-955e-0219c2029393-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8575d6f685-xtcth\" (UID: \"5f9e1df5-7c67-4761-955e-0219c2029393\") " pod="openshift-monitoring/telemeter-client-8575d6f685-xtcth"
Jul 06 01:05:10.794081 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.794058    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5f9e1df5-7c67-4761-955e-0219c2029393-telemeter-client-tls\") pod \"telemeter-client-8575d6f685-xtcth\" (UID: \"5f9e1df5-7c67-4761-955e-0219c2029393\") " pod="openshift-monitoring/telemeter-client-8575d6f685-xtcth"
Jul 06 01:05:10.794196 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.794173    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5f9e1df5-7c67-4761-955e-0219c2029393-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8575d6f685-xtcth\" (UID: \"5f9e1df5-7c67-4761-955e-0219c2029393\") " pod="openshift-monitoring/telemeter-client-8575d6f685-xtcth"
Jul 06 01:05:10.794449 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.794432    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5f9e1df5-7c67-4761-955e-0219c2029393-secret-telemeter-client\") pod \"telemeter-client-8575d6f685-xtcth\" (UID: \"5f9e1df5-7c67-4761-955e-0219c2029393\") " pod="openshift-monitoring/telemeter-client-8575d6f685-xtcth"
Jul 06 01:05:10.794544 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.794527    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5f9e1df5-7c67-4761-955e-0219c2029393-federate-client-tls\") pod \"telemeter-client-8575d6f685-xtcth\" (UID: \"5f9e1df5-7c67-4761-955e-0219c2029393\") " pod="openshift-monitoring/telemeter-client-8575d6f685-xtcth"
Jul 06 01:05:10.798968 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.798949    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lrj9\" (UniqueName: \"kubernetes.io/projected/5f9e1df5-7c67-4761-955e-0219c2029393-kube-api-access-8lrj9\") pod \"telemeter-client-8575d6f685-xtcth\" (UID: \"5f9e1df5-7c67-4761-955e-0219c2029393\") " pod="openshift-monitoring/telemeter-client-8575d6f685-xtcth"
Jul 06 01:05:10.884987 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.884957    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 01:05:10.885293 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.885265    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3cd43843-469c-40f8-871e-0d30dc302dc2" containerName="prometheus" containerID="cri-o://fcf9863aab33285198a0d67375bfb073c6cf7414fbd57102b1b88fce0dc02b51" gracePeriod=600
Jul 06 01:05:10.885372 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.885275    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3cd43843-469c-40f8-871e-0d30dc302dc2" containerName="kube-rbac-proxy" containerID="cri-o://f8824ec1995bd74bb31065a31a64380c7664604984dd2a924ec2f5506e767c6e" gracePeriod=600
Jul 06 01:05:10.885372 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.885301    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3cd43843-469c-40f8-871e-0d30dc302dc2" containerName="config-reloader" containerID="cri-o://d6ef45da5b41d3d0c8d9e9905ac4ab613ceb72630938bc31558530e8b2bc80e1" gracePeriod=600
Jul 06 01:05:10.885372 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.885325    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3cd43843-469c-40f8-871e-0d30dc302dc2" containerName="kube-rbac-proxy-thanos" containerID="cri-o://1806a82347136cee3351bd9c226b554519e735a33732ba50ba30f44b04f4a4af" gracePeriod=600
Jul 06 01:05:10.885372 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.885280    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3cd43843-469c-40f8-871e-0d30dc302dc2" containerName="thanos-sidecar" containerID="cri-o://9777e0fbb8f2ed0799572354cb8355a3cfe9b7e04b20aafa5e65baba10628347" gracePeriod=600
Jul 06 01:05:10.885554 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.885299    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3cd43843-469c-40f8-871e-0d30dc302dc2" containerName="kube-rbac-proxy-web" containerID="cri-o://2db9a99c1a60e3782a8624bc8a6eb8058d3ff9c9607404c686bc9916a7e4b6a7" gracePeriod=600
Jul 06 01:05:10.902948 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:10.902739    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8575d6f685-xtcth"
Jul 06 01:05:11.050326 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.050294    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8575d6f685-xtcth"]
Jul 06 01:05:11.052931 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:05:11.052884    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f9e1df5_7c67_4761_955e_0219c2029393.slice/crio-9a324065f8103c758b7e77a9f29641d655a44aeccbba7bf9648a0b9220cd5a63 WatchSource:0}: Error finding container 9a324065f8103c758b7e77a9f29641d655a44aeccbba7bf9648a0b9220cd5a63: Status 404 returned error can't find the container with id 9a324065f8103c758b7e77a9f29641d655a44aeccbba7bf9648a0b9220cd5a63
Jul 06 01:05:11.055064 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.055041    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 01:05:11.117488 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.117457    2562 generic.go:356] "Generic (PLEG): container finished" podID="3cd43843-469c-40f8-871e-0d30dc302dc2" containerID="1806a82347136cee3351bd9c226b554519e735a33732ba50ba30f44b04f4a4af" exitCode=0
Jul 06 01:05:11.117488 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.117481    2562 generic.go:356] "Generic (PLEG): container finished" podID="3cd43843-469c-40f8-871e-0d30dc302dc2" containerID="f8824ec1995bd74bb31065a31a64380c7664604984dd2a924ec2f5506e767c6e" exitCode=0
Jul 06 01:05:11.117488 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.117490    2562 generic.go:356] "Generic (PLEG): container finished" podID="3cd43843-469c-40f8-871e-0d30dc302dc2" containerID="2db9a99c1a60e3782a8624bc8a6eb8058d3ff9c9607404c686bc9916a7e4b6a7" exitCode=0
Jul 06 01:05:11.117488 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.117498    2562 generic.go:356] "Generic (PLEG): container finished" podID="3cd43843-469c-40f8-871e-0d30dc302dc2" containerID="9777e0fbb8f2ed0799572354cb8355a3cfe9b7e04b20aafa5e65baba10628347" exitCode=0
Jul 06 01:05:11.118043 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.117506    2562 generic.go:356] "Generic (PLEG): container finished" podID="3cd43843-469c-40f8-871e-0d30dc302dc2" containerID="d6ef45da5b41d3d0c8d9e9905ac4ab613ceb72630938bc31558530e8b2bc80e1" exitCode=0
Jul 06 01:05:11.118043 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.117514    2562 generic.go:356] "Generic (PLEG): container finished" podID="3cd43843-469c-40f8-871e-0d30dc302dc2" containerID="fcf9863aab33285198a0d67375bfb073c6cf7414fbd57102b1b88fce0dc02b51" exitCode=0
Jul 06 01:05:11.118043 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.117512    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3cd43843-469c-40f8-871e-0d30dc302dc2","Type":"ContainerDied","Data":"1806a82347136cee3351bd9c226b554519e735a33732ba50ba30f44b04f4a4af"}
Jul 06 01:05:11.118043 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.117578    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3cd43843-469c-40f8-871e-0d30dc302dc2","Type":"ContainerDied","Data":"f8824ec1995bd74bb31065a31a64380c7664604984dd2a924ec2f5506e767c6e"}
Jul 06 01:05:11.118043 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.117606    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3cd43843-469c-40f8-871e-0d30dc302dc2","Type":"ContainerDied","Data":"2db9a99c1a60e3782a8624bc8a6eb8058d3ff9c9607404c686bc9916a7e4b6a7"}
Jul 06 01:05:11.118043 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.117630    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3cd43843-469c-40f8-871e-0d30dc302dc2","Type":"ContainerDied","Data":"9777e0fbb8f2ed0799572354cb8355a3cfe9b7e04b20aafa5e65baba10628347"}
Jul 06 01:05:11.118043 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.117659    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3cd43843-469c-40f8-871e-0d30dc302dc2","Type":"ContainerDied","Data":"d6ef45da5b41d3d0c8d9e9905ac4ab613ceb72630938bc31558530e8b2bc80e1"}
Jul 06 01:05:11.118043 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.117697    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3cd43843-469c-40f8-871e-0d30dc302dc2","Type":"ContainerDied","Data":"fcf9863aab33285198a0d67375bfb073c6cf7414fbd57102b1b88fce0dc02b51"}
Jul 06 01:05:11.118861 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.118839    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8575d6f685-xtcth" event={"ID":"5f9e1df5-7c67-4761-955e-0219c2029393","Type":"ContainerStarted","Data":"9a324065f8103c758b7e77a9f29641d655a44aeccbba7bf9648a0b9220cd5a63"}
Jul 06 01:05:11.134276 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.134260    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:11.195930 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.195854    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3cd43843-469c-40f8-871e-0d30dc302dc2-prometheus-k8s-rulefiles-0\") pod \"3cd43843-469c-40f8-871e-0d30dc302dc2\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") "
Jul 06 01:05:11.195930 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.195910    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cd43843-469c-40f8-871e-0d30dc302dc2-configmap-kubelet-serving-ca-bundle\") pod \"3cd43843-469c-40f8-871e-0d30dc302dc2\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") "
Jul 06 01:05:11.196163 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.195933    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-thanos-prometheus-http-client-file\") pod \"3cd43843-469c-40f8-871e-0d30dc302dc2\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") "
Jul 06 01:05:11.196163 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.195984    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"3cd43843-469c-40f8-871e-0d30dc302dc2\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") "
Jul 06 01:05:11.196163 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.196005    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-config\") pod \"3cd43843-469c-40f8-871e-0d30dc302dc2\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") "
Jul 06 01:05:11.196163 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.196024    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-secret-grpc-tls\") pod \"3cd43843-469c-40f8-871e-0d30dc302dc2\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") "
Jul 06 01:05:11.196163 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.196042    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3cd43843-469c-40f8-871e-0d30dc302dc2-prometheus-k8s-rulefiles-2\") pod \"3cd43843-469c-40f8-871e-0d30dc302dc2\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") "
Jul 06 01:05:11.196163 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.196071    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3cd43843-469c-40f8-871e-0d30dc302dc2-tls-assets\") pod \"3cd43843-469c-40f8-871e-0d30dc302dc2\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") "
Jul 06 01:05:11.196163 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.196098    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cd43843-469c-40f8-871e-0d30dc302dc2-configmap-serving-certs-ca-bundle\") pod \"3cd43843-469c-40f8-871e-0d30dc302dc2\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") "
Jul 06 01:05:11.196163 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.196158    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cd43843-469c-40f8-871e-0d30dc302dc2-prometheus-trusted-ca-bundle\") pod \"3cd43843-469c-40f8-871e-0d30dc302dc2\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") "
Jul 06 01:05:11.196602 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.196204    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-secret-prometheus-k8s-tls\") pod \"3cd43843-469c-40f8-871e-0d30dc302dc2\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") "
Jul 06 01:05:11.196602 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.196236    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3cd43843-469c-40f8-871e-0d30dc302dc2-prometheus-k8s-db\") pod \"3cd43843-469c-40f8-871e-0d30dc302dc2\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") "
Jul 06 01:05:11.196602 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.196263    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cd43843-469c-40f8-871e-0d30dc302dc2-configmap-metrics-client-ca\") pod \"3cd43843-469c-40f8-871e-0d30dc302dc2\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") "
Jul 06 01:05:11.196602 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.196295    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3cd43843-469c-40f8-871e-0d30dc302dc2-prometheus-k8s-rulefiles-1\") pod \"3cd43843-469c-40f8-871e-0d30dc302dc2\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") "
Jul 06 01:05:11.196602 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.196328    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"3cd43843-469c-40f8-871e-0d30dc302dc2\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") "
Jul 06 01:05:11.196602 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.196353    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lznkm\" (UniqueName: \"kubernetes.io/projected/3cd43843-469c-40f8-871e-0d30dc302dc2-kube-api-access-lznkm\") pod \"3cd43843-469c-40f8-871e-0d30dc302dc2\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") "
Jul 06 01:05:11.196602 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.196365    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cd43843-469c-40f8-871e-0d30dc302dc2-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "3cd43843-469c-40f8-871e-0d30dc302dc2" (UID: "3cd43843-469c-40f8-871e-0d30dc302dc2"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:05:11.196602 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.196389    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3cd43843-469c-40f8-871e-0d30dc302dc2-config-out\") pod \"3cd43843-469c-40f8-871e-0d30dc302dc2\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") "
Jul 06 01:05:11.196602 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.196413    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-web-config\") pod \"3cd43843-469c-40f8-871e-0d30dc302dc2\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") "
Jul 06 01:05:11.196602 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.196446    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-secret-kube-rbac-proxy\") pod \"3cd43843-469c-40f8-871e-0d30dc302dc2\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") "
Jul 06 01:05:11.196602 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.196470    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-secret-metrics-client-certs\") pod \"3cd43843-469c-40f8-871e-0d30dc302dc2\" (UID: \"3cd43843-469c-40f8-871e-0d30dc302dc2\") "
Jul 06 01:05:11.197129 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.196979    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cd43843-469c-40f8-871e-0d30dc302dc2-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:05:11.197129 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.197078    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cd43843-469c-40f8-871e-0d30dc302dc2-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "3cd43843-469c-40f8-871e-0d30dc302dc2" (UID: "3cd43843-469c-40f8-871e-0d30dc302dc2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:05:11.198300 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.197845    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cd43843-469c-40f8-871e-0d30dc302dc2-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "3cd43843-469c-40f8-871e-0d30dc302dc2" (UID: "3cd43843-469c-40f8-871e-0d30dc302dc2"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:05:11.198300 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.198266    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cd43843-469c-40f8-871e-0d30dc302dc2-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "3cd43843-469c-40f8-871e-0d30dc302dc2" (UID: "3cd43843-469c-40f8-871e-0d30dc302dc2"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:05:11.198300 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.198286    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cd43843-469c-40f8-871e-0d30dc302dc2-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "3cd43843-469c-40f8-871e-0d30dc302dc2" (UID: "3cd43843-469c-40f8-871e-0d30dc302dc2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:05:11.198300 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.198296    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cd43843-469c-40f8-871e-0d30dc302dc2-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "3cd43843-469c-40f8-871e-0d30dc302dc2" (UID: "3cd43843-469c-40f8-871e-0d30dc302dc2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:05:11.198571 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.198463    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cd43843-469c-40f8-871e-0d30dc302dc2-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "3cd43843-469c-40f8-871e-0d30dc302dc2" (UID: "3cd43843-469c-40f8-871e-0d30dc302dc2"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:05:11.198571 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.198531    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cd43843-469c-40f8-871e-0d30dc302dc2-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "3cd43843-469c-40f8-871e-0d30dc302dc2" (UID: "3cd43843-469c-40f8-871e-0d30dc302dc2"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:05:11.199138 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.199094    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "3cd43843-469c-40f8-871e-0d30dc302dc2" (UID: "3cd43843-469c-40f8-871e-0d30dc302dc2"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:05:11.199138 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.199118    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-config" (OuterVolumeSpecName: "config") pod "3cd43843-469c-40f8-871e-0d30dc302dc2" (UID: "3cd43843-469c-40f8-871e-0d30dc302dc2"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:05:11.201114 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.201089    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "3cd43843-469c-40f8-871e-0d30dc302dc2" (UID: "3cd43843-469c-40f8-871e-0d30dc302dc2"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:05:11.201261 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.201177    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cd43843-469c-40f8-871e-0d30dc302dc2-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3cd43843-469c-40f8-871e-0d30dc302dc2" (UID: "3cd43843-469c-40f8-871e-0d30dc302dc2"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:05:11.201261 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.201189    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "3cd43843-469c-40f8-871e-0d30dc302dc2" (UID: "3cd43843-469c-40f8-871e-0d30dc302dc2"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:05:11.201382 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.201282    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cd43843-469c-40f8-871e-0d30dc302dc2-kube-api-access-lznkm" (OuterVolumeSpecName: "kube-api-access-lznkm") pod "3cd43843-469c-40f8-871e-0d30dc302dc2" (UID: "3cd43843-469c-40f8-871e-0d30dc302dc2"). InnerVolumeSpecName "kube-api-access-lznkm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:05:11.201586 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.201548    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "3cd43843-469c-40f8-871e-0d30dc302dc2" (UID: "3cd43843-469c-40f8-871e-0d30dc302dc2"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:05:11.201689 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.201632    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "3cd43843-469c-40f8-871e-0d30dc302dc2" (UID: "3cd43843-469c-40f8-871e-0d30dc302dc2"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:05:11.202073 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.202051    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "3cd43843-469c-40f8-871e-0d30dc302dc2" (UID: "3cd43843-469c-40f8-871e-0d30dc302dc2"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:05:11.202266 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.202245    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cd43843-469c-40f8-871e-0d30dc302dc2-config-out" (OuterVolumeSpecName: "config-out") pod "3cd43843-469c-40f8-871e-0d30dc302dc2" (UID: "3cd43843-469c-40f8-871e-0d30dc302dc2"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:05:11.202647 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.202626    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "3cd43843-469c-40f8-871e-0d30dc302dc2" (UID: "3cd43843-469c-40f8-871e-0d30dc302dc2"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:05:11.213728 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.213707    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-web-config" (OuterVolumeSpecName: "web-config") pod "3cd43843-469c-40f8-871e-0d30dc302dc2" (UID: "3cd43843-469c-40f8-871e-0d30dc302dc2"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:05:11.298380 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.298348    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:05:11.298380 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.298375    2562 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-config\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:05:11.298380 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.298385    2562 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-secret-grpc-tls\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:05:11.298588 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.298398    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3cd43843-469c-40f8-871e-0d30dc302dc2-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:05:11.298588 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.298406    2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3cd43843-469c-40f8-871e-0d30dc302dc2-tls-assets\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:05:11.298588 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.298414    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cd43843-469c-40f8-871e-0d30dc302dc2-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:05:11.298588 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.298423    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cd43843-469c-40f8-871e-0d30dc302dc2-prometheus-trusted-ca-bundle\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:05:11.298588 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.298432    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-secret-prometheus-k8s-tls\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:05:11.298588 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.298440    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3cd43843-469c-40f8-871e-0d30dc302dc2-prometheus-k8s-db\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:05:11.298588 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.298450    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cd43843-469c-40f8-871e-0d30dc302dc2-configmap-metrics-client-ca\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:05:11.298588 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.298458    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3cd43843-469c-40f8-871e-0d30dc302dc2-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:05:11.298588 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.298468    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:05:11.298588 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.298476    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lznkm\" (UniqueName: \"kubernetes.io/projected/3cd43843-469c-40f8-871e-0d30dc302dc2-kube-api-access-lznkm\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:05:11.298588 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.298484    2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3cd43843-469c-40f8-871e-0d30dc302dc2-config-out\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:05:11.298588 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.298492    2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-web-config\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:05:11.298588 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.298499    2562 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-secret-kube-rbac-proxy\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:05:11.298588 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.298507    2562 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-secret-metrics-client-certs\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:05:11.298588 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.298516    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3cd43843-469c-40f8-871e-0d30dc302dc2-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:05:11.298588 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:11.298524    2562 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3cd43843-469c-40f8-871e-0d30dc302dc2-thanos-prometheus-http-client-file\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:05:12.127008 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.126966    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3cd43843-469c-40f8-871e-0d30dc302dc2","Type":"ContainerDied","Data":"8b6c75917a51fa401782b4a06be83bd9d8dd066f07b9ed910391a5cc1687462a"}
Jul 06 01:05:12.127410 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.127038    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.127410 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.127060    2562 scope.go:117] "RemoveContainer" containerID="1806a82347136cee3351bd9c226b554519e735a33732ba50ba30f44b04f4a4af"
Jul 06 01:05:12.135699 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.135678    2562 scope.go:117] "RemoveContainer" containerID="f8824ec1995bd74bb31065a31a64380c7664604984dd2a924ec2f5506e767c6e"
Jul 06 01:05:12.142575 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.142559    2562 scope.go:117] "RemoveContainer" containerID="2db9a99c1a60e3782a8624bc8a6eb8058d3ff9c9607404c686bc9916a7e4b6a7"
Jul 06 01:05:12.149357 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.149337    2562 scope.go:117] "RemoveContainer" containerID="9777e0fbb8f2ed0799572354cb8355a3cfe9b7e04b20aafa5e65baba10628347"
Jul 06 01:05:12.149720 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.149693    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 01:05:12.155442 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.155419    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 01:05:12.157789 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.157772    2562 scope.go:117] "RemoveContainer" containerID="d6ef45da5b41d3d0c8d9e9905ac4ab613ceb72630938bc31558530e8b2bc80e1"
Jul 06 01:05:12.165873 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.165854    2562 scope.go:117] "RemoveContainer" containerID="fcf9863aab33285198a0d67375bfb073c6cf7414fbd57102b1b88fce0dc02b51"
Jul 06 01:05:12.176118 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.176081    2562 scope.go:117] "RemoveContainer" containerID="a748857f26ee0046908a9cef36b763bb42f0dff870b5f10f64bfbcfac1cdc892"
Jul 06 01:05:12.181267 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.181232    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 01:05:12.181629 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.181613    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cd43843-469c-40f8-871e-0d30dc302dc2" containerName="config-reloader"
Jul 06 01:05:12.181629 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.181629    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cd43843-469c-40f8-871e-0d30dc302dc2" containerName="config-reloader"
Jul 06 01:05:12.181782 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.181635    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cd43843-469c-40f8-871e-0d30dc302dc2" containerName="kube-rbac-proxy-web"
Jul 06 01:05:12.181782 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.181641    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cd43843-469c-40f8-871e-0d30dc302dc2" containerName="kube-rbac-proxy-web"
Jul 06 01:05:12.181782 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.181653    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cd43843-469c-40f8-871e-0d30dc302dc2" containerName="init-config-reloader"
Jul 06 01:05:12.181782 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.181663    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cd43843-469c-40f8-871e-0d30dc302dc2" containerName="init-config-reloader"
Jul 06 01:05:12.181782 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.181675    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cd43843-469c-40f8-871e-0d30dc302dc2" containerName="prometheus"
Jul 06 01:05:12.181782 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.181681    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cd43843-469c-40f8-871e-0d30dc302dc2" containerName="prometheus"
Jul 06 01:05:12.181782 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.181697    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cd43843-469c-40f8-871e-0d30dc302dc2" containerName="kube-rbac-proxy-thanos"
Jul 06 01:05:12.181782 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.181703    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cd43843-469c-40f8-871e-0d30dc302dc2" containerName="kube-rbac-proxy-thanos"
Jul 06 01:05:12.181782 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.181714    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cd43843-469c-40f8-871e-0d30dc302dc2" containerName="thanos-sidecar"
Jul 06 01:05:12.181782 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.181720    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cd43843-469c-40f8-871e-0d30dc302dc2" containerName="thanos-sidecar"
Jul 06 01:05:12.181782 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.181726    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cd43843-469c-40f8-871e-0d30dc302dc2" containerName="kube-rbac-proxy"
Jul 06 01:05:12.181782 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.181731    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cd43843-469c-40f8-871e-0d30dc302dc2" containerName="kube-rbac-proxy"
Jul 06 01:05:12.181782 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.181785    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cd43843-469c-40f8-871e-0d30dc302dc2" containerName="kube-rbac-proxy"
Jul 06 01:05:12.182424 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.181800    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cd43843-469c-40f8-871e-0d30dc302dc2" containerName="prometheus"
Jul 06 01:05:12.182424 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.181808    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cd43843-469c-40f8-871e-0d30dc302dc2" containerName="kube-rbac-proxy-web"
Jul 06 01:05:12.182424 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.181818    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cd43843-469c-40f8-871e-0d30dc302dc2" containerName="thanos-sidecar"
Jul 06 01:05:12.182424 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.181824    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cd43843-469c-40f8-871e-0d30dc302dc2" containerName="config-reloader"
Jul 06 01:05:12.182424 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.181829    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cd43843-469c-40f8-871e-0d30dc302dc2" containerName="kube-rbac-proxy-thanos"
Jul 06 01:05:12.185713 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.185691    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.187953 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.187930    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 06 01:05:12.188051 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.188004    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 06 01:05:12.188108 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.188080    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 06 01:05:12.188283 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.188267    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-31a38qv3cgjp7\""
Jul 06 01:05:12.188741 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.188559    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 06 01:05:12.188741 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.188587    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 06 01:05:12.188741 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.188590    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 06 01:05:12.188741 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.188674    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 06 01:05:12.188741 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.188684    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 06 01:05:12.189027 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.188614    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 06 01:05:12.189100 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.189080    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-dj4m9\""
Jul 06 01:05:12.189216 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.189199    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 06 01:05:12.189440 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.189417    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 06 01:05:12.189546 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.189525    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 06 01:05:12.192000 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.191983    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 06 01:05:12.193969 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.193949    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 06 01:05:12.202105 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.202079    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 01:05:12.306165 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.306117    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-config-out\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.306323 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.306181    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.306323 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.306234    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.306323 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.306276    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.306323 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.306304    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.306323 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.306321    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.306568 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.306339    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-web-config\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.306568 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.306397    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.306568 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.306455    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.306568 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.306531    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.306568 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.306549    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-config\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.306767 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.306569    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.306767 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.306622    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrsf5\" (UniqueName: \"kubernetes.io/projected/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-kube-api-access-qrsf5\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.306767 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.306649    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.306767 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.306710    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.306961 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.306779    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.306961 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.306829    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.306961 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.306862    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.306961 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.306880    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.306961 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.306916    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.407633 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.407551    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.407633 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.407603    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.407633 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.407636    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.407907 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.407677    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-config-out\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.407907 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.407705    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.407907 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.407727    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.408059 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.407913    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.408059 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.407959    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.408059 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.407990    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.408059 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.408014    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-web-config\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.408059 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.408045    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.408337 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.408068    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.408337 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.408111    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.408337 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.408133    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-config\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.408337 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.408185    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.408337 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.408217    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrsf5\" (UniqueName: \"kubernetes.io/projected/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-kube-api-access-qrsf5\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.408337 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.408245    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.408337 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.408275    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.408337 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.408304    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.408700 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.408353    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.408700 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.408398    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.408700 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.408470    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.408700 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.408533    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.408919 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.408739    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.410983 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.410681    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-config-out\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.410983 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.410909    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.411199 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.411045    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.411266 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.411223    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-config\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.411924 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.411418    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.411924 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.411717    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.411924 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.411734    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.411924 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.411763    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.412380 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.412356    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.412455 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.412384    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.413033 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.413008    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.413375 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.413350    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.413644 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.413623    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.413898 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.413882    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-web-config\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.415212 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.415168    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.416971 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.416952    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrsf5\" (UniqueName: \"kubernetes.io/projected/ce5d2828-ce6b-4cef-8a5f-6412ca5234e3-kube-api-access-qrsf5\") pod \"prometheus-k8s-0\" (UID: \"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.497526 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.497487    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:05:12.752970 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:12.752876    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cd43843-469c-40f8-871e-0d30dc302dc2" path="/var/lib/kubelet/pods/3cd43843-469c-40f8-871e-0d30dc302dc2/volumes"
Jul 06 01:05:13.051883 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:13.051844    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 01:05:13.054825 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:05:13.054774    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce5d2828_ce6b_4cef_8a5f_6412ca5234e3.slice/crio-7c3d4d3164851dfa99dc7d6f91e8f0751f2058ad048d73a1c4b7ed98ae7e9565 WatchSource:0}: Error finding container 7c3d4d3164851dfa99dc7d6f91e8f0751f2058ad048d73a1c4b7ed98ae7e9565: Status 404 returned error can't find the container with id 7c3d4d3164851dfa99dc7d6f91e8f0751f2058ad048d73a1c4b7ed98ae7e9565
Jul 06 01:05:13.134471 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:13.134444    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8575d6f685-xtcth" event={"ID":"5f9e1df5-7c67-4761-955e-0219c2029393","Type":"ContainerStarted","Data":"6662059cd1a523a65a5b35630bac16f7947bc40e082cb0030dbe1033d647b755"}
Jul 06 01:05:13.134795 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:13.134502    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8575d6f685-xtcth" event={"ID":"5f9e1df5-7c67-4761-955e-0219c2029393","Type":"ContainerStarted","Data":"efd48ee2724d4564249432c5b322f3778e9db110b9eebc9b436ee94da49d16d4"}
Jul 06 01:05:13.136374 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:13.136342    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3","Type":"ContainerStarted","Data":"99482f4273ed01b78b8074735bf1594011835cf4d582e8c196103a2b4465be84"}
Jul 06 01:05:13.136458 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:13.136423    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3","Type":"ContainerStarted","Data":"7c3d4d3164851dfa99dc7d6f91e8f0751f2058ad048d73a1c4b7ed98ae7e9565"}
Jul 06 01:05:14.143891 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:14.143851    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8575d6f685-xtcth" event={"ID":"5f9e1df5-7c67-4761-955e-0219c2029393","Type":"ContainerStarted","Data":"7c467405742106a8f9a28c56c3544fe4b546a693fd5019150af2e5ff6c0bb8fb"}
Jul 06 01:05:14.146987 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:14.146960    2562 generic.go:356] "Generic (PLEG): container finished" podID="ce5d2828-ce6b-4cef-8a5f-6412ca5234e3" containerID="99482f4273ed01b78b8074735bf1594011835cf4d582e8c196103a2b4465be84" exitCode=0
Jul 06 01:05:14.147094 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:14.147042    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3","Type":"ContainerDied","Data":"99482f4273ed01b78b8074735bf1594011835cf4d582e8c196103a2b4465be84"}
Jul 06 01:05:14.147198 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:14.147112    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3","Type":"ContainerStarted","Data":"29123c6722b26b3a4eada8dac1031869e82ccb21dda8fbef2d891ae27d93924c"}
Jul 06 01:05:14.147198 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:14.147180    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3","Type":"ContainerStarted","Data":"28c63f04bb818f0e6a510905594e3e3e8bfc7d161842b3ec6a851b22178a954f"}
Jul 06 01:05:14.147262 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:14.147211    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3","Type":"ContainerStarted","Data":"b8fe7e81b4f6fe62a18607e1e2a128bd6d5a3eef02bc4a32e07091938d6890cd"}
Jul 06 01:05:14.147262 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:14.147234    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3","Type":"ContainerStarted","Data":"442478f3b1af133ccd7c0ee0d0b40e48aa1b212a8ac4f5a5d73a11aec730c8c0"}
Jul 06 01:05:14.147317 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:14.147273    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3","Type":"ContainerStarted","Data":"a0839cab66828d2e53e406d3cec405a0b5d64dd224b802bd61b9669f29eeeef6"}
Jul 06 01:05:14.147317 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:14.147297    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ce5d2828-ce6b-4cef-8a5f-6412ca5234e3","Type":"ContainerStarted","Data":"fe41101f3a6a293fa11d1cea0c99047f9921c992624b903167fbfd9b861bbb58"}
Jul 06 01:05:14.163977 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:14.163924    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-8575d6f685-xtcth" podStartSLOduration=2.27941238 podStartE2EDuration="4.163904019s" totalImagesPullingTime="1.884491639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:05:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:05:14.162238835 +0000 UTC m=+345.973214078" watchObservedRunningTime="2026-07-06 01:05:14.163904019 +0000 UTC m=+345.974879263"
Jul 06 01:05:14.190017 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:14.189968    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.165444823 podStartE2EDuration="2.189950863s" totalImagesPullingTime="0s" totalInitContainerRuntime="24.50604ms" isStatefulPod=false podCreationTimestamp="2026-07-06 01:05:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:05:14.188335985 +0000 UTC m=+345.999311230" watchObservedRunningTime="2026-07-06 01:05:14.189950863 +0000 UTC m=+346.000926105"
Jul 06 01:05:17.497872 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:05:17.497834    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:06:12.497947 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:06:12.497909    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:06:12.513606 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:06:12.513582    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:06:13.418950 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:06:13.418924    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 01:08:35.162511 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:35.162428    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l"]
Jul 06 01:08:35.165961 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:35.165938    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l"
Jul 06 01:08:35.168716 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:35.168695    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 01:08:35.168716 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:35.168718    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 01:08:35.168920 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:35.168759    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-cv7kv\""
Jul 06 01:08:35.168920 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:35.168809    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 01:08:35.169351 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:35.169337    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 01:08:35.182160 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:35.182128    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l"]
Jul 06 01:08:35.354437 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:35.354399    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ad8bcc1e-2979-43e2-908a-760544f457b4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l\" (UID: \"ad8bcc1e-2979-43e2-908a-760544f457b4\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l"
Jul 06 01:08:35.354646 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:35.354445    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad8bcc1e-2979-43e2-908a-760544f457b4-tmp\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l\" (UID: \"ad8bcc1e-2979-43e2-908a-760544f457b4\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l"
Jul 06 01:08:35.354646 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:35.354466    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfkwf\" (UniqueName: \"kubernetes.io/projected/ad8bcc1e-2979-43e2-908a-760544f457b4-kube-api-access-xfkwf\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l\" (UID: \"ad8bcc1e-2979-43e2-908a-760544f457b4\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l"
Jul 06 01:08:35.354646 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:35.354542    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ad8bcc1e-2979-43e2-908a-760544f457b4-manifests\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l\" (UID: \"ad8bcc1e-2979-43e2-908a-760544f457b4\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l"
Jul 06 01:08:35.354646 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:35.354582    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad8bcc1e-2979-43e2-908a-760544f457b4-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l\" (UID: \"ad8bcc1e-2979-43e2-908a-760544f457b4\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l"
Jul 06 01:08:35.455334 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:35.455240    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ad8bcc1e-2979-43e2-908a-760544f457b4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l\" (UID: \"ad8bcc1e-2979-43e2-908a-760544f457b4\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l"
Jul 06 01:08:35.455334 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:35.455301    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad8bcc1e-2979-43e2-908a-760544f457b4-tmp\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l\" (UID: \"ad8bcc1e-2979-43e2-908a-760544f457b4\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l"
Jul 06 01:08:35.455334 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:35.455329    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfkwf\" (UniqueName: \"kubernetes.io/projected/ad8bcc1e-2979-43e2-908a-760544f457b4-kube-api-access-xfkwf\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l\" (UID: \"ad8bcc1e-2979-43e2-908a-760544f457b4\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l"
Jul 06 01:08:35.455616 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:35.455359    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ad8bcc1e-2979-43e2-908a-760544f457b4-manifests\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l\" (UID: \"ad8bcc1e-2979-43e2-908a-760544f457b4\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l"
Jul 06 01:08:35.455616 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:35.455400    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad8bcc1e-2979-43e2-908a-760544f457b4-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l\" (UID: \"ad8bcc1e-2979-43e2-908a-760544f457b4\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l"
Jul 06 01:08:35.455855 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:35.455833    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ad8bcc1e-2979-43e2-908a-760544f457b4-manifests\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l\" (UID: \"ad8bcc1e-2979-43e2-908a-760544f457b4\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l"
Jul 06 01:08:35.457792 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:35.457767    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad8bcc1e-2979-43e2-908a-760544f457b4-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l\" (UID: \"ad8bcc1e-2979-43e2-908a-760544f457b4\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l"
Jul 06 01:08:35.458092 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:35.458072    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad8bcc1e-2979-43e2-908a-760544f457b4-tmp\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l\" (UID: \"ad8bcc1e-2979-43e2-908a-760544f457b4\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l"
Jul 06 01:08:35.458258 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:35.458241    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ad8bcc1e-2979-43e2-908a-760544f457b4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l\" (UID: \"ad8bcc1e-2979-43e2-908a-760544f457b4\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l"
Jul 06 01:08:35.475623 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:35.475594    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfkwf\" (UniqueName: \"kubernetes.io/projected/ad8bcc1e-2979-43e2-908a-760544f457b4-kube-api-access-xfkwf\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l\" (UID: \"ad8bcc1e-2979-43e2-908a-760544f457b4\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l"
Jul 06 01:08:35.476376 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:35.476361    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l"
Jul 06 01:08:35.620934 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:35.620896    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l"]
Jul 06 01:08:35.625423 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:08:35.625396    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad8bcc1e_2979_43e2_908a_760544f457b4.slice/crio-6a6941202277056f7ee7ae4d1302917dbb3d29d80e80bdddafa2d85910fc7b84 WatchSource:0}: Error finding container 6a6941202277056f7ee7ae4d1302917dbb3d29d80e80bdddafa2d85910fc7b84: Status 404 returned error can't find the container with id 6a6941202277056f7ee7ae4d1302917dbb3d29d80e80bdddafa2d85910fc7b84
Jul 06 01:08:35.967715 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:35.967678    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l" event={"ID":"ad8bcc1e-2979-43e2-908a-760544f457b4","Type":"ContainerStarted","Data":"6a6941202277056f7ee7ae4d1302917dbb3d29d80e80bdddafa2d85910fc7b84"}
Jul 06 01:08:38.984319 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:38.984283    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l" event={"ID":"ad8bcc1e-2979-43e2-908a-760544f457b4","Type":"ContainerStarted","Data":"953ea4d35b2398efac20df3b91f46c4b438f917c902bd195d8e6baa97a3faddc"}
Jul 06 01:08:39.990280 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:39.990198    2562 generic.go:356] "Generic (PLEG): container finished" podID="ad8bcc1e-2979-43e2-908a-760544f457b4" containerID="953ea4d35b2398efac20df3b91f46c4b438f917c902bd195d8e6baa97a3faddc" exitCode=0
Jul 06 01:08:39.990638 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:39.990281    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l" event={"ID":"ad8bcc1e-2979-43e2-908a-760544f457b4","Type":"ContainerDied","Data":"953ea4d35b2398efac20df3b91f46c4b438f917c902bd195d8e6baa97a3faddc"}
Jul 06 01:08:40.996696 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:40.996656    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l" event={"ID":"ad8bcc1e-2979-43e2-908a-760544f457b4","Type":"ContainerStarted","Data":"e2c650c0c513097e607dfe4de0a203aef7669772a7261b56c7fa4e2152aaa5cc"}
Jul 06 01:08:40.997205 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:40.996782    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l"
Jul 06 01:08:41.015586 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:41.015542    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l" podStartSLOduration=1.629141686 podStartE2EDuration="6.015526277s" totalImagesPullingTime="3.33588822s" totalInitContainerRuntime="1.050496371s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:08:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:08:41.014709506 +0000 UTC m=+552.825684749" watchObservedRunningTime="2026-07-06 01:08:41.015526277 +0000 UTC m=+552.826501521"
Jul 06 01:08:52.003282 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:52.003252    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l"
Jul 06 01:08:54.906530 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:54.906488    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-557bfcf777-sps77"]
Jul 06 01:08:54.910109 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:54.910088    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-557bfcf777-sps77"
Jul 06 01:08:54.912828 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:54.912800    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 01:08:54.912828 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:54.912821    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 01:08:54.913013 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:54.912810    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 06 01:08:54.913823 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:54.913802    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 06 01:08:54.913930 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:54.913833    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-vbtwh\""
Jul 06 01:08:54.921433 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:54.921408    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-557bfcf777-sps77"]
Jul 06 01:08:55.032429 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:55.032393    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7xnd\" (UniqueName: \"kubernetes.io/projected/1fe777b9-df8e-4ec8-b517-4cf6f0cd2160-kube-api-access-q7xnd\") pod \"kube-auth-proxy-557bfcf777-sps77\" (UID: \"1fe777b9-df8e-4ec8-b517-4cf6f0cd2160\") " pod="openshift-ingress/kube-auth-proxy-557bfcf777-sps77"
Jul 06 01:08:55.032628 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:55.032440    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1fe777b9-df8e-4ec8-b517-4cf6f0cd2160-tls-certs\") pod \"kube-auth-proxy-557bfcf777-sps77\" (UID: \"1fe777b9-df8e-4ec8-b517-4cf6f0cd2160\") " pod="openshift-ingress/kube-auth-proxy-557bfcf777-sps77"
Jul 06 01:08:55.032628 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:55.032580    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1fe777b9-df8e-4ec8-b517-4cf6f0cd2160-tmp\") pod \"kube-auth-proxy-557bfcf777-sps77\" (UID: \"1fe777b9-df8e-4ec8-b517-4cf6f0cd2160\") " pod="openshift-ingress/kube-auth-proxy-557bfcf777-sps77"
Jul 06 01:08:55.133388 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:55.133348    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1fe777b9-df8e-4ec8-b517-4cf6f0cd2160-tmp\") pod \"kube-auth-proxy-557bfcf777-sps77\" (UID: \"1fe777b9-df8e-4ec8-b517-4cf6f0cd2160\") " pod="openshift-ingress/kube-auth-proxy-557bfcf777-sps77"
Jul 06 01:08:55.133553 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:55.133509    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7xnd\" (UniqueName: \"kubernetes.io/projected/1fe777b9-df8e-4ec8-b517-4cf6f0cd2160-kube-api-access-q7xnd\") pod \"kube-auth-proxy-557bfcf777-sps77\" (UID: \"1fe777b9-df8e-4ec8-b517-4cf6f0cd2160\") " pod="openshift-ingress/kube-auth-proxy-557bfcf777-sps77"
Jul 06 01:08:55.133553 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:55.133548    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1fe777b9-df8e-4ec8-b517-4cf6f0cd2160-tls-certs\") pod \"kube-auth-proxy-557bfcf777-sps77\" (UID: \"1fe777b9-df8e-4ec8-b517-4cf6f0cd2160\") " pod="openshift-ingress/kube-auth-proxy-557bfcf777-sps77"
Jul 06 01:08:55.135560 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:55.135531    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1fe777b9-df8e-4ec8-b517-4cf6f0cd2160-tmp\") pod \"kube-auth-proxy-557bfcf777-sps77\" (UID: \"1fe777b9-df8e-4ec8-b517-4cf6f0cd2160\") " pod="openshift-ingress/kube-auth-proxy-557bfcf777-sps77"
Jul 06 01:08:55.135809 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:55.135790    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1fe777b9-df8e-4ec8-b517-4cf6f0cd2160-tls-certs\") pod \"kube-auth-proxy-557bfcf777-sps77\" (UID: \"1fe777b9-df8e-4ec8-b517-4cf6f0cd2160\") " pod="openshift-ingress/kube-auth-proxy-557bfcf777-sps77"
Jul 06 01:08:55.153358 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:55.153319    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7xnd\" (UniqueName: \"kubernetes.io/projected/1fe777b9-df8e-4ec8-b517-4cf6f0cd2160-kube-api-access-q7xnd\") pod \"kube-auth-proxy-557bfcf777-sps77\" (UID: \"1fe777b9-df8e-4ec8-b517-4cf6f0cd2160\") " pod="openshift-ingress/kube-auth-proxy-557bfcf777-sps77"
Jul 06 01:08:55.221910 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:55.221818    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-557bfcf777-sps77"
Jul 06 01:08:55.367487 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:55.367462    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-557bfcf777-sps77"]
Jul 06 01:08:55.369756 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:08:55.369730    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fe777b9_df8e_4ec8_b517_4cf6f0cd2160.slice/crio-74db3e9920d37bea32b1d8359063d7f226bc2392392b8619d70573fd0da3ead5 WatchSource:0}: Error finding container 74db3e9920d37bea32b1d8359063d7f226bc2392392b8619d70573fd0da3ead5: Status 404 returned error can't find the container with id 74db3e9920d37bea32b1d8359063d7f226bc2392392b8619d70573fd0da3ead5
Jul 06 01:08:56.062898 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:56.062860    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-557bfcf777-sps77" event={"ID":"1fe777b9-df8e-4ec8-b517-4cf6f0cd2160","Type":"ContainerStarted","Data":"74db3e9920d37bea32b1d8359063d7f226bc2392392b8619d70573fd0da3ead5"}
Jul 06 01:08:58.073480 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:58.073440    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-557bfcf777-sps77" event={"ID":"1fe777b9-df8e-4ec8-b517-4cf6f0cd2160","Type":"ContainerStarted","Data":"e42199585d69d6944083ee205bfe668a28406e0ca98e45eaac758613d6128e95"}
Jul 06 01:08:58.089276 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:08:58.089225    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-557bfcf777-sps77" podStartSLOduration=1.5187968600000001 podStartE2EDuration="4.089210999s" totalImagesPullingTime="2.570414139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:08:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:08:58.088255149 +0000 UTC m=+569.899230392" watchObservedRunningTime="2026-07-06 01:08:58.089210999 +0000 UTC m=+569.900186242"
Jul 06 01:09:02.869350 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:09:02.869315    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-fb6f5cd49-dcxdf"]
Jul 06 01:09:02.872774 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:09:02.872748    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-fb6f5cd49-dcxdf"
Jul 06 01:09:02.875164 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:09:02.875126    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 06 01:09:02.875961 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:09:02.875941    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 06 01:09:02.876077 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:09:02.875982    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 06 01:09:02.876179 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:09:02.876140    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 06 01:09:02.876238 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:09:02.876171    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 06 01:09:02.876238 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:09:02.876223    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-whhcz\""
Jul 06 01:09:02.880586 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:09:02.880564    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-fb6f5cd49-dcxdf"]
Jul 06 01:09:03.004524 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:09:03.004483    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pfpv\" (UniqueName: \"kubernetes.io/projected/5c25d907-95d8-4332-9b20-c2e64c234ac1-kube-api-access-6pfpv\") pod \"lws-controller-manager-fb6f5cd49-dcxdf\" (UID: \"5c25d907-95d8-4332-9b20-c2e64c234ac1\") " pod="openshift-lws-operator/lws-controller-manager-fb6f5cd49-dcxdf"
Jul 06 01:09:03.004524 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:09:03.004523    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c25d907-95d8-4332-9b20-c2e64c234ac1-cert\") pod \"lws-controller-manager-fb6f5cd49-dcxdf\" (UID: \"5c25d907-95d8-4332-9b20-c2e64c234ac1\") " pod="openshift-lws-operator/lws-controller-manager-fb6f5cd49-dcxdf"
Jul 06 01:09:03.004732 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:09:03.004557    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5c25d907-95d8-4332-9b20-c2e64c234ac1-manager-config\") pod \"lws-controller-manager-fb6f5cd49-dcxdf\" (UID: \"5c25d907-95d8-4332-9b20-c2e64c234ac1\") " pod="openshift-lws-operator/lws-controller-manager-fb6f5cd49-dcxdf"
Jul 06 01:09:03.004732 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:09:03.004631    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5c25d907-95d8-4332-9b20-c2e64c234ac1-metrics-cert\") pod \"lws-controller-manager-fb6f5cd49-dcxdf\" (UID: \"5c25d907-95d8-4332-9b20-c2e64c234ac1\") " pod="openshift-lws-operator/lws-controller-manager-fb6f5cd49-dcxdf"
Jul 06 01:09:03.105815 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:09:03.105783    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5c25d907-95d8-4332-9b20-c2e64c234ac1-metrics-cert\") pod \"lws-controller-manager-fb6f5cd49-dcxdf\" (UID: \"5c25d907-95d8-4332-9b20-c2e64c234ac1\") " pod="openshift-lws-operator/lws-controller-manager-fb6f5cd49-dcxdf"
Jul 06 01:09:03.105986 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:09:03.105842    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pfpv\" (UniqueName: \"kubernetes.io/projected/5c25d907-95d8-4332-9b20-c2e64c234ac1-kube-api-access-6pfpv\") pod \"lws-controller-manager-fb6f5cd49-dcxdf\" (UID: \"5c25d907-95d8-4332-9b20-c2e64c234ac1\") " pod="openshift-lws-operator/lws-controller-manager-fb6f5cd49-dcxdf"
Jul 06 01:09:03.105986 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:09:03.105870    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c25d907-95d8-4332-9b20-c2e64c234ac1-cert\") pod \"lws-controller-manager-fb6f5cd49-dcxdf\" (UID: \"5c25d907-95d8-4332-9b20-c2e64c234ac1\") " pod="openshift-lws-operator/lws-controller-manager-fb6f5cd49-dcxdf"
Jul 06 01:09:03.105986 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:09:03.105901    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5c25d907-95d8-4332-9b20-c2e64c234ac1-manager-config\") pod \"lws-controller-manager-fb6f5cd49-dcxdf\" (UID: \"5c25d907-95d8-4332-9b20-c2e64c234ac1\") " pod="openshift-lws-operator/lws-controller-manager-fb6f5cd49-dcxdf"
Jul 06 01:09:03.110166 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:09:03.107123    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5c25d907-95d8-4332-9b20-c2e64c234ac1-manager-config\") pod \"lws-controller-manager-fb6f5cd49-dcxdf\" (UID: \"5c25d907-95d8-4332-9b20-c2e64c234ac1\") " pod="openshift-lws-operator/lws-controller-manager-fb6f5cd49-dcxdf"
Jul 06 01:09:03.115672 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:09:03.115642    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5c25d907-95d8-4332-9b20-c2e64c234ac1-metrics-cert\") pod \"lws-controller-manager-fb6f5cd49-dcxdf\" (UID: \"5c25d907-95d8-4332-9b20-c2e64c234ac1\") " pod="openshift-lws-operator/lws-controller-manager-fb6f5cd49-dcxdf"
Jul 06 01:09:03.115812 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:09:03.115763    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c25d907-95d8-4332-9b20-c2e64c234ac1-cert\") pod \"lws-controller-manager-fb6f5cd49-dcxdf\" (UID: \"5c25d907-95d8-4332-9b20-c2e64c234ac1\") " pod="openshift-lws-operator/lws-controller-manager-fb6f5cd49-dcxdf"
Jul 06 01:09:03.124748 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:09:03.124683    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pfpv\" (UniqueName: \"kubernetes.io/projected/5c25d907-95d8-4332-9b20-c2e64c234ac1-kube-api-access-6pfpv\") pod \"lws-controller-manager-fb6f5cd49-dcxdf\" (UID: \"5c25d907-95d8-4332-9b20-c2e64c234ac1\") " pod="openshift-lws-operator/lws-controller-manager-fb6f5cd49-dcxdf"
Jul 06 01:09:03.183435 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:09:03.183396    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-fb6f5cd49-dcxdf"
Jul 06 01:09:03.322350 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:09:03.322311    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-fb6f5cd49-dcxdf"]
Jul 06 01:09:03.324876 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:09:03.324840    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c25d907_95d8_4332_9b20_c2e64c234ac1.slice/crio-4c9a7cef1190ba11ab4a975aecae3a62b7219946097e705f63ebcc6a2b044399 WatchSource:0}: Error finding container 4c9a7cef1190ba11ab4a975aecae3a62b7219946097e705f63ebcc6a2b044399: Status 404 returned error can't find the container with id 4c9a7cef1190ba11ab4a975aecae3a62b7219946097e705f63ebcc6a2b044399
Jul 06 01:09:04.101131 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:09:04.101092    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-fb6f5cd49-dcxdf" event={"ID":"5c25d907-95d8-4332-9b20-c2e64c234ac1","Type":"ContainerStarted","Data":"4c9a7cef1190ba11ab4a975aecae3a62b7219946097e705f63ebcc6a2b044399"}
Jul 06 01:09:12.140243 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:09:12.140207    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-fb6f5cd49-dcxdf" event={"ID":"5c25d907-95d8-4332-9b20-c2e64c234ac1","Type":"ContainerStarted","Data":"dac2887dc11e56f0e79812149468b27edcc47f5ef7a919a2ea63334693ec03e0"}
Jul 06 01:09:12.140672 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:09:12.140287    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-fb6f5cd49-dcxdf"
Jul 06 01:09:12.155071 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:09:12.155018    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-fb6f5cd49-dcxdf" podStartSLOduration=1.537993231 podStartE2EDuration="10.155003745s" totalImagesPullingTime="8.617010514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:09:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:09:12.154786814 +0000 UTC m=+583.965762058" watchObservedRunningTime="2026-07-06 01:09:12.155003745 +0000 UTC m=+583.965978988"
Jul 06 01:09:23.147641 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:09:23.147611    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-fb6f5cd49-dcxdf"
Jul 06 01:10:39.541946 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:10:39.541912    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-d7hct"]
Jul 06 01:10:39.545261 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:10:39.545241    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-d7hct"
Jul 06 01:10:39.547899 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:10:39.547879    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 01:10:39.548825 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:10:39.548804    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 01:10:39.548938 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:10:39.548803    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-jmfbr\""
Jul 06 01:10:39.554481 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:10:39.554463    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-d7hct"]
Jul 06 01:10:39.661076 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:10:39.661039    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd5gt\" (UniqueName: \"kubernetes.io/projected/c59e6d3f-b313-443d-a71f-512502e5945b-kube-api-access-wd5gt\") pod \"authorino-operator-75cc8d5cb7-d7hct\" (UID: \"c59e6d3f-b313-443d-a71f-512502e5945b\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-d7hct"
Jul 06 01:10:39.761982 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:10:39.761946    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd5gt\" (UniqueName: \"kubernetes.io/projected/c59e6d3f-b313-443d-a71f-512502e5945b-kube-api-access-wd5gt\") pod \"authorino-operator-75cc8d5cb7-d7hct\" (UID: \"c59e6d3f-b313-443d-a71f-512502e5945b\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-d7hct"
Jul 06 01:10:39.770799 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:10:39.770763    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd5gt\" (UniqueName: \"kubernetes.io/projected/c59e6d3f-b313-443d-a71f-512502e5945b-kube-api-access-wd5gt\") pod \"authorino-operator-75cc8d5cb7-d7hct\" (UID: \"c59e6d3f-b313-443d-a71f-512502e5945b\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-d7hct"
Jul 06 01:10:39.855927 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:10:39.855863    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-d7hct"
Jul 06 01:10:40.026612 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:10:40.026578    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-d7hct"]
Jul 06 01:10:40.030323 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:10:40.030273    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc59e6d3f_b313_443d_a71f_512502e5945b.slice/crio-86d718ab5b9206a91742c8e6a384a7fc71462d3ec4f2294739e6f6194b339c91 WatchSource:0}: Error finding container 86d718ab5b9206a91742c8e6a384a7fc71462d3ec4f2294739e6f6194b339c91: Status 404 returned error can't find the container with id 86d718ab5b9206a91742c8e6a384a7fc71462d3ec4f2294739e6f6194b339c91
Jul 06 01:10:40.033222 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:10:40.033174    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 01:10:40.536418 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:10:40.536380    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-d7hct" event={"ID":"c59e6d3f-b313-443d-a71f-512502e5945b","Type":"ContainerStarted","Data":"86d718ab5b9206a91742c8e6a384a7fc71462d3ec4f2294739e6f6194b339c91"}
Jul 06 01:10:42.555315 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:10:42.555280    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-d7hct" event={"ID":"c59e6d3f-b313-443d-a71f-512502e5945b","Type":"ContainerStarted","Data":"bc672b287ff20b8507346cc13b86fae550cc07d3da271f4f7044786a8e19669e"}
Jul 06 01:10:42.555708 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:10:42.555359    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-d7hct"
Jul 06 01:10:42.576499 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:10:42.576450    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-d7hct" podStartSLOduration=1.2414332 podStartE2EDuration="3.576434563s" totalImagesPullingTime="2.335001363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:10:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:10:42.574021108 +0000 UTC m=+674.384996351" watchObservedRunningTime="2026-07-06 01:10:42.576434563 +0000 UTC m=+674.387409806"
Jul 06 01:10:46.122175 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:10:46.122127    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-s4nw5"]
Jul 06 01:10:46.125649 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:10:46.125630    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s4nw5"
Jul 06 01:10:46.127968 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:10:46.127939    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 06 01:10:46.127968 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:10:46.127955    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 06 01:10:46.127968 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:10:46.127965    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-c5ldt\""
Jul 06 01:10:46.134260 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:10:46.134235    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-s4nw5"]
Jul 06 01:10:46.221277 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:10:46.221239    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwplc\" (UniqueName: \"kubernetes.io/projected/b00d8c4c-95c3-49a1-adef-cd375ee5cb01-kube-api-access-vwplc\") pod \"kuadrant-console-plugin-66b5774985-s4nw5\" (UID: \"b00d8c4c-95c3-49a1-adef-cd375ee5cb01\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s4nw5"
Jul 06 01:10:46.221477 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:10:46.221287    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b00d8c4c-95c3-49a1-adef-cd375ee5cb01-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-s4nw5\" (UID: \"b00d8c4c-95c3-49a1-adef-cd375ee5cb01\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s4nw5"
Jul 06 01:10:46.221477 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:10:46.221371    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b00d8c4c-95c3-49a1-adef-cd375ee5cb01-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-s4nw5\" (UID: \"b00d8c4c-95c3-49a1-adef-cd375ee5cb01\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s4nw5"
Jul 06 01:10:46.322741 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:10:46.322707    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwplc\" (UniqueName: \"kubernetes.io/projected/b00d8c4c-95c3-49a1-adef-cd375ee5cb01-kube-api-access-vwplc\") pod \"kuadrant-console-plugin-66b5774985-s4nw5\" (UID: \"b00d8c4c-95c3-49a1-adef-cd375ee5cb01\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s4nw5"
Jul 06 01:10:46.322940 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:10:46.322768    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b00d8c4c-95c3-49a1-adef-cd375ee5cb01-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-s4nw5\" (UID: \"b00d8c4c-95c3-49a1-adef-cd375ee5cb01\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s4nw5"
Jul 06 01:10:46.322940 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:10:46.322834    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b00d8c4c-95c3-49a1-adef-cd375ee5cb01-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-s4nw5\" (UID: \"b00d8c4c-95c3-49a1-adef-cd375ee5cb01\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s4nw5"
Jul 06 01:10:46.323527 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:10:46.323505    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b00d8c4c-95c3-49a1-adef-cd375ee5cb01-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-s4nw5\" (UID: \"b00d8c4c-95c3-49a1-adef-cd375ee5cb01\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s4nw5"
Jul 06 01:10:46.325219 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:10:46.325196    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b00d8c4c-95c3-49a1-adef-cd375ee5cb01-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-s4nw5\" (UID: \"b00d8c4c-95c3-49a1-adef-cd375ee5cb01\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s4nw5"
Jul 06 01:10:46.334643 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:10:46.334620    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwplc\" (UniqueName: \"kubernetes.io/projected/b00d8c4c-95c3-49a1-adef-cd375ee5cb01-kube-api-access-vwplc\") pod \"kuadrant-console-plugin-66b5774985-s4nw5\" (UID: \"b00d8c4c-95c3-49a1-adef-cd375ee5cb01\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s4nw5"
Jul 06 01:10:46.452124 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:10:46.452036    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s4nw5"
Jul 06 01:10:46.584309 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:10:46.584283    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-s4nw5"]
Jul 06 01:10:46.586343 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:10:46.586317    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb00d8c4c_95c3_49a1_adef_cd375ee5cb01.slice/crio-aaa23b83f124bcf3578b2253e7cc6a75985027f40c77430c28215b59a4e359e5 WatchSource:0}: Error finding container aaa23b83f124bcf3578b2253e7cc6a75985027f40c77430c28215b59a4e359e5: Status 404 returned error can't find the container with id aaa23b83f124bcf3578b2253e7cc6a75985027f40c77430c28215b59a4e359e5
Jul 06 01:10:47.581174 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:10:47.581129    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s4nw5" event={"ID":"b00d8c4c-95c3-49a1-adef-cd375ee5cb01","Type":"ContainerStarted","Data":"aaa23b83f124bcf3578b2253e7cc6a75985027f40c77430c28215b59a4e359e5"}
Jul 06 01:10:53.564925 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:10:53.564895    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-d7hct"
Jul 06 01:11:10.702890 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:11:10.702854    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s4nw5" event={"ID":"b00d8c4c-95c3-49a1-adef-cd375ee5cb01","Type":"ContainerStarted","Data":"e31b0034cf35f6cc46d6425eca244e7f038c10a171a37cf7f411aa80b80d7194"}
Jul 06 01:11:10.718830 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:11:10.718780    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s4nw5" podStartSLOduration=1.587002022 podStartE2EDuration="24.718766337s" totalImagesPullingTime="23.131764315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:10:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:11:10.717533346 +0000 UTC m=+702.528508590" watchObservedRunningTime="2026-07-06 01:11:10.718766337 +0000 UTC m=+702.529741597"
Jul 06 01:11:43.254788 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:11:43.254710    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-bvmbl"]
Jul 06 01:11:43.277017 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:11:43.276980    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-bvmbl"]
Jul 06 01:11:43.277222 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:11:43.277101    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-bvmbl"
Jul 06 01:11:43.279564 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:11:43.279543    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-b67hh\""
Jul 06 01:11:43.365472 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:11:43.365433    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9fsb\" (UniqueName: \"kubernetes.io/projected/bc82f93e-c615-42ab-8108-9f820c77504e-kube-api-access-m9fsb\") pod \"authorino-58cd955675-bvmbl\" (UID: \"bc82f93e-c615-42ab-8108-9f820c77504e\") " pod="kuadrant-system/authorino-58cd955675-bvmbl"
Jul 06 01:11:43.465958 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:11:43.465922    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9fsb\" (UniqueName: \"kubernetes.io/projected/bc82f93e-c615-42ab-8108-9f820c77504e-kube-api-access-m9fsb\") pod \"authorino-58cd955675-bvmbl\" (UID: \"bc82f93e-c615-42ab-8108-9f820c77504e\") " pod="kuadrant-system/authorino-58cd955675-bvmbl"
Jul 06 01:11:43.473380 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:11:43.473354    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9fsb\" (UniqueName: \"kubernetes.io/projected/bc82f93e-c615-42ab-8108-9f820c77504e-kube-api-access-m9fsb\") pod \"authorino-58cd955675-bvmbl\" (UID: \"bc82f93e-c615-42ab-8108-9f820c77504e\") " pod="kuadrant-system/authorino-58cd955675-bvmbl"
Jul 06 01:11:43.586377 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:11:43.586294    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-bvmbl"
Jul 06 01:11:43.711713 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:11:43.711683    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-bvmbl"]
Jul 06 01:11:43.715311 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:11:43.715284    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbc82f93e_c615_42ab_8108_9f820c77504e.slice/crio-0bc6f87d2b2c66c20eca66cea8e5990a654fe8abed9be9f24f6e43b3cc18db86 WatchSource:0}: Error finding container 0bc6f87d2b2c66c20eca66cea8e5990a654fe8abed9be9f24f6e43b3cc18db86: Status 404 returned error can't find the container with id 0bc6f87d2b2c66c20eca66cea8e5990a654fe8abed9be9f24f6e43b3cc18db86
Jul 06 01:11:43.853177 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:11:43.853134    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-bvmbl" event={"ID":"bc82f93e-c615-42ab-8108-9f820c77504e","Type":"ContainerStarted","Data":"0bc6f87d2b2c66c20eca66cea8e5990a654fe8abed9be9f24f6e43b3cc18db86"}
Jul 06 01:11:46.870254 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:11:46.870216    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-bvmbl" event={"ID":"bc82f93e-c615-42ab-8108-9f820c77504e","Type":"ContainerStarted","Data":"926258f06c2380142bfd9c3b9023373684d5480d6bae860445166d7f5a63360b"}
Jul 06 01:11:46.884481 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:11:46.884437    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-bvmbl" podStartSLOduration=0.915979404 podStartE2EDuration="3.884423624s" totalImagesPullingTime="2.96844422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:11:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:11:46.883073892 +0000 UTC m=+738.694049135" watchObservedRunningTime="2026-07-06 01:11:46.884423624 +0000 UTC m=+738.695398867"
Jul 06 01:11:48.617237 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:11:48.617202    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-bvmbl"]
Jul 06 01:11:48.879313 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:11:48.879233    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-bvmbl" podUID="bc82f93e-c615-42ab-8108-9f820c77504e" containerName="authorino" containerID="cri-o://926258f06c2380142bfd9c3b9023373684d5480d6bae860445166d7f5a63360b" gracePeriod=30
Jul 06 01:11:49.132351 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:11:49.132285    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-bvmbl"
Jul 06 01:11:49.221355 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:11:49.221319    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9fsb\" (UniqueName: \"kubernetes.io/projected/bc82f93e-c615-42ab-8108-9f820c77504e-kube-api-access-m9fsb\") pod \"bc82f93e-c615-42ab-8108-9f820c77504e\" (UID: \"bc82f93e-c615-42ab-8108-9f820c77504e\") "
Jul 06 01:11:49.223518 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:11:49.223494    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc82f93e-c615-42ab-8108-9f820c77504e-kube-api-access-m9fsb" (OuterVolumeSpecName: "kube-api-access-m9fsb") pod "bc82f93e-c615-42ab-8108-9f820c77504e" (UID: "bc82f93e-c615-42ab-8108-9f820c77504e"). InnerVolumeSpecName "kube-api-access-m9fsb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:11:49.322606 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:11:49.322571    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9fsb\" (UniqueName: \"kubernetes.io/projected/bc82f93e-c615-42ab-8108-9f820c77504e-kube-api-access-m9fsb\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:11:49.891209 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:11:49.891174    2562 generic.go:356] "Generic (PLEG): container finished" podID="bc82f93e-c615-42ab-8108-9f820c77504e" containerID="926258f06c2380142bfd9c3b9023373684d5480d6bae860445166d7f5a63360b" exitCode=0
Jul 06 01:11:49.891622 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:11:49.891229    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-bvmbl"
Jul 06 01:11:49.891622 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:11:49.891238    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-bvmbl" event={"ID":"bc82f93e-c615-42ab-8108-9f820c77504e","Type":"ContainerDied","Data":"926258f06c2380142bfd9c3b9023373684d5480d6bae860445166d7f5a63360b"}
Jul 06 01:11:49.891622 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:11:49.891270    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-bvmbl" event={"ID":"bc82f93e-c615-42ab-8108-9f820c77504e","Type":"ContainerDied","Data":"0bc6f87d2b2c66c20eca66cea8e5990a654fe8abed9be9f24f6e43b3cc18db86"}
Jul 06 01:11:49.891622 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:11:49.891287    2562 scope.go:117] "RemoveContainer" containerID="926258f06c2380142bfd9c3b9023373684d5480d6bae860445166d7f5a63360b"
Jul 06 01:11:49.900447 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:11:49.900425    2562 scope.go:117] "RemoveContainer" containerID="926258f06c2380142bfd9c3b9023373684d5480d6bae860445166d7f5a63360b"
Jul 06 01:11:49.900694 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:11:49.900672    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"926258f06c2380142bfd9c3b9023373684d5480d6bae860445166d7f5a63360b\": container with ID starting with 926258f06c2380142bfd9c3b9023373684d5480d6bae860445166d7f5a63360b not found: ID does not exist" containerID="926258f06c2380142bfd9c3b9023373684d5480d6bae860445166d7f5a63360b"
Jul 06 01:11:49.900738 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:11:49.900701    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"926258f06c2380142bfd9c3b9023373684d5480d6bae860445166d7f5a63360b"} err="failed to get container status \"926258f06c2380142bfd9c3b9023373684d5480d6bae860445166d7f5a63360b\": rpc error: code = NotFound desc = could not find container \"926258f06c2380142bfd9c3b9023373684d5480d6bae860445166d7f5a63360b\": container with ID starting with 926258f06c2380142bfd9c3b9023373684d5480d6bae860445166d7f5a63360b not found: ID does not exist"
Jul 06 01:11:49.914062 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:11:49.914005    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-bvmbl"]
Jul 06 01:11:49.917513 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:11:49.917488    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-bvmbl"]
Jul 06 01:11:50.752687 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:11:50.752655    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc82f93e-c615-42ab-8108-9f820c77504e" path="/var/lib/kubelet/pods/bc82f93e-c615-42ab-8108-9f820c77504e/volumes"
Jul 06 01:12:15.300007 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:15.299972    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8h6v5"]
Jul 06 01:12:15.300489 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:15.300347    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc82f93e-c615-42ab-8108-9f820c77504e" containerName="authorino"
Jul 06 01:12:15.300489 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:15.300361    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc82f93e-c615-42ab-8108-9f820c77504e" containerName="authorino"
Jul 06 01:12:15.300489 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:15.300442    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc82f93e-c615-42ab-8108-9f820c77504e" containerName="authorino"
Jul 06 01:12:15.303557 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:15.303542    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8h6v5"
Jul 06 01:12:15.305949 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:15.305925    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-b67hh\""
Jul 06 01:12:15.309969 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:15.309942    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8h6v5"]
Jul 06 01:12:15.357581 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:15.357543    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8xqq\" (UniqueName: \"kubernetes.io/projected/293db336-d0ad-4674-bff1-32724dee95ca-kube-api-access-p8xqq\") pod \"authorino-5d4b67c446-8h6v5\" (UID: \"293db336-d0ad-4674-bff1-32724dee95ca\") " pod="kuadrant-system/authorino-5d4b67c446-8h6v5"
Jul 06 01:12:15.458832 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:15.458790    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8xqq\" (UniqueName: \"kubernetes.io/projected/293db336-d0ad-4674-bff1-32724dee95ca-kube-api-access-p8xqq\") pod \"authorino-5d4b67c446-8h6v5\" (UID: \"293db336-d0ad-4674-bff1-32724dee95ca\") " pod="kuadrant-system/authorino-5d4b67c446-8h6v5"
Jul 06 01:12:15.466879 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:15.466844    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8xqq\" (UniqueName: \"kubernetes.io/projected/293db336-d0ad-4674-bff1-32724dee95ca-kube-api-access-p8xqq\") pod \"authorino-5d4b67c446-8h6v5\" (UID: \"293db336-d0ad-4674-bff1-32724dee95ca\") " pod="kuadrant-system/authorino-5d4b67c446-8h6v5"
Jul 06 01:12:15.532410 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:15.532374    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8h6v5"]
Jul 06 01:12:15.532652 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:15.532640    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8h6v5"
Jul 06 01:12:15.553824 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:15.553755    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-79876f8978-7qbl7"]
Jul 06 01:12:15.557587 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:15.557563    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79876f8978-7qbl7"
Jul 06 01:12:15.563691 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:15.563662    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-79876f8978-7qbl7"]
Jul 06 01:12:15.661651 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:15.661617    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2fx2\" (UniqueName: \"kubernetes.io/projected/c3624ec5-a5e8-40e8-8cfe-68a255ad51c4-kube-api-access-z2fx2\") pod \"authorino-79876f8978-7qbl7\" (UID: \"c3624ec5-a5e8-40e8-8cfe-68a255ad51c4\") " pod="kuadrant-system/authorino-79876f8978-7qbl7"
Jul 06 01:12:15.665121 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:15.665087    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8h6v5"]
Jul 06 01:12:15.669033 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:15.668992    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-79876f8978-7qbl7"]
Jul 06 01:12:15.669376 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:12:15.669348    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-z2fx2], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-79876f8978-7qbl7" podUID="c3624ec5-a5e8-40e8-8cfe-68a255ad51c4"
Jul 06 01:12:15.669485 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:12:15.669421    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod293db336_d0ad_4674_bff1_32724dee95ca.slice/crio-242d81df4b82394fe70b50c659760b9744c916c007163e653625d568f8d08ae1 WatchSource:0}: Error finding container 242d81df4b82394fe70b50c659760b9744c916c007163e653625d568f8d08ae1: Status 404 returned error can't find the container with id 242d81df4b82394fe70b50c659760b9744c916c007163e653625d568f8d08ae1
Jul 06 01:12:15.695293 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:15.695263    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-65685d8686-mwnn8"]
Jul 06 01:12:15.698791 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:15.698773    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65685d8686-mwnn8"
Jul 06 01:12:15.700989 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:15.700965    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 06 01:12:15.705359 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:15.705333    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-65685d8686-mwnn8"]
Jul 06 01:12:15.762500 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:15.762438    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvzw5\" (UniqueName: \"kubernetes.io/projected/00541936-546e-48c6-a8a6-a9d7b0617951-kube-api-access-hvzw5\") pod \"authorino-65685d8686-mwnn8\" (UID: \"00541936-546e-48c6-a8a6-a9d7b0617951\") " pod="kuadrant-system/authorino-65685d8686-mwnn8"
Jul 06 01:12:15.762668 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:15.762554    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2fx2\" (UniqueName: \"kubernetes.io/projected/c3624ec5-a5e8-40e8-8cfe-68a255ad51c4-kube-api-access-z2fx2\") pod \"authorino-79876f8978-7qbl7\" (UID: \"c3624ec5-a5e8-40e8-8cfe-68a255ad51c4\") " pod="kuadrant-system/authorino-79876f8978-7qbl7"
Jul 06 01:12:15.762668 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:15.762578    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/00541936-546e-48c6-a8a6-a9d7b0617951-tls-cert\") pod \"authorino-65685d8686-mwnn8\" (UID: \"00541936-546e-48c6-a8a6-a9d7b0617951\") " pod="kuadrant-system/authorino-65685d8686-mwnn8"
Jul 06 01:12:15.770996 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:15.770964    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2fx2\" (UniqueName: \"kubernetes.io/projected/c3624ec5-a5e8-40e8-8cfe-68a255ad51c4-kube-api-access-z2fx2\") pod \"authorino-79876f8978-7qbl7\" (UID: \"c3624ec5-a5e8-40e8-8cfe-68a255ad51c4\") " pod="kuadrant-system/authorino-79876f8978-7qbl7"
Jul 06 01:12:15.863886 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:15.863856    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/00541936-546e-48c6-a8a6-a9d7b0617951-tls-cert\") pod \"authorino-65685d8686-mwnn8\" (UID: \"00541936-546e-48c6-a8a6-a9d7b0617951\") " pod="kuadrant-system/authorino-65685d8686-mwnn8"
Jul 06 01:12:15.864048 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:15.863913    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvzw5\" (UniqueName: \"kubernetes.io/projected/00541936-546e-48c6-a8a6-a9d7b0617951-kube-api-access-hvzw5\") pod \"authorino-65685d8686-mwnn8\" (UID: \"00541936-546e-48c6-a8a6-a9d7b0617951\") " pod="kuadrant-system/authorino-65685d8686-mwnn8"
Jul 06 01:12:15.866324 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:15.866290    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/00541936-546e-48c6-a8a6-a9d7b0617951-tls-cert\") pod \"authorino-65685d8686-mwnn8\" (UID: \"00541936-546e-48c6-a8a6-a9d7b0617951\") " pod="kuadrant-system/authorino-65685d8686-mwnn8"
Jul 06 01:12:15.871602 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:15.871583    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvzw5\" (UniqueName: \"kubernetes.io/projected/00541936-546e-48c6-a8a6-a9d7b0617951-kube-api-access-hvzw5\") pod \"authorino-65685d8686-mwnn8\" (UID: \"00541936-546e-48c6-a8a6-a9d7b0617951\") " pod="kuadrant-system/authorino-65685d8686-mwnn8"
Jul 06 01:12:16.009190 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:16.009159    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65685d8686-mwnn8"
Jul 06 01:12:16.010421 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:16.010389    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-8h6v5" event={"ID":"293db336-d0ad-4674-bff1-32724dee95ca","Type":"ContainerStarted","Data":"242d81df4b82394fe70b50c659760b9744c916c007163e653625d568f8d08ae1"}
Jul 06 01:12:16.010534 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:16.010442    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79876f8978-7qbl7"
Jul 06 01:12:16.018139 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:16.018117    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79876f8978-7qbl7"
Jul 06 01:12:16.065998 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:16.065969    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2fx2\" (UniqueName: \"kubernetes.io/projected/c3624ec5-a5e8-40e8-8cfe-68a255ad51c4-kube-api-access-z2fx2\") pod \"c3624ec5-a5e8-40e8-8cfe-68a255ad51c4\" (UID: \"c3624ec5-a5e8-40e8-8cfe-68a255ad51c4\") "
Jul 06 01:12:16.068182 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:16.068126    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3624ec5-a5e8-40e8-8cfe-68a255ad51c4-kube-api-access-z2fx2" (OuterVolumeSpecName: "kube-api-access-z2fx2") pod "c3624ec5-a5e8-40e8-8cfe-68a255ad51c4" (UID: "c3624ec5-a5e8-40e8-8cfe-68a255ad51c4"). InnerVolumeSpecName "kube-api-access-z2fx2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:12:16.144504 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:16.144482    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-65685d8686-mwnn8"]
Jul 06 01:12:16.147311 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:12:16.147288    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod00541936_546e_48c6_a8a6_a9d7b0617951.slice/crio-46e7ff53385fa61dac186c15d25a8178dc610233812449ef9d61d9523f366c68 WatchSource:0}: Error finding container 46e7ff53385fa61dac186c15d25a8178dc610233812449ef9d61d9523f366c68: Status 404 returned error can't find the container with id 46e7ff53385fa61dac186c15d25a8178dc610233812449ef9d61d9523f366c68
Jul 06 01:12:16.167519 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:16.167493    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2fx2\" (UniqueName: \"kubernetes.io/projected/c3624ec5-a5e8-40e8-8cfe-68a255ad51c4-kube-api-access-z2fx2\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:12:17.016599 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:17.016495    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-8h6v5" event={"ID":"293db336-d0ad-4674-bff1-32724dee95ca","Type":"ContainerStarted","Data":"65236a435a6702471f91a642247e1b00cf00491312e6bd7c119ae435f6d4c07e"}
Jul 06 01:12:17.016599 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:17.016555    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-8h6v5" podUID="293db336-d0ad-4674-bff1-32724dee95ca" containerName="authorino" containerID="cri-o://65236a435a6702471f91a642247e1b00cf00491312e6bd7c119ae435f6d4c07e" gracePeriod=30
Jul 06 01:12:17.018029 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:17.018004    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65685d8686-mwnn8" event={"ID":"00541936-546e-48c6-a8a6-a9d7b0617951","Type":"ContainerStarted","Data":"e2adb210debfad01e31c11fc694a7a9c685d5a5f9ae7f653e62b1e733e287786"}
Jul 06 01:12:17.018169 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:17.018039    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65685d8686-mwnn8" event={"ID":"00541936-546e-48c6-a8a6-a9d7b0617951","Type":"ContainerStarted","Data":"46e7ff53385fa61dac186c15d25a8178dc610233812449ef9d61d9523f366c68"}
Jul 06 01:12:17.018169 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:17.018078    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79876f8978-7qbl7"
Jul 06 01:12:17.031672 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:17.031620    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-8h6v5" podStartSLOduration=1.645424315 podStartE2EDuration="2.031602946s" totalImagesPullingTime="386.178631ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:12:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:12:17.031365457 +0000 UTC m=+768.842340701" watchObservedRunningTime="2026-07-06 01:12:17.031602946 +0000 UTC m=+768.842578189"
Jul 06 01:12:17.054204 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:17.054175    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-79876f8978-7qbl7"]
Jul 06 01:12:17.056772 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:17.056751    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-79876f8978-7qbl7"]
Jul 06 01:12:17.069089 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:17.069043    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-65685d8686-mwnn8" podStartSLOduration=1.7365084469999998 podStartE2EDuration="2.069028386s" totalImagesPullingTime="332.519939ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:12:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:12:17.067868337 +0000 UTC m=+768.878843579" watchObservedRunningTime="2026-07-06 01:12:17.069028386 +0000 UTC m=+768.880003640"
Jul 06 01:12:17.264673 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:17.264649    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8h6v5"
Jul 06 01:12:17.377741 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:17.377708    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8xqq\" (UniqueName: \"kubernetes.io/projected/293db336-d0ad-4674-bff1-32724dee95ca-kube-api-access-p8xqq\") pod \"293db336-d0ad-4674-bff1-32724dee95ca\" (UID: \"293db336-d0ad-4674-bff1-32724dee95ca\") "
Jul 06 01:12:17.379715 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:17.379685    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/293db336-d0ad-4674-bff1-32724dee95ca-kube-api-access-p8xqq" (OuterVolumeSpecName: "kube-api-access-p8xqq") pod "293db336-d0ad-4674-bff1-32724dee95ca" (UID: "293db336-d0ad-4674-bff1-32724dee95ca"). InnerVolumeSpecName "kube-api-access-p8xqq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:12:17.478316 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:17.478283    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8xqq\" (UniqueName: \"kubernetes.io/projected/293db336-d0ad-4674-bff1-32724dee95ca-kube-api-access-p8xqq\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:12:18.023491 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:18.023453    2562 generic.go:356] "Generic (PLEG): container finished" podID="293db336-d0ad-4674-bff1-32724dee95ca" containerID="65236a435a6702471f91a642247e1b00cf00491312e6bd7c119ae435f6d4c07e" exitCode=0
Jul 06 01:12:18.023884 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:18.023509    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8h6v5"
Jul 06 01:12:18.023884 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:18.023543    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-8h6v5" event={"ID":"293db336-d0ad-4674-bff1-32724dee95ca","Type":"ContainerDied","Data":"65236a435a6702471f91a642247e1b00cf00491312e6bd7c119ae435f6d4c07e"}
Jul 06 01:12:18.023884 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:18.023589    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-8h6v5" event={"ID":"293db336-d0ad-4674-bff1-32724dee95ca","Type":"ContainerDied","Data":"242d81df4b82394fe70b50c659760b9744c916c007163e653625d568f8d08ae1"}
Jul 06 01:12:18.023884 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:18.023613    2562 scope.go:117] "RemoveContainer" containerID="65236a435a6702471f91a642247e1b00cf00491312e6bd7c119ae435f6d4c07e"
Jul 06 01:12:18.035384 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:18.035367    2562 scope.go:117] "RemoveContainer" containerID="65236a435a6702471f91a642247e1b00cf00491312e6bd7c119ae435f6d4c07e"
Jul 06 01:12:18.035655 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:12:18.035635    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65236a435a6702471f91a642247e1b00cf00491312e6bd7c119ae435f6d4c07e\": container with ID starting with 65236a435a6702471f91a642247e1b00cf00491312e6bd7c119ae435f6d4c07e not found: ID does not exist" containerID="65236a435a6702471f91a642247e1b00cf00491312e6bd7c119ae435f6d4c07e"
Jul 06 01:12:18.035720 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:18.035668    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65236a435a6702471f91a642247e1b00cf00491312e6bd7c119ae435f6d4c07e"} err="failed to get container status \"65236a435a6702471f91a642247e1b00cf00491312e6bd7c119ae435f6d4c07e\": rpc error: code = NotFound desc = could not find container \"65236a435a6702471f91a642247e1b00cf00491312e6bd7c119ae435f6d4c07e\": container with ID starting with 65236a435a6702471f91a642247e1b00cf00491312e6bd7c119ae435f6d4c07e not found: ID does not exist"
Jul 06 01:12:18.044937 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:18.044914    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8h6v5"]
Jul 06 01:12:18.049068 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:18.049047    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8h6v5"]
Jul 06 01:12:18.752341 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:18.752307    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="293db336-d0ad-4674-bff1-32724dee95ca" path="/var/lib/kubelet/pods/293db336-d0ad-4674-bff1-32724dee95ca/volumes"
Jul 06 01:12:18.752636 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:12:18.752624    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3624ec5-a5e8-40e8-8cfe-68a255ad51c4" path="/var/lib/kubelet/pods/c3624ec5-a5e8-40e8-8cfe-68a255ad51c4/volumes"
Jul 06 01:13:20.343567 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:20.343533    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g"]
Jul 06 01:13:20.344077 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:20.343931    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="293db336-d0ad-4674-bff1-32724dee95ca" containerName="authorino"
Jul 06 01:13:20.344077 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:20.343948    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="293db336-d0ad-4674-bff1-32724dee95ca" containerName="authorino"
Jul 06 01:13:20.344077 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:20.344051    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="293db336-d0ad-4674-bff1-32724dee95ca" containerName="authorino"
Jul 06 01:13:20.347239 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:20.347209    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g"
Jul 06 01:13:20.350843 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:20.350819    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 01:13:20.351035 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:20.351014    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 06 01:13:20.351091 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:20.351033    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 01:13:20.351091 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:20.351040    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-xmhnf\""
Jul 06 01:13:20.356587 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:20.356563    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g"]
Jul 06 01:13:20.449339 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:20.449296    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb205dfa-8776-4a97-866c-2408d9bbb245-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g\" (UID: \"cb205dfa-8776-4a97-866c-2408d9bbb245\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g"
Jul 06 01:13:20.449339 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:20.449340    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb205dfa-8776-4a97-866c-2408d9bbb245-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g\" (UID: \"cb205dfa-8776-4a97-866c-2408d9bbb245\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g"
Jul 06 01:13:20.449582 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:20.449379    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb205dfa-8776-4a97-866c-2408d9bbb245-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g\" (UID: \"cb205dfa-8776-4a97-866c-2408d9bbb245\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g"
Jul 06 01:13:20.449582 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:20.449399    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrl8d\" (UniqueName: \"kubernetes.io/projected/cb205dfa-8776-4a97-866c-2408d9bbb245-kube-api-access-vrl8d\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g\" (UID: \"cb205dfa-8776-4a97-866c-2408d9bbb245\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g"
Jul 06 01:13:20.449582 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:20.449426    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb205dfa-8776-4a97-866c-2408d9bbb245-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g\" (UID: \"cb205dfa-8776-4a97-866c-2408d9bbb245\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g"
Jul 06 01:13:20.449582 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:20.449451    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb205dfa-8776-4a97-866c-2408d9bbb245-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g\" (UID: \"cb205dfa-8776-4a97-866c-2408d9bbb245\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g"
Jul 06 01:13:20.550852 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:20.550809    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb205dfa-8776-4a97-866c-2408d9bbb245-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g\" (UID: \"cb205dfa-8776-4a97-866c-2408d9bbb245\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g"
Jul 06 01:13:20.550852 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:20.550858    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb205dfa-8776-4a97-866c-2408d9bbb245-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g\" (UID: \"cb205dfa-8776-4a97-866c-2408d9bbb245\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g"
Jul 06 01:13:20.551104 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:20.550893    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb205dfa-8776-4a97-866c-2408d9bbb245-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g\" (UID: \"cb205dfa-8776-4a97-866c-2408d9bbb245\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g"
Jul 06 01:13:20.551104 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:20.550912    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb205dfa-8776-4a97-866c-2408d9bbb245-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g\" (UID: \"cb205dfa-8776-4a97-866c-2408d9bbb245\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g"
Jul 06 01:13:20.551104 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:20.550945    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb205dfa-8776-4a97-866c-2408d9bbb245-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g\" (UID: \"cb205dfa-8776-4a97-866c-2408d9bbb245\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g"
Jul 06 01:13:20.551104 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:20.550962    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrl8d\" (UniqueName: \"kubernetes.io/projected/cb205dfa-8776-4a97-866c-2408d9bbb245-kube-api-access-vrl8d\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g\" (UID: \"cb205dfa-8776-4a97-866c-2408d9bbb245\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g"
Jul 06 01:13:20.551418 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:20.551394    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb205dfa-8776-4a97-866c-2408d9bbb245-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g\" (UID: \"cb205dfa-8776-4a97-866c-2408d9bbb245\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g"
Jul 06 01:13:20.551467 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:20.551406    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb205dfa-8776-4a97-866c-2408d9bbb245-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g\" (UID: \"cb205dfa-8776-4a97-866c-2408d9bbb245\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g"
Jul 06 01:13:20.551467 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:20.551444    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb205dfa-8776-4a97-866c-2408d9bbb245-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g\" (UID: \"cb205dfa-8776-4a97-866c-2408d9bbb245\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g"
Jul 06 01:13:20.553059 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:20.553031    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb205dfa-8776-4a97-866c-2408d9bbb245-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g\" (UID: \"cb205dfa-8776-4a97-866c-2408d9bbb245\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g"
Jul 06 01:13:20.553399 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:20.553381    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb205dfa-8776-4a97-866c-2408d9bbb245-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g\" (UID: \"cb205dfa-8776-4a97-866c-2408d9bbb245\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g"
Jul 06 01:13:20.558323 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:20.558300    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrl8d\" (UniqueName: \"kubernetes.io/projected/cb205dfa-8776-4a97-866c-2408d9bbb245-kube-api-access-vrl8d\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g\" (UID: \"cb205dfa-8776-4a97-866c-2408d9bbb245\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g"
Jul 06 01:13:20.658583 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:20.658491    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g"
Jul 06 01:13:20.788764 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:20.788738    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g"]
Jul 06 01:13:20.790814 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:13:20.790785    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb205dfa_8776_4a97_866c_2408d9bbb245.slice/crio-8cc8f932089374dc90abcdd7a3082f58dc2f536832355485bfaa43c19f99a0a9 WatchSource:0}: Error finding container 8cc8f932089374dc90abcdd7a3082f58dc2f536832355485bfaa43c19f99a0a9: Status 404 returned error can't find the container with id 8cc8f932089374dc90abcdd7a3082f58dc2f536832355485bfaa43c19f99a0a9
Jul 06 01:13:21.317975 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:21.315793    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g" event={"ID":"cb205dfa-8776-4a97-866c-2408d9bbb245","Type":"ContainerStarted","Data":"8cc8f932089374dc90abcdd7a3082f58dc2f536832355485bfaa43c19f99a0a9"}
Jul 06 01:13:22.322567 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:22.322473    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g" event={"ID":"cb205dfa-8776-4a97-866c-2408d9bbb245","Type":"ContainerStarted","Data":"4c152a690e3c6edb49d11459eaa24882a0860f7b6bccd72c913cfdae86f55c10"}
Jul 06 01:13:22.339890 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:22.339843    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g" podStartSLOduration=1.089095531 podStartE2EDuration="2.339827063s" totalImagesPullingTime="1.250731532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:13:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:13:22.337858205 +0000 UTC m=+834.148833464" watchObservedRunningTime="2026-07-06 01:13:22.339827063 +0000 UTC m=+834.150802306"
Jul 06 01:13:30.659023 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:30.658974    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g"
Jul 06 01:13:30.659509 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:30.659056    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g"
Jul 06 01:13:30.671469 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:30.671444    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g"
Jul 06 01:13:31.378123 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:31.378090    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g"
Jul 06 01:13:33.130482 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:33.130451    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jtd6q"]
Jul 06 01:13:33.134365 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:33.134343    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jtd6q"
Jul 06 01:13:33.136947 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:33.136928    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 06 01:13:33.144181 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:33.144140    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jtd6q"]
Jul 06 01:13:33.263795 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:33.263746    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2dac909-bcef-4d85-98fe-4fe41f7ca6f4-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jtd6q\" (UID: \"c2dac909-bcef-4d85-98fe-4fe41f7ca6f4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jtd6q"
Jul 06 01:13:33.263795 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:33.263796    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2dac909-bcef-4d85-98fe-4fe41f7ca6f4-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jtd6q\" (UID: \"c2dac909-bcef-4d85-98fe-4fe41f7ca6f4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jtd6q"
Jul 06 01:13:33.264017 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:33.263828    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2dac909-bcef-4d85-98fe-4fe41f7ca6f4-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jtd6q\" (UID: \"c2dac909-bcef-4d85-98fe-4fe41f7ca6f4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jtd6q"
Jul 06 01:13:33.264017 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:33.263879    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2dac909-bcef-4d85-98fe-4fe41f7ca6f4-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jtd6q\" (UID: \"c2dac909-bcef-4d85-98fe-4fe41f7ca6f4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jtd6q"
Jul 06 01:13:33.264017 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:33.263920    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2dac909-bcef-4d85-98fe-4fe41f7ca6f4-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jtd6q\" (UID: \"c2dac909-bcef-4d85-98fe-4fe41f7ca6f4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jtd6q"
Jul 06 01:13:33.264017 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:33.263996    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wskk\" (UniqueName: \"kubernetes.io/projected/c2dac909-bcef-4d85-98fe-4fe41f7ca6f4-kube-api-access-2wskk\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jtd6q\" (UID: \"c2dac909-bcef-4d85-98fe-4fe41f7ca6f4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jtd6q"
Jul 06 01:13:33.365045 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:33.365005    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2dac909-bcef-4d85-98fe-4fe41f7ca6f4-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jtd6q\" (UID: \"c2dac909-bcef-4d85-98fe-4fe41f7ca6f4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jtd6q"
Jul 06 01:13:33.365045 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:33.365048    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2dac909-bcef-4d85-98fe-4fe41f7ca6f4-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jtd6q\" (UID: \"c2dac909-bcef-4d85-98fe-4fe41f7ca6f4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jtd6q"
Jul 06 01:13:33.365277 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:33.365117    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wskk\" (UniqueName: \"kubernetes.io/projected/c2dac909-bcef-4d85-98fe-4fe41f7ca6f4-kube-api-access-2wskk\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jtd6q\" (UID: \"c2dac909-bcef-4d85-98fe-4fe41f7ca6f4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jtd6q"
Jul 06 01:13:33.365277 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:33.365221    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2dac909-bcef-4d85-98fe-4fe41f7ca6f4-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jtd6q\" (UID: \"c2dac909-bcef-4d85-98fe-4fe41f7ca6f4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jtd6q"
Jul 06 01:13:33.365277 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:33.365249    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2dac909-bcef-4d85-98fe-4fe41f7ca6f4-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jtd6q\" (UID: \"c2dac909-bcef-4d85-98fe-4fe41f7ca6f4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jtd6q"
Jul 06 01:13:33.365411 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:33.365278    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2dac909-bcef-4d85-98fe-4fe41f7ca6f4-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jtd6q\" (UID: \"c2dac909-bcef-4d85-98fe-4fe41f7ca6f4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jtd6q"
Jul 06 01:13:33.365632 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:33.365599    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2dac909-bcef-4d85-98fe-4fe41f7ca6f4-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jtd6q\" (UID: \"c2dac909-bcef-4d85-98fe-4fe41f7ca6f4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jtd6q"
Jul 06 01:13:33.365632 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:33.365614    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2dac909-bcef-4d85-98fe-4fe41f7ca6f4-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jtd6q\" (UID: \"c2dac909-bcef-4d85-98fe-4fe41f7ca6f4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jtd6q"
Jul 06 01:13:33.365768 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:33.365650    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2dac909-bcef-4d85-98fe-4fe41f7ca6f4-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jtd6q\" (UID: \"c2dac909-bcef-4d85-98fe-4fe41f7ca6f4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jtd6q"
Jul 06 01:13:33.367415 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:33.367392    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2dac909-bcef-4d85-98fe-4fe41f7ca6f4-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jtd6q\" (UID: \"c2dac909-bcef-4d85-98fe-4fe41f7ca6f4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jtd6q"
Jul 06 01:13:33.367690 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:33.367672    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2dac909-bcef-4d85-98fe-4fe41f7ca6f4-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jtd6q\" (UID: \"c2dac909-bcef-4d85-98fe-4fe41f7ca6f4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jtd6q"
Jul 06 01:13:33.372679 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:33.372657    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wskk\" (UniqueName: \"kubernetes.io/projected/c2dac909-bcef-4d85-98fe-4fe41f7ca6f4-kube-api-access-2wskk\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jtd6q\" (UID: \"c2dac909-bcef-4d85-98fe-4fe41f7ca6f4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jtd6q"
Jul 06 01:13:33.444646 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:33.444559    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jtd6q"
Jul 06 01:13:33.575903 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:33.575880    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jtd6q"]
Jul 06 01:13:33.578130 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:13:33.578095    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2dac909_bcef_4d85_98fe_4fe41f7ca6f4.slice/crio-dbb7566484c63dd2aeec2176698429812db59057102b8ac8ea2faf74998a5e16 WatchSource:0}: Error finding container dbb7566484c63dd2aeec2176698429812db59057102b8ac8ea2faf74998a5e16: Status 404 returned error can't find the container with id dbb7566484c63dd2aeec2176698429812db59057102b8ac8ea2faf74998a5e16
Jul 06 01:13:34.380487 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:34.380449    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jtd6q" event={"ID":"c2dac909-bcef-4d85-98fe-4fe41f7ca6f4","Type":"ContainerStarted","Data":"41ffc80a13e0cfc1bb289fa337d24c1eeb58185bb5b032cbc484fa3467088715"}
Jul 06 01:13:34.380847 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:34.380515    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jtd6q" event={"ID":"c2dac909-bcef-4d85-98fe-4fe41f7ca6f4","Type":"ContainerStarted","Data":"dbb7566484c63dd2aeec2176698429812db59057102b8ac8ea2faf74998a5e16"}
Jul 06 01:13:34.397443 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:34.397393    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jtd6q" podStartSLOduration=1.222261798 podStartE2EDuration="1.397376851s" totalImagesPullingTime="175.115053ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:13:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:13:34.396202667 +0000 UTC m=+846.207177910" watchObservedRunningTime="2026-07-06 01:13:34.397376851 +0000 UTC m=+846.208352093"
Jul 06 01:13:43.445767 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:43.445734    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jtd6q"
Jul 06 01:13:43.446185 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:43.445801    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jtd6q"
Jul 06 01:13:43.458705 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:43.458674    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jtd6q"
Jul 06 01:13:44.438443 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:13:44.438411    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jtd6q"
Jul 06 01:15:00.139768 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:15:00.139729    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29721675-k4qcc"]
Jul 06 01:15:00.143202 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:15:00.143184    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29721675-k4qcc"
Jul 06 01:15:00.145488 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:15:00.145464    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-84mvh\""
Jul 06 01:15:00.149712 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:15:00.149687    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29721675-k4qcc"]
Jul 06 01:15:00.249819 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:15:00.249774    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9pgk\" (UniqueName: \"kubernetes.io/projected/29e61ada-30a1-4341-968d-7804bb8832b7-kube-api-access-d9pgk\") pod \"maas-api-key-cleanup-29721675-k4qcc\" (UID: \"29e61ada-30a1-4341-968d-7804bb8832b7\") " pod="opendatahub/maas-api-key-cleanup-29721675-k4qcc"
Jul 06 01:15:00.351222 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:15:00.351185    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9pgk\" (UniqueName: \"kubernetes.io/projected/29e61ada-30a1-4341-968d-7804bb8832b7-kube-api-access-d9pgk\") pod \"maas-api-key-cleanup-29721675-k4qcc\" (UID: \"29e61ada-30a1-4341-968d-7804bb8832b7\") " pod="opendatahub/maas-api-key-cleanup-29721675-k4qcc"
Jul 06 01:15:00.359550 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:15:00.359520    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9pgk\" (UniqueName: \"kubernetes.io/projected/29e61ada-30a1-4341-968d-7804bb8832b7-kube-api-access-d9pgk\") pod \"maas-api-key-cleanup-29721675-k4qcc\" (UID: \"29e61ada-30a1-4341-968d-7804bb8832b7\") " pod="opendatahub/maas-api-key-cleanup-29721675-k4qcc"
Jul 06 01:15:00.455428 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:15:00.455338    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29721675-k4qcc"
Jul 06 01:15:00.589290 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:15:00.589265    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29721675-k4qcc"]
Jul 06 01:15:00.591511 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:15:00.591483    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29e61ada_30a1_4341_968d_7804bb8832b7.slice/crio-3b6e0eb15bc7a36811bdc49d84af3f4f6296458c602f5283dbb93a927685c44d WatchSource:0}: Error finding container 3b6e0eb15bc7a36811bdc49d84af3f4f6296458c602f5283dbb93a927685c44d: Status 404 returned error can't find the container with id 3b6e0eb15bc7a36811bdc49d84af3f4f6296458c602f5283dbb93a927685c44d
Jul 06 01:15:00.776592 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:15:00.776495    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29721675-k4qcc" event={"ID":"29e61ada-30a1-4341-968d-7804bb8832b7","Type":"ContainerStarted","Data":"3b6e0eb15bc7a36811bdc49d84af3f4f6296458c602f5283dbb93a927685c44d"}
Jul 06 01:15:04.797235 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:15:04.797200    2562 generic.go:356] "Generic (PLEG): container finished" podID="29e61ada-30a1-4341-968d-7804bb8832b7" containerID="1f85a28194cfdfb50a3de41f5190c86b82d33e9afb4712f38a439d3996a2f22a" exitCode=0
Jul 06 01:15:04.797638 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:15:04.797287    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29721675-k4qcc" event={"ID":"29e61ada-30a1-4341-968d-7804bb8832b7","Type":"ContainerDied","Data":"1f85a28194cfdfb50a3de41f5190c86b82d33e9afb4712f38a439d3996a2f22a"}
Jul 06 01:15:05.935254 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:15:05.935228    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29721675-k4qcc"
Jul 06 01:15:06.105189 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:15:06.105128    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9pgk\" (UniqueName: \"kubernetes.io/projected/29e61ada-30a1-4341-968d-7804bb8832b7-kube-api-access-d9pgk\") pod \"29e61ada-30a1-4341-968d-7804bb8832b7\" (UID: \"29e61ada-30a1-4341-968d-7804bb8832b7\") "
Jul 06 01:15:06.107372 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:15:06.107344    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29e61ada-30a1-4341-968d-7804bb8832b7-kube-api-access-d9pgk" (OuterVolumeSpecName: "kube-api-access-d9pgk") pod "29e61ada-30a1-4341-968d-7804bb8832b7" (UID: "29e61ada-30a1-4341-968d-7804bb8832b7"). InnerVolumeSpecName "kube-api-access-d9pgk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:15:06.205955 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:15:06.205918    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9pgk\" (UniqueName: \"kubernetes.io/projected/29e61ada-30a1-4341-968d-7804bb8832b7-kube-api-access-d9pgk\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:15:06.428387 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:15:06.428285    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-65685d8686-mwnn8"]
Jul 06 01:15:06.428561 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:15:06.428480    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-65685d8686-mwnn8" podUID="00541936-546e-48c6-a8a6-a9d7b0617951" containerName="authorino" containerID="cri-o://e2adb210debfad01e31c11fc694a7a9c685d5a5f9ae7f653e62b1e733e287786" gracePeriod=30
Jul 06 01:15:06.676826 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:15:06.676800    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65685d8686-mwnn8"
Jul 06 01:15:06.808850 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:15:06.808815    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29721675-k4qcc" event={"ID":"29e61ada-30a1-4341-968d-7804bb8832b7","Type":"ContainerDied","Data":"3b6e0eb15bc7a36811bdc49d84af3f4f6296458c602f5283dbb93a927685c44d"}
Jul 06 01:15:06.809025 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:15:06.808882    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b6e0eb15bc7a36811bdc49d84af3f4f6296458c602f5283dbb93a927685c44d"
Jul 06 01:15:06.809025 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:15:06.808829    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29721675-k4qcc"
Jul 06 01:15:06.810164 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:15:06.810127    2562 generic.go:356] "Generic (PLEG): container finished" podID="00541936-546e-48c6-a8a6-a9d7b0617951" containerID="e2adb210debfad01e31c11fc694a7a9c685d5a5f9ae7f653e62b1e733e287786" exitCode=0
Jul 06 01:15:06.810275 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:15:06.810181    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65685d8686-mwnn8" event={"ID":"00541936-546e-48c6-a8a6-a9d7b0617951","Type":"ContainerDied","Data":"e2adb210debfad01e31c11fc694a7a9c685d5a5f9ae7f653e62b1e733e287786"}
Jul 06 01:15:06.810275 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:15:06.810222    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65685d8686-mwnn8" event={"ID":"00541936-546e-48c6-a8a6-a9d7b0617951","Type":"ContainerDied","Data":"46e7ff53385fa61dac186c15d25a8178dc610233812449ef9d61d9523f366c68"}
Jul 06 01:15:06.810275 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:15:06.810245    2562 scope.go:117] "RemoveContainer" containerID="e2adb210debfad01e31c11fc694a7a9c685d5a5f9ae7f653e62b1e733e287786"
Jul 06 01:15:06.810275 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:15:06.810192    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65685d8686-mwnn8"
Jul 06 01:15:06.811111 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:15:06.811090    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/00541936-546e-48c6-a8a6-a9d7b0617951-tls-cert\") pod \"00541936-546e-48c6-a8a6-a9d7b0617951\" (UID: \"00541936-546e-48c6-a8a6-a9d7b0617951\") "
Jul 06 01:15:06.811331 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:15:06.811134    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvzw5\" (UniqueName: \"kubernetes.io/projected/00541936-546e-48c6-a8a6-a9d7b0617951-kube-api-access-hvzw5\") pod \"00541936-546e-48c6-a8a6-a9d7b0617951\" (UID: \"00541936-546e-48c6-a8a6-a9d7b0617951\") "
Jul 06 01:15:06.813427 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:15:06.813399    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00541936-546e-48c6-a8a6-a9d7b0617951-kube-api-access-hvzw5" (OuterVolumeSpecName: "kube-api-access-hvzw5") pod "00541936-546e-48c6-a8a6-a9d7b0617951" (UID: "00541936-546e-48c6-a8a6-a9d7b0617951"). InnerVolumeSpecName "kube-api-access-hvzw5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:15:06.819097 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:15:06.819077    2562 scope.go:117] "RemoveContainer" containerID="e2adb210debfad01e31c11fc694a7a9c685d5a5f9ae7f653e62b1e733e287786"
Jul 06 01:15:06.819379 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:15:06.819359    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2adb210debfad01e31c11fc694a7a9c685d5a5f9ae7f653e62b1e733e287786\": container with ID starting with e2adb210debfad01e31c11fc694a7a9c685d5a5f9ae7f653e62b1e733e287786 not found: ID does not exist" containerID="e2adb210debfad01e31c11fc694a7a9c685d5a5f9ae7f653e62b1e733e287786"
Jul 06 01:15:06.819446 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:15:06.819386    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2adb210debfad01e31c11fc694a7a9c685d5a5f9ae7f653e62b1e733e287786"} err="failed to get container status \"e2adb210debfad01e31c11fc694a7a9c685d5a5f9ae7f653e62b1e733e287786\": rpc error: code = NotFound desc = could not find container \"e2adb210debfad01e31c11fc694a7a9c685d5a5f9ae7f653e62b1e733e287786\": container with ID starting with e2adb210debfad01e31c11fc694a7a9c685d5a5f9ae7f653e62b1e733e287786 not found: ID does not exist"
Jul 06 01:15:06.822004 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:15:06.821986    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00541936-546e-48c6-a8a6-a9d7b0617951-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "00541936-546e-48c6-a8a6-a9d7b0617951" (UID: "00541936-546e-48c6-a8a6-a9d7b0617951"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:15:06.912233 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:15:06.912194    2562 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/00541936-546e-48c6-a8a6-a9d7b0617951-tls-cert\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:15:06.912233 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:15:06.912227    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvzw5\" (UniqueName: \"kubernetes.io/projected/00541936-546e-48c6-a8a6-a9d7b0617951-kube-api-access-hvzw5\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:15:07.130773 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:15:07.130739    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-65685d8686-mwnn8"]
Jul 06 01:15:07.136832 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:15:07.136806    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-65685d8686-mwnn8"]
Jul 06 01:15:08.753015 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:15:08.752973    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00541936-546e-48c6-a8a6-a9d7b0617951" path="/var/lib/kubelet/pods/00541936-546e-48c6-a8a6-a9d7b0617951/volumes"
Jul 06 01:28:15.993054 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:15.993010    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj"]
Jul 06 01:28:15.995821 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:15.993432    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29e61ada-30a1-4341-968d-7804bb8832b7" containerName="cleanup"
Jul 06 01:28:15.995821 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:15.993449    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="29e61ada-30a1-4341-968d-7804bb8832b7" containerName="cleanup"
Jul 06 01:28:15.995821 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:15.993493    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00541936-546e-48c6-a8a6-a9d7b0617951" containerName="authorino"
Jul 06 01:28:15.995821 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:15.993505    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="00541936-546e-48c6-a8a6-a9d7b0617951" containerName="authorino"
Jul 06 01:28:15.995821 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:15.993612    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="00541936-546e-48c6-a8a6-a9d7b0617951" containerName="authorino"
Jul 06 01:28:15.995821 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:15.993631    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="29e61ada-30a1-4341-968d-7804bb8832b7" containerName="cleanup"
Jul 06 01:28:15.996915 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:15.996892    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj"
Jul 06 01:28:15.999281 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:15.999262    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 01:28:15.999446 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:15.999429    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-4585f71e-openshift-default-dockercfg-t6kxl\""
Jul 06 01:28:16.018776 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:16.018734    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj"]
Jul 06 01:28:16.085537 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:16.085504    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a57ea74-8b0d-485a-992d-50a41260d99c-istio-envoy\") pod \"e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj\" (UID: \"4a57ea74-8b0d-485a-992d-50a41260d99c\") " pod="openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj"
Jul 06 01:28:16.085741 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:16.085543    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a57ea74-8b0d-485a-992d-50a41260d99c-istiod-ca-cert\") pod \"e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj\" (UID: \"4a57ea74-8b0d-485a-992d-50a41260d99c\") " pod="openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj"
Jul 06 01:28:16.085741 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:16.085572    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a57ea74-8b0d-485a-992d-50a41260d99c-istio-data\") pod \"e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj\" (UID: \"4a57ea74-8b0d-485a-992d-50a41260d99c\") " pod="openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj"
Jul 06 01:28:16.085741 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:16.085595    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt74z\" (UniqueName: \"kubernetes.io/projected/4a57ea74-8b0d-485a-992d-50a41260d99c-kube-api-access-bt74z\") pod \"e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj\" (UID: \"4a57ea74-8b0d-485a-992d-50a41260d99c\") " pod="openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj"
Jul 06 01:28:16.085741 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:16.085693    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a57ea74-8b0d-485a-992d-50a41260d99c-credential-socket\") pod \"e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj\" (UID: \"4a57ea74-8b0d-485a-992d-50a41260d99c\") " pod="openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj"
Jul 06 01:28:16.085741 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:16.085728    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a57ea74-8b0d-485a-992d-50a41260d99c-workload-certs\") pod \"e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj\" (UID: \"4a57ea74-8b0d-485a-992d-50a41260d99c\") " pod="openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj"
Jul 06 01:28:16.085961 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:16.085802    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a57ea74-8b0d-485a-992d-50a41260d99c-istio-token\") pod \"e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj\" (UID: \"4a57ea74-8b0d-485a-992d-50a41260d99c\") " pod="openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj"
Jul 06 01:28:16.085961 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:16.085838    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a57ea74-8b0d-485a-992d-50a41260d99c-workload-socket\") pod \"e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj\" (UID: \"4a57ea74-8b0d-485a-992d-50a41260d99c\") " pod="openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj"
Jul 06 01:28:16.085961 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:16.085855    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a57ea74-8b0d-485a-992d-50a41260d99c-istio-podinfo\") pod \"e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj\" (UID: \"4a57ea74-8b0d-485a-992d-50a41260d99c\") " pod="openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj"
Jul 06 01:28:16.186467 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:16.186432    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a57ea74-8b0d-485a-992d-50a41260d99c-istio-envoy\") pod \"e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj\" (UID: \"4a57ea74-8b0d-485a-992d-50a41260d99c\") " pod="openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj"
Jul 06 01:28:16.186467 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:16.186470    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a57ea74-8b0d-485a-992d-50a41260d99c-istiod-ca-cert\") pod \"e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj\" (UID: \"4a57ea74-8b0d-485a-992d-50a41260d99c\") " pod="openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj"
Jul 06 01:28:16.186689 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:16.186494    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a57ea74-8b0d-485a-992d-50a41260d99c-istio-data\") pod \"e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj\" (UID: \"4a57ea74-8b0d-485a-992d-50a41260d99c\") " pod="openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj"
Jul 06 01:28:16.186689 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:16.186517    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt74z\" (UniqueName: \"kubernetes.io/projected/4a57ea74-8b0d-485a-992d-50a41260d99c-kube-api-access-bt74z\") pod \"e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj\" (UID: \"4a57ea74-8b0d-485a-992d-50a41260d99c\") " pod="openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj"
Jul 06 01:28:16.186798 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:16.186719    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a57ea74-8b0d-485a-992d-50a41260d99c-credential-socket\") pod \"e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj\" (UID: \"4a57ea74-8b0d-485a-992d-50a41260d99c\") " pod="openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj"
Jul 06 01:28:16.186798 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:16.186763    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a57ea74-8b0d-485a-992d-50a41260d99c-workload-certs\") pod \"e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj\" (UID: \"4a57ea74-8b0d-485a-992d-50a41260d99c\") " pod="openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj"
Jul 06 01:28:16.186895 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:16.186840    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a57ea74-8b0d-485a-992d-50a41260d99c-istio-token\") pod \"e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj\" (UID: \"4a57ea74-8b0d-485a-992d-50a41260d99c\") " pod="openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj"
Jul 06 01:28:16.186947 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:16.186908    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a57ea74-8b0d-485a-992d-50a41260d99c-istio-data\") pod \"e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj\" (UID: \"4a57ea74-8b0d-485a-992d-50a41260d99c\") " pod="openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj"
Jul 06 01:28:16.186947 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:16.186910    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a57ea74-8b0d-485a-992d-50a41260d99c-workload-socket\") pod \"e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj\" (UID: \"4a57ea74-8b0d-485a-992d-50a41260d99c\") " pod="openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj"
Jul 06 01:28:16.187054 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:16.186956    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a57ea74-8b0d-485a-992d-50a41260d99c-istio-podinfo\") pod \"e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj\" (UID: \"4a57ea74-8b0d-485a-992d-50a41260d99c\") " pod="openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj"
Jul 06 01:28:16.187139 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:16.187115    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a57ea74-8b0d-485a-992d-50a41260d99c-credential-socket\") pod \"e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj\" (UID: \"4a57ea74-8b0d-485a-992d-50a41260d99c\") " pod="openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj"
Jul 06 01:28:16.187235 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:16.187137    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a57ea74-8b0d-485a-992d-50a41260d99c-workload-certs\") pod \"e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj\" (UID: \"4a57ea74-8b0d-485a-992d-50a41260d99c\") " pod="openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj"
Jul 06 01:28:16.187293 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:16.187261    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a57ea74-8b0d-485a-992d-50a41260d99c-workload-socket\") pod \"e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj\" (UID: \"4a57ea74-8b0d-485a-992d-50a41260d99c\") " pod="openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj"
Jul 06 01:28:16.187336 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:16.187299    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a57ea74-8b0d-485a-992d-50a41260d99c-istiod-ca-cert\") pod \"e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj\" (UID: \"4a57ea74-8b0d-485a-992d-50a41260d99c\") " pod="openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj"
Jul 06 01:28:16.188680 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:16.188658    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a57ea74-8b0d-485a-992d-50a41260d99c-istio-envoy\") pod \"e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj\" (UID: \"4a57ea74-8b0d-485a-992d-50a41260d99c\") " pod="openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj"
Jul 06 01:28:16.189205 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:16.189187    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a57ea74-8b0d-485a-992d-50a41260d99c-istio-podinfo\") pod \"e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj\" (UID: \"4a57ea74-8b0d-485a-992d-50a41260d99c\") " pod="openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj"
Jul 06 01:28:16.195457 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:16.195434    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a57ea74-8b0d-485a-992d-50a41260d99c-istio-token\") pod \"e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj\" (UID: \"4a57ea74-8b0d-485a-992d-50a41260d99c\") " pod="openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj"
Jul 06 01:28:16.196049 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:16.196029    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt74z\" (UniqueName: \"kubernetes.io/projected/4a57ea74-8b0d-485a-992d-50a41260d99c-kube-api-access-bt74z\") pod \"e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj\" (UID: \"4a57ea74-8b0d-485a-992d-50a41260d99c\") " pod="openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj"
Jul 06 01:28:16.307463 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:16.307364    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj"
Jul 06 01:28:16.442885 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:16.442861    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj"]
Jul 06 01:28:16.444800 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:28:16.444777    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a57ea74_8b0d_485a_992d_50a41260d99c.slice/crio-db92311197d32c052e694ce131f83d8779772bfcdf573b9c555068b05cd0a7eb WatchSource:0}: Error finding container db92311197d32c052e694ce131f83d8779772bfcdf573b9c555068b05cd0a7eb: Status 404 returned error can't find the container with id db92311197d32c052e694ce131f83d8779772bfcdf573b9c555068b05cd0a7eb
Jul 06 01:28:16.446765 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:16.446749    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 01:28:16.559410 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:16.559314    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj" event={"ID":"4a57ea74-8b0d-485a-992d-50a41260d99c","Type":"ContainerStarted","Data":"db92311197d32c052e694ce131f83d8779772bfcdf573b9c555068b05cd0a7eb"}
Jul 06 01:28:17.329607 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:17.329568    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-4585f71e-fd7cbb65f-v9qs8"]
Jul 06 01:28:17.334045 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:17.333970    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-4585f71e-fd7cbb65f-v9qs8"
Jul 06 01:28:17.337490 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:17.337467    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-84mvh\""
Jul 06 01:28:17.337607 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:17.337582    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-4585f71e-serving-cert\""
Jul 06 01:28:17.352512 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:17.352448    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-4585f71e-fd7cbb65f-v9qs8"]
Jul 06 01:28:17.399577 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:17.399536    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r29t6\" (UniqueName: \"kubernetes.io/projected/ff271354-6dc0-4433-b711-53eee1bcc47e-kube-api-access-r29t6\") pod \"maas-api-e2e-ait-4585f71e-fd7cbb65f-v9qs8\" (UID: \"ff271354-6dc0-4433-b711-53eee1bcc47e\") " pod="opendatahub/maas-api-e2e-ait-4585f71e-fd7cbb65f-v9qs8"
Jul 06 01:28:17.399776 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:17.399594    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff271354-6dc0-4433-b711-53eee1bcc47e-maas-api-tls\") pod \"maas-api-e2e-ait-4585f71e-fd7cbb65f-v9qs8\" (UID: \"ff271354-6dc0-4433-b711-53eee1bcc47e\") " pod="opendatahub/maas-api-e2e-ait-4585f71e-fd7cbb65f-v9qs8"
Jul 06 01:28:17.399776 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:17.399632    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff271354-6dc0-4433-b711-53eee1bcc47e-openshift-service-ca\") pod \"maas-api-e2e-ait-4585f71e-fd7cbb65f-v9qs8\" (UID: \"ff271354-6dc0-4433-b711-53eee1bcc47e\") " pod="opendatahub/maas-api-e2e-ait-4585f71e-fd7cbb65f-v9qs8"
Jul 06 01:28:17.500307 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:17.500261    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r29t6\" (UniqueName: \"kubernetes.io/projected/ff271354-6dc0-4433-b711-53eee1bcc47e-kube-api-access-r29t6\") pod \"maas-api-e2e-ait-4585f71e-fd7cbb65f-v9qs8\" (UID: \"ff271354-6dc0-4433-b711-53eee1bcc47e\") " pod="opendatahub/maas-api-e2e-ait-4585f71e-fd7cbb65f-v9qs8"
Jul 06 01:28:17.500307 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:17.500317    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff271354-6dc0-4433-b711-53eee1bcc47e-maas-api-tls\") pod \"maas-api-e2e-ait-4585f71e-fd7cbb65f-v9qs8\" (UID: \"ff271354-6dc0-4433-b711-53eee1bcc47e\") " pod="opendatahub/maas-api-e2e-ait-4585f71e-fd7cbb65f-v9qs8"
Jul 06 01:28:17.500560 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:17.500359    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff271354-6dc0-4433-b711-53eee1bcc47e-openshift-service-ca\") pod \"maas-api-e2e-ait-4585f71e-fd7cbb65f-v9qs8\" (UID: \"ff271354-6dc0-4433-b711-53eee1bcc47e\") " pod="opendatahub/maas-api-e2e-ait-4585f71e-fd7cbb65f-v9qs8"
Jul 06 01:28:17.501323 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:17.501283    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff271354-6dc0-4433-b711-53eee1bcc47e-openshift-service-ca\") pod \"maas-api-e2e-ait-4585f71e-fd7cbb65f-v9qs8\" (UID: \"ff271354-6dc0-4433-b711-53eee1bcc47e\") " pod="opendatahub/maas-api-e2e-ait-4585f71e-fd7cbb65f-v9qs8"
Jul 06 01:28:17.503748 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:17.503650    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff271354-6dc0-4433-b711-53eee1bcc47e-maas-api-tls\") pod \"maas-api-e2e-ait-4585f71e-fd7cbb65f-v9qs8\" (UID: \"ff271354-6dc0-4433-b711-53eee1bcc47e\") " pod="opendatahub/maas-api-e2e-ait-4585f71e-fd7cbb65f-v9qs8"
Jul 06 01:28:17.509743 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:17.509697    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r29t6\" (UniqueName: \"kubernetes.io/projected/ff271354-6dc0-4433-b711-53eee1bcc47e-kube-api-access-r29t6\") pod \"maas-api-e2e-ait-4585f71e-fd7cbb65f-v9qs8\" (UID: \"ff271354-6dc0-4433-b711-53eee1bcc47e\") " pod="opendatahub/maas-api-e2e-ait-4585f71e-fd7cbb65f-v9qs8"
Jul 06 01:28:17.662535 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:17.662495    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-4585f71e-fd7cbb65f-v9qs8"
Jul 06 01:28:17.822217 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:17.822132    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-4585f71e-fd7cbb65f-v9qs8"]
Jul 06 01:28:17.824667 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:28:17.824637    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff271354_6dc0_4433_b711_53eee1bcc47e.slice/crio-6f52711ed0df907740d48a5d4a83dae2e51984f700fd77ae54713e36c591513c WatchSource:0}: Error finding container 6f52711ed0df907740d48a5d4a83dae2e51984f700fd77ae54713e36c591513c: Status 404 returned error can't find the container with id 6f52711ed0df907740d48a5d4a83dae2e51984f700fd77ae54713e36c591513c
Jul 06 01:28:18.578818 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:18.578766    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-4585f71e-fd7cbb65f-v9qs8" event={"ID":"ff271354-6dc0-4433-b711-53eee1bcc47e","Type":"ContainerStarted","Data":"6f52711ed0df907740d48a5d4a83dae2e51984f700fd77ae54713e36c591513c"}
Jul 06 01:28:19.269455 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:19.269418    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:28:19.269536 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:19.269494    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:28:19.269536 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:19.269521    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:28:19.588528 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:19.588292    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj" event={"ID":"4a57ea74-8b0d-485a-992d-50a41260d99c","Type":"ContainerStarted","Data":"c9233938ce4623dc856e15c5974908e06b186bcdbb95dea9a39320161a57dff0"}
Jul 06 01:28:19.612485 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:19.612288    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj" podStartSLOduration=1.790020904 podStartE2EDuration="4.612267062s" totalImagesPullingTime="2.822246158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:28:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:28:19.609745571 +0000 UTC m=+1731.420720815" watchObservedRunningTime="2026-07-06 01:28:19.612267062 +0000 UTC m=+1731.423242310"
Jul 06 01:28:20.307575 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:20.307541    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj"
Jul 06 01:28:20.312804 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:20.312780    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj"
Jul 06 01:28:20.594515 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:20.594432    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj"
Jul 06 01:28:20.595585 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:20.595564    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj"
Jul 06 01:28:21.601113 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:21.601080    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-4585f71e-fd7cbb65f-v9qs8" event={"ID":"ff271354-6dc0-4433-b711-53eee1bcc47e","Type":"ContainerStarted","Data":"342ce32e3bb32cdec049f09c774de915a6617944e7361e264382b03ae2738346"}
Jul 06 01:28:22.605818 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:22.605787    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-4585f71e-fd7cbb65f-v9qs8"
Jul 06 01:28:22.657014 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:22.656941    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-4585f71e-fd7cbb65f-v9qs8" podStartSLOduration=2.3271119430000002 podStartE2EDuration="5.656923322s" totalImagesPullingTime="3.329811379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:28:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:28:21.620562674 +0000 UTC m=+1733.431537918" watchObservedRunningTime="2026-07-06 01:28:22.656923322 +0000 UTC m=+1734.467898566"
Jul 06 01:28:22.658365 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:22.658341    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj"]
Jul 06 01:28:22.860494 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:22.860407    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-4585f71e-fd7cbb65f-v9qs8"]
Jul 06 01:28:23.610593 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:23.610531    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj" podUID="4a57ea74-8b0d-485a-992d-50a41260d99c" containerName="istio-proxy" containerID="cri-o://c9233938ce4623dc856e15c5974908e06b186bcdbb95dea9a39320161a57dff0" gracePeriod=30
Jul 06 01:28:23.761992 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:28:23.761952    2562 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-4585f71e-serving-cert: secret "maas-api-e2e-ait-4585f71e-serving-cert" not found
Jul 06 01:28:23.762244 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:28:23.762024    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff271354-6dc0-4433-b711-53eee1bcc47e-maas-api-tls podName:ff271354-6dc0-4433-b711-53eee1bcc47e nodeName:}" failed. No retries permitted until 2026-07-06 01:28:24.262006419 +0000 UTC m=+1736.072981639 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ff271354-6dc0-4433-b711-53eee1bcc47e-maas-api-tls") pod "maas-api-e2e-ait-4585f71e-fd7cbb65f-v9qs8" (UID: "ff271354-6dc0-4433-b711-53eee1bcc47e") : secret "maas-api-e2e-ait-4585f71e-serving-cert" not found
Jul 06 01:28:24.266795 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:28:24.266756    2562 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-4585f71e-serving-cert: secret "maas-api-e2e-ait-4585f71e-serving-cert" not found
Jul 06 01:28:24.267280 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:28:24.266837    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff271354-6dc0-4433-b711-53eee1bcc47e-maas-api-tls podName:ff271354-6dc0-4433-b711-53eee1bcc47e nodeName:}" failed. No retries permitted until 2026-07-06 01:28:25.266819297 +0000 UTC m=+1737.077794531 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ff271354-6dc0-4433-b711-53eee1bcc47e-maas-api-tls") pod "maas-api-e2e-ait-4585f71e-fd7cbb65f-v9qs8" (UID: "ff271354-6dc0-4433-b711-53eee1bcc47e") : secret "maas-api-e2e-ait-4585f71e-serving-cert" not found
Jul 06 01:28:24.616085 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:24.616040    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-4585f71e-fd7cbb65f-v9qs8" podUID="ff271354-6dc0-4433-b711-53eee1bcc47e" containerName="maas-api" containerID="cri-o://342ce32e3bb32cdec049f09c774de915a6617944e7361e264382b03ae2738346" gracePeriod=30
Jul 06 01:28:24.891870 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:24.891839    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-4585f71e-fd7cbb65f-v9qs8"
Jul 06 01:28:24.973622 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:24.973585    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff271354-6dc0-4433-b711-53eee1bcc47e-maas-api-tls\") pod \"ff271354-6dc0-4433-b711-53eee1bcc47e\" (UID: \"ff271354-6dc0-4433-b711-53eee1bcc47e\") "
Jul 06 01:28:24.973794 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:24.973640    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r29t6\" (UniqueName: \"kubernetes.io/projected/ff271354-6dc0-4433-b711-53eee1bcc47e-kube-api-access-r29t6\") pod \"ff271354-6dc0-4433-b711-53eee1bcc47e\" (UID: \"ff271354-6dc0-4433-b711-53eee1bcc47e\") "
Jul 06 01:28:24.973794 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:24.973691    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff271354-6dc0-4433-b711-53eee1bcc47e-openshift-service-ca\") pod \"ff271354-6dc0-4433-b711-53eee1bcc47e\" (UID: \"ff271354-6dc0-4433-b711-53eee1bcc47e\") "
Jul 06 01:28:24.974078 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:24.974052    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff271354-6dc0-4433-b711-53eee1bcc47e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ff271354-6dc0-4433-b711-53eee1bcc47e" (UID: "ff271354-6dc0-4433-b711-53eee1bcc47e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:28:24.975749 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:24.975730    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff271354-6dc0-4433-b711-53eee1bcc47e-kube-api-access-r29t6" (OuterVolumeSpecName: "kube-api-access-r29t6") pod "ff271354-6dc0-4433-b711-53eee1bcc47e" (UID: "ff271354-6dc0-4433-b711-53eee1bcc47e"). InnerVolumeSpecName "kube-api-access-r29t6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:28:24.975840 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:24.975809    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff271354-6dc0-4433-b711-53eee1bcc47e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ff271354-6dc0-4433-b711-53eee1bcc47e" (UID: "ff271354-6dc0-4433-b711-53eee1bcc47e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:28:25.074817 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:25.074780    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff271354-6dc0-4433-b711-53eee1bcc47e-openshift-service-ca\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:28:25.074817 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:25.074809    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff271354-6dc0-4433-b711-53eee1bcc47e-maas-api-tls\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:28:25.074817 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:25.074818    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r29t6\" (UniqueName: \"kubernetes.io/projected/ff271354-6dc0-4433-b711-53eee1bcc47e-kube-api-access-r29t6\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:28:25.623377 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:25.623343    2562 generic.go:356] "Generic (PLEG): container finished" podID="ff271354-6dc0-4433-b711-53eee1bcc47e" containerID="342ce32e3bb32cdec049f09c774de915a6617944e7361e264382b03ae2738346" exitCode=0
Jul 06 01:28:25.623730 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:25.623390    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-4585f71e-fd7cbb65f-v9qs8"
Jul 06 01:28:25.623730 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:25.623437    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-4585f71e-fd7cbb65f-v9qs8" event={"ID":"ff271354-6dc0-4433-b711-53eee1bcc47e","Type":"ContainerDied","Data":"342ce32e3bb32cdec049f09c774de915a6617944e7361e264382b03ae2738346"}
Jul 06 01:28:25.623730 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:25.623500    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-4585f71e-fd7cbb65f-v9qs8" event={"ID":"ff271354-6dc0-4433-b711-53eee1bcc47e","Type":"ContainerDied","Data":"6f52711ed0df907740d48a5d4a83dae2e51984f700fd77ae54713e36c591513c"}
Jul 06 01:28:25.623730 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:25.623531    2562 scope.go:117] "RemoveContainer" containerID="342ce32e3bb32cdec049f09c774de915a6617944e7361e264382b03ae2738346"
Jul 06 01:28:25.633369 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:25.633346    2562 scope.go:117] "RemoveContainer" containerID="342ce32e3bb32cdec049f09c774de915a6617944e7361e264382b03ae2738346"
Jul 06 01:28:25.633664 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:28:25.633638    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"342ce32e3bb32cdec049f09c774de915a6617944e7361e264382b03ae2738346\": container with ID starting with 342ce32e3bb32cdec049f09c774de915a6617944e7361e264382b03ae2738346 not found: ID does not exist" containerID="342ce32e3bb32cdec049f09c774de915a6617944e7361e264382b03ae2738346"
Jul 06 01:28:25.633732 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:25.633678    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"342ce32e3bb32cdec049f09c774de915a6617944e7361e264382b03ae2738346"} err="failed to get container status \"342ce32e3bb32cdec049f09c774de915a6617944e7361e264382b03ae2738346\": rpc error: code = NotFound desc = could not find container \"342ce32e3bb32cdec049f09c774de915a6617944e7361e264382b03ae2738346\": container with ID starting with 342ce32e3bb32cdec049f09c774de915a6617944e7361e264382b03ae2738346 not found: ID does not exist"
Jul 06 01:28:25.646049 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:25.645983    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-4585f71e-fd7cbb65f-v9qs8"]
Jul 06 01:28:25.648918 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:25.648893    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-4585f71e-fd7cbb65f-v9qs8"]
Jul 06 01:28:26.754607 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:26.754570    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff271354-6dc0-4433-b711-53eee1bcc47e" path="/var/lib/kubelet/pods/ff271354-6dc0-4433-b711-53eee1bcc47e/volumes"
Jul 06 01:28:27.869820 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:27.869792    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj"
Jul 06 01:28:28.006791 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.006695    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a57ea74-8b0d-485a-992d-50a41260d99c-istio-data\") pod \"4a57ea74-8b0d-485a-992d-50a41260d99c\" (UID: \"4a57ea74-8b0d-485a-992d-50a41260d99c\") "
Jul 06 01:28:28.006791 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.006730    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a57ea74-8b0d-485a-992d-50a41260d99c-workload-socket\") pod \"4a57ea74-8b0d-485a-992d-50a41260d99c\" (UID: \"4a57ea74-8b0d-485a-992d-50a41260d99c\") "
Jul 06 01:28:28.006791 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.006762    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a57ea74-8b0d-485a-992d-50a41260d99c-istiod-ca-cert\") pod \"4a57ea74-8b0d-485a-992d-50a41260d99c\" (UID: \"4a57ea74-8b0d-485a-992d-50a41260d99c\") "
Jul 06 01:28:28.006791 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.006792    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a57ea74-8b0d-485a-992d-50a41260d99c-istio-podinfo\") pod \"4a57ea74-8b0d-485a-992d-50a41260d99c\" (UID: \"4a57ea74-8b0d-485a-992d-50a41260d99c\") "
Jul 06 01:28:28.007085 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.006872    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bt74z\" (UniqueName: \"kubernetes.io/projected/4a57ea74-8b0d-485a-992d-50a41260d99c-kube-api-access-bt74z\") pod \"4a57ea74-8b0d-485a-992d-50a41260d99c\" (UID: \"4a57ea74-8b0d-485a-992d-50a41260d99c\") "
Jul 06 01:28:28.007085 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.006899    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a57ea74-8b0d-485a-992d-50a41260d99c-credential-socket\") pod \"4a57ea74-8b0d-485a-992d-50a41260d99c\" (UID: \"4a57ea74-8b0d-485a-992d-50a41260d99c\") "
Jul 06 01:28:28.007085 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.006967    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a57ea74-8b0d-485a-992d-50a41260d99c-workload-certs\") pod \"4a57ea74-8b0d-485a-992d-50a41260d99c\" (UID: \"4a57ea74-8b0d-485a-992d-50a41260d99c\") "
Jul 06 01:28:28.007085 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.006998    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a57ea74-8b0d-485a-992d-50a41260d99c-istio-token\") pod \"4a57ea74-8b0d-485a-992d-50a41260d99c\" (UID: \"4a57ea74-8b0d-485a-992d-50a41260d99c\") "
Jul 06 01:28:28.007085 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.007030    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a57ea74-8b0d-485a-992d-50a41260d99c-istio-envoy\") pod \"4a57ea74-8b0d-485a-992d-50a41260d99c\" (UID: \"4a57ea74-8b0d-485a-992d-50a41260d99c\") "
Jul 06 01:28:28.007373 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.007255    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a57ea74-8b0d-485a-992d-50a41260d99c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4a57ea74-8b0d-485a-992d-50a41260d99c" (UID: "4a57ea74-8b0d-485a-992d-50a41260d99c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:28:28.007373 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.007275    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a57ea74-8b0d-485a-992d-50a41260d99c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4a57ea74-8b0d-485a-992d-50a41260d99c" (UID: "4a57ea74-8b0d-485a-992d-50a41260d99c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:28:28.007373 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.007290    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a57ea74-8b0d-485a-992d-50a41260d99c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4a57ea74-8b0d-485a-992d-50a41260d99c" (UID: "4a57ea74-8b0d-485a-992d-50a41260d99c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:28:28.007529 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.007408    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a57ea74-8b0d-485a-992d-50a41260d99c-credential-socket\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:28:28.007529 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.007428    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a57ea74-8b0d-485a-992d-50a41260d99c-workload-certs\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:28:28.007529 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.007442    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a57ea74-8b0d-485a-992d-50a41260d99c-istiod-ca-cert\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:28:28.007684 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.007543    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a57ea74-8b0d-485a-992d-50a41260d99c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4a57ea74-8b0d-485a-992d-50a41260d99c" (UID: "4a57ea74-8b0d-485a-992d-50a41260d99c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:28:28.007742 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.007713    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a57ea74-8b0d-485a-992d-50a41260d99c-istio-data" (OuterVolumeSpecName: "istio-data") pod "4a57ea74-8b0d-485a-992d-50a41260d99c" (UID: "4a57ea74-8b0d-485a-992d-50a41260d99c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:28:28.009394 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.009368    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4a57ea74-8b0d-485a-992d-50a41260d99c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4a57ea74-8b0d-485a-992d-50a41260d99c" (UID: "4a57ea74-8b0d-485a-992d-50a41260d99c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 01:28:28.009503 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.009392    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a57ea74-8b0d-485a-992d-50a41260d99c-kube-api-access-bt74z" (OuterVolumeSpecName: "kube-api-access-bt74z") pod "4a57ea74-8b0d-485a-992d-50a41260d99c" (UID: "4a57ea74-8b0d-485a-992d-50a41260d99c"). InnerVolumeSpecName "kube-api-access-bt74z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:28:28.009633 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.009609    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a57ea74-8b0d-485a-992d-50a41260d99c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4a57ea74-8b0d-485a-992d-50a41260d99c" (UID: "4a57ea74-8b0d-485a-992d-50a41260d99c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:28:28.009739 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.009650    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a57ea74-8b0d-485a-992d-50a41260d99c-istio-token" (OuterVolumeSpecName: "istio-token") pod "4a57ea74-8b0d-485a-992d-50a41260d99c" (UID: "4a57ea74-8b0d-485a-992d-50a41260d99c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:28:28.108458 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.108422    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a57ea74-8b0d-485a-992d-50a41260d99c-istio-token\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:28:28.108458 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.108451    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a57ea74-8b0d-485a-992d-50a41260d99c-istio-envoy\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:28:28.108458 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.108460    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a57ea74-8b0d-485a-992d-50a41260d99c-istio-data\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:28:28.108693 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.108468    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a57ea74-8b0d-485a-992d-50a41260d99c-workload-socket\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:28:28.108693 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.108478    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a57ea74-8b0d-485a-992d-50a41260d99c-istio-podinfo\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:28:28.108693 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.108487    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bt74z\" (UniqueName: \"kubernetes.io/projected/4a57ea74-8b0d-485a-992d-50a41260d99c-kube-api-access-bt74z\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:28:28.642804 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.642759    2562 generic.go:356] "Generic (PLEG): container finished" podID="4a57ea74-8b0d-485a-992d-50a41260d99c" containerID="c9233938ce4623dc856e15c5974908e06b186bcdbb95dea9a39320161a57dff0" exitCode=0
Jul 06 01:28:28.642974 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.642815    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj"
Jul 06 01:28:28.642974 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.642822    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj" event={"ID":"4a57ea74-8b0d-485a-992d-50a41260d99c","Type":"ContainerDied","Data":"c9233938ce4623dc856e15c5974908e06b186bcdbb95dea9a39320161a57dff0"}
Jul 06 01:28:28.642974 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.642877    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj" event={"ID":"4a57ea74-8b0d-485a-992d-50a41260d99c","Type":"ContainerDied","Data":"db92311197d32c052e694ce131f83d8779772bfcdf573b9c555068b05cd0a7eb"}
Jul 06 01:28:28.642974 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.642901    2562 scope.go:117] "RemoveContainer" containerID="c9233938ce4623dc856e15c5974908e06b186bcdbb95dea9a39320161a57dff0"
Jul 06 01:28:28.652663 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.652645    2562 scope.go:117] "RemoveContainer" containerID="c9233938ce4623dc856e15c5974908e06b186bcdbb95dea9a39320161a57dff0"
Jul 06 01:28:28.652970 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:28:28.652939    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9233938ce4623dc856e15c5974908e06b186bcdbb95dea9a39320161a57dff0\": container with ID starting with c9233938ce4623dc856e15c5974908e06b186bcdbb95dea9a39320161a57dff0 not found: ID does not exist" containerID="c9233938ce4623dc856e15c5974908e06b186bcdbb95dea9a39320161a57dff0"
Jul 06 01:28:28.653073 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.652979    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9233938ce4623dc856e15c5974908e06b186bcdbb95dea9a39320161a57dff0"} err="failed to get container status \"c9233938ce4623dc856e15c5974908e06b186bcdbb95dea9a39320161a57dff0\": rpc error: code = NotFound desc = could not find container \"c9233938ce4623dc856e15c5974908e06b186bcdbb95dea9a39320161a57dff0\": container with ID starting with c9233938ce4623dc856e15c5974908e06b186bcdbb95dea9a39320161a57dff0 not found: ID does not exist"
Jul 06 01:28:28.664327 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.664303    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj"]
Jul 06 01:28:28.670939 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.670919    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-4585f71e-openshift-default-7fffb7bb77-2l9qj"]
Jul 06 01:28:28.717449 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.717419    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh"]
Jul 06 01:28:28.717971 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.717948    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a57ea74-8b0d-485a-992d-50a41260d99c" containerName="istio-proxy"
Jul 06 01:28:28.717971 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.717973    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a57ea74-8b0d-485a-992d-50a41260d99c" containerName="istio-proxy"
Jul 06 01:28:28.718130 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.717999    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff271354-6dc0-4433-b711-53eee1bcc47e" containerName="maas-api"
Jul 06 01:28:28.718130 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.718008    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff271354-6dc0-4433-b711-53eee1bcc47e" containerName="maas-api"
Jul 06 01:28:28.718130 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.718088    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a57ea74-8b0d-485a-992d-50a41260d99c" containerName="istio-proxy"
Jul 06 01:28:28.718130 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.718101    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff271354-6dc0-4433-b711-53eee1bcc47e" containerName="maas-api"
Jul 06 01:28:28.727708 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.727691    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh"
Jul 06 01:28:28.729909 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.729891    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-540f868a-openshift-default-dockercfg-cpqnb\""
Jul 06 01:28:28.730115 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.730103    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 01:28:28.734739 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.734718    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh"]
Jul 06 01:28:28.754619 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.754590    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a57ea74-8b0d-485a-992d-50a41260d99c" path="/var/lib/kubelet/pods/4a57ea74-8b0d-485a-992d-50a41260d99c/volumes"
Jul 06 01:28:28.813396 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.813360    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-istio-envoy\") pod \"e2e-ait-540f868a-openshift-default-5dbc968487-gccxh\" (UID: \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\") " pod="openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh"
Jul 06 01:28:28.813536 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.813402    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-istio-data\") pod \"e2e-ait-540f868a-openshift-default-5dbc968487-gccxh\" (UID: \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\") " pod="openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh"
Jul 06 01:28:28.813536 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.813494    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-istio-podinfo\") pod \"e2e-ait-540f868a-openshift-default-5dbc968487-gccxh\" (UID: \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\") " pod="openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh"
Jul 06 01:28:28.813536 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.813513    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vzjd\" (UniqueName: \"kubernetes.io/projected/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-kube-api-access-9vzjd\") pod \"e2e-ait-540f868a-openshift-default-5dbc968487-gccxh\" (UID: \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\") " pod="openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh"
Jul 06 01:28:28.813710 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.813692    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-istiod-ca-cert\") pod \"e2e-ait-540f868a-openshift-default-5dbc968487-gccxh\" (UID: \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\") " pod="openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh"
Jul 06 01:28:28.814050 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.814032    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-workload-socket\") pod \"e2e-ait-540f868a-openshift-default-5dbc968487-gccxh\" (UID: \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\") " pod="openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh"
Jul 06 01:28:28.814208 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.814190    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-istio-token\") pod \"e2e-ait-540f868a-openshift-default-5dbc968487-gccxh\" (UID: \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\") " pod="openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh"
Jul 06 01:28:28.814281 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.814247    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-credential-socket\") pod \"e2e-ait-540f868a-openshift-default-5dbc968487-gccxh\" (UID: \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\") " pod="openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh"
Jul 06 01:28:28.814384 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.814364    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-workload-certs\") pod \"e2e-ait-540f868a-openshift-default-5dbc968487-gccxh\" (UID: \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\") " pod="openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh"
Jul 06 01:28:28.915487 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.915402    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-workload-certs\") pod \"e2e-ait-540f868a-openshift-default-5dbc968487-gccxh\" (UID: \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\") " pod="openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh"
Jul 06 01:28:28.915487 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.915446    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-istio-envoy\") pod \"e2e-ait-540f868a-openshift-default-5dbc968487-gccxh\" (UID: \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\") " pod="openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh"
Jul 06 01:28:28.915487 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.915463    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-istio-data\") pod \"e2e-ait-540f868a-openshift-default-5dbc968487-gccxh\" (UID: \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\") " pod="openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh"
Jul 06 01:28:28.916035 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.915573    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-istio-podinfo\") pod \"e2e-ait-540f868a-openshift-default-5dbc968487-gccxh\" (UID: \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\") " pod="openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh"
Jul 06 01:28:28.916035 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.915609    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vzjd\" (UniqueName: \"kubernetes.io/projected/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-kube-api-access-9vzjd\") pod \"e2e-ait-540f868a-openshift-default-5dbc968487-gccxh\" (UID: \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\") " pod="openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh"
Jul 06 01:28:28.916035 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.915664    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-istiod-ca-cert\") pod \"e2e-ait-540f868a-openshift-default-5dbc968487-gccxh\" (UID: \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\") " pod="openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh"
Jul 06 01:28:28.916035 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.915731    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-workload-socket\") pod \"e2e-ait-540f868a-openshift-default-5dbc968487-gccxh\" (UID: \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\") " pod="openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh"
Jul 06 01:28:28.916035 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.915758    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-istio-token\") pod \"e2e-ait-540f868a-openshift-default-5dbc968487-gccxh\" (UID: \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\") " pod="openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh"
Jul 06 01:28:28.916035 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.915791    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-credential-socket\") pod \"e2e-ait-540f868a-openshift-default-5dbc968487-gccxh\" (UID: \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\") " pod="openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh"
Jul 06 01:28:28.916035 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.915821    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-istio-data\") pod \"e2e-ait-540f868a-openshift-default-5dbc968487-gccxh\" (UID: \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\") " pod="openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh"
Jul 06 01:28:28.916035 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.915858    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-workload-certs\") pod \"e2e-ait-540f868a-openshift-default-5dbc968487-gccxh\" (UID: \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\") " pod="openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh"
Jul 06 01:28:28.916489 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.916072    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-workload-socket\") pod \"e2e-ait-540f868a-openshift-default-5dbc968487-gccxh\" (UID: \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\") " pod="openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh"
Jul 06 01:28:28.916489 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.916087    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-credential-socket\") pod \"e2e-ait-540f868a-openshift-default-5dbc968487-gccxh\" (UID: \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\") " pod="openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh"
Jul 06 01:28:28.916701 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.916681    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-istiod-ca-cert\") pod \"e2e-ait-540f868a-openshift-default-5dbc968487-gccxh\" (UID: \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\") " pod="openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh"
Jul 06 01:28:28.917786 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.917757    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-istio-envoy\") pod \"e2e-ait-540f868a-openshift-default-5dbc968487-gccxh\" (UID: \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\") " pod="openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh"
Jul 06 01:28:28.917974 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.917956    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-istio-podinfo\") pod \"e2e-ait-540f868a-openshift-default-5dbc968487-gccxh\" (UID: \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\") " pod="openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh"
Jul 06 01:28:28.923328 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.923291    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-istio-token\") pod \"e2e-ait-540f868a-openshift-default-5dbc968487-gccxh\" (UID: \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\") " pod="openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh"
Jul 06 01:28:28.923429 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:28.923401    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vzjd\" (UniqueName: \"kubernetes.io/projected/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-kube-api-access-9vzjd\") pod \"e2e-ait-540f868a-openshift-default-5dbc968487-gccxh\" (UID: \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\") " pod="openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh"
Jul 06 01:28:29.040939 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:29.040912    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh"
Jul 06 01:28:29.178416 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:29.178392    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh"]
Jul 06 01:28:29.180697 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:28:29.180670    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a7fd35d_40bf_4ff5_aaf8_1302708b509d.slice/crio-c0d03d1f5fbffc10f9906b9350ae84f352ce54fd6385ca1e77d29b6c6d12e367 WatchSource:0}: Error finding container c0d03d1f5fbffc10f9906b9350ae84f352ce54fd6385ca1e77d29b6c6d12e367: Status 404 returned error can't find the container with id c0d03d1f5fbffc10f9906b9350ae84f352ce54fd6385ca1e77d29b6c6d12e367
Jul 06 01:28:29.183831 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:29.183799    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:28:29.183896 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:29.183866    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:28:29.183940 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:29.183898    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:28:29.648444 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:29.648411    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh" event={"ID":"1a7fd35d-40bf-4ff5-aaf8-1302708b509d","Type":"ContainerStarted","Data":"986db93ce753bda0ca389eb47940fd46295a3f8eb183c9c9c9a5eb8118b8f0c7"}
Jul 06 01:28:29.648597 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:29.648467    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh" event={"ID":"1a7fd35d-40bf-4ff5-aaf8-1302708b509d","Type":"ContainerStarted","Data":"c0d03d1f5fbffc10f9906b9350ae84f352ce54fd6385ca1e77d29b6c6d12e367"}
Jul 06 01:28:29.668786 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:29.668734    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh" podStartSLOduration=1.66871838 podStartE2EDuration="1.66871838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:28:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:28:29.66622167 +0000 UTC m=+1741.477196913" watchObservedRunningTime="2026-07-06 01:28:29.66871838 +0000 UTC m=+1741.479693623"
Jul 06 01:28:30.013404 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:30.013321    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-540f868a-658fff8f54-24gcb"]
Jul 06 01:28:30.017177 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:30.017137    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-540f868a-658fff8f54-24gcb"
Jul 06 01:28:30.019735 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:30.019713    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-540f868a-serving-cert\""
Jul 06 01:28:30.019862 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:30.019785    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-84mvh\""
Jul 06 01:28:30.028060 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:30.028007    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-540f868a-658fff8f54-24gcb"]
Jul 06 01:28:30.041382 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:30.041345    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh"
Jul 06 01:28:30.046689 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:30.046665    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh"
Jul 06 01:28:30.128434 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:30.128400    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8130e92-efcf-4f4e-a00a-0ff754c0d4a6-maas-api-tls\") pod \"maas-api-e2e-ait-540f868a-658fff8f54-24gcb\" (UID: \"d8130e92-efcf-4f4e-a00a-0ff754c0d4a6\") " pod="opendatahub/maas-api-e2e-ait-540f868a-658fff8f54-24gcb"
Jul 06 01:28:30.128609 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:30.128482    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8130e92-efcf-4f4e-a00a-0ff754c0d4a6-openshift-service-ca\") pod \"maas-api-e2e-ait-540f868a-658fff8f54-24gcb\" (UID: \"d8130e92-efcf-4f4e-a00a-0ff754c0d4a6\") " pod="opendatahub/maas-api-e2e-ait-540f868a-658fff8f54-24gcb"
Jul 06 01:28:30.128609 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:30.128537    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zglm\" (UniqueName: \"kubernetes.io/projected/d8130e92-efcf-4f4e-a00a-0ff754c0d4a6-kube-api-access-5zglm\") pod \"maas-api-e2e-ait-540f868a-658fff8f54-24gcb\" (UID: \"d8130e92-efcf-4f4e-a00a-0ff754c0d4a6\") " pod="opendatahub/maas-api-e2e-ait-540f868a-658fff8f54-24gcb"
Jul 06 01:28:30.229087 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:30.229055    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8130e92-efcf-4f4e-a00a-0ff754c0d4a6-maas-api-tls\") pod \"maas-api-e2e-ait-540f868a-658fff8f54-24gcb\" (UID: \"d8130e92-efcf-4f4e-a00a-0ff754c0d4a6\") " pod="opendatahub/maas-api-e2e-ait-540f868a-658fff8f54-24gcb"
Jul 06 01:28:30.229300 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:30.229123    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8130e92-efcf-4f4e-a00a-0ff754c0d4a6-openshift-service-ca\") pod \"maas-api-e2e-ait-540f868a-658fff8f54-24gcb\" (UID: \"d8130e92-efcf-4f4e-a00a-0ff754c0d4a6\") " pod="opendatahub/maas-api-e2e-ait-540f868a-658fff8f54-24gcb"
Jul 06 01:28:30.229300 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:30.229221    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zglm\" (UniqueName: \"kubernetes.io/projected/d8130e92-efcf-4f4e-a00a-0ff754c0d4a6-kube-api-access-5zglm\") pod \"maas-api-e2e-ait-540f868a-658fff8f54-24gcb\" (UID: \"d8130e92-efcf-4f4e-a00a-0ff754c0d4a6\") " pod="opendatahub/maas-api-e2e-ait-540f868a-658fff8f54-24gcb"
Jul 06 01:28:30.229937 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:30.229897    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8130e92-efcf-4f4e-a00a-0ff754c0d4a6-openshift-service-ca\") pod \"maas-api-e2e-ait-540f868a-658fff8f54-24gcb\" (UID: \"d8130e92-efcf-4f4e-a00a-0ff754c0d4a6\") " pod="opendatahub/maas-api-e2e-ait-540f868a-658fff8f54-24gcb"
Jul 06 01:28:30.231915 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:30.231896    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8130e92-efcf-4f4e-a00a-0ff754c0d4a6-maas-api-tls\") pod \"maas-api-e2e-ait-540f868a-658fff8f54-24gcb\" (UID: \"d8130e92-efcf-4f4e-a00a-0ff754c0d4a6\") " pod="opendatahub/maas-api-e2e-ait-540f868a-658fff8f54-24gcb"
Jul 06 01:28:30.237516 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:30.237493    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zglm\" (UniqueName: \"kubernetes.io/projected/d8130e92-efcf-4f4e-a00a-0ff754c0d4a6-kube-api-access-5zglm\") pod \"maas-api-e2e-ait-540f868a-658fff8f54-24gcb\" (UID: \"d8130e92-efcf-4f4e-a00a-0ff754c0d4a6\") " pod="opendatahub/maas-api-e2e-ait-540f868a-658fff8f54-24gcb"
Jul 06 01:28:30.332740 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:30.332655    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-540f868a-658fff8f54-24gcb"
Jul 06 01:28:30.662099 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:30.662066    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh"
Jul 06 01:28:30.663015 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:30.662992    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh"
Jul 06 01:28:30.677808 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:30.677782    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-540f868a-658fff8f54-24gcb"]
Jul 06 01:28:31.667952 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:31.667915    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-540f868a-658fff8f54-24gcb" event={"ID":"d8130e92-efcf-4f4e-a00a-0ff754c0d4a6","Type":"ContainerStarted","Data":"5d83e528ef8047f1b718b14d9315f7d0e436bb5d40ef1adbdbe131087d9cb590"}
Jul 06 01:28:31.668405 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:31.667974    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-540f868a-658fff8f54-24gcb" event={"ID":"d8130e92-efcf-4f4e-a00a-0ff754c0d4a6","Type":"ContainerStarted","Data":"a1aa7bd5f1235ce18df95fab84524e5c78788b5f64835a6694138bd052361211"}
Jul 06 01:28:31.668405 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:31.668108    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-540f868a-658fff8f54-24gcb"
Jul 06 01:28:31.700694 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:31.700642    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-540f868a-658fff8f54-24gcb" podStartSLOduration=2.36632834 podStartE2EDuration="2.700625912s" totalImagesPullingTime="334.297572ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:28:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:28:31.698588726 +0000 UTC m=+1743.509563968" watchObservedRunningTime="2026-07-06 01:28:31.700625912 +0000 UTC m=+1743.511601161"
Jul 06 01:28:35.392547 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:35.392467    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-540f868a-658fff8f54-24gcb"]
Jul 06 01:28:35.393070 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:35.392839    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-540f868a-658fff8f54-24gcb" podUID="d8130e92-efcf-4f4e-a00a-0ff754c0d4a6" containerName="maas-api" containerID="cri-o://5d83e528ef8047f1b718b14d9315f7d0e436bb5d40ef1adbdbe131087d9cb590" gracePeriod=30
Jul 06 01:28:35.645704 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:35.645649    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-540f868a-658fff8f54-24gcb"
Jul 06 01:28:35.695276 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:35.695242    2562 generic.go:356] "Generic (PLEG): container finished" podID="d8130e92-efcf-4f4e-a00a-0ff754c0d4a6" containerID="5d83e528ef8047f1b718b14d9315f7d0e436bb5d40ef1adbdbe131087d9cb590" exitCode=0
Jul 06 01:28:35.695458 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:35.695288    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-540f868a-658fff8f54-24gcb"
Jul 06 01:28:35.695458 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:35.695336    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-540f868a-658fff8f54-24gcb" event={"ID":"d8130e92-efcf-4f4e-a00a-0ff754c0d4a6","Type":"ContainerDied","Data":"5d83e528ef8047f1b718b14d9315f7d0e436bb5d40ef1adbdbe131087d9cb590"}
Jul 06 01:28:35.695458 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:35.695395    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-540f868a-658fff8f54-24gcb" event={"ID":"d8130e92-efcf-4f4e-a00a-0ff754c0d4a6","Type":"ContainerDied","Data":"a1aa7bd5f1235ce18df95fab84524e5c78788b5f64835a6694138bd052361211"}
Jul 06 01:28:35.695458 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:35.695426    2562 scope.go:117] "RemoveContainer" containerID="5d83e528ef8047f1b718b14d9315f7d0e436bb5d40ef1adbdbe131087d9cb590"
Jul 06 01:28:35.703739 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:35.703717    2562 scope.go:117] "RemoveContainer" containerID="5d83e528ef8047f1b718b14d9315f7d0e436bb5d40ef1adbdbe131087d9cb590"
Jul 06 01:28:35.703997 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:28:35.703978    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d83e528ef8047f1b718b14d9315f7d0e436bb5d40ef1adbdbe131087d9cb590\": container with ID starting with 5d83e528ef8047f1b718b14d9315f7d0e436bb5d40ef1adbdbe131087d9cb590 not found: ID does not exist" containerID="5d83e528ef8047f1b718b14d9315f7d0e436bb5d40ef1adbdbe131087d9cb590"
Jul 06 01:28:35.704064 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:35.704005    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d83e528ef8047f1b718b14d9315f7d0e436bb5d40ef1adbdbe131087d9cb590"} err="failed to get container status \"5d83e528ef8047f1b718b14d9315f7d0e436bb5d40ef1adbdbe131087d9cb590\": rpc error: code = NotFound desc = could not find container \"5d83e528ef8047f1b718b14d9315f7d0e436bb5d40ef1adbdbe131087d9cb590\": container with ID starting with 5d83e528ef8047f1b718b14d9315f7d0e436bb5d40ef1adbdbe131087d9cb590 not found: ID does not exist"
Jul 06 01:28:35.784318 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:35.784286    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8130e92-efcf-4f4e-a00a-0ff754c0d4a6-maas-api-tls\") pod \"d8130e92-efcf-4f4e-a00a-0ff754c0d4a6\" (UID: \"d8130e92-efcf-4f4e-a00a-0ff754c0d4a6\") "
Jul 06 01:28:35.784318 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:35.784324    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zglm\" (UniqueName: \"kubernetes.io/projected/d8130e92-efcf-4f4e-a00a-0ff754c0d4a6-kube-api-access-5zglm\") pod \"d8130e92-efcf-4f4e-a00a-0ff754c0d4a6\" (UID: \"d8130e92-efcf-4f4e-a00a-0ff754c0d4a6\") "
Jul 06 01:28:35.784532 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:35.784413    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8130e92-efcf-4f4e-a00a-0ff754c0d4a6-openshift-service-ca\") pod \"d8130e92-efcf-4f4e-a00a-0ff754c0d4a6\" (UID: \"d8130e92-efcf-4f4e-a00a-0ff754c0d4a6\") "
Jul 06 01:28:35.784786 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:35.784762    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8130e92-efcf-4f4e-a00a-0ff754c0d4a6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d8130e92-efcf-4f4e-a00a-0ff754c0d4a6" (UID: "d8130e92-efcf-4f4e-a00a-0ff754c0d4a6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:28:35.786566 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:35.786538    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8130e92-efcf-4f4e-a00a-0ff754c0d4a6-kube-api-access-5zglm" (OuterVolumeSpecName: "kube-api-access-5zglm") pod "d8130e92-efcf-4f4e-a00a-0ff754c0d4a6" (UID: "d8130e92-efcf-4f4e-a00a-0ff754c0d4a6"). InnerVolumeSpecName "kube-api-access-5zglm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:28:35.786700 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:35.786652    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8130e92-efcf-4f4e-a00a-0ff754c0d4a6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d8130e92-efcf-4f4e-a00a-0ff754c0d4a6" (UID: "d8130e92-efcf-4f4e-a00a-0ff754c0d4a6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:28:35.886049 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:35.886012    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d8130e92-efcf-4f4e-a00a-0ff754c0d4a6-maas-api-tls\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:28:35.886049 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:35.886041    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zglm\" (UniqueName: \"kubernetes.io/projected/d8130e92-efcf-4f4e-a00a-0ff754c0d4a6-kube-api-access-5zglm\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:28:35.886049 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:35.886052    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8130e92-efcf-4f4e-a00a-0ff754c0d4a6-openshift-service-ca\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:28:36.018662 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:36.018630    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-540f868a-658fff8f54-24gcb"]
Jul 06 01:28:36.021816 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:36.021791    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-540f868a-658fff8f54-24gcb"]
Jul 06 01:28:36.752361 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:36.752325    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8130e92-efcf-4f4e-a00a-0ff754c0d4a6" path="/var/lib/kubelet/pods/d8130e92-efcf-4f4e-a00a-0ff754c0d4a6/volumes"
Jul 06 01:28:41.433361 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:41.433330    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh"]
Jul 06 01:28:41.433832 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:41.433561    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh" podUID="1a7fd35d-40bf-4ff5-aaf8-1302708b509d" containerName="istio-proxy" containerID="cri-o://986db93ce753bda0ca389eb47940fd46295a3f8eb183c9c9c9a5eb8118b8f0c7" gracePeriod=30
Jul 06 01:28:45.664112 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:45.664072    2562 patch_prober.go:28] interesting pod/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 06 01:28:45.664541 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:45.664130    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh" podUID="1a7fd35d-40bf-4ff5-aaf8-1302708b509d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 01:28:46.685560 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:46.685537    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh"
Jul 06 01:28:46.752475 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:46.752438    2562 generic.go:356] "Generic (PLEG): container finished" podID="1a7fd35d-40bf-4ff5-aaf8-1302708b509d" containerID="986db93ce753bda0ca389eb47940fd46295a3f8eb183c9c9c9a5eb8118b8f0c7" exitCode=0
Jul 06 01:28:46.752708 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:46.752583    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh"
Jul 06 01:28:46.755374 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:46.755352    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh" event={"ID":"1a7fd35d-40bf-4ff5-aaf8-1302708b509d","Type":"ContainerDied","Data":"986db93ce753bda0ca389eb47940fd46295a3f8eb183c9c9c9a5eb8118b8f0c7"}
Jul 06 01:28:46.755490 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:46.755404    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh" event={"ID":"1a7fd35d-40bf-4ff5-aaf8-1302708b509d","Type":"ContainerDied","Data":"c0d03d1f5fbffc10f9906b9350ae84f352ce54fd6385ca1e77d29b6c6d12e367"}
Jul 06 01:28:46.755490 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:46.755437    2562 scope.go:117] "RemoveContainer" containerID="986db93ce753bda0ca389eb47940fd46295a3f8eb183c9c9c9a5eb8118b8f0c7"
Jul 06 01:28:46.766397 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:46.766116    2562 scope.go:117] "RemoveContainer" containerID="986db93ce753bda0ca389eb47940fd46295a3f8eb183c9c9c9a5eb8118b8f0c7"
Jul 06 01:28:46.766631 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:28:46.766554    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"986db93ce753bda0ca389eb47940fd46295a3f8eb183c9c9c9a5eb8118b8f0c7\": container with ID starting with 986db93ce753bda0ca389eb47940fd46295a3f8eb183c9c9c9a5eb8118b8f0c7 not found: ID does not exist" containerID="986db93ce753bda0ca389eb47940fd46295a3f8eb183c9c9c9a5eb8118b8f0c7"
Jul 06 01:28:46.766631 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:46.766591    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"986db93ce753bda0ca389eb47940fd46295a3f8eb183c9c9c9a5eb8118b8f0c7"} err="failed to get container status \"986db93ce753bda0ca389eb47940fd46295a3f8eb183c9c9c9a5eb8118b8f0c7\": rpc error: code = NotFound desc = could not find container \"986db93ce753bda0ca389eb47940fd46295a3f8eb183c9c9c9a5eb8118b8f0c7\": container with ID starting with 986db93ce753bda0ca389eb47940fd46295a3f8eb183c9c9c9a5eb8118b8f0c7 not found: ID does not exist"
Jul 06 01:28:46.782179 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:46.782140    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-istio-token\") pod \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\" (UID: \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\") "
Jul 06 01:28:46.782179 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:46.782187    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-istio-envoy\") pod \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\" (UID: \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\") "
Jul 06 01:28:46.782319 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:46.782214    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-workload-certs\") pod \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\" (UID: \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\") "
Jul 06 01:28:46.782319 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:46.782264    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-workload-socket\") pod \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\" (UID: \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\") "
Jul 06 01:28:46.782319 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:46.782292    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vzjd\" (UniqueName: \"kubernetes.io/projected/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-kube-api-access-9vzjd\") pod \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\" (UID: \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\") "
Jul 06 01:28:46.782450 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:46.782341    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-credential-socket\") pod \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\" (UID: \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\") "
Jul 06 01:28:46.782450 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:46.782358    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-istio-data\") pod \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\" (UID: \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\") "
Jul 06 01:28:46.782450 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:46.782378    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-istio-podinfo\") pod \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\" (UID: \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\") "
Jul 06 01:28:46.782450 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:46.782410    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-istiod-ca-cert\") pod \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\" (UID: \"1a7fd35d-40bf-4ff5-aaf8-1302708b509d\") "
Jul 06 01:28:46.782650 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:46.782517    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1a7fd35d-40bf-4ff5-aaf8-1302708b509d" (UID: "1a7fd35d-40bf-4ff5-aaf8-1302708b509d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:28:46.782650 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:46.782528    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1a7fd35d-40bf-4ff5-aaf8-1302708b509d" (UID: "1a7fd35d-40bf-4ff5-aaf8-1302708b509d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:28:46.782650 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:46.782638    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1a7fd35d-40bf-4ff5-aaf8-1302708b509d" (UID: "1a7fd35d-40bf-4ff5-aaf8-1302708b509d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:28:46.782811 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:46.782651    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-istio-data" (OuterVolumeSpecName: "istio-data") pod "1a7fd35d-40bf-4ff5-aaf8-1302708b509d" (UID: "1a7fd35d-40bf-4ff5-aaf8-1302708b509d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:28:46.782811 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:46.782798    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-workload-certs\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:28:46.782895 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:46.782823    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-workload-socket\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:28:46.782895 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:46.782839    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-credential-socket\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:28:46.782895 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:46.782856    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-istio-data\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:28:46.783087 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:46.783067    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1a7fd35d-40bf-4ff5-aaf8-1302708b509d" (UID: "1a7fd35d-40bf-4ff5-aaf8-1302708b509d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:28:46.784555 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:46.784530    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1a7fd35d-40bf-4ff5-aaf8-1302708b509d" (UID: "1a7fd35d-40bf-4ff5-aaf8-1302708b509d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:28:46.784555 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:46.784535    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-kube-api-access-9vzjd" (OuterVolumeSpecName: "kube-api-access-9vzjd") pod "1a7fd35d-40bf-4ff5-aaf8-1302708b509d" (UID: "1a7fd35d-40bf-4ff5-aaf8-1302708b509d"). InnerVolumeSpecName "kube-api-access-9vzjd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:28:46.784736 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:46.784718    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-istio-token" (OuterVolumeSpecName: "istio-token") pod "1a7fd35d-40bf-4ff5-aaf8-1302708b509d" (UID: "1a7fd35d-40bf-4ff5-aaf8-1302708b509d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:28:46.784796 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:46.784749    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1a7fd35d-40bf-4ff5-aaf8-1302708b509d" (UID: "1a7fd35d-40bf-4ff5-aaf8-1302708b509d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 01:28:46.883642 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:46.883600    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vzjd\" (UniqueName: \"kubernetes.io/projected/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-kube-api-access-9vzjd\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:28:46.883642 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:46.883641    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-istio-podinfo\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:28:46.883642 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:46.883651    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-istiod-ca-cert\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:28:46.883642 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:46.883659    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-istio-token\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:28:46.883925 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:46.883667    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a7fd35d-40bf-4ff5-aaf8-1302708b509d-istio-envoy\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:28:47.073719 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.073685    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh"]
Jul 06 01:28:47.077007 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.076982    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-540f868a-openshift-default-5dbc968487-gccxh"]
Jul 06 01:28:47.449664 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.449573    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb"]
Jul 06 01:28:47.450198 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.450135    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8130e92-efcf-4f4e-a00a-0ff754c0d4a6" containerName="maas-api"
Jul 06 01:28:47.450198 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.450189    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8130e92-efcf-4f4e-a00a-0ff754c0d4a6" containerName="maas-api"
Jul 06 01:28:47.450395 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.450247    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a7fd35d-40bf-4ff5-aaf8-1302708b509d" containerName="istio-proxy"
Jul 06 01:28:47.450395 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.450260    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a7fd35d-40bf-4ff5-aaf8-1302708b509d" containerName="istio-proxy"
Jul 06 01:28:47.450395 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.450349    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a7fd35d-40bf-4ff5-aaf8-1302708b509d" containerName="istio-proxy"
Jul 06 01:28:47.450395 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.450363    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8130e92-efcf-4f4e-a00a-0ff754c0d4a6" containerName="maas-api"
Jul 06 01:28:47.454466 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.454446    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb"
Jul 06 01:28:47.456968 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.456943    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 01:28:47.457094 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.456999    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-cc99fb90-openshift-default-dockercfg-k2rsd\""
Jul 06 01:28:47.466071 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.466046    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb"]
Jul 06 01:28:47.488668 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.488639    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e270e64c-35cb-4d5b-ad78-89872fba98b7-istio-data\") pod \"e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb\" (UID: \"e270e64c-35cb-4d5b-ad78-89872fba98b7\") " pod="openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb"
Jul 06 01:28:47.488822 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.488692    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e270e64c-35cb-4d5b-ad78-89872fba98b7-workload-certs\") pod \"e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb\" (UID: \"e270e64c-35cb-4d5b-ad78-89872fba98b7\") " pod="openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb"
Jul 06 01:28:47.488822 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.488735    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e270e64c-35cb-4d5b-ad78-89872fba98b7-istio-envoy\") pod \"e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb\" (UID: \"e270e64c-35cb-4d5b-ad78-89872fba98b7\") " pod="openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb"
Jul 06 01:28:47.488822 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.488768    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e270e64c-35cb-4d5b-ad78-89872fba98b7-istio-podinfo\") pod \"e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb\" (UID: \"e270e64c-35cb-4d5b-ad78-89872fba98b7\") " pod="openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb"
Jul 06 01:28:47.488983 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.488825    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e270e64c-35cb-4d5b-ad78-89872fba98b7-workload-socket\") pod \"e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb\" (UID: \"e270e64c-35cb-4d5b-ad78-89872fba98b7\") " pod="openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb"
Jul 06 01:28:47.488983 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.488853    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e270e64c-35cb-4d5b-ad78-89872fba98b7-istio-token\") pod \"e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb\" (UID: \"e270e64c-35cb-4d5b-ad78-89872fba98b7\") " pod="openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb"
Jul 06 01:28:47.488983 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.488869    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwq2g\" (UniqueName: \"kubernetes.io/projected/e270e64c-35cb-4d5b-ad78-89872fba98b7-kube-api-access-hwq2g\") pod \"e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb\" (UID: \"e270e64c-35cb-4d5b-ad78-89872fba98b7\") " pod="openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb"
Jul 06 01:28:47.488983 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.488894    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e270e64c-35cb-4d5b-ad78-89872fba98b7-istiod-ca-cert\") pod \"e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb\" (UID: \"e270e64c-35cb-4d5b-ad78-89872fba98b7\") " pod="openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb"
Jul 06 01:28:47.488983 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.488928    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e270e64c-35cb-4d5b-ad78-89872fba98b7-credential-socket\") pod \"e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb\" (UID: \"e270e64c-35cb-4d5b-ad78-89872fba98b7\") " pod="openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb"
Jul 06 01:28:47.590183 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.590134    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e270e64c-35cb-4d5b-ad78-89872fba98b7-istio-data\") pod \"e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb\" (UID: \"e270e64c-35cb-4d5b-ad78-89872fba98b7\") " pod="openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb"
Jul 06 01:28:47.590378 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.590204    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e270e64c-35cb-4d5b-ad78-89872fba98b7-workload-certs\") pod \"e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb\" (UID: \"e270e64c-35cb-4d5b-ad78-89872fba98b7\") " pod="openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb"
Jul 06 01:28:47.590378 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.590223    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e270e64c-35cb-4d5b-ad78-89872fba98b7-istio-envoy\") pod \"e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb\" (UID: \"e270e64c-35cb-4d5b-ad78-89872fba98b7\") " pod="openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb"
Jul 06 01:28:47.590378 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.590241    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e270e64c-35cb-4d5b-ad78-89872fba98b7-istio-podinfo\") pod \"e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb\" (UID: \"e270e64c-35cb-4d5b-ad78-89872fba98b7\") " pod="openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb"
Jul 06 01:28:47.590378 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.590277    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e270e64c-35cb-4d5b-ad78-89872fba98b7-workload-socket\") pod \"e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb\" (UID: \"e270e64c-35cb-4d5b-ad78-89872fba98b7\") " pod="openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb"
Jul 06 01:28:47.590378 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.590317    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e270e64c-35cb-4d5b-ad78-89872fba98b7-istio-token\") pod \"e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb\" (UID: \"e270e64c-35cb-4d5b-ad78-89872fba98b7\") " pod="openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb"
Jul 06 01:28:47.590612 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.590514    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwq2g\" (UniqueName: \"kubernetes.io/projected/e270e64c-35cb-4d5b-ad78-89872fba98b7-kube-api-access-hwq2g\") pod \"e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb\" (UID: \"e270e64c-35cb-4d5b-ad78-89872fba98b7\") " pod="openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb"
Jul 06 01:28:47.590612 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.590573    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e270e64c-35cb-4d5b-ad78-89872fba98b7-istiod-ca-cert\") pod \"e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb\" (UID: \"e270e64c-35cb-4d5b-ad78-89872fba98b7\") " pod="openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb"
Jul 06 01:28:47.590726 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.590620    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e270e64c-35cb-4d5b-ad78-89872fba98b7-istio-data\") pod \"e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb\" (UID: \"e270e64c-35cb-4d5b-ad78-89872fba98b7\") " pod="openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb"
Jul 06 01:28:47.590726 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.590678    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e270e64c-35cb-4d5b-ad78-89872fba98b7-workload-certs\") pod \"e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb\" (UID: \"e270e64c-35cb-4d5b-ad78-89872fba98b7\") " pod="openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb"
Jul 06 01:28:47.590833 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.590731    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e270e64c-35cb-4d5b-ad78-89872fba98b7-credential-socket\") pod \"e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb\" (UID: \"e270e64c-35cb-4d5b-ad78-89872fba98b7\") " pod="openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb"
Jul 06 01:28:47.590833 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.590804    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e270e64c-35cb-4d5b-ad78-89872fba98b7-workload-socket\") pod \"e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb\" (UID: \"e270e64c-35cb-4d5b-ad78-89872fba98b7\") " pod="openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb"
Jul 06 01:28:47.590991 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.590972    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e270e64c-35cb-4d5b-ad78-89872fba98b7-credential-socket\") pod \"e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb\" (UID: \"e270e64c-35cb-4d5b-ad78-89872fba98b7\") " pod="openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb"
Jul 06 01:28:47.591365 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.591343    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e270e64c-35cb-4d5b-ad78-89872fba98b7-istiod-ca-cert\") pod \"e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb\" (UID: \"e270e64c-35cb-4d5b-ad78-89872fba98b7\") " pod="openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb"
Jul 06 01:28:47.592479 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.592459    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e270e64c-35cb-4d5b-ad78-89872fba98b7-istio-envoy\") pod \"e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb\" (UID: \"e270e64c-35cb-4d5b-ad78-89872fba98b7\") " pod="openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb"
Jul 06 01:28:47.592852 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.592832    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e270e64c-35cb-4d5b-ad78-89872fba98b7-istio-podinfo\") pod \"e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb\" (UID: \"e270e64c-35cb-4d5b-ad78-89872fba98b7\") " pod="openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb"
Jul 06 01:28:47.597732 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.597712    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e270e64c-35cb-4d5b-ad78-89872fba98b7-istio-token\") pod \"e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb\" (UID: \"e270e64c-35cb-4d5b-ad78-89872fba98b7\") " pod="openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb"
Jul 06 01:28:47.597913 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.597893    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwq2g\" (UniqueName: \"kubernetes.io/projected/e270e64c-35cb-4d5b-ad78-89872fba98b7-kube-api-access-hwq2g\") pod \"e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb\" (UID: \"e270e64c-35cb-4d5b-ad78-89872fba98b7\") " pod="openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb"
Jul 06 01:28:47.768167 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.768073    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb"
Jul 06 01:28:47.901132 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.901108    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb"]
Jul 06 01:28:47.903640 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:28:47.903611    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode270e64c_35cb_4d5b_ad78_89872fba98b7.slice/crio-85b8cd3d044769da51c4d17091371ff329e5ec005b5de7cf28ebfc571f03bb83 WatchSource:0}: Error finding container 85b8cd3d044769da51c4d17091371ff329e5ec005b5de7cf28ebfc571f03bb83: Status 404 returned error can't find the container with id 85b8cd3d044769da51c4d17091371ff329e5ec005b5de7cf28ebfc571f03bb83
Jul 06 01:28:47.905742 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.905711    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:28:47.905836 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.905787    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:28:47.905903 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:47.905836    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:28:48.754690 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:48.754651    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a7fd35d-40bf-4ff5-aaf8-1302708b509d" path="/var/lib/kubelet/pods/1a7fd35d-40bf-4ff5-aaf8-1302708b509d/volumes"
Jul 06 01:28:48.764344 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:48.764312    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb" event={"ID":"e270e64c-35cb-4d5b-ad78-89872fba98b7","Type":"ContainerStarted","Data":"d6e2343c479ead8bd8534e04757570a1a32434c3866fb7f359d13a99da4b66e1"}
Jul 06 01:28:48.764482 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:48.764369    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb" event={"ID":"e270e64c-35cb-4d5b-ad78-89872fba98b7","Type":"ContainerStarted","Data":"85b8cd3d044769da51c4d17091371ff329e5ec005b5de7cf28ebfc571f03bb83"}
Jul 06 01:28:48.768474 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:48.768455    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb"
Jul 06 01:28:48.770044 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:48.770021    2562 patch_prober.go:28] interesting pod/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 06 01:28:48.770140 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:48.770063    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb" podUID="e270e64c-35cb-4d5b-ad78-89872fba98b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 06 01:28:48.784995 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:48.784913    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb" podStartSLOduration=1.784900025 podStartE2EDuration="1.784900025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:28:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:28:48.783219423 +0000 UTC m=+1760.594194667" watchObservedRunningTime="2026-07-06 01:28:48.784900025 +0000 UTC m=+1760.595875267"
Jul 06 01:28:48.885292 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:48.885258    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-cc99fb90-59d7c6fbfb-c8sb7"]
Jul 06 01:28:48.889043 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:48.889014    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-cc99fb90-59d7c6fbfb-c8sb7"
Jul 06 01:28:48.892393 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:48.892372    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-cc99fb90-serving-cert\""
Jul 06 01:28:48.892583 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:48.892523    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-84mvh\""
Jul 06 01:28:48.902606 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:48.902576    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d6f4cc7-9677-4109-bf9a-22097792fc31-maas-api-tls\") pod \"maas-api-e2e-derive-cc99fb90-59d7c6fbfb-c8sb7\" (UID: \"3d6f4cc7-9677-4109-bf9a-22097792fc31\") " pod="opendatahub/maas-api-e2e-derive-cc99fb90-59d7c6fbfb-c8sb7"
Jul 06 01:28:48.902733 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:48.902621    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d6f4cc7-9677-4109-bf9a-22097792fc31-openshift-service-ca\") pod \"maas-api-e2e-derive-cc99fb90-59d7c6fbfb-c8sb7\" (UID: \"3d6f4cc7-9677-4109-bf9a-22097792fc31\") " pod="opendatahub/maas-api-e2e-derive-cc99fb90-59d7c6fbfb-c8sb7"
Jul 06 01:28:48.902827 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:48.902737    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lxqn\" (UniqueName: \"kubernetes.io/projected/3d6f4cc7-9677-4109-bf9a-22097792fc31-kube-api-access-7lxqn\") pod \"maas-api-e2e-derive-cc99fb90-59d7c6fbfb-c8sb7\" (UID: \"3d6f4cc7-9677-4109-bf9a-22097792fc31\") " pod="opendatahub/maas-api-e2e-derive-cc99fb90-59d7c6fbfb-c8sb7"
Jul 06 01:28:48.905688 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:48.905662    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-cc99fb90-59d7c6fbfb-c8sb7"]
Jul 06 01:28:49.003298 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:49.003270    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d6f4cc7-9677-4109-bf9a-22097792fc31-maas-api-tls\") pod \"maas-api-e2e-derive-cc99fb90-59d7c6fbfb-c8sb7\" (UID: \"3d6f4cc7-9677-4109-bf9a-22097792fc31\") " pod="opendatahub/maas-api-e2e-derive-cc99fb90-59d7c6fbfb-c8sb7"
Jul 06 01:28:49.003298 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:49.003300    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d6f4cc7-9677-4109-bf9a-22097792fc31-openshift-service-ca\") pod \"maas-api-e2e-derive-cc99fb90-59d7c6fbfb-c8sb7\" (UID: \"3d6f4cc7-9677-4109-bf9a-22097792fc31\") " pod="opendatahub/maas-api-e2e-derive-cc99fb90-59d7c6fbfb-c8sb7"
Jul 06 01:28:49.003528 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:49.003338    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lxqn\" (UniqueName: \"kubernetes.io/projected/3d6f4cc7-9677-4109-bf9a-22097792fc31-kube-api-access-7lxqn\") pod \"maas-api-e2e-derive-cc99fb90-59d7c6fbfb-c8sb7\" (UID: \"3d6f4cc7-9677-4109-bf9a-22097792fc31\") " pod="opendatahub/maas-api-e2e-derive-cc99fb90-59d7c6fbfb-c8sb7"
Jul 06 01:28:49.003528 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:28:49.003480    2562 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-derive-cc99fb90-serving-cert: secret "maas-api-e2e-derive-cc99fb90-serving-cert" not found
Jul 06 01:28:49.003614 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:28:49.003554    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d6f4cc7-9677-4109-bf9a-22097792fc31-maas-api-tls podName:3d6f4cc7-9677-4109-bf9a-22097792fc31 nodeName:}" failed. No retries permitted until 2026-07-06 01:28:49.503537485 +0000 UTC m=+1761.314512707 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3d6f4cc7-9677-4109-bf9a-22097792fc31-maas-api-tls") pod "maas-api-e2e-derive-cc99fb90-59d7c6fbfb-c8sb7" (UID: "3d6f4cc7-9677-4109-bf9a-22097792fc31") : secret "maas-api-e2e-derive-cc99fb90-serving-cert" not found
Jul 06 01:28:49.003923 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:49.003904    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d6f4cc7-9677-4109-bf9a-22097792fc31-openshift-service-ca\") pod \"maas-api-e2e-derive-cc99fb90-59d7c6fbfb-c8sb7\" (UID: \"3d6f4cc7-9677-4109-bf9a-22097792fc31\") " pod="opendatahub/maas-api-e2e-derive-cc99fb90-59d7c6fbfb-c8sb7"
Jul 06 01:28:49.016634 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:49.016610    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lxqn\" (UniqueName: \"kubernetes.io/projected/3d6f4cc7-9677-4109-bf9a-22097792fc31-kube-api-access-7lxqn\") pod \"maas-api-e2e-derive-cc99fb90-59d7c6fbfb-c8sb7\" (UID: \"3d6f4cc7-9677-4109-bf9a-22097792fc31\") " pod="opendatahub/maas-api-e2e-derive-cc99fb90-59d7c6fbfb-c8sb7"
Jul 06 01:28:49.508477 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:49.508442    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d6f4cc7-9677-4109-bf9a-22097792fc31-maas-api-tls\") pod \"maas-api-e2e-derive-cc99fb90-59d7c6fbfb-c8sb7\" (UID: \"3d6f4cc7-9677-4109-bf9a-22097792fc31\") " pod="opendatahub/maas-api-e2e-derive-cc99fb90-59d7c6fbfb-c8sb7"
Jul 06 01:28:49.510812 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:49.510782    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d6f4cc7-9677-4109-bf9a-22097792fc31-maas-api-tls\") pod \"maas-api-e2e-derive-cc99fb90-59d7c6fbfb-c8sb7\" (UID: \"3d6f4cc7-9677-4109-bf9a-22097792fc31\") " pod="opendatahub/maas-api-e2e-derive-cc99fb90-59d7c6fbfb-c8sb7"
Jul 06 01:28:49.772862 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:49.772784    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb"
Jul 06 01:28:49.799927 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:49.799889    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-cc99fb90-59d7c6fbfb-c8sb7"
Jul 06 01:28:50.141341 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:50.141315    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-cc99fb90-59d7c6fbfb-c8sb7"]
Jul 06 01:28:50.143220 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:28:50.143195    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d6f4cc7_9677_4109_bf9a_22097792fc31.slice/crio-c2f90efdda6a8afadd815b2c50cbbe0c34dcba9a251ecd30ea60b46d0d74f759 WatchSource:0}: Error finding container c2f90efdda6a8afadd815b2c50cbbe0c34dcba9a251ecd30ea60b46d0d74f759: Status 404 returned error can't find the container with id c2f90efdda6a8afadd815b2c50cbbe0c34dcba9a251ecd30ea60b46d0d74f759
Jul 06 01:28:50.778315 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:50.778277    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-cc99fb90-59d7c6fbfb-c8sb7" event={"ID":"3d6f4cc7-9677-4109-bf9a-22097792fc31","Type":"ContainerStarted","Data":"c3b00df0c385e4364e0f733b8dac0e1deeb82712c0d39895a219e12c13df1f91"}
Jul 06 01:28:50.778698 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:50.778344    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-cc99fb90-59d7c6fbfb-c8sb7"
Jul 06 01:28:50.778698 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:50.778386    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb"
Jul 06 01:28:50.778698 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:50.778408    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-cc99fb90-59d7c6fbfb-c8sb7" event={"ID":"3d6f4cc7-9677-4109-bf9a-22097792fc31","Type":"ContainerStarted","Data":"c2f90efdda6a8afadd815b2c50cbbe0c34dcba9a251ecd30ea60b46d0d74f759"}
Jul 06 01:28:50.779311 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:50.779290    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb"
Jul 06 01:28:50.798487 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:50.798404    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-cc99fb90-59d7c6fbfb-c8sb7" podStartSLOduration=2.409410809 podStartE2EDuration="2.798389652s" totalImagesPullingTime="388.978843ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:28:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:28:50.796306977 +0000 UTC m=+1762.607282221" watchObservedRunningTime="2026-07-06 01:28:50.798389652 +0000 UTC m=+1762.609364895"
Jul 06 01:28:53.330020 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:53.329986    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb"]
Jul 06 01:28:53.467368 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:53.467334    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-cc99fb90-59d7c6fbfb-c8sb7"]
Jul 06 01:28:53.467618 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:53.467588    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-cc99fb90-59d7c6fbfb-c8sb7" podUID="3d6f4cc7-9677-4109-bf9a-22097792fc31" containerName="maas-api" containerID="cri-o://c3b00df0c385e4364e0f733b8dac0e1deeb82712c0d39895a219e12c13df1f91" gracePeriod=30
Jul 06 01:28:53.719437 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:53.719416    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-cc99fb90-59d7c6fbfb-c8sb7"
Jul 06 01:28:53.748854 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:53.748807    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d6f4cc7-9677-4109-bf9a-22097792fc31-maas-api-tls\") pod \"3d6f4cc7-9677-4109-bf9a-22097792fc31\" (UID: \"3d6f4cc7-9677-4109-bf9a-22097792fc31\") "
Jul 06 01:28:53.748854 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:53.748848    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d6f4cc7-9677-4109-bf9a-22097792fc31-openshift-service-ca\") pod \"3d6f4cc7-9677-4109-bf9a-22097792fc31\" (UID: \"3d6f4cc7-9677-4109-bf9a-22097792fc31\") "
Jul 06 01:28:53.749100 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:53.748881    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7lxqn\" (UniqueName: \"kubernetes.io/projected/3d6f4cc7-9677-4109-bf9a-22097792fc31-kube-api-access-7lxqn\") pod \"3d6f4cc7-9677-4109-bf9a-22097792fc31\" (UID: \"3d6f4cc7-9677-4109-bf9a-22097792fc31\") "
Jul 06 01:28:53.749223 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:53.749201    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d6f4cc7-9677-4109-bf9a-22097792fc31-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3d6f4cc7-9677-4109-bf9a-22097792fc31" (UID: "3d6f4cc7-9677-4109-bf9a-22097792fc31"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:28:53.750961 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:53.750933    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d6f4cc7-9677-4109-bf9a-22097792fc31-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3d6f4cc7-9677-4109-bf9a-22097792fc31" (UID: "3d6f4cc7-9677-4109-bf9a-22097792fc31"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:28:53.751063 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:53.751033    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d6f4cc7-9677-4109-bf9a-22097792fc31-kube-api-access-7lxqn" (OuterVolumeSpecName: "kube-api-access-7lxqn") pod "3d6f4cc7-9677-4109-bf9a-22097792fc31" (UID: "3d6f4cc7-9677-4109-bf9a-22097792fc31"). InnerVolumeSpecName "kube-api-access-7lxqn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:28:53.796207 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:53.796177    2562 generic.go:356] "Generic (PLEG): container finished" podID="3d6f4cc7-9677-4109-bf9a-22097792fc31" containerID="c3b00df0c385e4364e0f733b8dac0e1deeb82712c0d39895a219e12c13df1f91" exitCode=0
Jul 06 01:28:53.796385 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:53.796219    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-cc99fb90-59d7c6fbfb-c8sb7"
Jul 06 01:28:53.796385 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:53.796268    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-cc99fb90-59d7c6fbfb-c8sb7" event={"ID":"3d6f4cc7-9677-4109-bf9a-22097792fc31","Type":"ContainerDied","Data":"c3b00df0c385e4364e0f733b8dac0e1deeb82712c0d39895a219e12c13df1f91"}
Jul 06 01:28:53.796385 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:53.796322    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-cc99fb90-59d7c6fbfb-c8sb7" event={"ID":"3d6f4cc7-9677-4109-bf9a-22097792fc31","Type":"ContainerDied","Data":"c2f90efdda6a8afadd815b2c50cbbe0c34dcba9a251ecd30ea60b46d0d74f759"}
Jul 06 01:28:53.796385 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:53.796351    2562 scope.go:117] "RemoveContainer" containerID="c3b00df0c385e4364e0f733b8dac0e1deeb82712c0d39895a219e12c13df1f91"
Jul 06 01:28:53.796607 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:53.796463    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb" podUID="e270e64c-35cb-4d5b-ad78-89872fba98b7" containerName="istio-proxy" containerID="cri-o://d6e2343c479ead8bd8534e04757570a1a32434c3866fb7f359d13a99da4b66e1" gracePeriod=30
Jul 06 01:28:53.805940 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:53.805921    2562 scope.go:117] "RemoveContainer" containerID="c3b00df0c385e4364e0f733b8dac0e1deeb82712c0d39895a219e12c13df1f91"
Jul 06 01:28:53.806238 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:28:53.806218    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3b00df0c385e4364e0f733b8dac0e1deeb82712c0d39895a219e12c13df1f91\": container with ID starting with c3b00df0c385e4364e0f733b8dac0e1deeb82712c0d39895a219e12c13df1f91 not found: ID does not exist" containerID="c3b00df0c385e4364e0f733b8dac0e1deeb82712c0d39895a219e12c13df1f91"
Jul 06 01:28:53.806311 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:53.806248    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3b00df0c385e4364e0f733b8dac0e1deeb82712c0d39895a219e12c13df1f91"} err="failed to get container status \"c3b00df0c385e4364e0f733b8dac0e1deeb82712c0d39895a219e12c13df1f91\": rpc error: code = NotFound desc = could not find container \"c3b00df0c385e4364e0f733b8dac0e1deeb82712c0d39895a219e12c13df1f91\": container with ID starting with c3b00df0c385e4364e0f733b8dac0e1deeb82712c0d39895a219e12c13df1f91 not found: ID does not exist"
Jul 06 01:28:53.829491 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:53.829465    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-cc99fb90-59d7c6fbfb-c8sb7"]
Jul 06 01:28:53.831486 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:53.831465    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-cc99fb90-59d7c6fbfb-c8sb7"]
Jul 06 01:28:53.849909 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:53.849853    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d6f4cc7-9677-4109-bf9a-22097792fc31-maas-api-tls\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:28:53.849909 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:53.849873    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d6f4cc7-9677-4109-bf9a-22097792fc31-openshift-service-ca\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:28:53.849909 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:53.849885    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7lxqn\" (UniqueName: \"kubernetes.io/projected/3d6f4cc7-9677-4109-bf9a-22097792fc31-kube-api-access-7lxqn\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:28:54.755199 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:54.755129    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d6f4cc7-9677-4109-bf9a-22097792fc31" path="/var/lib/kubelet/pods/3d6f4cc7-9677-4109-bf9a-22097792fc31/volumes"
Jul 06 01:28:59.051048 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:59.051027    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb"
Jul 06 01:28:59.092399 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:59.092314    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e270e64c-35cb-4d5b-ad78-89872fba98b7-istiod-ca-cert\") pod \"e270e64c-35cb-4d5b-ad78-89872fba98b7\" (UID: \"e270e64c-35cb-4d5b-ad78-89872fba98b7\") "
Jul 06 01:28:59.092399 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:59.092360    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e270e64c-35cb-4d5b-ad78-89872fba98b7-workload-socket\") pod \"e270e64c-35cb-4d5b-ad78-89872fba98b7\" (UID: \"e270e64c-35cb-4d5b-ad78-89872fba98b7\") "
Jul 06 01:28:59.092636 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:59.092428    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e270e64c-35cb-4d5b-ad78-89872fba98b7-workload-certs\") pod \"e270e64c-35cb-4d5b-ad78-89872fba98b7\" (UID: \"e270e64c-35cb-4d5b-ad78-89872fba98b7\") "
Jul 06 01:28:59.092636 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:59.092457    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e270e64c-35cb-4d5b-ad78-89872fba98b7-istio-podinfo\") pod \"e270e64c-35cb-4d5b-ad78-89872fba98b7\" (UID: \"e270e64c-35cb-4d5b-ad78-89872fba98b7\") "
Jul 06 01:28:59.092636 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:59.092489    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e270e64c-35cb-4d5b-ad78-89872fba98b7-istio-token\") pod \"e270e64c-35cb-4d5b-ad78-89872fba98b7\" (UID: \"e270e64c-35cb-4d5b-ad78-89872fba98b7\") "
Jul 06 01:28:59.092636 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:59.092540    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e270e64c-35cb-4d5b-ad78-89872fba98b7-credential-socket\") pod \"e270e64c-35cb-4d5b-ad78-89872fba98b7\" (UID: \"e270e64c-35cb-4d5b-ad78-89872fba98b7\") "
Jul 06 01:28:59.092636 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:59.092567    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e270e64c-35cb-4d5b-ad78-89872fba98b7-istio-data\") pod \"e270e64c-35cb-4d5b-ad78-89872fba98b7\" (UID: \"e270e64c-35cb-4d5b-ad78-89872fba98b7\") "
Jul 06 01:28:59.092636 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:59.092610    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e270e64c-35cb-4d5b-ad78-89872fba98b7-istio-envoy\") pod \"e270e64c-35cb-4d5b-ad78-89872fba98b7\" (UID: \"e270e64c-35cb-4d5b-ad78-89872fba98b7\") "
Jul 06 01:28:59.092636 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:59.092633    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwq2g\" (UniqueName: \"kubernetes.io/projected/e270e64c-35cb-4d5b-ad78-89872fba98b7-kube-api-access-hwq2g\") pod \"e270e64c-35cb-4d5b-ad78-89872fba98b7\" (UID: \"e270e64c-35cb-4d5b-ad78-89872fba98b7\") "
Jul 06 01:28:59.093100 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:59.092661    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e270e64c-35cb-4d5b-ad78-89872fba98b7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e270e64c-35cb-4d5b-ad78-89872fba98b7" (UID: "e270e64c-35cb-4d5b-ad78-89872fba98b7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:28:59.093100 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:59.092692    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e270e64c-35cb-4d5b-ad78-89872fba98b7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e270e64c-35cb-4d5b-ad78-89872fba98b7" (UID: "e270e64c-35cb-4d5b-ad78-89872fba98b7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:28:59.093100 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:59.092856    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e270e64c-35cb-4d5b-ad78-89872fba98b7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e270e64c-35cb-4d5b-ad78-89872fba98b7" (UID: "e270e64c-35cb-4d5b-ad78-89872fba98b7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:28:59.093100 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:59.092941    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e270e64c-35cb-4d5b-ad78-89872fba98b7-credential-socket\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:28:59.093100 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:59.092960    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e270e64c-35cb-4d5b-ad78-89872fba98b7-workload-socket\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:28:59.093100 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:59.092976    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e270e64c-35cb-4d5b-ad78-89872fba98b7-workload-certs\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:28:59.093447 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:59.093133    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e270e64c-35cb-4d5b-ad78-89872fba98b7-istio-data" (OuterVolumeSpecName: "istio-data") pod "e270e64c-35cb-4d5b-ad78-89872fba98b7" (UID: "e270e64c-35cb-4d5b-ad78-89872fba98b7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:28:59.093511 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:59.093495    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e270e64c-35cb-4d5b-ad78-89872fba98b7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e270e64c-35cb-4d5b-ad78-89872fba98b7" (UID: "e270e64c-35cb-4d5b-ad78-89872fba98b7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:28:59.095372 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:59.095345    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e270e64c-35cb-4d5b-ad78-89872fba98b7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e270e64c-35cb-4d5b-ad78-89872fba98b7" (UID: "e270e64c-35cb-4d5b-ad78-89872fba98b7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:28:59.095510 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:59.095457    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e270e64c-35cb-4d5b-ad78-89872fba98b7-istio-token" (OuterVolumeSpecName: "istio-token") pod "e270e64c-35cb-4d5b-ad78-89872fba98b7" (UID: "e270e64c-35cb-4d5b-ad78-89872fba98b7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:28:59.095597 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:59.095567    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e270e64c-35cb-4d5b-ad78-89872fba98b7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e270e64c-35cb-4d5b-ad78-89872fba98b7" (UID: "e270e64c-35cb-4d5b-ad78-89872fba98b7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 01:28:59.095731 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:59.095655    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e270e64c-35cb-4d5b-ad78-89872fba98b7-kube-api-access-hwq2g" (OuterVolumeSpecName: "kube-api-access-hwq2g") pod "e270e64c-35cb-4d5b-ad78-89872fba98b7" (UID: "e270e64c-35cb-4d5b-ad78-89872fba98b7"). InnerVolumeSpecName "kube-api-access-hwq2g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:28:59.194331 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:59.194295    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e270e64c-35cb-4d5b-ad78-89872fba98b7-istio-token\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:28:59.194331 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:59.194325    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e270e64c-35cb-4d5b-ad78-89872fba98b7-istio-data\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:28:59.194331 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:59.194333    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e270e64c-35cb-4d5b-ad78-89872fba98b7-istio-envoy\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:28:59.194559 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:59.194348    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwq2g\" (UniqueName: \"kubernetes.io/projected/e270e64c-35cb-4d5b-ad78-89872fba98b7-kube-api-access-hwq2g\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:28:59.194559 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:59.194378    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e270e64c-35cb-4d5b-ad78-89872fba98b7-istiod-ca-cert\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:28:59.194559 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:59.194387    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e270e64c-35cb-4d5b-ad78-89872fba98b7-istio-podinfo\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:28:59.827561 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:59.827526    2562 generic.go:356] "Generic (PLEG): container finished" podID="e270e64c-35cb-4d5b-ad78-89872fba98b7" containerID="d6e2343c479ead8bd8534e04757570a1a32434c3866fb7f359d13a99da4b66e1" exitCode=0
Jul 06 01:28:59.827743 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:59.827565    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb" event={"ID":"e270e64c-35cb-4d5b-ad78-89872fba98b7","Type":"ContainerDied","Data":"d6e2343c479ead8bd8534e04757570a1a32434c3866fb7f359d13a99da4b66e1"}
Jul 06 01:28:59.827743 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:59.827591    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb"
Jul 06 01:28:59.827743 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:59.827639    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb" event={"ID":"e270e64c-35cb-4d5b-ad78-89872fba98b7","Type":"ContainerDied","Data":"85b8cd3d044769da51c4d17091371ff329e5ec005b5de7cf28ebfc571f03bb83"}
Jul 06 01:28:59.827743 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:59.827676    2562 scope.go:117] "RemoveContainer" containerID="d6e2343c479ead8bd8534e04757570a1a32434c3866fb7f359d13a99da4b66e1"
Jul 06 01:28:59.837455 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:59.837438    2562 scope.go:117] "RemoveContainer" containerID="d6e2343c479ead8bd8534e04757570a1a32434c3866fb7f359d13a99da4b66e1"
Jul 06 01:28:59.837736 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:28:59.837718    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6e2343c479ead8bd8534e04757570a1a32434c3866fb7f359d13a99da4b66e1\": container with ID starting with d6e2343c479ead8bd8534e04757570a1a32434c3866fb7f359d13a99da4b66e1 not found: ID does not exist" containerID="d6e2343c479ead8bd8534e04757570a1a32434c3866fb7f359d13a99da4b66e1"
Jul 06 01:28:59.837776 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:59.837747    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6e2343c479ead8bd8534e04757570a1a32434c3866fb7f359d13a99da4b66e1"} err="failed to get container status \"d6e2343c479ead8bd8534e04757570a1a32434c3866fb7f359d13a99da4b66e1\": rpc error: code = NotFound desc = could not find container \"d6e2343c479ead8bd8534e04757570a1a32434c3866fb7f359d13a99da4b66e1\": container with ID starting with d6e2343c479ead8bd8534e04757570a1a32434c3866fb7f359d13a99da4b66e1 not found: ID does not exist"
Jul 06 01:28:59.849686 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:59.849657    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb"]
Jul 06 01:28:59.852830 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:28:59.852807    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-cc99fb90-openshift-default-c7c77c6dc-n7xfb"]
Jul 06 01:29:00.753490 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:29:00.753457    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e270e64c-35cb-4d5b-ad78-89872fba98b7" path="/var/lib/kubelet/pods/e270e64c-35cb-4d5b-ad78-89872fba98b7/volumes"
Jul 06 01:30:00.131277 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:00.131232    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29721690-hnrlr"]
Jul 06 01:30:00.131895 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:00.131811    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e270e64c-35cb-4d5b-ad78-89872fba98b7" containerName="istio-proxy"
Jul 06 01:30:00.131895 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:00.131830    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e270e64c-35cb-4d5b-ad78-89872fba98b7" containerName="istio-proxy"
Jul 06 01:30:00.131895 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:00.131861    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d6f4cc7-9677-4109-bf9a-22097792fc31" containerName="maas-api"
Jul 06 01:30:00.131895 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:00.131871    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d6f4cc7-9677-4109-bf9a-22097792fc31" containerName="maas-api"
Jul 06 01:30:00.132108 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:00.131990    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d6f4cc7-9677-4109-bf9a-22097792fc31" containerName="maas-api"
Jul 06 01:30:00.132108 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:00.132004    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e270e64c-35cb-4d5b-ad78-89872fba98b7" containerName="istio-proxy"
Jul 06 01:30:00.134131 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:00.134110    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29721690-hnrlr"
Jul 06 01:30:00.136386 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:00.136364    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-84mvh\""
Jul 06 01:30:00.140674 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:00.140646    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29721690-hnrlr"]
Jul 06 01:30:00.237310 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:00.237273    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssl4f\" (UniqueName: \"kubernetes.io/projected/e8089c5f-ef38-4619-9530-1def224f99ae-kube-api-access-ssl4f\") pod \"maas-api-key-cleanup-29721690-hnrlr\" (UID: \"e8089c5f-ef38-4619-9530-1def224f99ae\") " pod="opendatahub/maas-api-key-cleanup-29721690-hnrlr"
Jul 06 01:30:00.338614 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:00.338575    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssl4f\" (UniqueName: \"kubernetes.io/projected/e8089c5f-ef38-4619-9530-1def224f99ae-kube-api-access-ssl4f\") pod \"maas-api-key-cleanup-29721690-hnrlr\" (UID: \"e8089c5f-ef38-4619-9530-1def224f99ae\") " pod="opendatahub/maas-api-key-cleanup-29721690-hnrlr"
Jul 06 01:30:00.346590 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:00.346558    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssl4f\" (UniqueName: \"kubernetes.io/projected/e8089c5f-ef38-4619-9530-1def224f99ae-kube-api-access-ssl4f\") pod \"maas-api-key-cleanup-29721690-hnrlr\" (UID: \"e8089c5f-ef38-4619-9530-1def224f99ae\") " pod="opendatahub/maas-api-key-cleanup-29721690-hnrlr"
Jul 06 01:30:00.446398 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:00.446301    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29721690-hnrlr"
Jul 06 01:30:00.580516 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:00.580491    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29721690-hnrlr"]
Jul 06 01:30:00.582506 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:30:00.582480    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8089c5f_ef38_4619_9530_1def224f99ae.slice/crio-c6c85c74dc8f0e2c5488a760587d84683125696757c8e31eff4e687b5af4a9bd WatchSource:0}: Error finding container c6c85c74dc8f0e2c5488a760587d84683125696757c8e31eff4e687b5af4a9bd: Status 404 returned error can't find the container with id c6c85c74dc8f0e2c5488a760587d84683125696757c8e31eff4e687b5af4a9bd
Jul 06 01:30:01.121398 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:01.121354    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29721690-hnrlr" event={"ID":"e8089c5f-ef38-4619-9530-1def224f99ae","Type":"ContainerStarted","Data":"e7ca65fcefa38c559241fa129eeb43e44da4f642803ea2920902c400ce4fb1ad"}
Jul 06 01:30:01.121604 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:01.121409    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29721690-hnrlr" event={"ID":"e8089c5f-ef38-4619-9530-1def224f99ae","Type":"ContainerStarted","Data":"c6c85c74dc8f0e2c5488a760587d84683125696757c8e31eff4e687b5af4a9bd"}
Jul 06 01:30:01.135775 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:01.135686    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29721690-hnrlr" podStartSLOduration=1.135670357 podStartE2EDuration="1.135670357s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:30:01.135140436 +0000 UTC m=+1832.946115689" watchObservedRunningTime="2026-07-06 01:30:01.135670357 +0000 UTC m=+1832.946645602"
Jul 06 01:30:02.128043 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:02.128006    2562 generic.go:356] "Generic (PLEG): container finished" podID="e8089c5f-ef38-4619-9530-1def224f99ae" containerID="e7ca65fcefa38c559241fa129eeb43e44da4f642803ea2920902c400ce4fb1ad" exitCode=0
Jul 06 01:30:02.128278 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:02.128079    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29721690-hnrlr" event={"ID":"e8089c5f-ef38-4619-9530-1def224f99ae","Type":"ContainerDied","Data":"e7ca65fcefa38c559241fa129eeb43e44da4f642803ea2920902c400ce4fb1ad"}
Jul 06 01:30:03.265621 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:03.265595    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29721690-hnrlr"
Jul 06 01:30:03.367314 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:03.367263    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ssl4f\" (UniqueName: \"kubernetes.io/projected/e8089c5f-ef38-4619-9530-1def224f99ae-kube-api-access-ssl4f\") pod \"e8089c5f-ef38-4619-9530-1def224f99ae\" (UID: \"e8089c5f-ef38-4619-9530-1def224f99ae\") "
Jul 06 01:30:03.369410 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:03.369379    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8089c5f-ef38-4619-9530-1def224f99ae-kube-api-access-ssl4f" (OuterVolumeSpecName: "kube-api-access-ssl4f") pod "e8089c5f-ef38-4619-9530-1def224f99ae" (UID: "e8089c5f-ef38-4619-9530-1def224f99ae"). InnerVolumeSpecName "kube-api-access-ssl4f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:30:03.468114 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:03.468027    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ssl4f\" (UniqueName: \"kubernetes.io/projected/e8089c5f-ef38-4619-9530-1def224f99ae-kube-api-access-ssl4f\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:30:04.137878 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:04.137849    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29721690-hnrlr"
Jul 06 01:30:04.137878 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:04.137859    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29721690-hnrlr" event={"ID":"e8089c5f-ef38-4619-9530-1def224f99ae","Type":"ContainerDied","Data":"c6c85c74dc8f0e2c5488a760587d84683125696757c8e31eff4e687b5af4a9bd"}
Jul 06 01:30:04.138110 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:04.137918    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c6c85c74dc8f0e2c5488a760587d84683125696757c8e31eff4e687b5af4a9bd"
Jul 06 01:30:33.685213 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:33.685179    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"]
Jul 06 01:30:33.685689 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:33.685557    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8089c5f-ef38-4619-9530-1def224f99ae" containerName="cleanup"
Jul 06 01:30:33.685689 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:33.685567    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8089c5f-ef38-4619-9530-1def224f99ae" containerName="cleanup"
Jul 06 01:30:33.685689 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:33.685641    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8089c5f-ef38-4619-9530-1def224f99ae" containerName="cleanup"
Jul 06 01:30:33.688636 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:33.688619    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"
Jul 06 01:30:33.691197 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:33.691177    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 01:30:33.691303 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:33.691239    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-002250d0-openshift-default-dockercfg-wz27f\""
Jul 06 01:30:33.700648 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:33.700619    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"]
Jul 06 01:30:33.745989 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:33.745959    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-credential-socket\") pod \"e2e-mt-002250d0-openshift-default-5668689db7-n96zq\" (UID: \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\") " pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"
Jul 06 01:30:33.746200 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:33.745994    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-workload-certs\") pod \"e2e-mt-002250d0-openshift-default-5668689db7-n96zq\" (UID: \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\") " pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"
Jul 06 01:30:33.746200 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:33.746046    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-istio-token\") pod \"e2e-mt-002250d0-openshift-default-5668689db7-n96zq\" (UID: \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\") " pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"
Jul 06 01:30:33.746200 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:33.746109    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-istio-data\") pod \"e2e-mt-002250d0-openshift-default-5668689db7-n96zq\" (UID: \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\") " pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"
Jul 06 01:30:33.746200 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:33.746179    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-istio-podinfo\") pod \"e2e-mt-002250d0-openshift-default-5668689db7-n96zq\" (UID: \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\") " pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"
Jul 06 01:30:33.746440 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:33.746215    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-workload-socket\") pod \"e2e-mt-002250d0-openshift-default-5668689db7-n96zq\" (UID: \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\") " pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"
Jul 06 01:30:33.746440 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:33.746239    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-istiod-ca-cert\") pod \"e2e-mt-002250d0-openshift-default-5668689db7-n96zq\" (UID: \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\") " pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"
Jul 06 01:30:33.746440 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:33.746282    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rd99\" (UniqueName: \"kubernetes.io/projected/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-kube-api-access-7rd99\") pod \"e2e-mt-002250d0-openshift-default-5668689db7-n96zq\" (UID: \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\") " pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"
Jul 06 01:30:33.746440 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:33.746346    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-istio-envoy\") pod \"e2e-mt-002250d0-openshift-default-5668689db7-n96zq\" (UID: \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\") " pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"
Jul 06 01:30:33.847124 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:33.847086    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-credential-socket\") pod \"e2e-mt-002250d0-openshift-default-5668689db7-n96zq\" (UID: \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\") " pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"
Jul 06 01:30:33.847124 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:33.847122    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-workload-certs\") pod \"e2e-mt-002250d0-openshift-default-5668689db7-n96zq\" (UID: \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\") " pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"
Jul 06 01:30:33.847428 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:33.847143    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-istio-token\") pod \"e2e-mt-002250d0-openshift-default-5668689db7-n96zq\" (UID: \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\") " pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"
Jul 06 01:30:33.847428 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:33.847207    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-istio-data\") pod \"e2e-mt-002250d0-openshift-default-5668689db7-n96zq\" (UID: \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\") " pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"
Jul 06 01:30:33.847428 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:33.847238    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-istio-podinfo\") pod \"e2e-mt-002250d0-openshift-default-5668689db7-n96zq\" (UID: \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\") " pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"
Jul 06 01:30:33.847428 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:33.847370    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-workload-socket\") pod \"e2e-mt-002250d0-openshift-default-5668689db7-n96zq\" (UID: \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\") " pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"
Jul 06 01:30:33.847428 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:33.847415    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-istiod-ca-cert\") pod \"e2e-mt-002250d0-openshift-default-5668689db7-n96zq\" (UID: \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\") " pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"
Jul 06 01:30:33.847695 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:33.847460    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rd99\" (UniqueName: \"kubernetes.io/projected/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-kube-api-access-7rd99\") pod \"e2e-mt-002250d0-openshift-default-5668689db7-n96zq\" (UID: \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\") " pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"
Jul 06 01:30:33.847695 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:33.847518    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-istio-envoy\") pod \"e2e-mt-002250d0-openshift-default-5668689db7-n96zq\" (UID: \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\") " pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"
Jul 06 01:30:33.847695 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:33.847553    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-workload-certs\") pod \"e2e-mt-002250d0-openshift-default-5668689db7-n96zq\" (UID: \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\") " pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"
Jul 06 01:30:33.847695 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:33.847642    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-istio-data\") pod \"e2e-mt-002250d0-openshift-default-5668689db7-n96zq\" (UID: \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\") " pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"
Jul 06 01:30:33.847907 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:33.847715    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-workload-socket\") pod \"e2e-mt-002250d0-openshift-default-5668689db7-n96zq\" (UID: \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\") " pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"
Jul 06 01:30:33.848089 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:33.848068    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-credential-socket\") pod \"e2e-mt-002250d0-openshift-default-5668689db7-n96zq\" (UID: \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\") " pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"
Jul 06 01:30:33.848250 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:33.848095    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-istiod-ca-cert\") pod \"e2e-mt-002250d0-openshift-default-5668689db7-n96zq\" (UID: \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\") " pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"
Jul 06 01:30:33.849583 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:33.849564    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-istio-envoy\") pod \"e2e-mt-002250d0-openshift-default-5668689db7-n96zq\" (UID: \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\") " pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"
Jul 06 01:30:33.849691 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:33.849675    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-istio-podinfo\") pod \"e2e-mt-002250d0-openshift-default-5668689db7-n96zq\" (UID: \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\") " pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"
Jul 06 01:30:33.854544 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:33.854521    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-istio-token\") pod \"e2e-mt-002250d0-openshift-default-5668689db7-n96zq\" (UID: \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\") " pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"
Jul 06 01:30:33.854626 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:33.854598    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rd99\" (UniqueName: \"kubernetes.io/projected/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-kube-api-access-7rd99\") pod \"e2e-mt-002250d0-openshift-default-5668689db7-n96zq\" (UID: \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\") " pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"
Jul 06 01:30:34.000429 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:34.000336    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"
Jul 06 01:30:34.133968 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:34.133934    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"]
Jul 06 01:30:34.135628 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:30:34.135600    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc133e3b1_0948_4fa4_bf7f_6911c9fcb5d2.slice/crio-f1925708a2b94d78c246cd91ccb5f152dceefefd608a84d328181f1339ff5eec WatchSource:0}: Error finding container f1925708a2b94d78c246cd91ccb5f152dceefefd608a84d328181f1339ff5eec: Status 404 returned error can't find the container with id f1925708a2b94d78c246cd91ccb5f152dceefefd608a84d328181f1339ff5eec
Jul 06 01:30:34.137725 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:34.137691    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:30:34.137886 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:34.137753    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:30:34.137886 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:34.137781    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:30:34.287210 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:34.287106    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq" event={"ID":"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2","Type":"ContainerStarted","Data":"10fe2cc59ba6e93c7d335d92b2558838c4af47e72ae5797d2d6b63c89e2d6ecd"}
Jul 06 01:30:34.287210 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:34.287201    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq" event={"ID":"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2","Type":"ContainerStarted","Data":"f1925708a2b94d78c246cd91ccb5f152dceefefd608a84d328181f1339ff5eec"}
Jul 06 01:30:34.305589 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:34.305519    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq" podStartSLOduration=1.305498376 podStartE2EDuration="1.305498376s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:30:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:30:34.303677575 +0000 UTC m=+1866.114652817" watchObservedRunningTime="2026-07-06 01:30:34.305498376 +0000 UTC m=+1866.116473621"
Jul 06 01:30:35.000512 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:35.000476    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"
Jul 06 01:30:35.005307 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:35.005284    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"
Jul 06 01:30:35.291740 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:35.291661    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"
Jul 06 01:30:35.292537 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:35.292520    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"
Jul 06 01:30:36.530187 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:36.530136    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-002250d0-5b69d48c86-m4rgl"]
Jul 06 01:30:36.541572 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:36.541534    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-002250d0-5b69d48c86-m4rgl"
Jul 06 01:30:36.545138 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:36.544812    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-84mvh\""
Jul 06 01:30:36.545312 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:36.545143    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-002250d0-serving-cert\""
Jul 06 01:30:36.545674 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:36.545645    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-002250d0-5b69d48c86-m4rgl"]
Jul 06 01:30:36.571867 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:36.571837    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6029315e-5b00-40ea-bd7c-50516dc629f1-openshift-service-ca\") pod \"maas-api-e2e-mt-002250d0-5b69d48c86-m4rgl\" (UID: \"6029315e-5b00-40ea-bd7c-50516dc629f1\") " pod="opendatahub/maas-api-e2e-mt-002250d0-5b69d48c86-m4rgl"
Jul 06 01:30:36.572022 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:36.571883    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6029315e-5b00-40ea-bd7c-50516dc629f1-maas-api-tls\") pod \"maas-api-e2e-mt-002250d0-5b69d48c86-m4rgl\" (UID: \"6029315e-5b00-40ea-bd7c-50516dc629f1\") " pod="opendatahub/maas-api-e2e-mt-002250d0-5b69d48c86-m4rgl"
Jul 06 01:30:36.572072 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:36.572031    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqvnp\" (UniqueName: \"kubernetes.io/projected/6029315e-5b00-40ea-bd7c-50516dc629f1-kube-api-access-lqvnp\") pod \"maas-api-e2e-mt-002250d0-5b69d48c86-m4rgl\" (UID: \"6029315e-5b00-40ea-bd7c-50516dc629f1\") " pod="opendatahub/maas-api-e2e-mt-002250d0-5b69d48c86-m4rgl"
Jul 06 01:30:36.672730 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:36.672691    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqvnp\" (UniqueName: \"kubernetes.io/projected/6029315e-5b00-40ea-bd7c-50516dc629f1-kube-api-access-lqvnp\") pod \"maas-api-e2e-mt-002250d0-5b69d48c86-m4rgl\" (UID: \"6029315e-5b00-40ea-bd7c-50516dc629f1\") " pod="opendatahub/maas-api-e2e-mt-002250d0-5b69d48c86-m4rgl"
Jul 06 01:30:36.672905 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:36.672751    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6029315e-5b00-40ea-bd7c-50516dc629f1-openshift-service-ca\") pod \"maas-api-e2e-mt-002250d0-5b69d48c86-m4rgl\" (UID: \"6029315e-5b00-40ea-bd7c-50516dc629f1\") " pod="opendatahub/maas-api-e2e-mt-002250d0-5b69d48c86-m4rgl"
Jul 06 01:30:36.672905 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:36.672779    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6029315e-5b00-40ea-bd7c-50516dc629f1-maas-api-tls\") pod \"maas-api-e2e-mt-002250d0-5b69d48c86-m4rgl\" (UID: \"6029315e-5b00-40ea-bd7c-50516dc629f1\") " pod="opendatahub/maas-api-e2e-mt-002250d0-5b69d48c86-m4rgl"
Jul 06 01:30:36.672995 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:30:36.672905    2562 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-002250d0-serving-cert: secret "maas-api-e2e-mt-002250d0-serving-cert" not found
Jul 06 01:30:36.672995 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:30:36.672973    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6029315e-5b00-40ea-bd7c-50516dc629f1-maas-api-tls podName:6029315e-5b00-40ea-bd7c-50516dc629f1 nodeName:}" failed. No retries permitted until 2026-07-06 01:30:37.172952668 +0000 UTC m=+1868.983927892 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6029315e-5b00-40ea-bd7c-50516dc629f1-maas-api-tls") pod "maas-api-e2e-mt-002250d0-5b69d48c86-m4rgl" (UID: "6029315e-5b00-40ea-bd7c-50516dc629f1") : secret "maas-api-e2e-mt-002250d0-serving-cert" not found
Jul 06 01:30:36.673486 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:36.673466    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6029315e-5b00-40ea-bd7c-50516dc629f1-openshift-service-ca\") pod \"maas-api-e2e-mt-002250d0-5b69d48c86-m4rgl\" (UID: \"6029315e-5b00-40ea-bd7c-50516dc629f1\") " pod="opendatahub/maas-api-e2e-mt-002250d0-5b69d48c86-m4rgl"
Jul 06 01:30:36.686569 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:36.686538    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqvnp\" (UniqueName: \"kubernetes.io/projected/6029315e-5b00-40ea-bd7c-50516dc629f1-kube-api-access-lqvnp\") pod \"maas-api-e2e-mt-002250d0-5b69d48c86-m4rgl\" (UID: \"6029315e-5b00-40ea-bd7c-50516dc629f1\") " pod="opendatahub/maas-api-e2e-mt-002250d0-5b69d48c86-m4rgl"
Jul 06 01:30:37.177497 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:37.177458    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6029315e-5b00-40ea-bd7c-50516dc629f1-maas-api-tls\") pod \"maas-api-e2e-mt-002250d0-5b69d48c86-m4rgl\" (UID: \"6029315e-5b00-40ea-bd7c-50516dc629f1\") " pod="opendatahub/maas-api-e2e-mt-002250d0-5b69d48c86-m4rgl"
Jul 06 01:30:37.179950 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:37.179915    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6029315e-5b00-40ea-bd7c-50516dc629f1-maas-api-tls\") pod \"maas-api-e2e-mt-002250d0-5b69d48c86-m4rgl\" (UID: \"6029315e-5b00-40ea-bd7c-50516dc629f1\") " pod="opendatahub/maas-api-e2e-mt-002250d0-5b69d48c86-m4rgl"
Jul 06 01:30:37.456911 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:37.456793    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-002250d0-5b69d48c86-m4rgl"
Jul 06 01:30:37.594767 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:37.594742    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-002250d0-5b69d48c86-m4rgl"]
Jul 06 01:30:37.596819 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:30:37.596783    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6029315e_5b00_40ea_bd7c_50516dc629f1.slice/crio-93406ae23e708b3a51196f7c691b7e55c46f9fe3d7eddc9a50a977e138d214c3 WatchSource:0}: Error finding container 93406ae23e708b3a51196f7c691b7e55c46f9fe3d7eddc9a50a977e138d214c3: Status 404 returned error can't find the container with id 93406ae23e708b3a51196f7c691b7e55c46f9fe3d7eddc9a50a977e138d214c3
Jul 06 01:30:38.307760 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:38.307664    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-002250d0-5b69d48c86-m4rgl" event={"ID":"6029315e-5b00-40ea-bd7c-50516dc629f1","Type":"ContainerStarted","Data":"3582c34cdd9d950f358a224f004a28465f7538571791223890e90ede638c1b1c"}
Jul 06 01:30:38.307760 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:38.307732    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-002250d0-5b69d48c86-m4rgl"
Jul 06 01:30:38.307760 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:38.307748    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-002250d0-5b69d48c86-m4rgl" event={"ID":"6029315e-5b00-40ea-bd7c-50516dc629f1","Type":"ContainerStarted","Data":"93406ae23e708b3a51196f7c691b7e55c46f9fe3d7eddc9a50a977e138d214c3"}
Jul 06 01:30:38.324000 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:38.323952    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-002250d0-5b69d48c86-m4rgl" podStartSLOduration=1.930848428 podStartE2EDuration="2.323935225s" totalImagesPullingTime="393.086797ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:30:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:30:38.323130348 +0000 UTC m=+1870.134105592" watchObservedRunningTime="2026-07-06 01:30:38.323935225 +0000 UTC m=+1870.134910467"
Jul 06 01:30:44.329489 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:44.329446    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-002250d0-5b69d48c86-m4rgl"
Jul 06 01:30:48.618670 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:48.618632    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-002250d0-5b69d48c86-m4rgl"]
Jul 06 01:30:48.619099 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:48.618875    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-002250d0-5b69d48c86-m4rgl" podUID="6029315e-5b00-40ea-bd7c-50516dc629f1" containerName="maas-api" containerID="cri-o://3582c34cdd9d950f358a224f004a28465f7538571791223890e90ede638c1b1c" gracePeriod=30
Jul 06 01:30:48.872252 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:48.872193    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-002250d0-5b69d48c86-m4rgl"
Jul 06 01:30:48.996063 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:48.996031    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqvnp\" (UniqueName: \"kubernetes.io/projected/6029315e-5b00-40ea-bd7c-50516dc629f1-kube-api-access-lqvnp\") pod \"6029315e-5b00-40ea-bd7c-50516dc629f1\" (UID: \"6029315e-5b00-40ea-bd7c-50516dc629f1\") "
Jul 06 01:30:48.998001 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:48.996112    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6029315e-5b00-40ea-bd7c-50516dc629f1-openshift-service-ca\") pod \"6029315e-5b00-40ea-bd7c-50516dc629f1\" (UID: \"6029315e-5b00-40ea-bd7c-50516dc629f1\") "
Jul 06 01:30:48.998001 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:48.996196    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6029315e-5b00-40ea-bd7c-50516dc629f1-maas-api-tls\") pod \"6029315e-5b00-40ea-bd7c-50516dc629f1\" (UID: \"6029315e-5b00-40ea-bd7c-50516dc629f1\") "
Jul 06 01:30:48.998001 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:48.996525    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6029315e-5b00-40ea-bd7c-50516dc629f1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6029315e-5b00-40ea-bd7c-50516dc629f1" (UID: "6029315e-5b00-40ea-bd7c-50516dc629f1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:30:48.998266 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:48.998242    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6029315e-5b00-40ea-bd7c-50516dc629f1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6029315e-5b00-40ea-bd7c-50516dc629f1" (UID: "6029315e-5b00-40ea-bd7c-50516dc629f1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:30:48.998376 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:48.998355    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6029315e-5b00-40ea-bd7c-50516dc629f1-kube-api-access-lqvnp" (OuterVolumeSpecName: "kube-api-access-lqvnp") pod "6029315e-5b00-40ea-bd7c-50516dc629f1" (UID: "6029315e-5b00-40ea-bd7c-50516dc629f1"). InnerVolumeSpecName "kube-api-access-lqvnp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:30:49.097346 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:49.097316    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6029315e-5b00-40ea-bd7c-50516dc629f1-openshift-service-ca\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:30:49.097346 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:49.097342    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6029315e-5b00-40ea-bd7c-50516dc629f1-maas-api-tls\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:30:49.097346 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:49.097352    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqvnp\" (UniqueName: \"kubernetes.io/projected/6029315e-5b00-40ea-bd7c-50516dc629f1-kube-api-access-lqvnp\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:30:49.374808 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:49.374774    2562 generic.go:356] "Generic (PLEG): container finished" podID="c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2" containerID="10fe2cc59ba6e93c7d335d92b2558838c4af47e72ae5797d2d6b63c89e2d6ecd" exitCode=0
Jul 06 01:30:49.375011 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:49.374849    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq" event={"ID":"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2","Type":"ContainerDied","Data":"10fe2cc59ba6e93c7d335d92b2558838c4af47e72ae5797d2d6b63c89e2d6ecd"}
Jul 06 01:30:49.375367 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:49.375346    2562 scope.go:117] "RemoveContainer" containerID="10fe2cc59ba6e93c7d335d92b2558838c4af47e72ae5797d2d6b63c89e2d6ecd"
Jul 06 01:30:49.376204 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:49.376180    2562 generic.go:356] "Generic (PLEG): container finished" podID="6029315e-5b00-40ea-bd7c-50516dc629f1" containerID="3582c34cdd9d950f358a224f004a28465f7538571791223890e90ede638c1b1c" exitCode=0
Jul 06 01:30:49.376304 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:49.376210    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-002250d0-5b69d48c86-m4rgl" event={"ID":"6029315e-5b00-40ea-bd7c-50516dc629f1","Type":"ContainerDied","Data":"3582c34cdd9d950f358a224f004a28465f7538571791223890e90ede638c1b1c"}
Jul 06 01:30:49.376304 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:49.376228    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-002250d0-5b69d48c86-m4rgl"
Jul 06 01:30:49.376304 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:49.376252    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-002250d0-5b69d48c86-m4rgl" event={"ID":"6029315e-5b00-40ea-bd7c-50516dc629f1","Type":"ContainerDied","Data":"93406ae23e708b3a51196f7c691b7e55c46f9fe3d7eddc9a50a977e138d214c3"}
Jul 06 01:30:49.376304 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:49.376274    2562 scope.go:117] "RemoveContainer" containerID="3582c34cdd9d950f358a224f004a28465f7538571791223890e90ede638c1b1c"
Jul 06 01:30:49.376544 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:49.376367    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:30:49.376544 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:49.376447    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:30:49.376544 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:49.376492    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:30:49.386378 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:49.386360    2562 scope.go:117] "RemoveContainer" containerID="3582c34cdd9d950f358a224f004a28465f7538571791223890e90ede638c1b1c"
Jul 06 01:30:49.386658 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:30:49.386641    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3582c34cdd9d950f358a224f004a28465f7538571791223890e90ede638c1b1c\": container with ID starting with 3582c34cdd9d950f358a224f004a28465f7538571791223890e90ede638c1b1c not found: ID does not exist" containerID="3582c34cdd9d950f358a224f004a28465f7538571791223890e90ede638c1b1c"
Jul 06 01:30:49.386708 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:49.386665    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3582c34cdd9d950f358a224f004a28465f7538571791223890e90ede638c1b1c"} err="failed to get container status \"3582c34cdd9d950f358a224f004a28465f7538571791223890e90ede638c1b1c\": rpc error: code = NotFound desc = could not find container \"3582c34cdd9d950f358a224f004a28465f7538571791223890e90ede638c1b1c\": container with ID starting with 3582c34cdd9d950f358a224f004a28465f7538571791223890e90ede638c1b1c not found: ID does not exist"
Jul 06 01:30:49.409748 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:49.409716    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-002250d0-5b69d48c86-m4rgl"]
Jul 06 01:30:49.413405 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:49.413381    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-002250d0-5b69d48c86-m4rgl"]
Jul 06 01:30:50.292080 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:50.292045    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"
Jul 06 01:30:50.384733 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:50.384700    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq" event={"ID":"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2","Type":"ContainerStarted","Data":"167d792bb64af019c070779c2e5a0921a7bce6c4e5350ff4c54489f5d2403bd6"}
Jul 06 01:30:50.752477 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:50.752435    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6029315e-5b00-40ea-bd7c-50516dc629f1" path="/var/lib/kubelet/pods/6029315e-5b00-40ea-bd7c-50516dc629f1/volumes"
Jul 06 01:30:51.001498 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:51.001466    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"
Jul 06 01:30:51.002661 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:51.002599    2562 patch_prober.go:28] interesting pod/e2e-mt-002250d0-openshift-default-5668689db7-n96zq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 06 01:30:51.002766 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:51.002651    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq" podUID="c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 06 01:30:52.001758 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:52.001713    2562 patch_prober.go:28] interesting pod/e2e-mt-002250d0-openshift-default-5668689db7-n96zq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 06 01:30:52.002269 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:52.001780    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq" podUID="c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 06 01:30:53.001237 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:53.001199    2562 patch_prober.go:28] interesting pod/e2e-mt-002250d0-openshift-default-5668689db7-n96zq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 06 01:30:53.001410 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:53.001263    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq" podUID="c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 06 01:30:54.000907 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:54.000860    2562 patch_prober.go:28] interesting pod/e2e-mt-002250d0-openshift-default-5668689db7-n96zq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Jul 06 01:30:54.001322 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:54.000944    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq" podUID="c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Jul 06 01:30:54.772722 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:54.772683    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"]
Jul 06 01:30:54.772931 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:30:54.772889    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq" podUID="c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2" containerName="istio-proxy" containerID="cri-o://167d792bb64af019c070779c2e5a0921a7bce6c4e5350ff4c54489f5d2403bd6" gracePeriod=30
Jul 06 01:31:00.015106 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:00.015081    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"
Jul 06 01:31:00.109437 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:00.109404    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rd99\" (UniqueName: \"kubernetes.io/projected/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-kube-api-access-7rd99\") pod \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\" (UID: \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\") "
Jul 06 01:31:00.109437 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:00.109449    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-istio-token\") pod \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\" (UID: \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\") "
Jul 06 01:31:00.109714 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:00.109479    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-istiod-ca-cert\") pod \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\" (UID: \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\") "
Jul 06 01:31:00.109714 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:00.109524    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-istio-envoy\") pod \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\" (UID: \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\") "
Jul 06 01:31:00.109714 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:00.109560    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-workload-certs\") pod \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\" (UID: \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\") "
Jul 06 01:31:00.109714 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:00.109603    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-istio-podinfo\") pod \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\" (UID: \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\") "
Jul 06 01:31:00.109714 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:00.109624    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-workload-socket\") pod \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\" (UID: \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\") "
Jul 06 01:31:00.109714 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:00.109660    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-credential-socket\") pod \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\" (UID: \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\") "
Jul 06 01:31:00.109714 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:00.109688    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-istio-data\") pod \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\" (UID: \"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2\") "
Jul 06 01:31:00.110119 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:00.109932    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2" (UID: "c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:31:00.110119 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:00.109896    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2" (UID: "c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:31:00.110447 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:00.110143    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-workload-certs\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:31:00.110447 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:00.110183    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-istiod-ca-cert\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:31:00.110447 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:00.110203    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2" (UID: "c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:31:00.110447 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:00.110221    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2" (UID: "c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:31:00.110855 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:00.110834    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-istio-data" (OuterVolumeSpecName: "istio-data") pod "c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2" (UID: "c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:31:00.111822 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:00.111793    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2" (UID: "c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:31:00.111822 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:00.111802    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-kube-api-access-7rd99" (OuterVolumeSpecName: "kube-api-access-7rd99") pod "c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2" (UID: "c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2"). InnerVolumeSpecName "kube-api-access-7rd99". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:31:00.112086 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:00.112067    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-istio-token" (OuterVolumeSpecName: "istio-token") pod "c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2" (UID: "c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:31:00.112086 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:00.112068    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2" (UID: "c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 01:31:00.211435 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:00.211388    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rd99\" (UniqueName: \"kubernetes.io/projected/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-kube-api-access-7rd99\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:31:00.211435 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:00.211429    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-istio-token\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:31:00.211435 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:00.211440    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-istio-envoy\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:31:00.211435 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:00.211448    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-istio-podinfo\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:31:00.211435 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:00.211458    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-workload-socket\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:31:00.211763 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:00.211467    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-credential-socket\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:31:00.211763 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:00.211477    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2-istio-data\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:31:00.433914 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:00.433832    2562 generic.go:356] "Generic (PLEG): container finished" podID="c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2" containerID="167d792bb64af019c070779c2e5a0921a7bce6c4e5350ff4c54489f5d2403bd6" exitCode=0
Jul 06 01:31:00.433914 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:00.433885    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"
Jul 06 01:31:00.433914 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:00.433896    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq" event={"ID":"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2","Type":"ContainerDied","Data":"167d792bb64af019c070779c2e5a0921a7bce6c4e5350ff4c54489f5d2403bd6"}
Jul 06 01:31:00.434129 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:00.433940    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq" event={"ID":"c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2","Type":"ContainerDied","Data":"f1925708a2b94d78c246cd91ccb5f152dceefefd608a84d328181f1339ff5eec"}
Jul 06 01:31:00.434129 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:00.433962    2562 scope.go:117] "RemoveContainer" containerID="167d792bb64af019c070779c2e5a0921a7bce6c4e5350ff4c54489f5d2403bd6"
Jul 06 01:31:00.443725 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:00.443707    2562 scope.go:117] "RemoveContainer" containerID="10fe2cc59ba6e93c7d335d92b2558838c4af47e72ae5797d2d6b63c89e2d6ecd"
Jul 06 01:31:00.451775 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:00.451756    2562 scope.go:117] "RemoveContainer" containerID="167d792bb64af019c070779c2e5a0921a7bce6c4e5350ff4c54489f5d2403bd6"
Jul 06 01:31:00.452052 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:31:00.452031    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"167d792bb64af019c070779c2e5a0921a7bce6c4e5350ff4c54489f5d2403bd6\": container with ID starting with 167d792bb64af019c070779c2e5a0921a7bce6c4e5350ff4c54489f5d2403bd6 not found: ID does not exist" containerID="167d792bb64af019c070779c2e5a0921a7bce6c4e5350ff4c54489f5d2403bd6"
Jul 06 01:31:00.452122 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:00.452064    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"167d792bb64af019c070779c2e5a0921a7bce6c4e5350ff4c54489f5d2403bd6"} err="failed to get container status \"167d792bb64af019c070779c2e5a0921a7bce6c4e5350ff4c54489f5d2403bd6\": rpc error: code = NotFound desc = could not find container \"167d792bb64af019c070779c2e5a0921a7bce6c4e5350ff4c54489f5d2403bd6\": container with ID starting with 167d792bb64af019c070779c2e5a0921a7bce6c4e5350ff4c54489f5d2403bd6 not found: ID does not exist"
Jul 06 01:31:00.452122 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:00.452094    2562 scope.go:117] "RemoveContainer" containerID="10fe2cc59ba6e93c7d335d92b2558838c4af47e72ae5797d2d6b63c89e2d6ecd"
Jul 06 01:31:00.452412 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:31:00.452392    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10fe2cc59ba6e93c7d335d92b2558838c4af47e72ae5797d2d6b63c89e2d6ecd\": container with ID starting with 10fe2cc59ba6e93c7d335d92b2558838c4af47e72ae5797d2d6b63c89e2d6ecd not found: ID does not exist" containerID="10fe2cc59ba6e93c7d335d92b2558838c4af47e72ae5797d2d6b63c89e2d6ecd"
Jul 06 01:31:00.452463 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:00.452418    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10fe2cc59ba6e93c7d335d92b2558838c4af47e72ae5797d2d6b63c89e2d6ecd"} err="failed to get container status \"10fe2cc59ba6e93c7d335d92b2558838c4af47e72ae5797d2d6b63c89e2d6ecd\": rpc error: code = NotFound desc = could not find container \"10fe2cc59ba6e93c7d335d92b2558838c4af47e72ae5797d2d6b63c89e2d6ecd\": container with ID starting with 10fe2cc59ba6e93c7d335d92b2558838c4af47e72ae5797d2d6b63c89e2d6ecd not found: ID does not exist"
Jul 06 01:31:00.455661 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:00.455639    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"]
Jul 06 01:31:00.459353 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:00.459333    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-002250d0-openshift-default-5668689db7-n96zq"]
Jul 06 01:31:00.752457 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:00.752380    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2" path="/var/lib/kubelet/pods/c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2/volumes"
Jul 06 01:31:13.608197 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:13.608163    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"]
Jul 06 01:31:13.608913 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:13.608738    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6029315e-5b00-40ea-bd7c-50516dc629f1" containerName="maas-api"
Jul 06 01:31:13.608913 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:13.608759    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6029315e-5b00-40ea-bd7c-50516dc629f1" containerName="maas-api"
Jul 06 01:31:13.608913 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:13.608772    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2" containerName="istio-proxy"
Jul 06 01:31:13.608913 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:13.608782    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2" containerName="istio-proxy"
Jul 06 01:31:13.608913 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:13.608819    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2" containerName="istio-proxy"
Jul 06 01:31:13.608913 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:13.608829    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2" containerName="istio-proxy"
Jul 06 01:31:13.609294 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:13.608927    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6029315e-5b00-40ea-bd7c-50516dc629f1" containerName="maas-api"
Jul 06 01:31:13.609294 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:13.608940    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2" containerName="istio-proxy"
Jul 06 01:31:13.609294 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:13.608952    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c133e3b1-0948-4fa4-bf7f-6911c9fcb5d2" containerName="istio-proxy"
Jul 06 01:31:13.611048 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:13.611029    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"
Jul 06 01:31:13.613573 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:13.613558    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 01:31:13.613689 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:13.613594    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-4b3aa7dc-openshift-default-dockercfg-8gxdg\""
Jul 06 01:31:13.623458 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:13.623430    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"]
Jul 06 01:31:13.728582 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:13.728549    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91f5f889-a0d0-4825-8385-045e98676991-istio-podinfo\") pod \"e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw\" (UID: \"91f5f889-a0d0-4825-8385-045e98676991\") " pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"
Jul 06 01:31:13.728787 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:13.728589    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc59s\" (UniqueName: \"kubernetes.io/projected/91f5f889-a0d0-4825-8385-045e98676991-kube-api-access-tc59s\") pod \"e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw\" (UID: \"91f5f889-a0d0-4825-8385-045e98676991\") " pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"
Jul 06 01:31:13.728787 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:13.728611    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91f5f889-a0d0-4825-8385-045e98676991-workload-socket\") pod \"e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw\" (UID: \"91f5f889-a0d0-4825-8385-045e98676991\") " pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"
Jul 06 01:31:13.728787 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:13.728631    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91f5f889-a0d0-4825-8385-045e98676991-credential-socket\") pod \"e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw\" (UID: \"91f5f889-a0d0-4825-8385-045e98676991\") " pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"
Jul 06 01:31:13.728787 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:13.728693    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91f5f889-a0d0-4825-8385-045e98676991-istio-data\") pod \"e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw\" (UID: \"91f5f889-a0d0-4825-8385-045e98676991\") " pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"
Jul 06 01:31:13.728787 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:13.728721    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91f5f889-a0d0-4825-8385-045e98676991-istiod-ca-cert\") pod \"e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw\" (UID: \"91f5f889-a0d0-4825-8385-045e98676991\") " pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"
Jul 06 01:31:13.728787 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:13.728745    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91f5f889-a0d0-4825-8385-045e98676991-workload-certs\") pod \"e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw\" (UID: \"91f5f889-a0d0-4825-8385-045e98676991\") " pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"
Jul 06 01:31:13.728787 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:13.728788    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91f5f889-a0d0-4825-8385-045e98676991-istio-token\") pod \"e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw\" (UID: \"91f5f889-a0d0-4825-8385-045e98676991\") " pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"
Jul 06 01:31:13.729197 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:13.728858    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91f5f889-a0d0-4825-8385-045e98676991-istio-envoy\") pod \"e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw\" (UID: \"91f5f889-a0d0-4825-8385-045e98676991\") " pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"
Jul 06 01:31:13.830293 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:13.830253    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91f5f889-a0d0-4825-8385-045e98676991-istio-envoy\") pod \"e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw\" (UID: \"91f5f889-a0d0-4825-8385-045e98676991\") " pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"
Jul 06 01:31:13.830293 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:13.830301    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91f5f889-a0d0-4825-8385-045e98676991-istio-podinfo\") pod \"e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw\" (UID: \"91f5f889-a0d0-4825-8385-045e98676991\") " pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"
Jul 06 01:31:13.830532 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:13.830323    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc59s\" (UniqueName: \"kubernetes.io/projected/91f5f889-a0d0-4825-8385-045e98676991-kube-api-access-tc59s\") pod \"e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw\" (UID: \"91f5f889-a0d0-4825-8385-045e98676991\") " pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"
Jul 06 01:31:13.830532 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:13.830436    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91f5f889-a0d0-4825-8385-045e98676991-workload-socket\") pod \"e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw\" (UID: \"91f5f889-a0d0-4825-8385-045e98676991\") " pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"
Jul 06 01:31:13.830532 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:13.830470    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91f5f889-a0d0-4825-8385-045e98676991-credential-socket\") pod \"e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw\" (UID: \"91f5f889-a0d0-4825-8385-045e98676991\") " pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"
Jul 06 01:31:13.830532 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:13.830511    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91f5f889-a0d0-4825-8385-045e98676991-istio-data\") pod \"e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw\" (UID: \"91f5f889-a0d0-4825-8385-045e98676991\") " pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"
Jul 06 01:31:13.830748 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:13.830556    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91f5f889-a0d0-4825-8385-045e98676991-istiod-ca-cert\") pod \"e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw\" (UID: \"91f5f889-a0d0-4825-8385-045e98676991\") " pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"
Jul 06 01:31:13.830748 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:13.830606    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91f5f889-a0d0-4825-8385-045e98676991-workload-certs\") pod \"e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw\" (UID: \"91f5f889-a0d0-4825-8385-045e98676991\") " pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"
Jul 06 01:31:13.830748 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:13.830666    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91f5f889-a0d0-4825-8385-045e98676991-istio-token\") pod \"e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw\" (UID: \"91f5f889-a0d0-4825-8385-045e98676991\") " pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"
Jul 06 01:31:13.830913 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:13.830805    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91f5f889-a0d0-4825-8385-045e98676991-workload-socket\") pod \"e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw\" (UID: \"91f5f889-a0d0-4825-8385-045e98676991\") " pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"
Jul 06 01:31:13.830913 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:13.830847    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91f5f889-a0d0-4825-8385-045e98676991-istio-data\") pod \"e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw\" (UID: \"91f5f889-a0d0-4825-8385-045e98676991\") " pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"
Jul 06 01:31:13.831024 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:13.830934    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91f5f889-a0d0-4825-8385-045e98676991-credential-socket\") pod \"e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw\" (UID: \"91f5f889-a0d0-4825-8385-045e98676991\") " pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"
Jul 06 01:31:13.831209 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:13.831187    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91f5f889-a0d0-4825-8385-045e98676991-workload-certs\") pod \"e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw\" (UID: \"91f5f889-a0d0-4825-8385-045e98676991\") " pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"
Jul 06 01:31:13.831465 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:13.831441    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91f5f889-a0d0-4825-8385-045e98676991-istiod-ca-cert\") pod \"e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw\" (UID: \"91f5f889-a0d0-4825-8385-045e98676991\") " pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"
Jul 06 01:31:13.832668 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:13.832650    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91f5f889-a0d0-4825-8385-045e98676991-istio-envoy\") pod \"e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw\" (UID: \"91f5f889-a0d0-4825-8385-045e98676991\") " pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"
Jul 06 01:31:13.833217 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:13.833198    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91f5f889-a0d0-4825-8385-045e98676991-istio-podinfo\") pod \"e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw\" (UID: \"91f5f889-a0d0-4825-8385-045e98676991\") " pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"
Jul 06 01:31:13.837954 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:13.837932    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91f5f889-a0d0-4825-8385-045e98676991-istio-token\") pod \"e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw\" (UID: \"91f5f889-a0d0-4825-8385-045e98676991\") " pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"
Jul 06 01:31:13.838202 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:13.838182    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc59s\" (UniqueName: \"kubernetes.io/projected/91f5f889-a0d0-4825-8385-045e98676991-kube-api-access-tc59s\") pod \"e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw\" (UID: \"91f5f889-a0d0-4825-8385-045e98676991\") " pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"
Jul 06 01:31:13.922318 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:13.922221    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"
Jul 06 01:31:14.060131 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:14.060105    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"]
Jul 06 01:31:14.062660 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:31:14.062632    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91f5f889_a0d0_4825_8385_045e98676991.slice/crio-8938dffdf377d9176be7e867df6968fa8ee55682424eb9e24e1dd96231dda65c WatchSource:0}: Error finding container 8938dffdf377d9176be7e867df6968fa8ee55682424eb9e24e1dd96231dda65c: Status 404 returned error can't find the container with id 8938dffdf377d9176be7e867df6968fa8ee55682424eb9e24e1dd96231dda65c
Jul 06 01:31:14.064895 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:14.064861    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:31:14.064984 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:14.064930    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:31:14.064984 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:14.064964    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:31:14.506578 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:14.506541    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw" event={"ID":"91f5f889-a0d0-4825-8385-045e98676991","Type":"ContainerStarted","Data":"27e6a0194803df1b216fb74a6a29a11cef6fb7178243e7a7324d53c2098e8a44"}
Jul 06 01:31:14.506753 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:14.506605    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw" event={"ID":"91f5f889-a0d0-4825-8385-045e98676991","Type":"ContainerStarted","Data":"8938dffdf377d9176be7e867df6968fa8ee55682424eb9e24e1dd96231dda65c"}
Jul 06 01:31:14.526400 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:14.526346    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw" podStartSLOduration=1.526326843 podStartE2EDuration="1.526326843s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:31:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:31:14.525618467 +0000 UTC m=+1906.336593712" watchObservedRunningTime="2026-07-06 01:31:14.526326843 +0000 UTC m=+1906.337302087"
Jul 06 01:31:14.922589 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:14.922555    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"
Jul 06 01:31:15.927895 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:15.927861    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"
Jul 06 01:31:16.517326 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:16.517294    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"
Jul 06 01:31:16.518139 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:16.518120    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"
Jul 06 01:31:16.867669 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:16.867638    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-4b3aa7dc-5ddbd6f776-vnhg6"]
Jul 06 01:31:16.870265 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:16.870234    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-4b3aa7dc-5ddbd6f776-vnhg6"
Jul 06 01:31:16.872799 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:16.872770    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-4b3aa7dc-serving-cert\""
Jul 06 01:31:16.873070 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:16.873024    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-84mvh\""
Jul 06 01:31:16.882076 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:16.882048    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-4b3aa7dc-5ddbd6f776-vnhg6"]
Jul 06 01:31:16.962822 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:16.962787    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6srpx\" (UniqueName: \"kubernetes.io/projected/256d9671-2d1a-4423-9f69-229fdeada5e3-kube-api-access-6srpx\") pod \"maas-api-e2e-mt-4b3aa7dc-5ddbd6f776-vnhg6\" (UID: \"256d9671-2d1a-4423-9f69-229fdeada5e3\") " pod="opendatahub/maas-api-e2e-mt-4b3aa7dc-5ddbd6f776-vnhg6"
Jul 06 01:31:16.963216 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:16.962848    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/256d9671-2d1a-4423-9f69-229fdeada5e3-maas-api-tls\") pod \"maas-api-e2e-mt-4b3aa7dc-5ddbd6f776-vnhg6\" (UID: \"256d9671-2d1a-4423-9f69-229fdeada5e3\") " pod="opendatahub/maas-api-e2e-mt-4b3aa7dc-5ddbd6f776-vnhg6"
Jul 06 01:31:16.963216 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:16.962873    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/256d9671-2d1a-4423-9f69-229fdeada5e3-openshift-service-ca\") pod \"maas-api-e2e-mt-4b3aa7dc-5ddbd6f776-vnhg6\" (UID: \"256d9671-2d1a-4423-9f69-229fdeada5e3\") " pod="opendatahub/maas-api-e2e-mt-4b3aa7dc-5ddbd6f776-vnhg6"
Jul 06 01:31:17.064105 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:17.064075    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6srpx\" (UniqueName: \"kubernetes.io/projected/256d9671-2d1a-4423-9f69-229fdeada5e3-kube-api-access-6srpx\") pod \"maas-api-e2e-mt-4b3aa7dc-5ddbd6f776-vnhg6\" (UID: \"256d9671-2d1a-4423-9f69-229fdeada5e3\") " pod="opendatahub/maas-api-e2e-mt-4b3aa7dc-5ddbd6f776-vnhg6"
Jul 06 01:31:17.064311 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:17.064126    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/256d9671-2d1a-4423-9f69-229fdeada5e3-maas-api-tls\") pod \"maas-api-e2e-mt-4b3aa7dc-5ddbd6f776-vnhg6\" (UID: \"256d9671-2d1a-4423-9f69-229fdeada5e3\") " pod="opendatahub/maas-api-e2e-mt-4b3aa7dc-5ddbd6f776-vnhg6"
Jul 06 01:31:17.064311 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:17.064158    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/256d9671-2d1a-4423-9f69-229fdeada5e3-openshift-service-ca\") pod \"maas-api-e2e-mt-4b3aa7dc-5ddbd6f776-vnhg6\" (UID: \"256d9671-2d1a-4423-9f69-229fdeada5e3\") " pod="opendatahub/maas-api-e2e-mt-4b3aa7dc-5ddbd6f776-vnhg6"
Jul 06 01:31:17.064744 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:17.064725    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/256d9671-2d1a-4423-9f69-229fdeada5e3-openshift-service-ca\") pod \"maas-api-e2e-mt-4b3aa7dc-5ddbd6f776-vnhg6\" (UID: \"256d9671-2d1a-4423-9f69-229fdeada5e3\") " pod="opendatahub/maas-api-e2e-mt-4b3aa7dc-5ddbd6f776-vnhg6"
Jul 06 01:31:17.066483 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:17.066460    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/256d9671-2d1a-4423-9f69-229fdeada5e3-maas-api-tls\") pod \"maas-api-e2e-mt-4b3aa7dc-5ddbd6f776-vnhg6\" (UID: \"256d9671-2d1a-4423-9f69-229fdeada5e3\") " pod="opendatahub/maas-api-e2e-mt-4b3aa7dc-5ddbd6f776-vnhg6"
Jul 06 01:31:17.075479 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:17.075453    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6srpx\" (UniqueName: \"kubernetes.io/projected/256d9671-2d1a-4423-9f69-229fdeada5e3-kube-api-access-6srpx\") pod \"maas-api-e2e-mt-4b3aa7dc-5ddbd6f776-vnhg6\" (UID: \"256d9671-2d1a-4423-9f69-229fdeada5e3\") " pod="opendatahub/maas-api-e2e-mt-4b3aa7dc-5ddbd6f776-vnhg6"
Jul 06 01:31:17.183761 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:17.183675    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-4b3aa7dc-5ddbd6f776-vnhg6"
Jul 06 01:31:17.317123 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:17.317099    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-4b3aa7dc-5ddbd6f776-vnhg6"]
Jul 06 01:31:17.319679 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:31:17.319653    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod256d9671_2d1a_4423_9f69_229fdeada5e3.slice/crio-2f17aa586b5e9c935bbf2fa6cbce4be97acf31d55ff99d23e9cffa2348426bb6 WatchSource:0}: Error finding container 2f17aa586b5e9c935bbf2fa6cbce4be97acf31d55ff99d23e9cffa2348426bb6: Status 404 returned error can't find the container with id 2f17aa586b5e9c935bbf2fa6cbce4be97acf31d55ff99d23e9cffa2348426bb6
Jul 06 01:31:17.524819 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:17.524732    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-4b3aa7dc-5ddbd6f776-vnhg6" event={"ID":"256d9671-2d1a-4423-9f69-229fdeada5e3","Type":"ContainerStarted","Data":"2f17aa586b5e9c935bbf2fa6cbce4be97acf31d55ff99d23e9cffa2348426bb6"}
Jul 06 01:31:18.530677 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:18.530640    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-4b3aa7dc-5ddbd6f776-vnhg6" event={"ID":"256d9671-2d1a-4423-9f69-229fdeada5e3","Type":"ContainerStarted","Data":"754a262be39eb804d72662f705ad2ad3a5ac0ccc63c371e83aa457e5b96186ed"}
Jul 06 01:31:18.531131 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:18.530790    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-4b3aa7dc-5ddbd6f776-vnhg6"
Jul 06 01:31:18.551164 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:18.551105    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-4b3aa7dc-5ddbd6f776-vnhg6" podStartSLOduration=2.116154486 podStartE2EDuration="2.55108851s" totalImagesPullingTime="434.934024ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:31:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:31:18.550456135 +0000 UTC m=+1910.361431378" watchObservedRunningTime="2026-07-06 01:31:18.55108851 +0000 UTC m=+1910.362063752"
Jul 06 01:31:22.959717 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:22.959685    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-4b3aa7dc/e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf"]
Jul 06 01:31:22.962215 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:22.962193    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4b3aa7dc/e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf"
Jul 06 01:31:22.966437 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:22.966418    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-4b3aa7dc\"/\"default-dockercfg-pkmds\""
Jul 06 01:31:22.966559 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:22.966456    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-4b3aa7dc\"/\"kube-root-ca.crt\""
Jul 06 01:31:22.966559 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:22.966421    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-4b3aa7dc\"/\"openshift-service-ca.crt\""
Jul 06 01:31:22.966559 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:22.966421    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-4b3aa7dc\"/\"e2e-lifecycle-model-4b3aa7dc-kserve-self-signed-certs\""
Jul 06 01:31:22.975557 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:22.975532    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-4b3aa7dc/e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf"]
Jul 06 01:31:23.033325 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:23.033290    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f45853cd-c4e3-48a4-8903-9a2a910f34c0-model-cache\") pod \"e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf\" (UID: \"f45853cd-c4e3-48a4-8903-9a2a910f34c0\") " pod="ai-tenant-e2e-mt-4b3aa7dc/e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf"
Jul 06 01:31:23.033529 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:23.033335    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f45853cd-c4e3-48a4-8903-9a2a910f34c0-tmp-dir\") pod \"e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf\" (UID: \"f45853cd-c4e3-48a4-8903-9a2a910f34c0\") " pod="ai-tenant-e2e-mt-4b3aa7dc/e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf"
Jul 06 01:31:23.033529 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:23.033411    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f45853cd-c4e3-48a4-8903-9a2a910f34c0-home\") pod \"e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf\" (UID: \"f45853cd-c4e3-48a4-8903-9a2a910f34c0\") " pod="ai-tenant-e2e-mt-4b3aa7dc/e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf"
Jul 06 01:31:23.033529 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:23.033452    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnrft\" (UniqueName: \"kubernetes.io/projected/f45853cd-c4e3-48a4-8903-9a2a910f34c0-kube-api-access-rnrft\") pod \"e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf\" (UID: \"f45853cd-c4e3-48a4-8903-9a2a910f34c0\") " pod="ai-tenant-e2e-mt-4b3aa7dc/e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf"
Jul 06 01:31:23.033529 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:23.033508    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f45853cd-c4e3-48a4-8903-9a2a910f34c0-tls-certs\") pod \"e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf\" (UID: \"f45853cd-c4e3-48a4-8903-9a2a910f34c0\") " pod="ai-tenant-e2e-mt-4b3aa7dc/e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf"
Jul 06 01:31:23.033529 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:23.033526    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f45853cd-c4e3-48a4-8903-9a2a910f34c0-dshm\") pod \"e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf\" (UID: \"f45853cd-c4e3-48a4-8903-9a2a910f34c0\") " pod="ai-tenant-e2e-mt-4b3aa7dc/e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf"
Jul 06 01:31:23.134594 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:23.134561    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnrft\" (UniqueName: \"kubernetes.io/projected/f45853cd-c4e3-48a4-8903-9a2a910f34c0-kube-api-access-rnrft\") pod \"e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf\" (UID: \"f45853cd-c4e3-48a4-8903-9a2a910f34c0\") " pod="ai-tenant-e2e-mt-4b3aa7dc/e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf"
Jul 06 01:31:23.134796 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:23.134604    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f45853cd-c4e3-48a4-8903-9a2a910f34c0-tls-certs\") pod \"e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf\" (UID: \"f45853cd-c4e3-48a4-8903-9a2a910f34c0\") " pod="ai-tenant-e2e-mt-4b3aa7dc/e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf"
Jul 06 01:31:23.134796 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:23.134625    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f45853cd-c4e3-48a4-8903-9a2a910f34c0-dshm\") pod \"e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf\" (UID: \"f45853cd-c4e3-48a4-8903-9a2a910f34c0\") " pod="ai-tenant-e2e-mt-4b3aa7dc/e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf"
Jul 06 01:31:23.134796 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:23.134670    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f45853cd-c4e3-48a4-8903-9a2a910f34c0-model-cache\") pod \"e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf\" (UID: \"f45853cd-c4e3-48a4-8903-9a2a910f34c0\") " pod="ai-tenant-e2e-mt-4b3aa7dc/e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf"
Jul 06 01:31:23.134796 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:23.134704    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f45853cd-c4e3-48a4-8903-9a2a910f34c0-tmp-dir\") pod \"e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf\" (UID: \"f45853cd-c4e3-48a4-8903-9a2a910f34c0\") " pod="ai-tenant-e2e-mt-4b3aa7dc/e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf"
Jul 06 01:31:23.134796 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:23.134785    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f45853cd-c4e3-48a4-8903-9a2a910f34c0-home\") pod \"e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf\" (UID: \"f45853cd-c4e3-48a4-8903-9a2a910f34c0\") " pod="ai-tenant-e2e-mt-4b3aa7dc/e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf"
Jul 06 01:31:23.135164 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:23.135120    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f45853cd-c4e3-48a4-8903-9a2a910f34c0-model-cache\") pod \"e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf\" (UID: \"f45853cd-c4e3-48a4-8903-9a2a910f34c0\") " pod="ai-tenant-e2e-mt-4b3aa7dc/e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf"
Jul 06 01:31:23.135293 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:23.135218    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f45853cd-c4e3-48a4-8903-9a2a910f34c0-tmp-dir\") pod \"e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf\" (UID: \"f45853cd-c4e3-48a4-8903-9a2a910f34c0\") " pod="ai-tenant-e2e-mt-4b3aa7dc/e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf"
Jul 06 01:31:23.135377 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:23.135355    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f45853cd-c4e3-48a4-8903-9a2a910f34c0-home\") pod \"e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf\" (UID: \"f45853cd-c4e3-48a4-8903-9a2a910f34c0\") " pod="ai-tenant-e2e-mt-4b3aa7dc/e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf"
Jul 06 01:31:23.136996 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:23.136977    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f45853cd-c4e3-48a4-8903-9a2a910f34c0-dshm\") pod \"e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf\" (UID: \"f45853cd-c4e3-48a4-8903-9a2a910f34c0\") " pod="ai-tenant-e2e-mt-4b3aa7dc/e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf"
Jul 06 01:31:23.137444 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:23.137428    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f45853cd-c4e3-48a4-8903-9a2a910f34c0-tls-certs\") pod \"e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf\" (UID: \"f45853cd-c4e3-48a4-8903-9a2a910f34c0\") " pod="ai-tenant-e2e-mt-4b3aa7dc/e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf"
Jul 06 01:31:23.143402 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:23.143382    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnrft\" (UniqueName: \"kubernetes.io/projected/f45853cd-c4e3-48a4-8903-9a2a910f34c0-kube-api-access-rnrft\") pod \"e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf\" (UID: \"f45853cd-c4e3-48a4-8903-9a2a910f34c0\") " pod="ai-tenant-e2e-mt-4b3aa7dc/e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf"
Jul 06 01:31:23.271958 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:23.271871    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4b3aa7dc/e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf"
Jul 06 01:31:23.404553 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:23.404527    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-4b3aa7dc/e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf"]
Jul 06 01:31:23.406713 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:31:23.406686    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf45853cd_c4e3_48a4_8903_9a2a910f34c0.slice/crio-b6b389590573bf13e0f1ed54706ca38771400ac249c15f0a033a3ab188a9fbce WatchSource:0}: Error finding container b6b389590573bf13e0f1ed54706ca38771400ac249c15f0a033a3ab188a9fbce: Status 404 returned error can't find the container with id b6b389590573bf13e0f1ed54706ca38771400ac249c15f0a033a3ab188a9fbce
Jul 06 01:31:23.558004 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:23.557917    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4b3aa7dc/e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf" event={"ID":"f45853cd-c4e3-48a4-8903-9a2a910f34c0","Type":"ContainerStarted","Data":"4c0e0f68c3dcda427cc176bf5fa61e047b65a9601a96872d38a09f9bf9f97489"}
Jul 06 01:31:23.558004 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:23.557961    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4b3aa7dc/e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf" event={"ID":"f45853cd-c4e3-48a4-8903-9a2a910f34c0","Type":"ContainerStarted","Data":"b6b389590573bf13e0f1ed54706ca38771400ac249c15f0a033a3ab188a9fbce"}
Jul 06 01:31:23.580097 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:23.580042    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-4b3aa7dc/e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf" podStartSLOduration=1.58002452 podStartE2EDuration="1.58002452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:31:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:31:23.579106265 +0000 UTC m=+1915.390081544" watchObservedRunningTime="2026-07-06 01:31:23.58002452 +0000 UTC m=+1915.390999763"
Jul 06 01:31:24.544318 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:24.544286    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-4b3aa7dc-5ddbd6f776-vnhg6"
Jul 06 01:31:31.519079 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:31.519042    2562 patch_prober.go:28] interesting pod/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 06 01:31:31.519539 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:31.519103    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw" podUID="91f5f889-a0d0-4825-8385-045e98676991" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 06 01:31:31.598758 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:31.598726    2562 generic.go:356] "Generic (PLEG): container finished" podID="91f5f889-a0d0-4825-8385-045e98676991" containerID="27e6a0194803df1b216fb74a6a29a11cef6fb7178243e7a7324d53c2098e8a44" exitCode=0
Jul 06 01:31:31.598758 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:31.598761    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw" event={"ID":"91f5f889-a0d0-4825-8385-045e98676991","Type":"ContainerDied","Data":"27e6a0194803df1b216fb74a6a29a11cef6fb7178243e7a7324d53c2098e8a44"}
Jul 06 01:31:31.599222 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:31.599204    2562 scope.go:117] "RemoveContainer" containerID="27e6a0194803df1b216fb74a6a29a11cef6fb7178243e7a7324d53c2098e8a44"
Jul 06 01:31:31.600182 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:31.600139    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:31:31.600261 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:31.600225    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:31:31.600261 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:31.600257    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:31:32.604902 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:32.604867    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw" event={"ID":"91f5f889-a0d0-4825-8385-045e98676991","Type":"ContainerStarted","Data":"0e3a6fa471d2ea59d892ced404fc30cee966ba4aac6a30cbc0fa19b2474c2fb0"}
Jul 06 01:31:32.923007 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:32.922915    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"
Jul 06 01:31:32.923692 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:32.923668    2562 patch_prober.go:28] interesting pod/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 06 01:31:32.923917 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:32.923892    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw" podUID="91f5f889-a0d0-4825-8385-045e98676991" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 06 01:31:33.272498 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:33.272410    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-4b3aa7dc/e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf"
Jul 06 01:31:33.272498 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:33.272451    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-4b3aa7dc/e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf"
Jul 06 01:31:33.284919 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:33.284897    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-4b3aa7dc/e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf"
Jul 06 01:31:33.646458 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:33.646428    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-4b3aa7dc/e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf"
Jul 06 01:31:33.923381 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:33.922814    2562 patch_prober.go:28] interesting pod/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 06 01:31:33.923381 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:33.922881    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw" podUID="91f5f889-a0d0-4825-8385-045e98676991" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 06 01:31:34.923647 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:34.923605    2562 patch_prober.go:28] interesting pod/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 06 01:31:34.924276 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:34.924239    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw" podUID="91f5f889-a0d0-4825-8385-045e98676991" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 06 01:31:35.923514 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:35.923470    2562 patch_prober.go:28] interesting pod/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 06 01:31:35.923733 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:35.923559    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw" podUID="91f5f889-a0d0-4825-8385-045e98676991" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 06 01:31:36.926808 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:36.926771    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"
Jul 06 01:31:36.927223 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:36.927054    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"
Jul 06 01:31:36.927754 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:36.927737    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"
Jul 06 01:31:49.352211 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:49.352175    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-4b3aa7dc-5ddbd6f776-vnhg6"]
Jul 06 01:31:49.352702 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:49.352435    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-4b3aa7dc-5ddbd6f776-vnhg6" podUID="256d9671-2d1a-4423-9f69-229fdeada5e3" containerName="maas-api" containerID="cri-o://754a262be39eb804d72662f705ad2ad3a5ac0ccc63c371e83aa457e5b96186ed" gracePeriod=30
Jul 06 01:31:49.600156 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:49.600113    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-4b3aa7dc-5ddbd6f776-vnhg6"
Jul 06 01:31:49.696656 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:49.696565    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6srpx\" (UniqueName: \"kubernetes.io/projected/256d9671-2d1a-4423-9f69-229fdeada5e3-kube-api-access-6srpx\") pod \"256d9671-2d1a-4423-9f69-229fdeada5e3\" (UID: \"256d9671-2d1a-4423-9f69-229fdeada5e3\") "
Jul 06 01:31:49.696656 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:49.696609    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/256d9671-2d1a-4423-9f69-229fdeada5e3-maas-api-tls\") pod \"256d9671-2d1a-4423-9f69-229fdeada5e3\" (UID: \"256d9671-2d1a-4423-9f69-229fdeada5e3\") "
Jul 06 01:31:49.696903 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:49.696715    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/256d9671-2d1a-4423-9f69-229fdeada5e3-openshift-service-ca\") pod \"256d9671-2d1a-4423-9f69-229fdeada5e3\" (UID: \"256d9671-2d1a-4423-9f69-229fdeada5e3\") "
Jul 06 01:31:49.697111 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:49.697086    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/256d9671-2d1a-4423-9f69-229fdeada5e3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "256d9671-2d1a-4423-9f69-229fdeada5e3" (UID: "256d9671-2d1a-4423-9f69-229fdeada5e3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:31:49.697816 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:49.697792    2562 generic.go:356] "Generic (PLEG): container finished" podID="256d9671-2d1a-4423-9f69-229fdeada5e3" containerID="754a262be39eb804d72662f705ad2ad3a5ac0ccc63c371e83aa457e5b96186ed" exitCode=0
Jul 06 01:31:49.697933 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:49.697841    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-4b3aa7dc-5ddbd6f776-vnhg6"
Jul 06 01:31:49.697933 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:49.697886    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-4b3aa7dc-5ddbd6f776-vnhg6" event={"ID":"256d9671-2d1a-4423-9f69-229fdeada5e3","Type":"ContainerDied","Data":"754a262be39eb804d72662f705ad2ad3a5ac0ccc63c371e83aa457e5b96186ed"}
Jul 06 01:31:49.698051 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:49.697946    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-4b3aa7dc-5ddbd6f776-vnhg6" event={"ID":"256d9671-2d1a-4423-9f69-229fdeada5e3","Type":"ContainerDied","Data":"2f17aa586b5e9c935bbf2fa6cbce4be97acf31d55ff99d23e9cffa2348426bb6"}
Jul 06 01:31:49.698051 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:49.697977    2562 scope.go:117] "RemoveContainer" containerID="754a262be39eb804d72662f705ad2ad3a5ac0ccc63c371e83aa457e5b96186ed"
Jul 06 01:31:49.699232 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:49.699073    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/256d9671-2d1a-4423-9f69-229fdeada5e3-kube-api-access-6srpx" (OuterVolumeSpecName: "kube-api-access-6srpx") pod "256d9671-2d1a-4423-9f69-229fdeada5e3" (UID: "256d9671-2d1a-4423-9f69-229fdeada5e3"). InnerVolumeSpecName "kube-api-access-6srpx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:31:49.699232 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:49.699080    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/256d9671-2d1a-4423-9f69-229fdeada5e3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "256d9671-2d1a-4423-9f69-229fdeada5e3" (UID: "256d9671-2d1a-4423-9f69-229fdeada5e3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:31:49.717492 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:49.717474    2562 scope.go:117] "RemoveContainer" containerID="754a262be39eb804d72662f705ad2ad3a5ac0ccc63c371e83aa457e5b96186ed"
Jul 06 01:31:49.717829 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:31:49.717811    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"754a262be39eb804d72662f705ad2ad3a5ac0ccc63c371e83aa457e5b96186ed\": container with ID starting with 754a262be39eb804d72662f705ad2ad3a5ac0ccc63c371e83aa457e5b96186ed not found: ID does not exist" containerID="754a262be39eb804d72662f705ad2ad3a5ac0ccc63c371e83aa457e5b96186ed"
Jul 06 01:31:49.717890 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:49.717840    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"754a262be39eb804d72662f705ad2ad3a5ac0ccc63c371e83aa457e5b96186ed"} err="failed to get container status \"754a262be39eb804d72662f705ad2ad3a5ac0ccc63c371e83aa457e5b96186ed\": rpc error: code = NotFound desc = could not find container \"754a262be39eb804d72662f705ad2ad3a5ac0ccc63c371e83aa457e5b96186ed\": container with ID starting with 754a262be39eb804d72662f705ad2ad3a5ac0ccc63c371e83aa457e5b96186ed not found: ID does not exist"
Jul 06 01:31:49.797921 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:49.797887    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6srpx\" (UniqueName: \"kubernetes.io/projected/256d9671-2d1a-4423-9f69-229fdeada5e3-kube-api-access-6srpx\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:31:49.797921 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:49.797917    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/256d9671-2d1a-4423-9f69-229fdeada5e3-maas-api-tls\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:31:49.797921 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:49.797929    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/256d9671-2d1a-4423-9f69-229fdeada5e3-openshift-service-ca\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:31:50.021314 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:50.021279    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-4b3aa7dc-5ddbd6f776-vnhg6"]
Jul 06 01:31:50.026230 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:50.026207    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-4b3aa7dc-5ddbd6f776-vnhg6"]
Jul 06 01:31:50.752589 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:50.752557    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="256d9671-2d1a-4423-9f69-229fdeada5e3" path="/var/lib/kubelet/pods/256d9671-2d1a-4423-9f69-229fdeada5e3/volumes"
Jul 06 01:31:52.538410 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:52.538371    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-e2e-mt-4b3aa7dc-5ddbd6f776-vnhg6" podUID="256d9671-2d1a-4423-9f69-229fdeada5e3" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.48:8443/health\": context deadline exceeded"
Jul 06 01:31:59.610238 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:31:59.610205    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-4b3aa7dc/e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf"]
Jul 06 01:32:14.630760 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:14.630688    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-4b3aa7dc/e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf" podUID="f45853cd-c4e3-48a4-8903-9a2a910f34c0" containerName="main" containerID="cri-o://4c0e0f68c3dcda427cc176bf5fa61e047b65a9601a96872d38a09f9bf9f97489" gracePeriod=45
Jul 06 01:32:14.828185 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:14.828139    2562 generic.go:356] "Generic (PLEG): container finished" podID="f45853cd-c4e3-48a4-8903-9a2a910f34c0" containerID="4c0e0f68c3dcda427cc176bf5fa61e047b65a9601a96872d38a09f9bf9f97489" exitCode=0
Jul 06 01:32:14.828185 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:14.828177    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4b3aa7dc/e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf" event={"ID":"f45853cd-c4e3-48a4-8903-9a2a910f34c0","Type":"ContainerDied","Data":"4c0e0f68c3dcda427cc176bf5fa61e047b65a9601a96872d38a09f9bf9f97489"}
Jul 06 01:32:14.878700 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:14.878676    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4b3aa7dc/e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf"
Jul 06 01:32:15.037780 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:15.037686    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f45853cd-c4e3-48a4-8903-9a2a910f34c0-tls-certs\") pod \"f45853cd-c4e3-48a4-8903-9a2a910f34c0\" (UID: \"f45853cd-c4e3-48a4-8903-9a2a910f34c0\") "
Jul 06 01:32:15.037780 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:15.037765    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f45853cd-c4e3-48a4-8903-9a2a910f34c0-home\") pod \"f45853cd-c4e3-48a4-8903-9a2a910f34c0\" (UID: \"f45853cd-c4e3-48a4-8903-9a2a910f34c0\") "
Jul 06 01:32:15.038003 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:15.037792    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnrft\" (UniqueName: \"kubernetes.io/projected/f45853cd-c4e3-48a4-8903-9a2a910f34c0-kube-api-access-rnrft\") pod \"f45853cd-c4e3-48a4-8903-9a2a910f34c0\" (UID: \"f45853cd-c4e3-48a4-8903-9a2a910f34c0\") "
Jul 06 01:32:15.038003 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:15.037835    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f45853cd-c4e3-48a4-8903-9a2a910f34c0-tmp-dir\") pod \"f45853cd-c4e3-48a4-8903-9a2a910f34c0\" (UID: \"f45853cd-c4e3-48a4-8903-9a2a910f34c0\") "
Jul 06 01:32:15.038003 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:15.037890    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f45853cd-c4e3-48a4-8903-9a2a910f34c0-model-cache\") pod \"f45853cd-c4e3-48a4-8903-9a2a910f34c0\" (UID: \"f45853cd-c4e3-48a4-8903-9a2a910f34c0\") "
Jul 06 01:32:15.038003 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:15.037939    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f45853cd-c4e3-48a4-8903-9a2a910f34c0-dshm\") pod \"f45853cd-c4e3-48a4-8903-9a2a910f34c0\" (UID: \"f45853cd-c4e3-48a4-8903-9a2a910f34c0\") "
Jul 06 01:32:15.038228 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:15.038074    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f45853cd-c4e3-48a4-8903-9a2a910f34c0-home" (OuterVolumeSpecName: "home") pod "f45853cd-c4e3-48a4-8903-9a2a910f34c0" (UID: "f45853cd-c4e3-48a4-8903-9a2a910f34c0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:32:15.038228 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:15.038161    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f45853cd-c4e3-48a4-8903-9a2a910f34c0-model-cache" (OuterVolumeSpecName: "model-cache") pod "f45853cd-c4e3-48a4-8903-9a2a910f34c0" (UID: "f45853cd-c4e3-48a4-8903-9a2a910f34c0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:32:15.038228 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:15.038178    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f45853cd-c4e3-48a4-8903-9a2a910f34c0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f45853cd-c4e3-48a4-8903-9a2a910f34c0" (UID: "f45853cd-c4e3-48a4-8903-9a2a910f34c0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:32:15.038338 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:15.038318    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f45853cd-c4e3-48a4-8903-9a2a910f34c0-home\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:32:15.038377 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:15.038335    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f45853cd-c4e3-48a4-8903-9a2a910f34c0-tmp-dir\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:32:15.038377 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:15.038349    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f45853cd-c4e3-48a4-8903-9a2a910f34c0-model-cache\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:32:15.040022 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:15.039997    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f45853cd-c4e3-48a4-8903-9a2a910f34c0-dshm" (OuterVolumeSpecName: "dshm") pod "f45853cd-c4e3-48a4-8903-9a2a910f34c0" (UID: "f45853cd-c4e3-48a4-8903-9a2a910f34c0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:32:15.040133 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:15.040055    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f45853cd-c4e3-48a4-8903-9a2a910f34c0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f45853cd-c4e3-48a4-8903-9a2a910f34c0" (UID: "f45853cd-c4e3-48a4-8903-9a2a910f34c0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:32:15.040133 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:15.040068    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f45853cd-c4e3-48a4-8903-9a2a910f34c0-kube-api-access-rnrft" (OuterVolumeSpecName: "kube-api-access-rnrft") pod "f45853cd-c4e3-48a4-8903-9a2a910f34c0" (UID: "f45853cd-c4e3-48a4-8903-9a2a910f34c0"). InnerVolumeSpecName "kube-api-access-rnrft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:32:15.139173 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:15.139117    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f45853cd-c4e3-48a4-8903-9a2a910f34c0-tls-certs\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:32:15.139173 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:15.139144    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnrft\" (UniqueName: \"kubernetes.io/projected/f45853cd-c4e3-48a4-8903-9a2a910f34c0-kube-api-access-rnrft\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:32:15.139173 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:15.139182    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f45853cd-c4e3-48a4-8903-9a2a910f34c0-dshm\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:32:15.834488 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:15.834456    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4b3aa7dc/e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf"
Jul 06 01:32:15.834913 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:15.834485    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4b3aa7dc/e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf" event={"ID":"f45853cd-c4e3-48a4-8903-9a2a910f34c0","Type":"ContainerDied","Data":"b6b389590573bf13e0f1ed54706ca38771400ac249c15f0a033a3ab188a9fbce"}
Jul 06 01:32:15.834913 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:15.834534    2562 scope.go:117] "RemoveContainer" containerID="4c0e0f68c3dcda427cc176bf5fa61e047b65a9601a96872d38a09f9bf9f97489"
Jul 06 01:32:15.867580 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:15.867553    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-4b3aa7dc/e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf"]
Jul 06 01:32:15.873118 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:15.873095    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-4b3aa7dc/e2e-lifecycle-model-4b3aa7dc-kserve-858d9cd48c-rfsrf"]
Jul 06 01:32:16.752619 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:16.752586    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f45853cd-c4e3-48a4-8903-9a2a910f34c0" path="/var/lib/kubelet/pods/f45853cd-c4e3-48a4-8903-9a2a910f34c0/volumes"
Jul 06 01:32:51.610379 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:51.610349    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"]
Jul 06 01:32:51.610859 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:51.610551    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw" podUID="91f5f889-a0d0-4825-8385-045e98676991" containerName="istio-proxy" containerID="cri-o://0e3a6fa471d2ea59d892ced404fc30cee966ba4aac6a30cbc0fa19b2474c2fb0" gracePeriod=30
Jul 06 01:32:51.929094 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:51.929005    2562 patch_prober.go:28] interesting pod/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 01:32:51.929094 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:51.929075    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw" podUID="91f5f889-a0d0-4825-8385-045e98676991" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 01:32:56.857867 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:56.857837    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"
Jul 06 01:32:56.929339 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:56.929252    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91f5f889-a0d0-4825-8385-045e98676991-istio-token\") pod \"91f5f889-a0d0-4825-8385-045e98676991\" (UID: \"91f5f889-a0d0-4825-8385-045e98676991\") "
Jul 06 01:32:56.929339 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:56.929290    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91f5f889-a0d0-4825-8385-045e98676991-istio-data\") pod \"91f5f889-a0d0-4825-8385-045e98676991\" (UID: \"91f5f889-a0d0-4825-8385-045e98676991\") "
Jul 06 01:32:56.929339 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:56.929314    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91f5f889-a0d0-4825-8385-045e98676991-istio-podinfo\") pod \"91f5f889-a0d0-4825-8385-045e98676991\" (UID: \"91f5f889-a0d0-4825-8385-045e98676991\") "
Jul 06 01:32:56.929613 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:56.929354    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91f5f889-a0d0-4825-8385-045e98676991-istiod-ca-cert\") pod \"91f5f889-a0d0-4825-8385-045e98676991\" (UID: \"91f5f889-a0d0-4825-8385-045e98676991\") "
Jul 06 01:32:56.929613 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:56.929375    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91f5f889-a0d0-4825-8385-045e98676991-credential-socket\") pod \"91f5f889-a0d0-4825-8385-045e98676991\" (UID: \"91f5f889-a0d0-4825-8385-045e98676991\") "
Jul 06 01:32:56.929613 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:56.929398    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91f5f889-a0d0-4825-8385-045e98676991-workload-certs\") pod \"91f5f889-a0d0-4825-8385-045e98676991\" (UID: \"91f5f889-a0d0-4825-8385-045e98676991\") "
Jul 06 01:32:56.929613 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:56.929426    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91f5f889-a0d0-4825-8385-045e98676991-workload-socket\") pod \"91f5f889-a0d0-4825-8385-045e98676991\" (UID: \"91f5f889-a0d0-4825-8385-045e98676991\") "
Jul 06 01:32:56.929613 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:56.929469    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tc59s\" (UniqueName: \"kubernetes.io/projected/91f5f889-a0d0-4825-8385-045e98676991-kube-api-access-tc59s\") pod \"91f5f889-a0d0-4825-8385-045e98676991\" (UID: \"91f5f889-a0d0-4825-8385-045e98676991\") "
Jul 06 01:32:56.929613 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:56.929535    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91f5f889-a0d0-4825-8385-045e98676991-istio-envoy\") pod \"91f5f889-a0d0-4825-8385-045e98676991\" (UID: \"91f5f889-a0d0-4825-8385-045e98676991\") "
Jul 06 01:32:56.929931 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:56.929732    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91f5f889-a0d0-4825-8385-045e98676991-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "91f5f889-a0d0-4825-8385-045e98676991" (UID: "91f5f889-a0d0-4825-8385-045e98676991"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:32:56.929931 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:56.929784    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91f5f889-a0d0-4825-8385-045e98676991-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "91f5f889-a0d0-4825-8385-045e98676991" (UID: "91f5f889-a0d0-4825-8385-045e98676991"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:32:56.929931 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:56.929840    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91f5f889-a0d0-4825-8385-045e98676991-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "91f5f889-a0d0-4825-8385-045e98676991" (UID: "91f5f889-a0d0-4825-8385-045e98676991"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:32:56.929931 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:56.929881    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91f5f889-a0d0-4825-8385-045e98676991-credential-socket\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:32:56.929931 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:56.929899    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91f5f889-a0d0-4825-8385-045e98676991-workload-socket\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:32:56.930206 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:56.930081    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91f5f889-a0d0-4825-8385-045e98676991-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "91f5f889-a0d0-4825-8385-045e98676991" (UID: "91f5f889-a0d0-4825-8385-045e98676991"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:32:56.930323 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:56.930295    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91f5f889-a0d0-4825-8385-045e98676991-istio-data" (OuterVolumeSpecName: "istio-data") pod "91f5f889-a0d0-4825-8385-045e98676991" (UID: "91f5f889-a0d0-4825-8385-045e98676991"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:32:56.931591 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:56.931560    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91f5f889-a0d0-4825-8385-045e98676991-istio-token" (OuterVolumeSpecName: "istio-token") pod "91f5f889-a0d0-4825-8385-045e98676991" (UID: "91f5f889-a0d0-4825-8385-045e98676991"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:32:56.931677 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:56.931617    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/91f5f889-a0d0-4825-8385-045e98676991-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "91f5f889-a0d0-4825-8385-045e98676991" (UID: "91f5f889-a0d0-4825-8385-045e98676991"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 01:32:56.931677 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:56.931671    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91f5f889-a0d0-4825-8385-045e98676991-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "91f5f889-a0d0-4825-8385-045e98676991" (UID: "91f5f889-a0d0-4825-8385-045e98676991"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:32:56.931784 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:56.931769    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91f5f889-a0d0-4825-8385-045e98676991-kube-api-access-tc59s" (OuterVolumeSpecName: "kube-api-access-tc59s") pod "91f5f889-a0d0-4825-8385-045e98676991" (UID: "91f5f889-a0d0-4825-8385-045e98676991"). InnerVolumeSpecName "kube-api-access-tc59s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:32:57.031287 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:57.031248    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91f5f889-a0d0-4825-8385-045e98676991-istio-envoy\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:32:57.031287 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:57.031276    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91f5f889-a0d0-4825-8385-045e98676991-istio-token\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:32:57.031287 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:57.031284    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91f5f889-a0d0-4825-8385-045e98676991-istio-data\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:32:57.031287 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:57.031295    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91f5f889-a0d0-4825-8385-045e98676991-istio-podinfo\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:32:57.031555 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:57.031303    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91f5f889-a0d0-4825-8385-045e98676991-istiod-ca-cert\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:32:57.031555 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:57.031311    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91f5f889-a0d0-4825-8385-045e98676991-workload-certs\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:32:57.031555 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:57.031320    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tc59s\" (UniqueName: \"kubernetes.io/projected/91f5f889-a0d0-4825-8385-045e98676991-kube-api-access-tc59s\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:32:57.037284 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:57.037254    2562 generic.go:356] "Generic (PLEG): container finished" podID="91f5f889-a0d0-4825-8385-045e98676991" containerID="0e3a6fa471d2ea59d892ced404fc30cee966ba4aac6a30cbc0fa19b2474c2fb0" exitCode=0
Jul 06 01:32:57.037451 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:57.037308    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"
Jul 06 01:32:57.037451 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:57.037340    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw" event={"ID":"91f5f889-a0d0-4825-8385-045e98676991","Type":"ContainerDied","Data":"0e3a6fa471d2ea59d892ced404fc30cee966ba4aac6a30cbc0fa19b2474c2fb0"}
Jul 06 01:32:57.037451 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:57.037423    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw" event={"ID":"91f5f889-a0d0-4825-8385-045e98676991","Type":"ContainerDied","Data":"8938dffdf377d9176be7e867df6968fa8ee55682424eb9e24e1dd96231dda65c"}
Jul 06 01:32:57.037451 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:57.037451    2562 scope.go:117] "RemoveContainer" containerID="0e3a6fa471d2ea59d892ced404fc30cee966ba4aac6a30cbc0fa19b2474c2fb0"
Jul 06 01:32:57.047027 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:57.047010    2562 scope.go:117] "RemoveContainer" containerID="27e6a0194803df1b216fb74a6a29a11cef6fb7178243e7a7324d53c2098e8a44"
Jul 06 01:32:57.055428 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:57.055408    2562 scope.go:117] "RemoveContainer" containerID="0e3a6fa471d2ea59d892ced404fc30cee966ba4aac6a30cbc0fa19b2474c2fb0"
Jul 06 01:32:57.055699 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:32:57.055681    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e3a6fa471d2ea59d892ced404fc30cee966ba4aac6a30cbc0fa19b2474c2fb0\": container with ID starting with 0e3a6fa471d2ea59d892ced404fc30cee966ba4aac6a30cbc0fa19b2474c2fb0 not found: ID does not exist" containerID="0e3a6fa471d2ea59d892ced404fc30cee966ba4aac6a30cbc0fa19b2474c2fb0"
Jul 06 01:32:57.055759 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:57.055706    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e3a6fa471d2ea59d892ced404fc30cee966ba4aac6a30cbc0fa19b2474c2fb0"} err="failed to get container status \"0e3a6fa471d2ea59d892ced404fc30cee966ba4aac6a30cbc0fa19b2474c2fb0\": rpc error: code = NotFound desc = could not find container \"0e3a6fa471d2ea59d892ced404fc30cee966ba4aac6a30cbc0fa19b2474c2fb0\": container with ID starting with 0e3a6fa471d2ea59d892ced404fc30cee966ba4aac6a30cbc0fa19b2474c2fb0 not found: ID does not exist"
Jul 06 01:32:57.055759 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:57.055723    2562 scope.go:117] "RemoveContainer" containerID="27e6a0194803df1b216fb74a6a29a11cef6fb7178243e7a7324d53c2098e8a44"
Jul 06 01:32:57.055952 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:32:57.055937    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27e6a0194803df1b216fb74a6a29a11cef6fb7178243e7a7324d53c2098e8a44\": container with ID starting with 27e6a0194803df1b216fb74a6a29a11cef6fb7178243e7a7324d53c2098e8a44 not found: ID does not exist" containerID="27e6a0194803df1b216fb74a6a29a11cef6fb7178243e7a7324d53c2098e8a44"
Jul 06 01:32:57.055996 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:57.055958    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27e6a0194803df1b216fb74a6a29a11cef6fb7178243e7a7324d53c2098e8a44"} err="failed to get container status \"27e6a0194803df1b216fb74a6a29a11cef6fb7178243e7a7324d53c2098e8a44\": rpc error: code = NotFound desc = could not find container \"27e6a0194803df1b216fb74a6a29a11cef6fb7178243e7a7324d53c2098e8a44\": container with ID starting with 27e6a0194803df1b216fb74a6a29a11cef6fb7178243e7a7324d53c2098e8a44 not found: ID does not exist"
Jul 06 01:32:57.062447 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:57.062423    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"]
Jul 06 01:32:57.065658 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:57.065639    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-4b3aa7dc-openshift-default-5c4b7b4f47-4jfmw"]
Jul 06 01:32:58.752278 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:32:58.752247    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91f5f889-a0d0-4825-8385-045e98676991" path="/var/lib/kubelet/pods/91f5f889-a0d0-4825-8385-045e98676991/volumes"
Jul 06 01:33:46.457176 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.457120    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"]
Jul 06 01:33:46.457634 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.457557    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91f5f889-a0d0-4825-8385-045e98676991" containerName="istio-proxy"
Jul 06 01:33:46.457634 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.457570    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="91f5f889-a0d0-4825-8385-045e98676991" containerName="istio-proxy"
Jul 06 01:33:46.457634 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.457589    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="256d9671-2d1a-4423-9f69-229fdeada5e3" containerName="maas-api"
Jul 06 01:33:46.457634 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.457595    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="256d9671-2d1a-4423-9f69-229fdeada5e3" containerName="maas-api"
Jul 06 01:33:46.457634 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.457608    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f45853cd-c4e3-48a4-8903-9a2a910f34c0" containerName="main"
Jul 06 01:33:46.457634 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.457614    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f45853cd-c4e3-48a4-8903-9a2a910f34c0" containerName="main"
Jul 06 01:33:46.457830 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.457674    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f45853cd-c4e3-48a4-8903-9a2a910f34c0" containerName="main"
Jul 06 01:33:46.457830 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.457686    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="91f5f889-a0d0-4825-8385-045e98676991" containerName="istio-proxy"
Jul 06 01:33:46.457830 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.457692    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="91f5f889-a0d0-4825-8385-045e98676991" containerName="istio-proxy"
Jul 06 01:33:46.457830 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.457700    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="256d9671-2d1a-4423-9f69-229fdeada5e3" containerName="maas-api"
Jul 06 01:33:46.459704 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.459689    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"
Jul 06 01:33:46.462256 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.462228    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 01:33:46.462419 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.462276    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-736613-openshift-default-dockercfg-8ql2s\""
Jul 06 01:33:46.470551 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.470529    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"]
Jul 06 01:33:46.487482 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.487454    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b5d71fa-f78e-472f-b12d-f21a0fa22701-istio-envoy\") pod \"e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct\" (UID: \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\") " pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"
Jul 06 01:33:46.487643 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.487494    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p5px\" (UniqueName: \"kubernetes.io/projected/6b5d71fa-f78e-472f-b12d-f21a0fa22701-kube-api-access-4p5px\") pod \"e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct\" (UID: \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\") " pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"
Jul 06 01:33:46.487643 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.487561    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b5d71fa-f78e-472f-b12d-f21a0fa22701-istiod-ca-cert\") pod \"e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct\" (UID: \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\") " pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"
Jul 06 01:33:46.487643 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.487586    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b5d71fa-f78e-472f-b12d-f21a0fa22701-workload-socket\") pod \"e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct\" (UID: \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\") " pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"
Jul 06 01:33:46.487643 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.487631    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b5d71fa-f78e-472f-b12d-f21a0fa22701-istio-podinfo\") pod \"e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct\" (UID: \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\") " pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"
Jul 06 01:33:46.487889 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.487726    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b5d71fa-f78e-472f-b12d-f21a0fa22701-credential-socket\") pod \"e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct\" (UID: \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\") " pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"
Jul 06 01:33:46.487889 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.487769    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b5d71fa-f78e-472f-b12d-f21a0fa22701-istio-token\") pod \"e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct\" (UID: \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\") " pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"
Jul 06 01:33:46.487889 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.487799    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b5d71fa-f78e-472f-b12d-f21a0fa22701-istio-data\") pod \"e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct\" (UID: \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\") " pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"
Jul 06 01:33:46.487889 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.487838    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b5d71fa-f78e-472f-b12d-f21a0fa22701-workload-certs\") pod \"e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct\" (UID: \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\") " pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"
Jul 06 01:33:46.588996 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.588961    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b5d71fa-f78e-472f-b12d-f21a0fa22701-istio-envoy\") pod \"e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct\" (UID: \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\") " pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"
Jul 06 01:33:46.588996 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.589007    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p5px\" (UniqueName: \"kubernetes.io/projected/6b5d71fa-f78e-472f-b12d-f21a0fa22701-kube-api-access-4p5px\") pod \"e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct\" (UID: \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\") " pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"
Jul 06 01:33:46.589278 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.589058    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b5d71fa-f78e-472f-b12d-f21a0fa22701-istiod-ca-cert\") pod \"e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct\" (UID: \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\") " pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"
Jul 06 01:33:46.589278 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.589084    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b5d71fa-f78e-472f-b12d-f21a0fa22701-workload-socket\") pod \"e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct\" (UID: \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\") " pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"
Jul 06 01:33:46.589278 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.589108    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b5d71fa-f78e-472f-b12d-f21a0fa22701-istio-podinfo\") pod \"e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct\" (UID: \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\") " pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"
Jul 06 01:33:46.589278 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.589139    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b5d71fa-f78e-472f-b12d-f21a0fa22701-credential-socket\") pod \"e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct\" (UID: \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\") " pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"
Jul 06 01:33:46.589278 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.589202    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b5d71fa-f78e-472f-b12d-f21a0fa22701-istio-token\") pod \"e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct\" (UID: \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\") " pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"
Jul 06 01:33:46.589278 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.589229    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b5d71fa-f78e-472f-b12d-f21a0fa22701-istio-data\") pod \"e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct\" (UID: \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\") " pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"
Jul 06 01:33:46.589278 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.589278    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b5d71fa-f78e-472f-b12d-f21a0fa22701-workload-certs\") pod \"e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct\" (UID: \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\") " pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"
Jul 06 01:33:46.589696 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.589506    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b5d71fa-f78e-472f-b12d-f21a0fa22701-workload-socket\") pod \"e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct\" (UID: \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\") " pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"
Jul 06 01:33:46.589696 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.589587    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b5d71fa-f78e-472f-b12d-f21a0fa22701-workload-certs\") pod \"e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct\" (UID: \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\") " pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"
Jul 06 01:33:46.589809 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.589764    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b5d71fa-f78e-472f-b12d-f21a0fa22701-istio-data\") pod \"e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct\" (UID: \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\") " pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"
Jul 06 01:33:46.589862 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.589807    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b5d71fa-f78e-472f-b12d-f21a0fa22701-credential-socket\") pod \"e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct\" (UID: \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\") " pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"
Jul 06 01:33:46.589912 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.589890    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b5d71fa-f78e-472f-b12d-f21a0fa22701-istiod-ca-cert\") pod \"e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct\" (UID: \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\") " pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"
Jul 06 01:33:46.591394 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.591372    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b5d71fa-f78e-472f-b12d-f21a0fa22701-istio-envoy\") pod \"e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct\" (UID: \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\") " pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"
Jul 06 01:33:46.591709 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.591685    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b5d71fa-f78e-472f-b12d-f21a0fa22701-istio-podinfo\") pod \"e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct\" (UID: \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\") " pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"
Jul 06 01:33:46.597217 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.597190    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b5d71fa-f78e-472f-b12d-f21a0fa22701-istio-token\") pod \"e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct\" (UID: \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\") " pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"
Jul 06 01:33:46.597388 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.597369    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p5px\" (UniqueName: \"kubernetes.io/projected/6b5d71fa-f78e-472f-b12d-f21a0fa22701-kube-api-access-4p5px\") pod \"e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct\" (UID: \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\") " pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"
Jul 06 01:33:46.770518 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.770437    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"
Jul 06 01:33:46.904504 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.904474    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"]
Jul 06 01:33:46.906782 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:33:46.906756    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b5d71fa_f78e_472f_b12d_f21a0fa22701.slice/crio-f481573f6807c4a891bcea82d25d3834ebdedda44e8ead0228fa3a4682019067 WatchSource:0}: Error finding container f481573f6807c4a891bcea82d25d3834ebdedda44e8ead0228fa3a4682019067: Status 404 returned error can't find the container with id f481573f6807c4a891bcea82d25d3834ebdedda44e8ead0228fa3a4682019067
Jul 06 01:33:46.908928 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.908893    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:33:46.909028 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.908962    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:33:46.909028 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:46.908988    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:33:47.278328 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:47.278286    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct" event={"ID":"6b5d71fa-f78e-472f-b12d-f21a0fa22701","Type":"ContainerStarted","Data":"3ee0072a62e928c5159ef83f069d7952209b6d40a4c6cf4bd57ec90de7ab1cda"}
Jul 06 01:33:47.278538 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:47.278351    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct" event={"ID":"6b5d71fa-f78e-472f-b12d-f21a0fa22701","Type":"ContainerStarted","Data":"f481573f6807c4a891bcea82d25d3834ebdedda44e8ead0228fa3a4682019067"}
Jul 06 01:33:47.297345 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:47.296930    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct" podStartSLOduration=1.296911452 podStartE2EDuration="1.296911452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:33:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:33:47.296295225 +0000 UTC m=+2059.107270483" watchObservedRunningTime="2026-07-06 01:33:47.296911452 +0000 UTC m=+2059.107886695"
Jul 06 01:33:47.771412 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:47.771376    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"
Jul 06 01:33:47.775867 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:47.775844    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"
Jul 06 01:33:48.283315 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:48.283288    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"
Jul 06 01:33:48.284105 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:48.284090    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"
Jul 06 01:33:49.417621 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:49.417570    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-736613-8b9549b69-n2qhf"]
Jul 06 01:33:49.419112 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:49.419066    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91f5f889-a0d0-4825-8385-045e98676991" containerName="istio-proxy"
Jul 06 01:33:49.419286 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:49.419272    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="91f5f889-a0d0-4825-8385-045e98676991" containerName="istio-proxy"
Jul 06 01:33:49.423750 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:49.423730    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-736613-8b9549b69-n2qhf"
Jul 06 01:33:49.431170 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:49.426803    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-736613-serving-cert\""
Jul 06 01:33:49.431170 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:49.426987    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-84mvh\""
Jul 06 01:33:49.431170 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:49.429977    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-736613-8b9549b69-n2qhf"]
Jul 06 01:33:49.526108 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:49.526067    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1b03b23-0127-43bb-876d-65d17218d471-openshift-service-ca\") pod \"maas-api-e2e-inf-a-736613-8b9549b69-n2qhf\" (UID: \"a1b03b23-0127-43bb-876d-65d17218d471\") " pod="opendatahub/maas-api-e2e-inf-a-736613-8b9549b69-n2qhf"
Jul 06 01:33:49.526108 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:49.526110    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1b03b23-0127-43bb-876d-65d17218d471-maas-api-tls\") pod \"maas-api-e2e-inf-a-736613-8b9549b69-n2qhf\" (UID: \"a1b03b23-0127-43bb-876d-65d17218d471\") " pod="opendatahub/maas-api-e2e-inf-a-736613-8b9549b69-n2qhf"
Jul 06 01:33:49.526349 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:49.526236    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqscq\" (UniqueName: \"kubernetes.io/projected/a1b03b23-0127-43bb-876d-65d17218d471-kube-api-access-pqscq\") pod \"maas-api-e2e-inf-a-736613-8b9549b69-n2qhf\" (UID: \"a1b03b23-0127-43bb-876d-65d17218d471\") " pod="opendatahub/maas-api-e2e-inf-a-736613-8b9549b69-n2qhf"
Jul 06 01:33:49.627365 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:49.627323    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqscq\" (UniqueName: \"kubernetes.io/projected/a1b03b23-0127-43bb-876d-65d17218d471-kube-api-access-pqscq\") pod \"maas-api-e2e-inf-a-736613-8b9549b69-n2qhf\" (UID: \"a1b03b23-0127-43bb-876d-65d17218d471\") " pod="opendatahub/maas-api-e2e-inf-a-736613-8b9549b69-n2qhf"
Jul 06 01:33:49.627558 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:49.627429    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1b03b23-0127-43bb-876d-65d17218d471-openshift-service-ca\") pod \"maas-api-e2e-inf-a-736613-8b9549b69-n2qhf\" (UID: \"a1b03b23-0127-43bb-876d-65d17218d471\") " pod="opendatahub/maas-api-e2e-inf-a-736613-8b9549b69-n2qhf"
Jul 06 01:33:49.627558 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:49.627452    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1b03b23-0127-43bb-876d-65d17218d471-maas-api-tls\") pod \"maas-api-e2e-inf-a-736613-8b9549b69-n2qhf\" (UID: \"a1b03b23-0127-43bb-876d-65d17218d471\") " pod="opendatahub/maas-api-e2e-inf-a-736613-8b9549b69-n2qhf"
Jul 06 01:33:49.628120 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:49.628093    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1b03b23-0127-43bb-876d-65d17218d471-openshift-service-ca\") pod \"maas-api-e2e-inf-a-736613-8b9549b69-n2qhf\" (UID: \"a1b03b23-0127-43bb-876d-65d17218d471\") " pod="opendatahub/maas-api-e2e-inf-a-736613-8b9549b69-n2qhf"
Jul 06 01:33:49.629773 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:49.629754    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1b03b23-0127-43bb-876d-65d17218d471-maas-api-tls\") pod \"maas-api-e2e-inf-a-736613-8b9549b69-n2qhf\" (UID: \"a1b03b23-0127-43bb-876d-65d17218d471\") " pod="opendatahub/maas-api-e2e-inf-a-736613-8b9549b69-n2qhf"
Jul 06 01:33:49.634761 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:49.634743    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqscq\" (UniqueName: \"kubernetes.io/projected/a1b03b23-0127-43bb-876d-65d17218d471-kube-api-access-pqscq\") pod \"maas-api-e2e-inf-a-736613-8b9549b69-n2qhf\" (UID: \"a1b03b23-0127-43bb-876d-65d17218d471\") " pod="opendatahub/maas-api-e2e-inf-a-736613-8b9549b69-n2qhf"
Jul 06 01:33:49.743019 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:49.742927    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-736613-8b9549b69-n2qhf"
Jul 06 01:33:49.881400 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:49.881376    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-736613-8b9549b69-n2qhf"]
Jul 06 01:33:49.883313 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:33:49.883288    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1b03b23_0127_43bb_876d_65d17218d471.slice/crio-a6a0edb21210028a33780fe51971e23b881e2b8595e385ebd383fe729ef4038f WatchSource:0}: Error finding container a6a0edb21210028a33780fe51971e23b881e2b8595e385ebd383fe729ef4038f: Status 404 returned error can't find the container with id a6a0edb21210028a33780fe51971e23b881e2b8595e385ebd383fe729ef4038f
Jul 06 01:33:49.885081 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:49.885060    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 01:33:50.293691 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:50.293654    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-736613-8b9549b69-n2qhf" event={"ID":"a1b03b23-0127-43bb-876d-65d17218d471","Type":"ContainerStarted","Data":"a6a0edb21210028a33780fe51971e23b881e2b8595e385ebd383fe729ef4038f"}
Jul 06 01:33:51.300548 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:51.300501    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-736613-8b9549b69-n2qhf" event={"ID":"a1b03b23-0127-43bb-876d-65d17218d471","Type":"ContainerStarted","Data":"494a6dc6a98de421a6b5a73dd3a134e1079fa19e1c06f6d92d646478a60e9641"}
Jul 06 01:33:51.300920 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:51.300569    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-736613-8b9549b69-n2qhf"
Jul 06 01:33:51.317556 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:51.317500    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-736613-8b9549b69-n2qhf" podStartSLOduration=1.77134472 podStartE2EDuration="2.317486188s" totalImagesPullingTime="546.141468ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:33:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:33:51.314847214 +0000 UTC m=+2063.125822458" watchObservedRunningTime="2026-07-06 01:33:51.317486188 +0000 UTC m=+2063.128461431"
Jul 06 01:33:54.534958 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:54.534920    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"]
Jul 06 01:33:54.538935 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:54.538914    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"
Jul 06 01:33:54.543077 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:54.543056    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-c2d358-openshift-default-dockercfg-bn7gf\""
Jul 06 01:33:54.553529 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:54.553501    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"]
Jul 06 01:33:54.675836 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:54.675808    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/695f568a-0b02-4596-8713-dafaf1b2afad-istio-data\") pod \"e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q\" (UID: \"695f568a-0b02-4596-8713-dafaf1b2afad\") " pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"
Jul 06 01:33:54.676024 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:54.675853    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/695f568a-0b02-4596-8713-dafaf1b2afad-workload-socket\") pod \"e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q\" (UID: \"695f568a-0b02-4596-8713-dafaf1b2afad\") " pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"
Jul 06 01:33:54.676024 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:54.675872    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/695f568a-0b02-4596-8713-dafaf1b2afad-credential-socket\") pod \"e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q\" (UID: \"695f568a-0b02-4596-8713-dafaf1b2afad\") " pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"
Jul 06 01:33:54.676024 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:54.675892    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/695f568a-0b02-4596-8713-dafaf1b2afad-istio-podinfo\") pod \"e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q\" (UID: \"695f568a-0b02-4596-8713-dafaf1b2afad\") " pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"
Jul 06 01:33:54.676024 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:54.675938    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/695f568a-0b02-4596-8713-dafaf1b2afad-istio-token\") pod \"e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q\" (UID: \"695f568a-0b02-4596-8713-dafaf1b2afad\") " pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"
Jul 06 01:33:54.676024 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:54.675952    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hj9b\" (UniqueName: \"kubernetes.io/projected/695f568a-0b02-4596-8713-dafaf1b2afad-kube-api-access-5hj9b\") pod \"e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q\" (UID: \"695f568a-0b02-4596-8713-dafaf1b2afad\") " pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"
Jul 06 01:33:54.676024 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:54.675987    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/695f568a-0b02-4596-8713-dafaf1b2afad-istio-envoy\") pod \"e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q\" (UID: \"695f568a-0b02-4596-8713-dafaf1b2afad\") " pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"
Jul 06 01:33:54.676024 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:54.676023    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/695f568a-0b02-4596-8713-dafaf1b2afad-istiod-ca-cert\") pod \"e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q\" (UID: \"695f568a-0b02-4596-8713-dafaf1b2afad\") " pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"
Jul 06 01:33:54.676319 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:54.676082    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/695f568a-0b02-4596-8713-dafaf1b2afad-workload-certs\") pod \"e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q\" (UID: \"695f568a-0b02-4596-8713-dafaf1b2afad\") " pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"
Jul 06 01:33:54.777455 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:54.777420    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/695f568a-0b02-4596-8713-dafaf1b2afad-workload-socket\") pod \"e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q\" (UID: \"695f568a-0b02-4596-8713-dafaf1b2afad\") " pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"
Jul 06 01:33:54.777455 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:54.777453    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/695f568a-0b02-4596-8713-dafaf1b2afad-credential-socket\") pod \"e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q\" (UID: \"695f568a-0b02-4596-8713-dafaf1b2afad\") " pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"
Jul 06 01:33:54.777720 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:54.777473    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/695f568a-0b02-4596-8713-dafaf1b2afad-istio-podinfo\") pod \"e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q\" (UID: \"695f568a-0b02-4596-8713-dafaf1b2afad\") " pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"
Jul 06 01:33:54.777720 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:54.777593    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/695f568a-0b02-4596-8713-dafaf1b2afad-istio-token\") pod \"e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q\" (UID: \"695f568a-0b02-4596-8713-dafaf1b2afad\") " pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"
Jul 06 01:33:54.777720 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:54.777628    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hj9b\" (UniqueName: \"kubernetes.io/projected/695f568a-0b02-4596-8713-dafaf1b2afad-kube-api-access-5hj9b\") pod \"e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q\" (UID: \"695f568a-0b02-4596-8713-dafaf1b2afad\") " pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"
Jul 06 01:33:54.777720 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:54.777683    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/695f568a-0b02-4596-8713-dafaf1b2afad-istio-envoy\") pod \"e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q\" (UID: \"695f568a-0b02-4596-8713-dafaf1b2afad\") " pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"
Jul 06 01:33:54.777938 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:54.777749    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/695f568a-0b02-4596-8713-dafaf1b2afad-istiod-ca-cert\") pod \"e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q\" (UID: \"695f568a-0b02-4596-8713-dafaf1b2afad\") " pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"
Jul 06 01:33:54.777938 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:54.777802    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/695f568a-0b02-4596-8713-dafaf1b2afad-workload-certs\") pod \"e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q\" (UID: \"695f568a-0b02-4596-8713-dafaf1b2afad\") " pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"
Jul 06 01:33:54.777938 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:54.777849    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/695f568a-0b02-4596-8713-dafaf1b2afad-credential-socket\") pod \"e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q\" (UID: \"695f568a-0b02-4596-8713-dafaf1b2afad\") " pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"
Jul 06 01:33:54.777938 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:54.777853    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/695f568a-0b02-4596-8713-dafaf1b2afad-istio-data\") pod \"e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q\" (UID: \"695f568a-0b02-4596-8713-dafaf1b2afad\") " pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"
Jul 06 01:33:54.777938 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:54.777892    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/695f568a-0b02-4596-8713-dafaf1b2afad-workload-socket\") pod \"e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q\" (UID: \"695f568a-0b02-4596-8713-dafaf1b2afad\") " pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"
Jul 06 01:33:54.778245 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:54.778177    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/695f568a-0b02-4596-8713-dafaf1b2afad-istio-data\") pod \"e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q\" (UID: \"695f568a-0b02-4596-8713-dafaf1b2afad\") " pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"
Jul 06 01:33:54.778245 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:54.778219    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/695f568a-0b02-4596-8713-dafaf1b2afad-workload-certs\") pod \"e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q\" (UID: \"695f568a-0b02-4596-8713-dafaf1b2afad\") " pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"
Jul 06 01:33:54.778448 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:54.778428    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/695f568a-0b02-4596-8713-dafaf1b2afad-istiod-ca-cert\") pod \"e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q\" (UID: \"695f568a-0b02-4596-8713-dafaf1b2afad\") " pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"
Jul 06 01:33:54.779962 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:54.779941    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/695f568a-0b02-4596-8713-dafaf1b2afad-istio-envoy\") pod \"e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q\" (UID: \"695f568a-0b02-4596-8713-dafaf1b2afad\") " pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"
Jul 06 01:33:54.780099 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:54.780079    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/695f568a-0b02-4596-8713-dafaf1b2afad-istio-podinfo\") pod \"e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q\" (UID: \"695f568a-0b02-4596-8713-dafaf1b2afad\") " pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"
Jul 06 01:33:54.785323 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:54.785262    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hj9b\" (UniqueName: \"kubernetes.io/projected/695f568a-0b02-4596-8713-dafaf1b2afad-kube-api-access-5hj9b\") pod \"e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q\" (UID: \"695f568a-0b02-4596-8713-dafaf1b2afad\") " pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"
Jul 06 01:33:54.785476 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:54.785443    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/695f568a-0b02-4596-8713-dafaf1b2afad-istio-token\") pod \"e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q\" (UID: \"695f568a-0b02-4596-8713-dafaf1b2afad\") " pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"
Jul 06 01:33:54.852709 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:54.852675    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"
Jul 06 01:33:54.992743 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:54.992719    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"]
Jul 06 01:33:54.994465 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:33:54.994443    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod695f568a_0b02_4596_8713_dafaf1b2afad.slice/crio-11a2a7d53fc5dd9c39d72a55ff726cf0332713a5415e722df63d09a3e2df97bf WatchSource:0}: Error finding container 11a2a7d53fc5dd9c39d72a55ff726cf0332713a5415e722df63d09a3e2df97bf: Status 404 returned error can't find the container with id 11a2a7d53fc5dd9c39d72a55ff726cf0332713a5415e722df63d09a3e2df97bf
Jul 06 01:33:54.997050 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:54.997009    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:33:54.997179 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:54.997108    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:33:54.997252 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:54.997179    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:33:55.320014 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:55.319926    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q" event={"ID":"695f568a-0b02-4596-8713-dafaf1b2afad","Type":"ContainerStarted","Data":"cfc079a80908f9faab6852e59354f8bc35a2164d9d46d562d83dfde4d23f6607"}
Jul 06 01:33:55.320014 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:55.319982    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q" event={"ID":"695f568a-0b02-4596-8713-dafaf1b2afad","Type":"ContainerStarted","Data":"11a2a7d53fc5dd9c39d72a55ff726cf0332713a5415e722df63d09a3e2df97bf"}
Jul 06 01:33:55.343169 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:55.340019    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q" podStartSLOduration=1.339999797 podStartE2EDuration="1.339999797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:33:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:33:55.338676408 +0000 UTC m=+2067.149651648" watchObservedRunningTime="2026-07-06 01:33:55.339999797 +0000 UTC m=+2067.150975040"
Jul 06 01:33:55.853481 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:55.853442    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"
Jul 06 01:33:56.858565 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:56.858535    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"
Jul 06 01:33:57.310664 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:57.310588    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-736613-8b9549b69-n2qhf"
Jul 06 01:33:57.329590 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:57.329562    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"
Jul 06 01:33:57.330390 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:57.330374    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"
Jul 06 01:33:57.645729 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:57.645691    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-c2d358-7fd6888b9c-26n2c"]
Jul 06 01:33:57.650114 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:57.650088    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-c2d358-7fd6888b9c-26n2c"
Jul 06 01:33:57.652505 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:57.652479    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-c2d358-serving-cert\""
Jul 06 01:33:57.657960 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:57.657891    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-c2d358-7fd6888b9c-26n2c"]
Jul 06 01:33:57.708585 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:57.708551    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p68cl\" (UniqueName: \"kubernetes.io/projected/c3575260-6b6a-4813-a99d-54715db3cf7f-kube-api-access-p68cl\") pod \"maas-api-e2e-inf-b-c2d358-7fd6888b9c-26n2c\" (UID: \"c3575260-6b6a-4813-a99d-54715db3cf7f\") " pod="opendatahub/maas-api-e2e-inf-b-c2d358-7fd6888b9c-26n2c"
Jul 06 01:33:57.708769 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:57.708593    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3575260-6b6a-4813-a99d-54715db3cf7f-maas-api-tls\") pod \"maas-api-e2e-inf-b-c2d358-7fd6888b9c-26n2c\" (UID: \"c3575260-6b6a-4813-a99d-54715db3cf7f\") " pod="opendatahub/maas-api-e2e-inf-b-c2d358-7fd6888b9c-26n2c"
Jul 06 01:33:57.708769 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:57.708689    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3575260-6b6a-4813-a99d-54715db3cf7f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c2d358-7fd6888b9c-26n2c\" (UID: \"c3575260-6b6a-4813-a99d-54715db3cf7f\") " pod="opendatahub/maas-api-e2e-inf-b-c2d358-7fd6888b9c-26n2c"
Jul 06 01:33:57.809864 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:57.809828    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p68cl\" (UniqueName: \"kubernetes.io/projected/c3575260-6b6a-4813-a99d-54715db3cf7f-kube-api-access-p68cl\") pod \"maas-api-e2e-inf-b-c2d358-7fd6888b9c-26n2c\" (UID: \"c3575260-6b6a-4813-a99d-54715db3cf7f\") " pod="opendatahub/maas-api-e2e-inf-b-c2d358-7fd6888b9c-26n2c"
Jul 06 01:33:57.809864 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:57.809869    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3575260-6b6a-4813-a99d-54715db3cf7f-maas-api-tls\") pod \"maas-api-e2e-inf-b-c2d358-7fd6888b9c-26n2c\" (UID: \"c3575260-6b6a-4813-a99d-54715db3cf7f\") " pod="opendatahub/maas-api-e2e-inf-b-c2d358-7fd6888b9c-26n2c"
Jul 06 01:33:57.810131 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:57.809927    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3575260-6b6a-4813-a99d-54715db3cf7f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c2d358-7fd6888b9c-26n2c\" (UID: \"c3575260-6b6a-4813-a99d-54715db3cf7f\") " pod="opendatahub/maas-api-e2e-inf-b-c2d358-7fd6888b9c-26n2c"
Jul 06 01:33:57.810131 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:33:57.810040    2562 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-b-c2d358-serving-cert: secret "maas-api-e2e-inf-b-c2d358-serving-cert" not found
Jul 06 01:33:57.810131 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:33:57.810100    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3575260-6b6a-4813-a99d-54715db3cf7f-maas-api-tls podName:c3575260-6b6a-4813-a99d-54715db3cf7f nodeName:}" failed. No retries permitted until 2026-07-06 01:33:58.310084793 +0000 UTC m=+2070.121060015 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c3575260-6b6a-4813-a99d-54715db3cf7f-maas-api-tls") pod "maas-api-e2e-inf-b-c2d358-7fd6888b9c-26n2c" (UID: "c3575260-6b6a-4813-a99d-54715db3cf7f") : secret "maas-api-e2e-inf-b-c2d358-serving-cert" not found
Jul 06 01:33:57.810597 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:57.810580    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3575260-6b6a-4813-a99d-54715db3cf7f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c2d358-7fd6888b9c-26n2c\" (UID: \"c3575260-6b6a-4813-a99d-54715db3cf7f\") " pod="opendatahub/maas-api-e2e-inf-b-c2d358-7fd6888b9c-26n2c"
Jul 06 01:33:57.820075 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:57.820020    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p68cl\" (UniqueName: \"kubernetes.io/projected/c3575260-6b6a-4813-a99d-54715db3cf7f-kube-api-access-p68cl\") pod \"maas-api-e2e-inf-b-c2d358-7fd6888b9c-26n2c\" (UID: \"c3575260-6b6a-4813-a99d-54715db3cf7f\") " pod="opendatahub/maas-api-e2e-inf-b-c2d358-7fd6888b9c-26n2c"
Jul 06 01:33:58.316331 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:58.316287    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3575260-6b6a-4813-a99d-54715db3cf7f-maas-api-tls\") pod \"maas-api-e2e-inf-b-c2d358-7fd6888b9c-26n2c\" (UID: \"c3575260-6b6a-4813-a99d-54715db3cf7f\") " pod="opendatahub/maas-api-e2e-inf-b-c2d358-7fd6888b9c-26n2c"
Jul 06 01:33:58.319658 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:58.319624    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3575260-6b6a-4813-a99d-54715db3cf7f-maas-api-tls\") pod \"maas-api-e2e-inf-b-c2d358-7fd6888b9c-26n2c\" (UID: \"c3575260-6b6a-4813-a99d-54715db3cf7f\") " pod="opendatahub/maas-api-e2e-inf-b-c2d358-7fd6888b9c-26n2c"
Jul 06 01:33:58.564421 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:58.564387    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-c2d358-7fd6888b9c-26n2c"
Jul 06 01:33:58.741103 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:58.741069    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-c2d358-7fd6888b9c-26n2c"]
Jul 06 01:33:58.744664 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:33:58.744628    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3575260_6b6a_4813_a99d_54715db3cf7f.slice/crio-a7556e479b1ade51e79042fb14ca83ee7f1f0bfc0e84f76c36501c4441376834 WatchSource:0}: Error finding container a7556e479b1ade51e79042fb14ca83ee7f1f0bfc0e84f76c36501c4441376834: Status 404 returned error can't find the container with id a7556e479b1ade51e79042fb14ca83ee7f1f0bfc0e84f76c36501c4441376834
Jul 06 01:33:59.345905 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:59.345870    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-c2d358-7fd6888b9c-26n2c" event={"ID":"c3575260-6b6a-4813-a99d-54715db3cf7f","Type":"ContainerStarted","Data":"7ed74e435ad48fc97869634e77f49ef3be3622d16b98423422d35c0eb1562655"}
Jul 06 01:33:59.346417 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:59.345930    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-c2d358-7fd6888b9c-26n2c" event={"ID":"c3575260-6b6a-4813-a99d-54715db3cf7f","Type":"ContainerStarted","Data":"a7556e479b1ade51e79042fb14ca83ee7f1f0bfc0e84f76c36501c4441376834"}
Jul 06 01:33:59.346417 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:59.346141    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-c2d358-7fd6888b9c-26n2c"
Jul 06 01:33:59.361557 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:33:59.361496    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-c2d358-7fd6888b9c-26n2c" podStartSLOduration=1.9568795570000002 podStartE2EDuration="2.361474234s" totalImagesPullingTime="404.594677ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:33:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:33:59.360880402 +0000 UTC m=+2071.171855646" watchObservedRunningTime="2026-07-06 01:33:59.361474234 +0000 UTC m=+2071.172449480"
Jul 06 01:34:04.325400 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:34:04.325358    2562 patch_prober.go:28] interesting pod/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 06 01:34:04.326076 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:34:04.326037    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct" podUID="6b5d71fa-f78e-472f-b12d-f21a0fa22701" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 01:34:05.356601 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:34:05.356573    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-c2d358-7fd6888b9c-26n2c"
Jul 06 01:34:05.378054 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:34:05.378021    2562 generic.go:356] "Generic (PLEG): container finished" podID="6b5d71fa-f78e-472f-b12d-f21a0fa22701" containerID="3ee0072a62e928c5159ef83f069d7952209b6d40a4c6cf4bd57ec90de7ab1cda" exitCode=0
Jul 06 01:34:05.378215 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:34:05.378075    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct" event={"ID":"6b5d71fa-f78e-472f-b12d-f21a0fa22701","Type":"ContainerDied","Data":"3ee0072a62e928c5159ef83f069d7952209b6d40a4c6cf4bd57ec90de7ab1cda"}
Jul 06 01:34:05.378480 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:34:05.378464    2562 scope.go:117] "RemoveContainer" containerID="3ee0072a62e928c5159ef83f069d7952209b6d40a4c6cf4bd57ec90de7ab1cda"
Jul 06 01:34:05.379407 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:34:05.379378    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:34:05.379476 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:34:05.379441    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:34:05.379515 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:34:05.379476    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:34:06.386126 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:34:06.386093    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct" event={"ID":"6b5d71fa-f78e-472f-b12d-f21a0fa22701","Type":"ContainerStarted","Data":"33896b3f0a48031dba69726bb51bc683af4267a680974ca6be859f7d24ee2d8b"}
Jul 06 01:34:06.771355 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:34:06.771265    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"
Jul 06 01:34:06.771602 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:34:06.771574    2562 patch_prober.go:28] interesting pod/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 06 01:34:06.771681 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:34:06.771651    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct" podUID="6b5d71fa-f78e-472f-b12d-f21a0fa22701" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 06 01:34:07.771679 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:34:07.771643    2562 patch_prober.go:28] interesting pod/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 06 01:34:07.772082 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:34:07.771730    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct" podUID="6b5d71fa-f78e-472f-b12d-f21a0fa22701" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 06 01:34:08.770909 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:34:08.770865    2562 patch_prober.go:28] interesting pod/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 06 01:34:08.771136 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:34:08.770968    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct" podUID="6b5d71fa-f78e-472f-b12d-f21a0fa22701" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 06 01:34:09.771021 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:34:09.770981    2562 patch_prober.go:28] interesting pod/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 06 01:34:09.771523 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:34:09.771047    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct" podUID="6b5d71fa-f78e-472f-b12d-f21a0fa22701" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 06 01:34:10.774707 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:34:10.774679    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"
Jul 06 01:34:10.775169 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:34:10.775059    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"
Jul 06 01:34:10.775814 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:34:10.775795    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"
Jul 06 01:34:11.413473 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:34:11.413443    2562 generic.go:356] "Generic (PLEG): container finished" podID="695f568a-0b02-4596-8713-dafaf1b2afad" containerID="cfc079a80908f9faab6852e59354f8bc35a2164d9d46d562d83dfde4d23f6607" exitCode=0
Jul 06 01:34:11.413717 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:34:11.413525    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q" event={"ID":"695f568a-0b02-4596-8713-dafaf1b2afad","Type":"ContainerDied","Data":"cfc079a80908f9faab6852e59354f8bc35a2164d9d46d562d83dfde4d23f6607"}
Jul 06 01:34:11.413984 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:34:11.413969    2562 scope.go:117] "RemoveContainer" containerID="cfc079a80908f9faab6852e59354f8bc35a2164d9d46d562d83dfde4d23f6607"
Jul 06 01:34:11.414950 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:34:11.414921    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:34:11.415045 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:34:11.415006    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:34:11.415203 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:34:11.415082    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:34:12.329638 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:34:12.329599    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"
Jul 06 01:34:12.426717 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:34:12.426683    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q" event={"ID":"695f568a-0b02-4596-8713-dafaf1b2afad","Type":"ContainerStarted","Data":"ece45958a89a4018092c4638a45b3ead3c47524566b730ee076878557d07962c"}
Jul 06 01:34:12.853813 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:34:12.853776    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"
Jul 06 01:34:12.854722 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:34:12.854695    2562 patch_prober.go:28] interesting pod/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 06 01:34:12.854829 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:34:12.854749    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q" podUID="695f568a-0b02-4596-8713-dafaf1b2afad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 06 01:34:13.853964 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:34:13.853926    2562 patch_prober.go:28] interesting pod/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 06 01:34:13.854385 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:34:13.853980    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q" podUID="695f568a-0b02-4596-8713-dafaf1b2afad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 06 01:34:14.853952 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:34:14.853916    2562 patch_prober.go:28] interesting pod/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 06 01:34:14.854135 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:34:14.853981    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q" podUID="695f568a-0b02-4596-8713-dafaf1b2afad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 06 01:34:15.853456 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:34:15.853415    2562 patch_prober.go:28] interesting pod/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 06 01:34:15.853658 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:34:15.853473    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q" podUID="695f568a-0b02-4596-8713-dafaf1b2afad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 06 01:34:16.857333 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:34:16.857303    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"
Jul 06 01:34:16.857755 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:34:16.857572    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"
Jul 06 01:34:16.858204 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:34:16.858188    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"
Jul 06 01:35:12.611178 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:12.611119    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-736613-8b9549b69-n2qhf"]
Jul 06 01:35:12.611733 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:12.611399    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-736613-8b9549b69-n2qhf" podUID="a1b03b23-0127-43bb-876d-65d17218d471" containerName="maas-api" containerID="cri-o://494a6dc6a98de421a6b5a73dd3a134e1079fa19e1c06f6d92d646478a60e9641" gracePeriod=30
Jul 06 01:35:12.739102 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:12.739068    2562 generic.go:356] "Generic (PLEG): container finished" podID="a1b03b23-0127-43bb-876d-65d17218d471" containerID="494a6dc6a98de421a6b5a73dd3a134e1079fa19e1c06f6d92d646478a60e9641" exitCode=0
Jul 06 01:35:12.739256 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:12.739097    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-736613-8b9549b69-n2qhf" event={"ID":"a1b03b23-0127-43bb-876d-65d17218d471","Type":"ContainerDied","Data":"494a6dc6a98de421a6b5a73dd3a134e1079fa19e1c06f6d92d646478a60e9641"}
Jul 06 01:35:12.864513 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:12.864455    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-736613-8b9549b69-n2qhf"
Jul 06 01:35:13.006675 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:13.006640    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqscq\" (UniqueName: \"kubernetes.io/projected/a1b03b23-0127-43bb-876d-65d17218d471-kube-api-access-pqscq\") pod \"a1b03b23-0127-43bb-876d-65d17218d471\" (UID: \"a1b03b23-0127-43bb-876d-65d17218d471\") "
Jul 06 01:35:13.006843 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:13.006686    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1b03b23-0127-43bb-876d-65d17218d471-maas-api-tls\") pod \"a1b03b23-0127-43bb-876d-65d17218d471\" (UID: \"a1b03b23-0127-43bb-876d-65d17218d471\") "
Jul 06 01:35:13.006843 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:13.006765    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1b03b23-0127-43bb-876d-65d17218d471-openshift-service-ca\") pod \"a1b03b23-0127-43bb-876d-65d17218d471\" (UID: \"a1b03b23-0127-43bb-876d-65d17218d471\") "
Jul 06 01:35:13.007177 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:13.007118    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1b03b23-0127-43bb-876d-65d17218d471-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a1b03b23-0127-43bb-876d-65d17218d471" (UID: "a1b03b23-0127-43bb-876d-65d17218d471"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:35:13.008674 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:13.008650    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1b03b23-0127-43bb-876d-65d17218d471-kube-api-access-pqscq" (OuterVolumeSpecName: "kube-api-access-pqscq") pod "a1b03b23-0127-43bb-876d-65d17218d471" (UID: "a1b03b23-0127-43bb-876d-65d17218d471"). InnerVolumeSpecName "kube-api-access-pqscq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:35:13.008762 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:13.008740    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1b03b23-0127-43bb-876d-65d17218d471-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a1b03b23-0127-43bb-876d-65d17218d471" (UID: "a1b03b23-0127-43bb-876d-65d17218d471"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:35:13.108556 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:13.108516    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqscq\" (UniqueName: \"kubernetes.io/projected/a1b03b23-0127-43bb-876d-65d17218d471-kube-api-access-pqscq\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:35:13.108556 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:13.108548    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1b03b23-0127-43bb-876d-65d17218d471-maas-api-tls\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:35:13.108556 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:13.108561    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1b03b23-0127-43bb-876d-65d17218d471-openshift-service-ca\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:35:13.745583 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:13.745558    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-736613-8b9549b69-n2qhf"
Jul 06 01:35:13.746058 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:13.745586    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-736613-8b9549b69-n2qhf" event={"ID":"a1b03b23-0127-43bb-876d-65d17218d471","Type":"ContainerDied","Data":"a6a0edb21210028a33780fe51971e23b881e2b8595e385ebd383fe729ef4038f"}
Jul 06 01:35:13.746058 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:13.745652    2562 scope.go:117] "RemoveContainer" containerID="494a6dc6a98de421a6b5a73dd3a134e1079fa19e1c06f6d92d646478a60e9641"
Jul 06 01:35:13.767122 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:13.767095    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-736613-8b9549b69-n2qhf"]
Jul 06 01:35:13.771779 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:13.771755    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-736613-8b9549b69-n2qhf"]
Jul 06 01:35:14.752645 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:14.752612    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1b03b23-0127-43bb-876d-65d17218d471" path="/var/lib/kubelet/pods/a1b03b23-0127-43bb-876d-65d17218d471/volumes"
Jul 06 01:35:54.286016 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:54.285984    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"]
Jul 06 01:35:54.286572 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:54.286256    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct" podUID="6b5d71fa-f78e-472f-b12d-f21a0fa22701" containerName="istio-proxy" containerID="cri-o://33896b3f0a48031dba69726bb51bc683af4267a680974ca6be859f7d24ee2d8b" gracePeriod=30
Jul 06 01:35:55.486668 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:55.486635    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-c2d358-7fd6888b9c-26n2c"]
Jul 06 01:35:55.487138 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:55.486913    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-c2d358-7fd6888b9c-26n2c" podUID="c3575260-6b6a-4813-a99d-54715db3cf7f" containerName="maas-api" containerID="cri-o://7ed74e435ad48fc97869634e77f49ef3be3622d16b98423422d35c0eb1562655" gracePeriod=30
Jul 06 01:35:55.736767 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:55.736704    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-c2d358-7fd6888b9c-26n2c"
Jul 06 01:35:55.776796 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:55.776760    2562 patch_prober.go:28] interesting pod/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 01:35:55.776984 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:55.776819    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct" podUID="6b5d71fa-f78e-472f-b12d-f21a0fa22701" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 01:35:55.817404 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:55.817372    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3575260-6b6a-4813-a99d-54715db3cf7f-maas-api-tls\") pod \"c3575260-6b6a-4813-a99d-54715db3cf7f\" (UID: \"c3575260-6b6a-4813-a99d-54715db3cf7f\") "
Jul 06 01:35:55.817557 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:55.817479    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3575260-6b6a-4813-a99d-54715db3cf7f-openshift-service-ca\") pod \"c3575260-6b6a-4813-a99d-54715db3cf7f\" (UID: \"c3575260-6b6a-4813-a99d-54715db3cf7f\") "
Jul 06 01:35:55.817557 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:55.817505    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p68cl\" (UniqueName: \"kubernetes.io/projected/c3575260-6b6a-4813-a99d-54715db3cf7f-kube-api-access-p68cl\") pod \"c3575260-6b6a-4813-a99d-54715db3cf7f\" (UID: \"c3575260-6b6a-4813-a99d-54715db3cf7f\") "
Jul 06 01:35:55.817854 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:55.817825    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3575260-6b6a-4813-a99d-54715db3cf7f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c3575260-6b6a-4813-a99d-54715db3cf7f" (UID: "c3575260-6b6a-4813-a99d-54715db3cf7f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:35:55.819373 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:55.819351    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3575260-6b6a-4813-a99d-54715db3cf7f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c3575260-6b6a-4813-a99d-54715db3cf7f" (UID: "c3575260-6b6a-4813-a99d-54715db3cf7f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:35:55.819611 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:55.819592    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3575260-6b6a-4813-a99d-54715db3cf7f-kube-api-access-p68cl" (OuterVolumeSpecName: "kube-api-access-p68cl") pod "c3575260-6b6a-4813-a99d-54715db3cf7f" (UID: "c3575260-6b6a-4813-a99d-54715db3cf7f"). InnerVolumeSpecName "kube-api-access-p68cl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:35:55.918826 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:55.918793    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3575260-6b6a-4813-a99d-54715db3cf7f-openshift-service-ca\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:35:55.918826 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:55.918831    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p68cl\" (UniqueName: \"kubernetes.io/projected/c3575260-6b6a-4813-a99d-54715db3cf7f-kube-api-access-p68cl\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:35:55.919033 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:55.918841    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3575260-6b6a-4813-a99d-54715db3cf7f-maas-api-tls\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:35:55.961714 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:55.961683    2562 generic.go:356] "Generic (PLEG): container finished" podID="c3575260-6b6a-4813-a99d-54715db3cf7f" containerID="7ed74e435ad48fc97869634e77f49ef3be3622d16b98423422d35c0eb1562655" exitCode=0
Jul 06 01:35:55.961892 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:55.961728    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-c2d358-7fd6888b9c-26n2c"
Jul 06 01:35:55.961892 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:55.961776    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-c2d358-7fd6888b9c-26n2c" event={"ID":"c3575260-6b6a-4813-a99d-54715db3cf7f","Type":"ContainerDied","Data":"7ed74e435ad48fc97869634e77f49ef3be3622d16b98423422d35c0eb1562655"}
Jul 06 01:35:55.961892 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:55.961824    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-c2d358-7fd6888b9c-26n2c" event={"ID":"c3575260-6b6a-4813-a99d-54715db3cf7f","Type":"ContainerDied","Data":"a7556e479b1ade51e79042fb14ca83ee7f1f0bfc0e84f76c36501c4441376834"}
Jul 06 01:35:55.961892 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:55.961846    2562 scope.go:117] "RemoveContainer" containerID="7ed74e435ad48fc97869634e77f49ef3be3622d16b98423422d35c0eb1562655"
Jul 06 01:35:55.970838 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:55.970822    2562 scope.go:117] "RemoveContainer" containerID="7ed74e435ad48fc97869634e77f49ef3be3622d16b98423422d35c0eb1562655"
Jul 06 01:35:55.971098 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:35:55.971078    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ed74e435ad48fc97869634e77f49ef3be3622d16b98423422d35c0eb1562655\": container with ID starting with 7ed74e435ad48fc97869634e77f49ef3be3622d16b98423422d35c0eb1562655 not found: ID does not exist" containerID="7ed74e435ad48fc97869634e77f49ef3be3622d16b98423422d35c0eb1562655"
Jul 06 01:35:55.971201 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:55.971106    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ed74e435ad48fc97869634e77f49ef3be3622d16b98423422d35c0eb1562655"} err="failed to get container status \"7ed74e435ad48fc97869634e77f49ef3be3622d16b98423422d35c0eb1562655\": rpc error: code = NotFound desc = could not find container \"7ed74e435ad48fc97869634e77f49ef3be3622d16b98423422d35c0eb1562655\": container with ID starting with 7ed74e435ad48fc97869634e77f49ef3be3622d16b98423422d35c0eb1562655 not found: ID does not exist"
Jul 06 01:35:55.983994 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:55.983972    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-c2d358-7fd6888b9c-26n2c"]
Jul 06 01:35:55.987741 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:55.987674    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-c2d358-7fd6888b9c-26n2c"]
Jul 06 01:35:56.752974 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:56.752938    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3575260-6b6a-4813-a99d-54715db3cf7f" path="/var/lib/kubelet/pods/c3575260-6b6a-4813-a99d-54715db3cf7f/volumes"
Jul 06 01:35:59.540675 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:59.540650    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"
Jul 06 01:35:59.551992 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:59.551939    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b5d71fa-f78e-472f-b12d-f21a0fa22701-istio-token\") pod \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\" (UID: \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\") "
Jul 06 01:35:59.552094 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:59.551995    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b5d71fa-f78e-472f-b12d-f21a0fa22701-workload-socket\") pod \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\" (UID: \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\") "
Jul 06 01:35:59.552094 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:59.552025    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b5d71fa-f78e-472f-b12d-f21a0fa22701-istio-envoy\") pod \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\" (UID: \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\") "
Jul 06 01:35:59.552094 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:59.552067    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b5d71fa-f78e-472f-b12d-f21a0fa22701-workload-certs\") pod \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\" (UID: \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\") "
Jul 06 01:35:59.552094 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:59.552087    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b5d71fa-f78e-472f-b12d-f21a0fa22701-istio-podinfo\") pod \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\" (UID: \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\") "
Jul 06 01:35:59.552303 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:59.552103    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b5d71fa-f78e-472f-b12d-f21a0fa22701-istio-data\") pod \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\" (UID: \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\") "
Jul 06 01:35:59.552303 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:59.552127    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b5d71fa-f78e-472f-b12d-f21a0fa22701-credential-socket\") pod \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\" (UID: \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\") "
Jul 06 01:35:59.552303 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:59.552195    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4p5px\" (UniqueName: \"kubernetes.io/projected/6b5d71fa-f78e-472f-b12d-f21a0fa22701-kube-api-access-4p5px\") pod \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\" (UID: \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\") "
Jul 06 01:35:59.552303 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:59.552227    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b5d71fa-f78e-472f-b12d-f21a0fa22701-istiod-ca-cert\") pod \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\" (UID: \"6b5d71fa-f78e-472f-b12d-f21a0fa22701\") "
Jul 06 01:35:59.552507 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:59.552358    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b5d71fa-f78e-472f-b12d-f21a0fa22701-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6b5d71fa-f78e-472f-b12d-f21a0fa22701" (UID: "6b5d71fa-f78e-472f-b12d-f21a0fa22701"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:35:59.552507 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:59.552367    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b5d71fa-f78e-472f-b12d-f21a0fa22701-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6b5d71fa-f78e-472f-b12d-f21a0fa22701" (UID: "6b5d71fa-f78e-472f-b12d-f21a0fa22701"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:35:59.552621 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:59.552550    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b5d71fa-f78e-472f-b12d-f21a0fa22701-workload-socket\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:35:59.552621 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:59.552564    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b5d71fa-f78e-472f-b12d-f21a0fa22701-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6b5d71fa-f78e-472f-b12d-f21a0fa22701" (UID: "6b5d71fa-f78e-472f-b12d-f21a0fa22701"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:35:59.552621 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:59.552570    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b5d71fa-f78e-472f-b12d-f21a0fa22701-workload-certs\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:35:59.552780 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:59.552665    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b5d71fa-f78e-472f-b12d-f21a0fa22701-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6b5d71fa-f78e-472f-b12d-f21a0fa22701" (UID: "6b5d71fa-f78e-472f-b12d-f21a0fa22701"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:35:59.553264 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:59.553239    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b5d71fa-f78e-472f-b12d-f21a0fa22701-istio-data" (OuterVolumeSpecName: "istio-data") pod "6b5d71fa-f78e-472f-b12d-f21a0fa22701" (UID: "6b5d71fa-f78e-472f-b12d-f21a0fa22701"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:35:59.554372 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:59.554353    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6b5d71fa-f78e-472f-b12d-f21a0fa22701-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6b5d71fa-f78e-472f-b12d-f21a0fa22701" (UID: "6b5d71fa-f78e-472f-b12d-f21a0fa22701"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 01:35:59.554444 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:59.554365    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b5d71fa-f78e-472f-b12d-f21a0fa22701-kube-api-access-4p5px" (OuterVolumeSpecName: "kube-api-access-4p5px") pod "6b5d71fa-f78e-472f-b12d-f21a0fa22701" (UID: "6b5d71fa-f78e-472f-b12d-f21a0fa22701"). InnerVolumeSpecName "kube-api-access-4p5px". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:35:59.554570 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:59.554548    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b5d71fa-f78e-472f-b12d-f21a0fa22701-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6b5d71fa-f78e-472f-b12d-f21a0fa22701" (UID: "6b5d71fa-f78e-472f-b12d-f21a0fa22701"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:35:59.554670 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:59.554581    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b5d71fa-f78e-472f-b12d-f21a0fa22701-istio-token" (OuterVolumeSpecName: "istio-token") pod "6b5d71fa-f78e-472f-b12d-f21a0fa22701" (UID: "6b5d71fa-f78e-472f-b12d-f21a0fa22701"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:35:59.653333 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:59.653299    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b5d71fa-f78e-472f-b12d-f21a0fa22701-istio-podinfo\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:35:59.653333 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:59.653326    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b5d71fa-f78e-472f-b12d-f21a0fa22701-istio-data\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:35:59.653333 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:59.653335    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b5d71fa-f78e-472f-b12d-f21a0fa22701-credential-socket\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:35:59.653333 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:59.653346    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4p5px\" (UniqueName: \"kubernetes.io/projected/6b5d71fa-f78e-472f-b12d-f21a0fa22701-kube-api-access-4p5px\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:35:59.653608 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:59.653355    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b5d71fa-f78e-472f-b12d-f21a0fa22701-istiod-ca-cert\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:35:59.653608 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:59.653363    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b5d71fa-f78e-472f-b12d-f21a0fa22701-istio-token\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:35:59.653608 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:59.653371    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b5d71fa-f78e-472f-b12d-f21a0fa22701-istio-envoy\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:35:59.983886 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:59.983850    2562 generic.go:356] "Generic (PLEG): container finished" podID="6b5d71fa-f78e-472f-b12d-f21a0fa22701" containerID="33896b3f0a48031dba69726bb51bc683af4267a680974ca6be859f7d24ee2d8b" exitCode=0
Jul 06 01:35:59.984067 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:59.983902    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"
Jul 06 01:35:59.984067 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:59.983923    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct" event={"ID":"6b5d71fa-f78e-472f-b12d-f21a0fa22701","Type":"ContainerDied","Data":"33896b3f0a48031dba69726bb51bc683af4267a680974ca6be859f7d24ee2d8b"}
Jul 06 01:35:59.984067 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:59.983969    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct" event={"ID":"6b5d71fa-f78e-472f-b12d-f21a0fa22701","Type":"ContainerDied","Data":"f481573f6807c4a891bcea82d25d3834ebdedda44e8ead0228fa3a4682019067"}
Jul 06 01:35:59.984067 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:59.983994    2562 scope.go:117] "RemoveContainer" containerID="33896b3f0a48031dba69726bb51bc683af4267a680974ca6be859f7d24ee2d8b"
Jul 06 01:35:59.996510 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:35:59.996485    2562 scope.go:117] "RemoveContainer" containerID="3ee0072a62e928c5159ef83f069d7952209b6d40a4c6cf4bd57ec90de7ab1cda"
Jul 06 01:36:00.005024 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:00.004993    2562 scope.go:117] "RemoveContainer" containerID="33896b3f0a48031dba69726bb51bc683af4267a680974ca6be859f7d24ee2d8b"
Jul 06 01:36:00.005310 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:36:00.005290    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33896b3f0a48031dba69726bb51bc683af4267a680974ca6be859f7d24ee2d8b\": container with ID starting with 33896b3f0a48031dba69726bb51bc683af4267a680974ca6be859f7d24ee2d8b not found: ID does not exist" containerID="33896b3f0a48031dba69726bb51bc683af4267a680974ca6be859f7d24ee2d8b"
Jul 06 01:36:00.005367 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:00.005319    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33896b3f0a48031dba69726bb51bc683af4267a680974ca6be859f7d24ee2d8b"} err="failed to get container status \"33896b3f0a48031dba69726bb51bc683af4267a680974ca6be859f7d24ee2d8b\": rpc error: code = NotFound desc = could not find container \"33896b3f0a48031dba69726bb51bc683af4267a680974ca6be859f7d24ee2d8b\": container with ID starting with 33896b3f0a48031dba69726bb51bc683af4267a680974ca6be859f7d24ee2d8b not found: ID does not exist"
Jul 06 01:36:00.005367 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:00.005338    2562 scope.go:117] "RemoveContainer" containerID="3ee0072a62e928c5159ef83f069d7952209b6d40a4c6cf4bd57ec90de7ab1cda"
Jul 06 01:36:00.005550 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:36:00.005535    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ee0072a62e928c5159ef83f069d7952209b6d40a4c6cf4bd57ec90de7ab1cda\": container with ID starting with 3ee0072a62e928c5159ef83f069d7952209b6d40a4c6cf4bd57ec90de7ab1cda not found: ID does not exist" containerID="3ee0072a62e928c5159ef83f069d7952209b6d40a4c6cf4bd57ec90de7ab1cda"
Jul 06 01:36:00.005592 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:00.005554    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ee0072a62e928c5159ef83f069d7952209b6d40a4c6cf4bd57ec90de7ab1cda"} err="failed to get container status \"3ee0072a62e928c5159ef83f069d7952209b6d40a4c6cf4bd57ec90de7ab1cda\": rpc error: code = NotFound desc = could not find container \"3ee0072a62e928c5159ef83f069d7952209b6d40a4c6cf4bd57ec90de7ab1cda\": container with ID starting with 3ee0072a62e928c5159ef83f069d7952209b6d40a4c6cf4bd57ec90de7ab1cda not found: ID does not exist"
Jul 06 01:36:00.009560 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:00.009536    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"]
Jul 06 01:36:00.015828 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:00.015805    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-736613-openshift-default-6899c7b78f-jtgct"]
Jul 06 01:36:00.753076 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:00.753042    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b5d71fa-f78e-472f-b12d-f21a0fa22701" path="/var/lib/kubelet/pods/6b5d71fa-f78e-472f-b12d-f21a0fa22701/volumes"
Jul 06 01:36:01.311195 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:01.311143    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"]
Jul 06 01:36:01.311405 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:01.311382    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q" podUID="695f568a-0b02-4596-8713-dafaf1b2afad" containerName="istio-proxy" containerID="cri-o://ece45958a89a4018092c4638a45b3ead3c47524566b730ee076878557d07962c" gracePeriod=30
Jul 06 01:36:01.859845 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:01.859811    2562 patch_prober.go:28] interesting pod/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 01:36:01.860311 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:01.859883    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q" podUID="695f568a-0b02-4596-8713-dafaf1b2afad" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 01:36:02.149071 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.148973    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"]
Jul 06 01:36:02.149542 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.149527    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3575260-6b6a-4813-a99d-54715db3cf7f" containerName="maas-api"
Jul 06 01:36:02.149592 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.149545    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3575260-6b6a-4813-a99d-54715db3cf7f" containerName="maas-api"
Jul 06 01:36:02.149592 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.149561    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b5d71fa-f78e-472f-b12d-f21a0fa22701" containerName="istio-proxy"
Jul 06 01:36:02.149592 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.149570    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b5d71fa-f78e-472f-b12d-f21a0fa22701" containerName="istio-proxy"
Jul 06 01:36:02.149698 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.149614    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1b03b23-0127-43bb-876d-65d17218d471" containerName="maas-api"
Jul 06 01:36:02.149698 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.149622    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1b03b23-0127-43bb-876d-65d17218d471" containerName="maas-api"
Jul 06 01:36:02.149698 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.149695    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1b03b23-0127-43bb-876d-65d17218d471" containerName="maas-api"
Jul 06 01:36:02.149793 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.149707    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b5d71fa-f78e-472f-b12d-f21a0fa22701" containerName="istio-proxy"
Jul 06 01:36:02.149793 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.149718    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3575260-6b6a-4813-a99d-54715db3cf7f" containerName="maas-api"
Jul 06 01:36:02.149793 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.149727    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b5d71fa-f78e-472f-b12d-f21a0fa22701" containerName="istio-proxy"
Jul 06 01:36:02.154585 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.154562    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"
Jul 06 01:36:02.157025 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.156992    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-307471-openshift-default-dockercfg-c22ph\""
Jul 06 01:36:02.161861 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.161837    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"]
Jul 06 01:36:02.178015 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.177987    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-istio-data\") pod \"e2e-api-a-307471-openshift-default-57d8d75bff-8xht8\" (UID: \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\") " pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"
Jul 06 01:36:02.178220 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.178027    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-workload-certs\") pod \"e2e-api-a-307471-openshift-default-57d8d75bff-8xht8\" (UID: \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\") " pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"
Jul 06 01:36:02.178220 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.178063    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-istio-envoy\") pod \"e2e-api-a-307471-openshift-default-57d8d75bff-8xht8\" (UID: \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\") " pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"
Jul 06 01:36:02.178220 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.178186    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-istio-token\") pod \"e2e-api-a-307471-openshift-default-57d8d75bff-8xht8\" (UID: \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\") " pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"
Jul 06 01:36:02.178380 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.178239    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-istiod-ca-cert\") pod \"e2e-api-a-307471-openshift-default-57d8d75bff-8xht8\" (UID: \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\") " pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"
Jul 06 01:36:02.178380 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.178276    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-workload-socket\") pod \"e2e-api-a-307471-openshift-default-57d8d75bff-8xht8\" (UID: \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\") " pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"
Jul 06 01:36:02.178380 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.178300    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9lrr\" (UniqueName: \"kubernetes.io/projected/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-kube-api-access-c9lrr\") pod \"e2e-api-a-307471-openshift-default-57d8d75bff-8xht8\" (UID: \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\") " pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"
Jul 06 01:36:02.178380 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.178329    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-credential-socket\") pod \"e2e-api-a-307471-openshift-default-57d8d75bff-8xht8\" (UID: \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\") " pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"
Jul 06 01:36:02.178380 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.178378    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-istio-podinfo\") pod \"e2e-api-a-307471-openshift-default-57d8d75bff-8xht8\" (UID: \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\") " pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"
Jul 06 01:36:02.278999 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.278959    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-workload-certs\") pod \"e2e-api-a-307471-openshift-default-57d8d75bff-8xht8\" (UID: \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\") " pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"
Jul 06 01:36:02.279231 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.279039    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-istio-envoy\") pod \"e2e-api-a-307471-openshift-default-57d8d75bff-8xht8\" (UID: \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\") " pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"
Jul 06 01:36:02.279231 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.279096    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-istio-token\") pod \"e2e-api-a-307471-openshift-default-57d8d75bff-8xht8\" (UID: \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\") " pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"
Jul 06 01:36:02.279231 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.279136    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-istiod-ca-cert\") pod \"e2e-api-a-307471-openshift-default-57d8d75bff-8xht8\" (UID: \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\") " pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"
Jul 06 01:36:02.279231 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.279195    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-workload-socket\") pod \"e2e-api-a-307471-openshift-default-57d8d75bff-8xht8\" (UID: \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\") " pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"
Jul 06 01:36:02.279482 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.279307    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9lrr\" (UniqueName: \"kubernetes.io/projected/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-kube-api-access-c9lrr\") pod \"e2e-api-a-307471-openshift-default-57d8d75bff-8xht8\" (UID: \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\") " pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"
Jul 06 01:36:02.279482 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.279344    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-credential-socket\") pod \"e2e-api-a-307471-openshift-default-57d8d75bff-8xht8\" (UID: \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\") " pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"
Jul 06 01:36:02.279482 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.279399    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-istio-podinfo\") pod \"e2e-api-a-307471-openshift-default-57d8d75bff-8xht8\" (UID: \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\") " pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"
Jul 06 01:36:02.279482 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.279425    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-workload-certs\") pod \"e2e-api-a-307471-openshift-default-57d8d75bff-8xht8\" (UID: \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\") " pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"
Jul 06 01:36:02.279482 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.279443    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-istio-data\") pod \"e2e-api-a-307471-openshift-default-57d8d75bff-8xht8\" (UID: \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\") " pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"
Jul 06 01:36:02.279730 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.279494    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-workload-socket\") pod \"e2e-api-a-307471-openshift-default-57d8d75bff-8xht8\" (UID: \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\") " pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"
Jul 06 01:36:02.279730 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.279688    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-credential-socket\") pod \"e2e-api-a-307471-openshift-default-57d8d75bff-8xht8\" (UID: \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\") " pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"
Jul 06 01:36:02.279730 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.279697    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-istio-data\") pod \"e2e-api-a-307471-openshift-default-57d8d75bff-8xht8\" (UID: \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\") " pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"
Jul 06 01:36:02.279931 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.279914    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-istiod-ca-cert\") pod \"e2e-api-a-307471-openshift-default-57d8d75bff-8xht8\" (UID: \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\") " pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"
Jul 06 01:36:02.281376 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.281353    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-istio-envoy\") pod \"e2e-api-a-307471-openshift-default-57d8d75bff-8xht8\" (UID: \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\") " pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"
Jul 06 01:36:02.281778 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.281759    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-istio-podinfo\") pod \"e2e-api-a-307471-openshift-default-57d8d75bff-8xht8\" (UID: \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\") " pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"
Jul 06 01:36:02.288448 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.288427    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-istio-token\") pod \"e2e-api-a-307471-openshift-default-57d8d75bff-8xht8\" (UID: \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\") " pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"
Jul 06 01:36:02.288671 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.288647    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9lrr\" (UniqueName: \"kubernetes.io/projected/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-kube-api-access-c9lrr\") pod \"e2e-api-a-307471-openshift-default-57d8d75bff-8xht8\" (UID: \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\") " pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"
Jul 06 01:36:02.467447 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.467345    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"
Jul 06 01:36:02.609586 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.609552    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"]
Jul 06 01:36:02.613005 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:36:02.612976    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde534ce7_e446_497d_9d6e_ccbe1cdeaa96.slice/crio-83b269d418ea273006e59c7cb3b75829d3bec252e1eb26eee4d943b27ba87820 WatchSource:0}: Error finding container 83b269d418ea273006e59c7cb3b75829d3bec252e1eb26eee4d943b27ba87820: Status 404 returned error can't find the container with id 83b269d418ea273006e59c7cb3b75829d3bec252e1eb26eee4d943b27ba87820
Jul 06 01:36:02.615070 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.615038    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:36:02.615176 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.615099    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:36:02.615176 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:02.615161    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:36:03.000728 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:03.000692    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8" event={"ID":"de534ce7-e446-497d-9d6e-ccbe1cdeaa96","Type":"ContainerStarted","Data":"91d7816908d3f2b0c60b210fae44894ad1097f77bc54a01a8d2795e13efcf254"}
Jul 06 01:36:03.001158 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:03.000754    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8" event={"ID":"de534ce7-e446-497d-9d6e-ccbe1cdeaa96","Type":"ContainerStarted","Data":"83b269d418ea273006e59c7cb3b75829d3bec252e1eb26eee4d943b27ba87820"}
Jul 06 01:36:03.020842 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:03.020784    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8" podStartSLOduration=1.020763449 podStartE2EDuration="1.020763449s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:36:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:36:03.020692721 +0000 UTC m=+2194.831667971" watchObservedRunningTime="2026-07-06 01:36:03.020763449 +0000 UTC m=+2194.831738695"
Jul 06 01:36:03.468217 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:03.468185    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"
Jul 06 01:36:03.472962 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:03.472940    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"
Jul 06 01:36:04.006280 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:04.006252    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"
Jul 06 01:36:04.007210 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:04.007191    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"
Jul 06 01:36:05.078821 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:05.078787    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-307471-67db9f4c96-rgp69"]
Jul 06 01:36:05.079296 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:05.079278    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b5d71fa-f78e-472f-b12d-f21a0fa22701" containerName="istio-proxy"
Jul 06 01:36:05.079296 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:05.079291    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b5d71fa-f78e-472f-b12d-f21a0fa22701" containerName="istio-proxy"
Jul 06 01:36:05.082463 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:05.082446    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-307471-67db9f4c96-rgp69"
Jul 06 01:36:05.084922 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:05.084901    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-84mvh\""
Jul 06 01:36:05.085083 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:05.085059    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-307471-serving-cert\""
Jul 06 01:36:05.093840 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:05.093815    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-307471-67db9f4c96-rgp69"]
Jul 06 01:36:05.103116 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:05.103088    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mnn5\" (UniqueName: \"kubernetes.io/projected/2e3aa5b4-103d-48c6-a68b-9db65b8f5557-kube-api-access-6mnn5\") pod \"maas-api-e2e-api-a-307471-67db9f4c96-rgp69\" (UID: \"2e3aa5b4-103d-48c6-a68b-9db65b8f5557\") " pod="opendatahub/maas-api-e2e-api-a-307471-67db9f4c96-rgp69"
Jul 06 01:36:05.103272 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:05.103183    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e3aa5b4-103d-48c6-a68b-9db65b8f5557-openshift-service-ca\") pod \"maas-api-e2e-api-a-307471-67db9f4c96-rgp69\" (UID: \"2e3aa5b4-103d-48c6-a68b-9db65b8f5557\") " pod="opendatahub/maas-api-e2e-api-a-307471-67db9f4c96-rgp69"
Jul 06 01:36:05.103352 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:05.103301    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e3aa5b4-103d-48c6-a68b-9db65b8f5557-maas-api-tls\") pod \"maas-api-e2e-api-a-307471-67db9f4c96-rgp69\" (UID: \"2e3aa5b4-103d-48c6-a68b-9db65b8f5557\") " pod="opendatahub/maas-api-e2e-api-a-307471-67db9f4c96-rgp69"
Jul 06 01:36:05.204256 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:05.204220    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mnn5\" (UniqueName: \"kubernetes.io/projected/2e3aa5b4-103d-48c6-a68b-9db65b8f5557-kube-api-access-6mnn5\") pod \"maas-api-e2e-api-a-307471-67db9f4c96-rgp69\" (UID: \"2e3aa5b4-103d-48c6-a68b-9db65b8f5557\") " pod="opendatahub/maas-api-e2e-api-a-307471-67db9f4c96-rgp69"
Jul 06 01:36:05.204466 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:05.204275    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e3aa5b4-103d-48c6-a68b-9db65b8f5557-openshift-service-ca\") pod \"maas-api-e2e-api-a-307471-67db9f4c96-rgp69\" (UID: \"2e3aa5b4-103d-48c6-a68b-9db65b8f5557\") " pod="opendatahub/maas-api-e2e-api-a-307471-67db9f4c96-rgp69"
Jul 06 01:36:05.204466 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:05.204337    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e3aa5b4-103d-48c6-a68b-9db65b8f5557-maas-api-tls\") pod \"maas-api-e2e-api-a-307471-67db9f4c96-rgp69\" (UID: \"2e3aa5b4-103d-48c6-a68b-9db65b8f5557\") " pod="opendatahub/maas-api-e2e-api-a-307471-67db9f4c96-rgp69"
Jul 06 01:36:05.204584 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:36:05.204484    2562 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-a-307471-serving-cert: secret "maas-api-e2e-api-a-307471-serving-cert" not found
Jul 06 01:36:05.204584 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:36:05.204556    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e3aa5b4-103d-48c6-a68b-9db65b8f5557-maas-api-tls podName:2e3aa5b4-103d-48c6-a68b-9db65b8f5557 nodeName:}" failed. No retries permitted until 2026-07-06 01:36:05.704534199 +0000 UTC m=+2197.515509437 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2e3aa5b4-103d-48c6-a68b-9db65b8f5557-maas-api-tls") pod "maas-api-e2e-api-a-307471-67db9f4c96-rgp69" (UID: "2e3aa5b4-103d-48c6-a68b-9db65b8f5557") : secret "maas-api-e2e-api-a-307471-serving-cert" not found
Jul 06 01:36:05.205040 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:05.205023    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e3aa5b4-103d-48c6-a68b-9db65b8f5557-openshift-service-ca\") pod \"maas-api-e2e-api-a-307471-67db9f4c96-rgp69\" (UID: \"2e3aa5b4-103d-48c6-a68b-9db65b8f5557\") " pod="opendatahub/maas-api-e2e-api-a-307471-67db9f4c96-rgp69"
Jul 06 01:36:05.221892 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:05.221867    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mnn5\" (UniqueName: \"kubernetes.io/projected/2e3aa5b4-103d-48c6-a68b-9db65b8f5557-kube-api-access-6mnn5\") pod \"maas-api-e2e-api-a-307471-67db9f4c96-rgp69\" (UID: \"2e3aa5b4-103d-48c6-a68b-9db65b8f5557\") " pod="opendatahub/maas-api-e2e-api-a-307471-67db9f4c96-rgp69"
Jul 06 01:36:05.709915 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:05.709877    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e3aa5b4-103d-48c6-a68b-9db65b8f5557-maas-api-tls\") pod \"maas-api-e2e-api-a-307471-67db9f4c96-rgp69\" (UID: \"2e3aa5b4-103d-48c6-a68b-9db65b8f5557\") " pod="opendatahub/maas-api-e2e-api-a-307471-67db9f4c96-rgp69"
Jul 06 01:36:05.712277 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:05.712249    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e3aa5b4-103d-48c6-a68b-9db65b8f5557-maas-api-tls\") pod \"maas-api-e2e-api-a-307471-67db9f4c96-rgp69\" (UID: \"2e3aa5b4-103d-48c6-a68b-9db65b8f5557\") " pod="opendatahub/maas-api-e2e-api-a-307471-67db9f4c96-rgp69"
Jul 06 01:36:05.995143 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:05.995047    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-307471-67db9f4c96-rgp69"
Jul 06 01:36:06.345114 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:06.345091    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-307471-67db9f4c96-rgp69"]
Jul 06 01:36:06.367979 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:36:06.367948    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e3aa5b4_103d_48c6_a68b_9db65b8f5557.slice/crio-92625a693267a5beccb4c259e869c55a98d6c8b90041fbe2909ca07364ffff8e WatchSource:0}: Error finding container 92625a693267a5beccb4c259e869c55a98d6c8b90041fbe2909ca07364ffff8e: Status 404 returned error can't find the container with id 92625a693267a5beccb4c259e869c55a98d6c8b90041fbe2909ca07364ffff8e
Jul 06 01:36:06.571304 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:06.571278    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"
Jul 06 01:36:06.619661 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:06.619631    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/695f568a-0b02-4596-8713-dafaf1b2afad-istiod-ca-cert\") pod \"695f568a-0b02-4596-8713-dafaf1b2afad\" (UID: \"695f568a-0b02-4596-8713-dafaf1b2afad\") "
Jul 06 01:36:06.619849 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:06.619674    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/695f568a-0b02-4596-8713-dafaf1b2afad-workload-certs\") pod \"695f568a-0b02-4596-8713-dafaf1b2afad\" (UID: \"695f568a-0b02-4596-8713-dafaf1b2afad\") "
Jul 06 01:36:06.619849 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:06.619701    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/695f568a-0b02-4596-8713-dafaf1b2afad-workload-socket\") pod \"695f568a-0b02-4596-8713-dafaf1b2afad\" (UID: \"695f568a-0b02-4596-8713-dafaf1b2afad\") "
Jul 06 01:36:06.619849 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:06.619741    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/695f568a-0b02-4596-8713-dafaf1b2afad-credential-socket\") pod \"695f568a-0b02-4596-8713-dafaf1b2afad\" (UID: \"695f568a-0b02-4596-8713-dafaf1b2afad\") "
Jul 06 01:36:06.619849 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:06.619779    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/695f568a-0b02-4596-8713-dafaf1b2afad-istio-data\") pod \"695f568a-0b02-4596-8713-dafaf1b2afad\" (UID: \"695f568a-0b02-4596-8713-dafaf1b2afad\") "
Jul 06 01:36:06.619849 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:06.619813    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/695f568a-0b02-4596-8713-dafaf1b2afad-istio-envoy\") pod \"695f568a-0b02-4596-8713-dafaf1b2afad\" (UID: \"695f568a-0b02-4596-8713-dafaf1b2afad\") "
Jul 06 01:36:06.619849 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:06.619844    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/695f568a-0b02-4596-8713-dafaf1b2afad-istio-token\") pod \"695f568a-0b02-4596-8713-dafaf1b2afad\" (UID: \"695f568a-0b02-4596-8713-dafaf1b2afad\") "
Jul 06 01:36:06.620187 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:06.619886    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/695f568a-0b02-4596-8713-dafaf1b2afad-istio-podinfo\") pod \"695f568a-0b02-4596-8713-dafaf1b2afad\" (UID: \"695f568a-0b02-4596-8713-dafaf1b2afad\") "
Jul 06 01:36:06.620187 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:06.619909    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hj9b\" (UniqueName: \"kubernetes.io/projected/695f568a-0b02-4596-8713-dafaf1b2afad-kube-api-access-5hj9b\") pod \"695f568a-0b02-4596-8713-dafaf1b2afad\" (UID: \"695f568a-0b02-4596-8713-dafaf1b2afad\") "
Jul 06 01:36:06.620187 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:06.619990    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/695f568a-0b02-4596-8713-dafaf1b2afad-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "695f568a-0b02-4596-8713-dafaf1b2afad" (UID: "695f568a-0b02-4596-8713-dafaf1b2afad"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:36:06.620187 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:06.620032    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/695f568a-0b02-4596-8713-dafaf1b2afad-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "695f568a-0b02-4596-8713-dafaf1b2afad" (UID: "695f568a-0b02-4596-8713-dafaf1b2afad"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:36:06.620187 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:06.620127    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/695f568a-0b02-4596-8713-dafaf1b2afad-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "695f568a-0b02-4596-8713-dafaf1b2afad" (UID: "695f568a-0b02-4596-8713-dafaf1b2afad"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:36:06.620481 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:06.620324    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/695f568a-0b02-4596-8713-dafaf1b2afad-credential-socket\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:36:06.620481 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:06.620348    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/695f568a-0b02-4596-8713-dafaf1b2afad-istiod-ca-cert\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:36:06.620481 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:06.620361    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/695f568a-0b02-4596-8713-dafaf1b2afad-workload-certs\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:36:06.620639 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:06.620501    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/695f568a-0b02-4596-8713-dafaf1b2afad-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "695f568a-0b02-4596-8713-dafaf1b2afad" (UID: "695f568a-0b02-4596-8713-dafaf1b2afad"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:36:06.620701 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:06.620672    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/695f568a-0b02-4596-8713-dafaf1b2afad-istio-data" (OuterVolumeSpecName: "istio-data") pod "695f568a-0b02-4596-8713-dafaf1b2afad" (UID: "695f568a-0b02-4596-8713-dafaf1b2afad"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:36:06.622251 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:06.622221    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/695f568a-0b02-4596-8713-dafaf1b2afad-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "695f568a-0b02-4596-8713-dafaf1b2afad" (UID: "695f568a-0b02-4596-8713-dafaf1b2afad"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 01:36:06.622251 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:06.622231    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/695f568a-0b02-4596-8713-dafaf1b2afad-istio-token" (OuterVolumeSpecName: "istio-token") pod "695f568a-0b02-4596-8713-dafaf1b2afad" (UID: "695f568a-0b02-4596-8713-dafaf1b2afad"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:36:06.622435 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:06.622248    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/695f568a-0b02-4596-8713-dafaf1b2afad-kube-api-access-5hj9b" (OuterVolumeSpecName: "kube-api-access-5hj9b") pod "695f568a-0b02-4596-8713-dafaf1b2afad" (UID: "695f568a-0b02-4596-8713-dafaf1b2afad"). InnerVolumeSpecName "kube-api-access-5hj9b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:36:06.622435 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:06.622278    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/695f568a-0b02-4596-8713-dafaf1b2afad-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "695f568a-0b02-4596-8713-dafaf1b2afad" (UID: "695f568a-0b02-4596-8713-dafaf1b2afad"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:36:06.720752 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:06.720714    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/695f568a-0b02-4596-8713-dafaf1b2afad-istio-data\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:36:06.720752 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:06.720745    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/695f568a-0b02-4596-8713-dafaf1b2afad-istio-envoy\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:36:06.720752 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:06.720753    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/695f568a-0b02-4596-8713-dafaf1b2afad-istio-token\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:36:06.720752 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:06.720760    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/695f568a-0b02-4596-8713-dafaf1b2afad-istio-podinfo\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:36:06.721033 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:06.720769    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hj9b\" (UniqueName: \"kubernetes.io/projected/695f568a-0b02-4596-8713-dafaf1b2afad-kube-api-access-5hj9b\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:36:06.721033 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:06.720778    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/695f568a-0b02-4596-8713-dafaf1b2afad-workload-socket\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:36:07.023108 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:07.023066    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-307471-67db9f4c96-rgp69" event={"ID":"2e3aa5b4-103d-48c6-a68b-9db65b8f5557","Type":"ContainerStarted","Data":"035428219f7606c651887c4028c338ccc99e513380861a4882bffe3d31527adb"}
Jul 06 01:36:07.023291 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:07.023129    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-307471-67db9f4c96-rgp69" event={"ID":"2e3aa5b4-103d-48c6-a68b-9db65b8f5557","Type":"ContainerStarted","Data":"92625a693267a5beccb4c259e869c55a98d6c8b90041fbe2909ca07364ffff8e"}
Jul 06 01:36:07.023291 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:07.023264    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-307471-67db9f4c96-rgp69"
Jul 06 01:36:07.024775 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:07.024746    2562 generic.go:356] "Generic (PLEG): container finished" podID="695f568a-0b02-4596-8713-dafaf1b2afad" containerID="ece45958a89a4018092c4638a45b3ead3c47524566b730ee076878557d07962c" exitCode=0
Jul 06 01:36:07.024896 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:07.024789    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"
Jul 06 01:36:07.024896 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:07.024822    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q" event={"ID":"695f568a-0b02-4596-8713-dafaf1b2afad","Type":"ContainerDied","Data":"ece45958a89a4018092c4638a45b3ead3c47524566b730ee076878557d07962c"}
Jul 06 01:36:07.024896 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:07.024868    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q" event={"ID":"695f568a-0b02-4596-8713-dafaf1b2afad","Type":"ContainerDied","Data":"11a2a7d53fc5dd9c39d72a55ff726cf0332713a5415e722df63d09a3e2df97bf"}
Jul 06 01:36:07.024896 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:07.024889    2562 scope.go:117] "RemoveContainer" containerID="ece45958a89a4018092c4638a45b3ead3c47524566b730ee076878557d07962c"
Jul 06 01:36:07.034812 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:07.034791    2562 scope.go:117] "RemoveContainer" containerID="cfc079a80908f9faab6852e59354f8bc35a2164d9d46d562d83dfde4d23f6607"
Jul 06 01:36:07.039908 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:07.039870    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-307471-67db9f4c96-rgp69" podStartSLOduration=1.594826235 podStartE2EDuration="2.039856229s" totalImagesPullingTime="445.029994ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:36:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:36:07.037864389 +0000 UTC m=+2198.848839635" watchObservedRunningTime="2026-07-06 01:36:07.039856229 +0000 UTC m=+2198.850831501"
Jul 06 01:36:07.045834 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:07.045802    2562 scope.go:117] "RemoveContainer" containerID="ece45958a89a4018092c4638a45b3ead3c47524566b730ee076878557d07962c"
Jul 06 01:36:07.046113 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:36:07.046094    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ece45958a89a4018092c4638a45b3ead3c47524566b730ee076878557d07962c\": container with ID starting with ece45958a89a4018092c4638a45b3ead3c47524566b730ee076878557d07962c not found: ID does not exist" containerID="ece45958a89a4018092c4638a45b3ead3c47524566b730ee076878557d07962c"
Jul 06 01:36:07.046224 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:07.046126    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ece45958a89a4018092c4638a45b3ead3c47524566b730ee076878557d07962c"} err="failed to get container status \"ece45958a89a4018092c4638a45b3ead3c47524566b730ee076878557d07962c\": rpc error: code = NotFound desc = could not find container \"ece45958a89a4018092c4638a45b3ead3c47524566b730ee076878557d07962c\": container with ID starting with ece45958a89a4018092c4638a45b3ead3c47524566b730ee076878557d07962c not found: ID does not exist"
Jul 06 01:36:07.046224 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:07.046166    2562 scope.go:117] "RemoveContainer" containerID="cfc079a80908f9faab6852e59354f8bc35a2164d9d46d562d83dfde4d23f6607"
Jul 06 01:36:07.046480 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:36:07.046463    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfc079a80908f9faab6852e59354f8bc35a2164d9d46d562d83dfde4d23f6607\": container with ID starting with cfc079a80908f9faab6852e59354f8bc35a2164d9d46d562d83dfde4d23f6607 not found: ID does not exist" containerID="cfc079a80908f9faab6852e59354f8bc35a2164d9d46d562d83dfde4d23f6607"
Jul 06 01:36:07.046535 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:07.046486    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfc079a80908f9faab6852e59354f8bc35a2164d9d46d562d83dfde4d23f6607"} err="failed to get container status \"cfc079a80908f9faab6852e59354f8bc35a2164d9d46d562d83dfde4d23f6607\": rpc error: code = NotFound desc = could not find container \"cfc079a80908f9faab6852e59354f8bc35a2164d9d46d562d83dfde4d23f6607\": container with ID starting with cfc079a80908f9faab6852e59354f8bc35a2164d9d46d562d83dfde4d23f6607 not found: ID does not exist"
Jul 06 01:36:07.051045 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:07.051022    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"]
Jul 06 01:36:07.055074 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:07.055051    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-c2d358-openshift-default-5c747b989c-gmt6q"]
Jul 06 01:36:08.752845 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:08.752814    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="695f568a-0b02-4596-8713-dafaf1b2afad" path="/var/lib/kubelet/pods/695f568a-0b02-4596-8713-dafaf1b2afad/volumes"
Jul 06 01:36:10.218690 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:10.218652    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"]
Jul 06 01:36:10.219326 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:10.219306    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="695f568a-0b02-4596-8713-dafaf1b2afad" containerName="istio-proxy"
Jul 06 01:36:10.219382 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:10.219329    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="695f568a-0b02-4596-8713-dafaf1b2afad" containerName="istio-proxy"
Jul 06 01:36:10.219382 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:10.219346    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="695f568a-0b02-4596-8713-dafaf1b2afad" containerName="istio-proxy"
Jul 06 01:36:10.219382 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:10.219355    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="695f568a-0b02-4596-8713-dafaf1b2afad" containerName="istio-proxy"
Jul 06 01:36:10.219520 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:10.219489    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="695f568a-0b02-4596-8713-dafaf1b2afad" containerName="istio-proxy"
Jul 06 01:36:10.219520 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:10.219503    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="695f568a-0b02-4596-8713-dafaf1b2afad" containerName="istio-proxy"
Jul 06 01:36:10.224658 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:10.224639    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"
Jul 06 01:36:10.226797 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:10.226778    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-f76007-openshift-default-dockercfg-fdrgz\""
Jul 06 01:36:10.233942 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:10.233921    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"]
Jul 06 01:36:10.358771 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:10.358698    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d33831b-5a3f-40c1-81b3-a40143c7c379-istio-token\") pod \"e2e-api-b-f76007-openshift-default-7f99899fc-vxqph\" (UID: \"0d33831b-5a3f-40c1-81b3-a40143c7c379\") " pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"
Jul 06 01:36:10.359085 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:10.358824    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d33831b-5a3f-40c1-81b3-a40143c7c379-istiod-ca-cert\") pod \"e2e-api-b-f76007-openshift-default-7f99899fc-vxqph\" (UID: \"0d33831b-5a3f-40c1-81b3-a40143c7c379\") " pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"
Jul 06 01:36:10.359085 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:10.358881    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d33831b-5a3f-40c1-81b3-a40143c7c379-credential-socket\") pod \"e2e-api-b-f76007-openshift-default-7f99899fc-vxqph\" (UID: \"0d33831b-5a3f-40c1-81b3-a40143c7c379\") " pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"
Jul 06 01:36:10.359085 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:10.358963    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d33831b-5a3f-40c1-81b3-a40143c7c379-workload-certs\") pod \"e2e-api-b-f76007-openshift-default-7f99899fc-vxqph\" (UID: \"0d33831b-5a3f-40c1-81b3-a40143c7c379\") " pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"
Jul 06 01:36:10.359085 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:10.359032    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d33831b-5a3f-40c1-81b3-a40143c7c379-istio-podinfo\") pod \"e2e-api-b-f76007-openshift-default-7f99899fc-vxqph\" (UID: \"0d33831b-5a3f-40c1-81b3-a40143c7c379\") " pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"
Jul 06 01:36:10.359085 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:10.359075    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d33831b-5a3f-40c1-81b3-a40143c7c379-istio-data\") pod \"e2e-api-b-f76007-openshift-default-7f99899fc-vxqph\" (UID: \"0d33831b-5a3f-40c1-81b3-a40143c7c379\") " pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"
Jul 06 01:36:10.359424 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:10.359109    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk6zk\" (UniqueName: \"kubernetes.io/projected/0d33831b-5a3f-40c1-81b3-a40143c7c379-kube-api-access-sk6zk\") pod \"e2e-api-b-f76007-openshift-default-7f99899fc-vxqph\" (UID: \"0d33831b-5a3f-40c1-81b3-a40143c7c379\") " pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"
Jul 06 01:36:10.359424 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:10.359142    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d33831b-5a3f-40c1-81b3-a40143c7c379-istio-envoy\") pod \"e2e-api-b-f76007-openshift-default-7f99899fc-vxqph\" (UID: \"0d33831b-5a3f-40c1-81b3-a40143c7c379\") " pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"
Jul 06 01:36:10.359424 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:10.359224    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d33831b-5a3f-40c1-81b3-a40143c7c379-workload-socket\") pod \"e2e-api-b-f76007-openshift-default-7f99899fc-vxqph\" (UID: \"0d33831b-5a3f-40c1-81b3-a40143c7c379\") " pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"
Jul 06 01:36:10.460613 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:10.460584    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d33831b-5a3f-40c1-81b3-a40143c7c379-istiod-ca-cert\") pod \"e2e-api-b-f76007-openshift-default-7f99899fc-vxqph\" (UID: \"0d33831b-5a3f-40c1-81b3-a40143c7c379\") " pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"
Jul 06 01:36:10.460613 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:10.460616    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d33831b-5a3f-40c1-81b3-a40143c7c379-credential-socket\") pod \"e2e-api-b-f76007-openshift-default-7f99899fc-vxqph\" (UID: \"0d33831b-5a3f-40c1-81b3-a40143c7c379\") " pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"
Jul 06 01:36:10.460881 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:10.460658    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d33831b-5a3f-40c1-81b3-a40143c7c379-workload-certs\") pod \"e2e-api-b-f76007-openshift-default-7f99899fc-vxqph\" (UID: \"0d33831b-5a3f-40c1-81b3-a40143c7c379\") " pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"
Jul 06 01:36:10.460881 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:10.460692    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d33831b-5a3f-40c1-81b3-a40143c7c379-istio-podinfo\") pod \"e2e-api-b-f76007-openshift-default-7f99899fc-vxqph\" (UID: \"0d33831b-5a3f-40c1-81b3-a40143c7c379\") " pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"
Jul 06 01:36:10.460881 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:10.460721    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d33831b-5a3f-40c1-81b3-a40143c7c379-istio-data\") pod \"e2e-api-b-f76007-openshift-default-7f99899fc-vxqph\" (UID: \"0d33831b-5a3f-40c1-81b3-a40143c7c379\") " pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"
Jul 06 01:36:10.460881 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:10.460803    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk6zk\" (UniqueName: \"kubernetes.io/projected/0d33831b-5a3f-40c1-81b3-a40143c7c379-kube-api-access-sk6zk\") pod \"e2e-api-b-f76007-openshift-default-7f99899fc-vxqph\" (UID: \"0d33831b-5a3f-40c1-81b3-a40143c7c379\") " pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"
Jul 06 01:36:10.460881 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:10.460860    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d33831b-5a3f-40c1-81b3-a40143c7c379-istio-envoy\") pod \"e2e-api-b-f76007-openshift-default-7f99899fc-vxqph\" (UID: \"0d33831b-5a3f-40c1-81b3-a40143c7c379\") " pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"
Jul 06 01:36:10.461197 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:10.460898    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d33831b-5a3f-40c1-81b3-a40143c7c379-workload-socket\") pod \"e2e-api-b-f76007-openshift-default-7f99899fc-vxqph\" (UID: \"0d33831b-5a3f-40c1-81b3-a40143c7c379\") " pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"
Jul 06 01:36:10.461197 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:10.460931    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d33831b-5a3f-40c1-81b3-a40143c7c379-istio-token\") pod \"e2e-api-b-f76007-openshift-default-7f99899fc-vxqph\" (UID: \"0d33831b-5a3f-40c1-81b3-a40143c7c379\") " pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"
Jul 06 01:36:10.461197 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:10.461110    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d33831b-5a3f-40c1-81b3-a40143c7c379-credential-socket\") pod \"e2e-api-b-f76007-openshift-default-7f99899fc-vxqph\" (UID: \"0d33831b-5a3f-40c1-81b3-a40143c7c379\") " pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"
Jul 06 01:36:10.461396 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:10.461193    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d33831b-5a3f-40c1-81b3-a40143c7c379-istio-data\") pod \"e2e-api-b-f76007-openshift-default-7f99899fc-vxqph\" (UID: \"0d33831b-5a3f-40c1-81b3-a40143c7c379\") " pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"
Jul 06 01:36:10.461454 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:10.461428    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d33831b-5a3f-40c1-81b3-a40143c7c379-workload-certs\") pod \"e2e-api-b-f76007-openshift-default-7f99899fc-vxqph\" (UID: \"0d33831b-5a3f-40c1-81b3-a40143c7c379\") " pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"
Jul 06 01:36:10.461516 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:10.461489    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d33831b-5a3f-40c1-81b3-a40143c7c379-workload-socket\") pod \"e2e-api-b-f76007-openshift-default-7f99899fc-vxqph\" (UID: \"0d33831b-5a3f-40c1-81b3-a40143c7c379\") " pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"
Jul 06 01:36:10.461567 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:10.461514    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d33831b-5a3f-40c1-81b3-a40143c7c379-istiod-ca-cert\") pod \"e2e-api-b-f76007-openshift-default-7f99899fc-vxqph\" (UID: \"0d33831b-5a3f-40c1-81b3-a40143c7c379\") " pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"
Jul 06 01:36:10.463093 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:10.463060    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d33831b-5a3f-40c1-81b3-a40143c7c379-istio-envoy\") pod \"e2e-api-b-f76007-openshift-default-7f99899fc-vxqph\" (UID: \"0d33831b-5a3f-40c1-81b3-a40143c7c379\") " pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"
Jul 06 01:36:10.463458 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:10.463439    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d33831b-5a3f-40c1-81b3-a40143c7c379-istio-podinfo\") pod \"e2e-api-b-f76007-openshift-default-7f99899fc-vxqph\" (UID: \"0d33831b-5a3f-40c1-81b3-a40143c7c379\") " pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"
Jul 06 01:36:10.468263 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:10.468241    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d33831b-5a3f-40c1-81b3-a40143c7c379-istio-token\") pod \"e2e-api-b-f76007-openshift-default-7f99899fc-vxqph\" (UID: \"0d33831b-5a3f-40c1-81b3-a40143c7c379\") " pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"
Jul 06 01:36:10.468368 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:10.468283    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk6zk\" (UniqueName: \"kubernetes.io/projected/0d33831b-5a3f-40c1-81b3-a40143c7c379-kube-api-access-sk6zk\") pod \"e2e-api-b-f76007-openshift-default-7f99899fc-vxqph\" (UID: \"0d33831b-5a3f-40c1-81b3-a40143c7c379\") " pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"
Jul 06 01:36:10.537427 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:10.537335    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"
Jul 06 01:36:10.678514 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:10.678491    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"]
Jul 06 01:36:10.681124 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:36:10.681097    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d33831b_5a3f_40c1_81b3_a40143c7c379.slice/crio-c0fb151ec598ef407a0fbbcaa9d8fd44e33b2bb2ef80c33fd743d8857e123a46 WatchSource:0}: Error finding container c0fb151ec598ef407a0fbbcaa9d8fd44e33b2bb2ef80c33fd743d8857e123a46: Status 404 returned error can't find the container with id c0fb151ec598ef407a0fbbcaa9d8fd44e33b2bb2ef80c33fd743d8857e123a46
Jul 06 01:36:10.683461 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:10.683428    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:36:10.683564 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:10.683497    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:36:10.683564 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:10.683527    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:36:11.045769 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:11.045731    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph" event={"ID":"0d33831b-5a3f-40c1-81b3-a40143c7c379","Type":"ContainerStarted","Data":"364f18c48c8459df878589496ab154ebe5c160510e6fcc520c7ff70202a0aea0"}
Jul 06 01:36:11.045975 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:11.045790    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph" event={"ID":"0d33831b-5a3f-40c1-81b3-a40143c7c379","Type":"ContainerStarted","Data":"c0fb151ec598ef407a0fbbcaa9d8fd44e33b2bb2ef80c33fd743d8857e123a46"}
Jul 06 01:36:11.068641 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:11.068594    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph" podStartSLOduration=1.068579307 podStartE2EDuration="1.068579307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:36:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:36:11.065876184 +0000 UTC m=+2202.876851427" watchObservedRunningTime="2026-07-06 01:36:11.068579307 +0000 UTC m=+2202.879554550"
Jul 06 01:36:11.538225 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:11.538177    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"
Jul 06 01:36:11.542661 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:11.542637    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"
Jul 06 01:36:12.050666 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:12.050630    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"
Jul 06 01:36:12.051611 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:12.051588    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"
Jul 06 01:36:13.041657 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:13.041629    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-307471-67db9f4c96-rgp69"
Jul 06 01:36:13.170215 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:13.170181    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-f76007-b665db8b5-rvggx"]
Jul 06 01:36:13.174022 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:13.174001    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-f76007-b665db8b5-rvggx"
Jul 06 01:36:13.176543 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:13.176524    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-f76007-serving-cert\""
Jul 06 01:36:13.187723 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:13.187696    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-f76007-b665db8b5-rvggx"]
Jul 06 01:36:13.289211 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:13.289173    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/718b80d0-dbc1-4214-bf65-a2327f81f2b4-openshift-service-ca\") pod \"maas-api-e2e-api-b-f76007-b665db8b5-rvggx\" (UID: \"718b80d0-dbc1-4214-bf65-a2327f81f2b4\") " pod="opendatahub/maas-api-e2e-api-b-f76007-b665db8b5-rvggx"
Jul 06 01:36:13.289418 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:13.289256    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xq6f\" (UniqueName: \"kubernetes.io/projected/718b80d0-dbc1-4214-bf65-a2327f81f2b4-kube-api-access-7xq6f\") pod \"maas-api-e2e-api-b-f76007-b665db8b5-rvggx\" (UID: \"718b80d0-dbc1-4214-bf65-a2327f81f2b4\") " pod="opendatahub/maas-api-e2e-api-b-f76007-b665db8b5-rvggx"
Jul 06 01:36:13.289418 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:13.289325    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/718b80d0-dbc1-4214-bf65-a2327f81f2b4-maas-api-tls\") pod \"maas-api-e2e-api-b-f76007-b665db8b5-rvggx\" (UID: \"718b80d0-dbc1-4214-bf65-a2327f81f2b4\") " pod="opendatahub/maas-api-e2e-api-b-f76007-b665db8b5-rvggx"
Jul 06 01:36:13.390595 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:13.390552    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xq6f\" (UniqueName: \"kubernetes.io/projected/718b80d0-dbc1-4214-bf65-a2327f81f2b4-kube-api-access-7xq6f\") pod \"maas-api-e2e-api-b-f76007-b665db8b5-rvggx\" (UID: \"718b80d0-dbc1-4214-bf65-a2327f81f2b4\") " pod="opendatahub/maas-api-e2e-api-b-f76007-b665db8b5-rvggx"
Jul 06 01:36:13.390799 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:13.390622    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/718b80d0-dbc1-4214-bf65-a2327f81f2b4-maas-api-tls\") pod \"maas-api-e2e-api-b-f76007-b665db8b5-rvggx\" (UID: \"718b80d0-dbc1-4214-bf65-a2327f81f2b4\") " pod="opendatahub/maas-api-e2e-api-b-f76007-b665db8b5-rvggx"
Jul 06 01:36:13.390799 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:13.390725    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/718b80d0-dbc1-4214-bf65-a2327f81f2b4-openshift-service-ca\") pod \"maas-api-e2e-api-b-f76007-b665db8b5-rvggx\" (UID: \"718b80d0-dbc1-4214-bf65-a2327f81f2b4\") " pod="opendatahub/maas-api-e2e-api-b-f76007-b665db8b5-rvggx"
Jul 06 01:36:13.391391 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:13.391367    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/718b80d0-dbc1-4214-bf65-a2327f81f2b4-openshift-service-ca\") pod \"maas-api-e2e-api-b-f76007-b665db8b5-rvggx\" (UID: \"718b80d0-dbc1-4214-bf65-a2327f81f2b4\") " pod="opendatahub/maas-api-e2e-api-b-f76007-b665db8b5-rvggx"
Jul 06 01:36:13.393095 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:13.393075    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/718b80d0-dbc1-4214-bf65-a2327f81f2b4-maas-api-tls\") pod \"maas-api-e2e-api-b-f76007-b665db8b5-rvggx\" (UID: \"718b80d0-dbc1-4214-bf65-a2327f81f2b4\") " pod="opendatahub/maas-api-e2e-api-b-f76007-b665db8b5-rvggx"
Jul 06 01:36:13.398093 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:13.398069    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xq6f\" (UniqueName: \"kubernetes.io/projected/718b80d0-dbc1-4214-bf65-a2327f81f2b4-kube-api-access-7xq6f\") pod \"maas-api-e2e-api-b-f76007-b665db8b5-rvggx\" (UID: \"718b80d0-dbc1-4214-bf65-a2327f81f2b4\") " pod="opendatahub/maas-api-e2e-api-b-f76007-b665db8b5-rvggx"
Jul 06 01:36:13.485162 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:13.485126    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-f76007-b665db8b5-rvggx"
Jul 06 01:36:13.640695 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:13.640591    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-f76007-b665db8b5-rvggx"]
Jul 06 01:36:13.644359 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:36:13.644319    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod718b80d0_dbc1_4214_bf65_a2327f81f2b4.slice/crio-9127f6af9fa7144ab6edad510305bf0d4fade64c2e7dd6b5036e18561a3cab68 WatchSource:0}: Error finding container 9127f6af9fa7144ab6edad510305bf0d4fade64c2e7dd6b5036e18561a3cab68: Status 404 returned error can't find the container with id 9127f6af9fa7144ab6edad510305bf0d4fade64c2e7dd6b5036e18561a3cab68
Jul 06 01:36:14.064131 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:14.064097    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-f76007-b665db8b5-rvggx" event={"ID":"718b80d0-dbc1-4214-bf65-a2327f81f2b4","Type":"ContainerStarted","Data":"5e43fa475c99d1c57f4ae454c0d90a4a85bdb1eedd932094a60f2714217f1d59"}
Jul 06 01:36:14.064635 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:14.064174    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-f76007-b665db8b5-rvggx" event={"ID":"718b80d0-dbc1-4214-bf65-a2327f81f2b4","Type":"ContainerStarted","Data":"9127f6af9fa7144ab6edad510305bf0d4fade64c2e7dd6b5036e18561a3cab68"}
Jul 06 01:36:14.064635 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:14.064423    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-f76007-b665db8b5-rvggx"
Jul 06 01:36:14.100107 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:14.100058    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-f76007-b665db8b5-rvggx" podStartSLOduration=0.768067475 podStartE2EDuration="1.100042346s" totalImagesPullingTime="331.974871ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:36:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:36:14.098106185 +0000 UTC m=+2205.909081429" watchObservedRunningTime="2026-07-06 01:36:14.100042346 +0000 UTC m=+2205.911017589"
Jul 06 01:36:18.086342 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:18.086249    2562 generic.go:356] "Generic (PLEG): container finished" podID="de534ce7-e446-497d-9d6e-ccbe1cdeaa96" containerID="91d7816908d3f2b0c60b210fae44894ad1097f77bc54a01a8d2795e13efcf254" exitCode=0
Jul 06 01:36:18.086342 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:18.086317    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8" event={"ID":"de534ce7-e446-497d-9d6e-ccbe1cdeaa96","Type":"ContainerDied","Data":"91d7816908d3f2b0c60b210fae44894ad1097f77bc54a01a8d2795e13efcf254"}
Jul 06 01:36:18.086779 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:18.086726    2562 scope.go:117] "RemoveContainer" containerID="91d7816908d3f2b0c60b210fae44894ad1097f77bc54a01a8d2795e13efcf254"
Jul 06 01:36:18.087807 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:18.087778    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:36:18.087868 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:18.087848    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:36:18.087907 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:18.087881    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:36:19.007211 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:19.007179    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"
Jul 06 01:36:19.093516 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:19.093481    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8" event={"ID":"de534ce7-e446-497d-9d6e-ccbe1cdeaa96","Type":"ContainerStarted","Data":"3fdd9e81da62a41779a7b82ef9e7e15fc5759b4a3f92acb50dc35cc99f529fb1"}
Jul 06 01:36:19.467618 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:19.467592    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"
Jul 06 01:36:19.468670 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:19.468646    2562 patch_prober.go:28] interesting pod/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 06 01:36:19.468756 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:19.468692    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8" podUID="de534ce7-e446-497d-9d6e-ccbe1cdeaa96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 06 01:36:20.074634 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:20.074604    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-f76007-b665db8b5-rvggx"
Jul 06 01:36:20.468116 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:20.468066    2562 patch_prober.go:28] interesting pod/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 06 01:36:20.468547 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:20.468131    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8" podUID="de534ce7-e446-497d-9d6e-ccbe1cdeaa96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 06 01:36:21.468281 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:21.468249    2562 patch_prober.go:28] interesting pod/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 06 01:36:21.468753 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:21.468719    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8" podUID="de534ce7-e446-497d-9d6e-ccbe1cdeaa96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 06 01:36:22.468466 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:22.468426    2562 patch_prober.go:28] interesting pod/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 06 01:36:22.468852 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:22.468480    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8" podUID="de534ce7-e446-497d-9d6e-ccbe1cdeaa96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 06 01:36:23.471752 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:23.471712    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"
Jul 06 01:36:23.472127 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:23.472020    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"
Jul 06 01:36:23.472723 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:23.472709    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"
Jul 06 01:36:26.362112 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:26.362075    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-307471-67db9f4c96-rgp69"]
Jul 06 01:36:26.364447 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:26.362426    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-307471-67db9f4c96-rgp69" podUID="2e3aa5b4-103d-48c6-a68b-9db65b8f5557" containerName="maas-api" containerID="cri-o://035428219f7606c651887c4028c338ccc99e513380861a4882bffe3d31527adb" gracePeriod=30
Jul 06 01:36:26.616178 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:26.616103    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-307471-67db9f4c96-rgp69"
Jul 06 01:36:26.729191 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:26.729136    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e3aa5b4-103d-48c6-a68b-9db65b8f5557-openshift-service-ca\") pod \"2e3aa5b4-103d-48c6-a68b-9db65b8f5557\" (UID: \"2e3aa5b4-103d-48c6-a68b-9db65b8f5557\") "
Jul 06 01:36:26.729365 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:26.729206    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e3aa5b4-103d-48c6-a68b-9db65b8f5557-maas-api-tls\") pod \"2e3aa5b4-103d-48c6-a68b-9db65b8f5557\" (UID: \"2e3aa5b4-103d-48c6-a68b-9db65b8f5557\") "
Jul 06 01:36:26.729365 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:26.729264    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mnn5\" (UniqueName: \"kubernetes.io/projected/2e3aa5b4-103d-48c6-a68b-9db65b8f5557-kube-api-access-6mnn5\") pod \"2e3aa5b4-103d-48c6-a68b-9db65b8f5557\" (UID: \"2e3aa5b4-103d-48c6-a68b-9db65b8f5557\") "
Jul 06 01:36:26.729623 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:26.729600    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e3aa5b4-103d-48c6-a68b-9db65b8f5557-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2e3aa5b4-103d-48c6-a68b-9db65b8f5557" (UID: "2e3aa5b4-103d-48c6-a68b-9db65b8f5557"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:36:26.731235 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:26.731215    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e3aa5b4-103d-48c6-a68b-9db65b8f5557-kube-api-access-6mnn5" (OuterVolumeSpecName: "kube-api-access-6mnn5") pod "2e3aa5b4-103d-48c6-a68b-9db65b8f5557" (UID: "2e3aa5b4-103d-48c6-a68b-9db65b8f5557"). InnerVolumeSpecName "kube-api-access-6mnn5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:36:26.731299 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:26.731251    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e3aa5b4-103d-48c6-a68b-9db65b8f5557-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2e3aa5b4-103d-48c6-a68b-9db65b8f5557" (UID: "2e3aa5b4-103d-48c6-a68b-9db65b8f5557"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:36:26.830677 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:26.830639    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e3aa5b4-103d-48c6-a68b-9db65b8f5557-openshift-service-ca\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:36:26.830677 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:26.830672    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e3aa5b4-103d-48c6-a68b-9db65b8f5557-maas-api-tls\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:36:26.830677 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:26.830681    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mnn5\" (UniqueName: \"kubernetes.io/projected/2e3aa5b4-103d-48c6-a68b-9db65b8f5557-kube-api-access-6mnn5\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:36:27.052747 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:27.052651    2562 patch_prober.go:28] interesting pod/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 06 01:36:27.052747 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:27.052703    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph" podUID="0d33831b-5a3f-40c1-81b3-a40143c7c379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 06 01:36:27.141951 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:27.141920    2562 generic.go:356] "Generic (PLEG): container finished" podID="0d33831b-5a3f-40c1-81b3-a40143c7c379" containerID="364f18c48c8459df878589496ab154ebe5c160510e6fcc520c7ff70202a0aea0" exitCode=0
Jul 06 01:36:27.142135 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:27.141994    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph" event={"ID":"0d33831b-5a3f-40c1-81b3-a40143c7c379","Type":"ContainerDied","Data":"364f18c48c8459df878589496ab154ebe5c160510e6fcc520c7ff70202a0aea0"}
Jul 06 01:36:27.142468 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:27.142446    2562 scope.go:117] "RemoveContainer" containerID="364f18c48c8459df878589496ab154ebe5c160510e6fcc520c7ff70202a0aea0"
Jul 06 01:36:27.143352 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:27.143329    2562 generic.go:356] "Generic (PLEG): container finished" podID="2e3aa5b4-103d-48c6-a68b-9db65b8f5557" containerID="035428219f7606c651887c4028c338ccc99e513380861a4882bffe3d31527adb" exitCode=0
Jul 06 01:36:27.143446 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:27.143407    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-307471-67db9f4c96-rgp69"
Jul 06 01:36:27.143496 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:27.143446    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-307471-67db9f4c96-rgp69" event={"ID":"2e3aa5b4-103d-48c6-a68b-9db65b8f5557","Type":"ContainerDied","Data":"035428219f7606c651887c4028c338ccc99e513380861a4882bffe3d31527adb"}
Jul 06 01:36:27.143538 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:27.143498    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-307471-67db9f4c96-rgp69" event={"ID":"2e3aa5b4-103d-48c6-a68b-9db65b8f5557","Type":"ContainerDied","Data":"92625a693267a5beccb4c259e869c55a98d6c8b90041fbe2909ca07364ffff8e"}
Jul 06 01:36:27.143538 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:27.143528    2562 scope.go:117] "RemoveContainer" containerID="035428219f7606c651887c4028c338ccc99e513380861a4882bffe3d31527adb"
Jul 06 01:36:27.143612 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:27.143569    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:36:27.143672 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:27.143655    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:36:27.143722 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:27.143704    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:36:27.155317 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:27.155270    2562 scope.go:117] "RemoveContainer" containerID="035428219f7606c651887c4028c338ccc99e513380861a4882bffe3d31527adb"
Jul 06 01:36:27.155565 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:36:27.155532    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"035428219f7606c651887c4028c338ccc99e513380861a4882bffe3d31527adb\": container with ID starting with 035428219f7606c651887c4028c338ccc99e513380861a4882bffe3d31527adb not found: ID does not exist" containerID="035428219f7606c651887c4028c338ccc99e513380861a4882bffe3d31527adb"
Jul 06 01:36:27.155633 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:27.155565    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"035428219f7606c651887c4028c338ccc99e513380861a4882bffe3d31527adb"} err="failed to get container status \"035428219f7606c651887c4028c338ccc99e513380861a4882bffe3d31527adb\": rpc error: code = NotFound desc = could not find container \"035428219f7606c651887c4028c338ccc99e513380861a4882bffe3d31527adb\": container with ID starting with 035428219f7606c651887c4028c338ccc99e513380861a4882bffe3d31527adb not found: ID does not exist"
Jul 06 01:36:27.178121 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:27.178092    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-307471-67db9f4c96-rgp69"]
Jul 06 01:36:27.183384 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:27.183350    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-307471-67db9f4c96-rgp69"]
Jul 06 01:36:28.150173 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:28.150118    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph" event={"ID":"0d33831b-5a3f-40c1-81b3-a40143c7c379","Type":"ContainerStarted","Data":"b5690992d59ccb027989100ac95089c8be1bfe5e3389b2a613b9773207cb7265"}
Jul 06 01:36:28.538113 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:28.538019    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"
Jul 06 01:36:28.538456 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:28.538281    2562 patch_prober.go:28] interesting pod/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 06 01:36:28.538576 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:28.538496    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph" podUID="0d33831b-5a3f-40c1-81b3-a40143c7c379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 06 01:36:28.752172 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:28.752114    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e3aa5b4-103d-48c6-a68b-9db65b8f5557" path="/var/lib/kubelet/pods/2e3aa5b4-103d-48c6-a68b-9db65b8f5557/volumes"
Jul 06 01:36:29.538465 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:29.538431    2562 patch_prober.go:28] interesting pod/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 06 01:36:29.538860 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:29.538484    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph" podUID="0d33831b-5a3f-40c1-81b3-a40143c7c379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 06 01:36:30.538431 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:30.538395    2562 patch_prober.go:28] interesting pod/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 06 01:36:30.538620 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:30.538455    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph" podUID="0d33831b-5a3f-40c1-81b3-a40143c7c379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 06 01:36:31.538667 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:31.538631    2562 patch_prober.go:28] interesting pod/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 06 01:36:31.539071 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:31.538686    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph" podUID="0d33831b-5a3f-40c1-81b3-a40143c7c379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 06 01:36:31.779328 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:31.779293    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"]
Jul 06 01:36:31.779552 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:31.779525    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8" podUID="de534ce7-e446-497d-9d6e-ccbe1cdeaa96" containerName="istio-proxy" containerID="cri-o://3fdd9e81da62a41779a7b82ef9e7e15fc5759b4a3f92acb50dc35cc99f529fb1" gracePeriod=30
Jul 06 01:36:32.541937 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:32.541912    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"
Jul 06 01:36:32.542389 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:32.542272    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"
Jul 06 01:36:32.542956 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:32.542939    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"
Jul 06 01:36:32.852353 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:32.852323    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-f76007-b665db8b5-rvggx"]
Jul 06 01:36:32.852591 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:32.852564    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-f76007-b665db8b5-rvggx" podUID="718b80d0-dbc1-4214-bf65-a2327f81f2b4" containerName="maas-api" containerID="cri-o://5e43fa475c99d1c57f4ae454c0d90a4a85bdb1eedd932094a60f2714217f1d59" gracePeriod=30
Jul 06 01:36:33.105119 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:33.105058    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-f76007-b665db8b5-rvggx"
Jul 06 01:36:33.179284 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:33.179249    2562 generic.go:356] "Generic (PLEG): container finished" podID="718b80d0-dbc1-4214-bf65-a2327f81f2b4" containerID="5e43fa475c99d1c57f4ae454c0d90a4a85bdb1eedd932094a60f2714217f1d59" exitCode=0
Jul 06 01:36:33.179472 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:33.179298    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-f76007-b665db8b5-rvggx"
Jul 06 01:36:33.179472 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:33.179330    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-f76007-b665db8b5-rvggx" event={"ID":"718b80d0-dbc1-4214-bf65-a2327f81f2b4","Type":"ContainerDied","Data":"5e43fa475c99d1c57f4ae454c0d90a4a85bdb1eedd932094a60f2714217f1d59"}
Jul 06 01:36:33.179472 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:33.179380    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-f76007-b665db8b5-rvggx" event={"ID":"718b80d0-dbc1-4214-bf65-a2327f81f2b4","Type":"ContainerDied","Data":"9127f6af9fa7144ab6edad510305bf0d4fade64c2e7dd6b5036e18561a3cab68"}
Jul 06 01:36:33.179472 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:33.179403    2562 scope.go:117] "RemoveContainer" containerID="5e43fa475c99d1c57f4ae454c0d90a4a85bdb1eedd932094a60f2714217f1d59"
Jul 06 01:36:33.187828 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:33.187816    2562 scope.go:117] "RemoveContainer" containerID="5e43fa475c99d1c57f4ae454c0d90a4a85bdb1eedd932094a60f2714217f1d59"
Jul 06 01:36:33.188074 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:36:33.188053    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e43fa475c99d1c57f4ae454c0d90a4a85bdb1eedd932094a60f2714217f1d59\": container with ID starting with 5e43fa475c99d1c57f4ae454c0d90a4a85bdb1eedd932094a60f2714217f1d59 not found: ID does not exist" containerID="5e43fa475c99d1c57f4ae454c0d90a4a85bdb1eedd932094a60f2714217f1d59"
Jul 06 01:36:33.188195 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:33.188080    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e43fa475c99d1c57f4ae454c0d90a4a85bdb1eedd932094a60f2714217f1d59"} err="failed to get container status \"5e43fa475c99d1c57f4ae454c0d90a4a85bdb1eedd932094a60f2714217f1d59\": rpc error: code = NotFound desc = could not find container \"5e43fa475c99d1c57f4ae454c0d90a4a85bdb1eedd932094a60f2714217f1d59\": container with ID starting with 5e43fa475c99d1c57f4ae454c0d90a4a85bdb1eedd932094a60f2714217f1d59 not found: ID does not exist"
Jul 06 01:36:33.290790 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:33.290761    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/718b80d0-dbc1-4214-bf65-a2327f81f2b4-openshift-service-ca\") pod \"718b80d0-dbc1-4214-bf65-a2327f81f2b4\" (UID: \"718b80d0-dbc1-4214-bf65-a2327f81f2b4\") "
Jul 06 01:36:33.290988 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:33.290836    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xq6f\" (UniqueName: \"kubernetes.io/projected/718b80d0-dbc1-4214-bf65-a2327f81f2b4-kube-api-access-7xq6f\") pod \"718b80d0-dbc1-4214-bf65-a2327f81f2b4\" (UID: \"718b80d0-dbc1-4214-bf65-a2327f81f2b4\") "
Jul 06 01:36:33.290988 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:33.290898    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/718b80d0-dbc1-4214-bf65-a2327f81f2b4-maas-api-tls\") pod \"718b80d0-dbc1-4214-bf65-a2327f81f2b4\" (UID: \"718b80d0-dbc1-4214-bf65-a2327f81f2b4\") "
Jul 06 01:36:33.291213 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:33.291190    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/718b80d0-dbc1-4214-bf65-a2327f81f2b4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "718b80d0-dbc1-4214-bf65-a2327f81f2b4" (UID: "718b80d0-dbc1-4214-bf65-a2327f81f2b4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:36:33.292949 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:33.292930    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/718b80d0-dbc1-4214-bf65-a2327f81f2b4-kube-api-access-7xq6f" (OuterVolumeSpecName: "kube-api-access-7xq6f") pod "718b80d0-dbc1-4214-bf65-a2327f81f2b4" (UID: "718b80d0-dbc1-4214-bf65-a2327f81f2b4"). InnerVolumeSpecName "kube-api-access-7xq6f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:36:33.293029 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:33.292963    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/718b80d0-dbc1-4214-bf65-a2327f81f2b4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "718b80d0-dbc1-4214-bf65-a2327f81f2b4" (UID: "718b80d0-dbc1-4214-bf65-a2327f81f2b4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:36:33.392448 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:33.392359    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/718b80d0-dbc1-4214-bf65-a2327f81f2b4-maas-api-tls\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:36:33.392448 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:33.392390    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/718b80d0-dbc1-4214-bf65-a2327f81f2b4-openshift-service-ca\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:36:33.392448 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:33.392402    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xq6f\" (UniqueName: \"kubernetes.io/projected/718b80d0-dbc1-4214-bf65-a2327f81f2b4-kube-api-access-7xq6f\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:36:33.500644 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:33.500614    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-f76007-b665db8b5-rvggx"]
Jul 06 01:36:33.507946 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:33.507914    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-f76007-b665db8b5-rvggx"]
Jul 06 01:36:34.752479 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:34.752446    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="718b80d0-dbc1-4214-bf65-a2327f81f2b4" path="/var/lib/kubelet/pods/718b80d0-dbc1-4214-bf65-a2327f81f2b4/volumes"
Jul 06 01:36:37.057762 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:37.057737    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"
Jul 06 01:36:37.128138 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:37.128105    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-istiod-ca-cert\") pod \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\" (UID: \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\") "
Jul 06 01:36:37.128336 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:37.128178    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-credential-socket\") pod \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\" (UID: \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\") "
Jul 06 01:36:37.128336 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:37.128219    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-istio-podinfo\") pod \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\" (UID: \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\") "
Jul 06 01:36:37.128336 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:37.128273    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-istio-token\") pod \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\" (UID: \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\") "
Jul 06 01:36:37.128336 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:37.128291    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-workload-socket\") pod \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\" (UID: \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\") "
Jul 06 01:36:37.128336 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:37.128308    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-istio-envoy\") pod \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\" (UID: \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\") "
Jul 06 01:36:37.128336 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:37.128329    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-istio-data\") pod \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\" (UID: \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\") "
Jul 06 01:36:37.128724 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:37.128420    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-workload-certs\") pod \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\" (UID: \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\") "
Jul 06 01:36:37.128724 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:37.128475    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9lrr\" (UniqueName: \"kubernetes.io/projected/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-kube-api-access-c9lrr\") pod \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\" (UID: \"de534ce7-e446-497d-9d6e-ccbe1cdeaa96\") "
Jul 06 01:36:37.128724 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:37.128513    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "de534ce7-e446-497d-9d6e-ccbe1cdeaa96" (UID: "de534ce7-e446-497d-9d6e-ccbe1cdeaa96"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:36:37.128724 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:37.128614    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "de534ce7-e446-497d-9d6e-ccbe1cdeaa96" (UID: "de534ce7-e446-497d-9d6e-ccbe1cdeaa96"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:36:37.128936 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:37.128737    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "de534ce7-e446-497d-9d6e-ccbe1cdeaa96" (UID: "de534ce7-e446-497d-9d6e-ccbe1cdeaa96"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:36:37.128936 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:37.128857    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-workload-certs\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:36:37.128936 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:37.128875    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-istiod-ca-cert\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:36:37.128936 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:37.128918    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-credential-socket\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:36:37.128936 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:37.128915    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "de534ce7-e446-497d-9d6e-ccbe1cdeaa96" (UID: "de534ce7-e446-497d-9d6e-ccbe1cdeaa96"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:36:37.129342 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:37.129319    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-istio-data" (OuterVolumeSpecName: "istio-data") pod "de534ce7-e446-497d-9d6e-ccbe1cdeaa96" (UID: "de534ce7-e446-497d-9d6e-ccbe1cdeaa96"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:36:37.130702 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:37.130673    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "de534ce7-e446-497d-9d6e-ccbe1cdeaa96" (UID: "de534ce7-e446-497d-9d6e-ccbe1cdeaa96"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:36:37.130797 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:37.130696    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-kube-api-access-c9lrr" (OuterVolumeSpecName: "kube-api-access-c9lrr") pod "de534ce7-e446-497d-9d6e-ccbe1cdeaa96" (UID: "de534ce7-e446-497d-9d6e-ccbe1cdeaa96"). InnerVolumeSpecName "kube-api-access-c9lrr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:36:37.130922 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:37.130904    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "de534ce7-e446-497d-9d6e-ccbe1cdeaa96" (UID: "de534ce7-e446-497d-9d6e-ccbe1cdeaa96"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 01:36:37.130922 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:37.130911    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-istio-token" (OuterVolumeSpecName: "istio-token") pod "de534ce7-e446-497d-9d6e-ccbe1cdeaa96" (UID: "de534ce7-e446-497d-9d6e-ccbe1cdeaa96"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:36:37.208981 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:37.208948    2562 generic.go:356] "Generic (PLEG): container finished" podID="de534ce7-e446-497d-9d6e-ccbe1cdeaa96" containerID="3fdd9e81da62a41779a7b82ef9e7e15fc5759b4a3f92acb50dc35cc99f529fb1" exitCode=0
Jul 06 01:36:37.209168 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:37.208993    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"
Jul 06 01:36:37.209168 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:37.209034    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8" event={"ID":"de534ce7-e446-497d-9d6e-ccbe1cdeaa96","Type":"ContainerDied","Data":"3fdd9e81da62a41779a7b82ef9e7e15fc5759b4a3f92acb50dc35cc99f529fb1"}
Jul 06 01:36:37.209168 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:37.209096    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8" event={"ID":"de534ce7-e446-497d-9d6e-ccbe1cdeaa96","Type":"ContainerDied","Data":"83b269d418ea273006e59c7cb3b75829d3bec252e1eb26eee4d943b27ba87820"}
Jul 06 01:36:37.209168 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:37.209126    2562 scope.go:117] "RemoveContainer" containerID="3fdd9e81da62a41779a7b82ef9e7e15fc5759b4a3f92acb50dc35cc99f529fb1"
Jul 06 01:36:37.218334 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:37.218316    2562 scope.go:117] "RemoveContainer" containerID="91d7816908d3f2b0c60b210fae44894ad1097f77bc54a01a8d2795e13efcf254"
Jul 06 01:36:37.226624 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:37.226606    2562 scope.go:117] "RemoveContainer" containerID="3fdd9e81da62a41779a7b82ef9e7e15fc5759b4a3f92acb50dc35cc99f529fb1"
Jul 06 01:36:37.226956 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:36:37.226926    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fdd9e81da62a41779a7b82ef9e7e15fc5759b4a3f92acb50dc35cc99f529fb1\": container with ID starting with 3fdd9e81da62a41779a7b82ef9e7e15fc5759b4a3f92acb50dc35cc99f529fb1 not found: ID does not exist" containerID="3fdd9e81da62a41779a7b82ef9e7e15fc5759b4a3f92acb50dc35cc99f529fb1"
Jul 06 01:36:37.227034 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:37.226955    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fdd9e81da62a41779a7b82ef9e7e15fc5759b4a3f92acb50dc35cc99f529fb1"} err="failed to get container status \"3fdd9e81da62a41779a7b82ef9e7e15fc5759b4a3f92acb50dc35cc99f529fb1\": rpc error: code = NotFound desc = could not find container \"3fdd9e81da62a41779a7b82ef9e7e15fc5759b4a3f92acb50dc35cc99f529fb1\": container with ID starting with 3fdd9e81da62a41779a7b82ef9e7e15fc5759b4a3f92acb50dc35cc99f529fb1 not found: ID does not exist"
Jul 06 01:36:37.227034 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:37.226972    2562 scope.go:117] "RemoveContainer" containerID="91d7816908d3f2b0c60b210fae44894ad1097f77bc54a01a8d2795e13efcf254"
Jul 06 01:36:37.227271 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:36:37.227248    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91d7816908d3f2b0c60b210fae44894ad1097f77bc54a01a8d2795e13efcf254\": container with ID starting with 91d7816908d3f2b0c60b210fae44894ad1097f77bc54a01a8d2795e13efcf254 not found: ID does not exist" containerID="91d7816908d3f2b0c60b210fae44894ad1097f77bc54a01a8d2795e13efcf254"
Jul 06 01:36:37.227324 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:37.227279    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91d7816908d3f2b0c60b210fae44894ad1097f77bc54a01a8d2795e13efcf254"} err="failed to get container status \"91d7816908d3f2b0c60b210fae44894ad1097f77bc54a01a8d2795e13efcf254\": rpc error: code = NotFound desc = could not find container \"91d7816908d3f2b0c60b210fae44894ad1097f77bc54a01a8d2795e13efcf254\": container with ID starting with 91d7816908d3f2b0c60b210fae44894ad1097f77bc54a01a8d2795e13efcf254 not found: ID does not exist"
Jul 06 01:36:37.230460 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:37.230435    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"]
Jul 06 01:36:37.230537 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:37.230485    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-istio-token\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:36:37.230537 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:37.230498    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-workload-socket\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:36:37.230537 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:37.230506    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-istio-envoy\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:36:37.230537 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:37.230514    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-istio-data\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:36:37.230537 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:37.230523    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9lrr\" (UniqueName: \"kubernetes.io/projected/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-kube-api-access-c9lrr\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:36:37.230537 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:37.230531    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de534ce7-e446-497d-9d6e-ccbe1cdeaa96-istio-podinfo\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:36:37.234115 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:37.234096    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-307471-openshift-default-57d8d75bff-8xht8"]
Jul 06 01:36:38.551526 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:38.551489    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"]
Jul 06 01:36:38.551942 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:38.551729    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph" podUID="0d33831b-5a3f-40c1-81b3-a40143c7c379" containerName="istio-proxy" containerID="cri-o://b5690992d59ccb027989100ac95089c8be1bfe5e3389b2a613b9773207cb7265" gracePeriod=30
Jul 06 01:36:38.751976 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:38.751944    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de534ce7-e446-497d-9d6e-ccbe1cdeaa96" path="/var/lib/kubelet/pods/de534ce7-e446-497d-9d6e-ccbe1cdeaa96/volumes"
Jul 06 01:36:39.401856 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.401821    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"]
Jul 06 01:36:39.402301 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.402287    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de534ce7-e446-497d-9d6e-ccbe1cdeaa96" containerName="istio-proxy"
Jul 06 01:36:39.402353 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.402303    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="de534ce7-e446-497d-9d6e-ccbe1cdeaa96" containerName="istio-proxy"
Jul 06 01:36:39.402353 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.402314    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de534ce7-e446-497d-9d6e-ccbe1cdeaa96" containerName="istio-proxy"
Jul 06 01:36:39.402353 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.402322    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="de534ce7-e446-497d-9d6e-ccbe1cdeaa96" containerName="istio-proxy"
Jul 06 01:36:39.402353 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.402340    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="718b80d0-dbc1-4214-bf65-a2327f81f2b4" containerName="maas-api"
Jul 06 01:36:39.402353 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.402345    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="718b80d0-dbc1-4214-bf65-a2327f81f2b4" containerName="maas-api"
Jul 06 01:36:39.402353 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.402354    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e3aa5b4-103d-48c6-a68b-9db65b8f5557" containerName="maas-api"
Jul 06 01:36:39.402531 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.402359    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e3aa5b4-103d-48c6-a68b-9db65b8f5557" containerName="maas-api"
Jul 06 01:36:39.402531 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.402429    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="718b80d0-dbc1-4214-bf65-a2327f81f2b4" containerName="maas-api"
Jul 06 01:36:39.402531 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.402439    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e3aa5b4-103d-48c6-a68b-9db65b8f5557" containerName="maas-api"
Jul 06 01:36:39.402531 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.402446    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="de534ce7-e446-497d-9d6e-ccbe1cdeaa96" containerName="istio-proxy"
Jul 06 01:36:39.402531 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.402453    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="de534ce7-e446-497d-9d6e-ccbe1cdeaa96" containerName="istio-proxy"
Jul 06 01:36:39.407276 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.407247    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"
Jul 06 01:36:39.410576 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.410549    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-7b5094-openshift-default-dockercfg-82plr\""
Jul 06 01:36:39.416165 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.416126    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"]
Jul 06 01:36:39.453471 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.453437    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbhtz\" (UniqueName: \"kubernetes.io/projected/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-kube-api-access-rbhtz\") pod \"e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2\" (UID: \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\") " pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"
Jul 06 01:36:39.453471 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.453474    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-istio-token\") pod \"e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2\" (UID: \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\") " pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"
Jul 06 01:36:39.453671 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.453498    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-istio-envoy\") pod \"e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2\" (UID: \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\") " pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"
Jul 06 01:36:39.453671 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.453513    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-workload-certs\") pod \"e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2\" (UID: \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\") " pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"
Jul 06 01:36:39.453671 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.453557    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-istio-data\") pod \"e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2\" (UID: \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\") " pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"
Jul 06 01:36:39.453671 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.453618    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-workload-socket\") pod \"e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2\" (UID: \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\") " pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"
Jul 06 01:36:39.453805 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.453694    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-istio-podinfo\") pod \"e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2\" (UID: \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\") " pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"
Jul 06 01:36:39.453805 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.453744    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-credential-socket\") pod \"e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2\" (UID: \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\") " pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"
Jul 06 01:36:39.453805 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.453786    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-istiod-ca-cert\") pod \"e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2\" (UID: \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\") " pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"
Jul 06 01:36:39.554549 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.554513    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-istio-envoy\") pod \"e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2\" (UID: \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\") " pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"
Jul 06 01:36:39.554549 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.554551    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-workload-certs\") pod \"e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2\" (UID: \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\") " pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"
Jul 06 01:36:39.555079 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.554570    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-istio-data\") pod \"e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2\" (UID: \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\") " pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"
Jul 06 01:36:39.555079 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.554596    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-workload-socket\") pod \"e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2\" (UID: \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\") " pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"
Jul 06 01:36:39.555079 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.554726    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-istio-podinfo\") pod \"e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2\" (UID: \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\") " pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"
Jul 06 01:36:39.555079 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.554817    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-credential-socket\") pod \"e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2\" (UID: \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\") " pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"
Jul 06 01:36:39.555079 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.554892    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-istiod-ca-cert\") pod \"e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2\" (UID: \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\") " pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"
Jul 06 01:36:39.555079 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.554949    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-workload-certs\") pod \"e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2\" (UID: \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\") " pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"
Jul 06 01:36:39.555079 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.554950    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbhtz\" (UniqueName: \"kubernetes.io/projected/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-kube-api-access-rbhtz\") pod \"e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2\" (UID: \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\") " pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"
Jul 06 01:36:39.555079 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.555013    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-workload-socket\") pod \"e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2\" (UID: \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\") " pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"
Jul 06 01:36:39.555079 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.555022    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-istio-token\") pod \"e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2\" (UID: \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\") " pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"
Jul 06 01:36:39.555079 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.555078    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-istio-data\") pod \"e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2\" (UID: \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\") " pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"
Jul 06 01:36:39.555542 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.555323    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-credential-socket\") pod \"e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2\" (UID: \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\") " pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"
Jul 06 01:36:39.555641 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.555619    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-istiod-ca-cert\") pod \"e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2\" (UID: \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\") " pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"
Jul 06 01:36:39.557087 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.557066    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-istio-envoy\") pod \"e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2\" (UID: \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\") " pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"
Jul 06 01:36:39.557294 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.557266    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-istio-podinfo\") pod \"e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2\" (UID: \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\") " pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"
Jul 06 01:36:39.562452 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.562430    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-istio-token\") pod \"e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2\" (UID: \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\") " pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"
Jul 06 01:36:39.562452 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.562446    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbhtz\" (UniqueName: \"kubernetes.io/projected/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-kube-api-access-rbhtz\") pod \"e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2\" (UID: \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\") " pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"
Jul 06 01:36:39.719905 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.719809    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"
Jul 06 01:36:39.853792 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.853769    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"]
Jul 06 01:36:39.856024 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:36:39.855996    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa936b60_e6cb_46eb_8f50_c1c0ec2d4c83.slice/crio-67416f0691e8e58cfe33a80d7f5b9e706bd7f035fd1a1e722b58616146caff38 WatchSource:0}: Error finding container 67416f0691e8e58cfe33a80d7f5b9e706bd7f035fd1a1e722b58616146caff38: Status 404 returned error can't find the container with id 67416f0691e8e58cfe33a80d7f5b9e706bd7f035fd1a1e722b58616146caff38
Jul 06 01:36:39.858364 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.858331    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:36:39.858448 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.858399    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:36:39.858448 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:39.858428    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:36:40.226859 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:40.226827    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2" event={"ID":"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83","Type":"ContainerStarted","Data":"b1c83a9efc87b4e15fcccdaa4d293ece6b723eb2ce97ac585274583fe5f53c65"}
Jul 06 01:36:40.227054 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:40.226878    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2" event={"ID":"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83","Type":"ContainerStarted","Data":"67416f0691e8e58cfe33a80d7f5b9e706bd7f035fd1a1e722b58616146caff38"}
Jul 06 01:36:40.247115 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:40.247065    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2" podStartSLOduration=1.247050238 podStartE2EDuration="1.247050238s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:36:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:36:40.245408269 +0000 UTC m=+2232.056383513" watchObservedRunningTime="2026-07-06 01:36:40.247050238 +0000 UTC m=+2232.058025481"
Jul 06 01:36:40.720514 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:40.720475    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"
Jul 06 01:36:40.725510 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:40.725483    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"
Jul 06 01:36:41.232302 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:41.232266    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"
Jul 06 01:36:41.233170 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:41.233128    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"
Jul 06 01:36:42.442141 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:42.442112    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-7b5094-784cbb6db4-9pg6n"]
Jul 06 01:36:42.445920 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:42.445898    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-7b5094-784cbb6db4-9pg6n"
Jul 06 01:36:42.448361 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:42.448339    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-7b5094-serving-cert\""
Jul 06 01:36:42.448591 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:42.448349    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-84mvh\""
Jul 06 01:36:42.456630 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:42.455678    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-7b5094-784cbb6db4-9pg6n"]
Jul 06 01:36:42.484399 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:42.484371    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11a557d1-0d05-4858-9f59-fd991a1bdc08-maas-api-tls\") pod \"maas-api-e2e-shared-a-7b5094-784cbb6db4-9pg6n\" (UID: \"11a557d1-0d05-4858-9f59-fd991a1bdc08\") " pod="opendatahub/maas-api-e2e-shared-a-7b5094-784cbb6db4-9pg6n"
Jul 06 01:36:42.484568 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:42.484433    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11a557d1-0d05-4858-9f59-fd991a1bdc08-openshift-service-ca\") pod \"maas-api-e2e-shared-a-7b5094-784cbb6db4-9pg6n\" (UID: \"11a557d1-0d05-4858-9f59-fd991a1bdc08\") " pod="opendatahub/maas-api-e2e-shared-a-7b5094-784cbb6db4-9pg6n"
Jul 06 01:36:42.484568 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:42.484477    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh8j9\" (UniqueName: \"kubernetes.io/projected/11a557d1-0d05-4858-9f59-fd991a1bdc08-kube-api-access-jh8j9\") pod \"maas-api-e2e-shared-a-7b5094-784cbb6db4-9pg6n\" (UID: \"11a557d1-0d05-4858-9f59-fd991a1bdc08\") " pod="opendatahub/maas-api-e2e-shared-a-7b5094-784cbb6db4-9pg6n"
Jul 06 01:36:42.585761 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:42.585731    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11a557d1-0d05-4858-9f59-fd991a1bdc08-maas-api-tls\") pod \"maas-api-e2e-shared-a-7b5094-784cbb6db4-9pg6n\" (UID: \"11a557d1-0d05-4858-9f59-fd991a1bdc08\") " pod="opendatahub/maas-api-e2e-shared-a-7b5094-784cbb6db4-9pg6n"
Jul 06 01:36:42.585935 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:42.585796    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11a557d1-0d05-4858-9f59-fd991a1bdc08-openshift-service-ca\") pod \"maas-api-e2e-shared-a-7b5094-784cbb6db4-9pg6n\" (UID: \"11a557d1-0d05-4858-9f59-fd991a1bdc08\") " pod="opendatahub/maas-api-e2e-shared-a-7b5094-784cbb6db4-9pg6n"
Jul 06 01:36:42.585935 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:42.585829    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh8j9\" (UniqueName: \"kubernetes.io/projected/11a557d1-0d05-4858-9f59-fd991a1bdc08-kube-api-access-jh8j9\") pod \"maas-api-e2e-shared-a-7b5094-784cbb6db4-9pg6n\" (UID: \"11a557d1-0d05-4858-9f59-fd991a1bdc08\") " pod="opendatahub/maas-api-e2e-shared-a-7b5094-784cbb6db4-9pg6n"
Jul 06 01:36:42.586571 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:42.586541    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11a557d1-0d05-4858-9f59-fd991a1bdc08-openshift-service-ca\") pod \"maas-api-e2e-shared-a-7b5094-784cbb6db4-9pg6n\" (UID: \"11a557d1-0d05-4858-9f59-fd991a1bdc08\") " pod="opendatahub/maas-api-e2e-shared-a-7b5094-784cbb6db4-9pg6n"
Jul 06 01:36:42.588199 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:42.588174    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11a557d1-0d05-4858-9f59-fd991a1bdc08-maas-api-tls\") pod \"maas-api-e2e-shared-a-7b5094-784cbb6db4-9pg6n\" (UID: \"11a557d1-0d05-4858-9f59-fd991a1bdc08\") " pod="opendatahub/maas-api-e2e-shared-a-7b5094-784cbb6db4-9pg6n"
Jul 06 01:36:42.593340 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:42.593321    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh8j9\" (UniqueName: \"kubernetes.io/projected/11a557d1-0d05-4858-9f59-fd991a1bdc08-kube-api-access-jh8j9\") pod \"maas-api-e2e-shared-a-7b5094-784cbb6db4-9pg6n\" (UID: \"11a557d1-0d05-4858-9f59-fd991a1bdc08\") " pod="opendatahub/maas-api-e2e-shared-a-7b5094-784cbb6db4-9pg6n"
Jul 06 01:36:42.759939 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:42.759851    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-7b5094-784cbb6db4-9pg6n"
Jul 06 01:36:42.895594 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:42.895569    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-7b5094-784cbb6db4-9pg6n"]
Jul 06 01:36:42.897724 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:36:42.897697    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11a557d1_0d05_4858_9f59_fd991a1bdc08.slice/crio-4513bbe9f568c0b08401c4c4ccde43bfa5d99248878087747247462e2e5aad75 WatchSource:0}: Error finding container 4513bbe9f568c0b08401c4c4ccde43bfa5d99248878087747247462e2e5aad75: Status 404 returned error can't find the container with id 4513bbe9f568c0b08401c4c4ccde43bfa5d99248878087747247462e2e5aad75
Jul 06 01:36:43.250536 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:43.250499    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-7b5094-784cbb6db4-9pg6n" event={"ID":"11a557d1-0d05-4858-9f59-fd991a1bdc08","Type":"ContainerStarted","Data":"4513bbe9f568c0b08401c4c4ccde43bfa5d99248878087747247462e2e5aad75"}
Jul 06 01:36:43.802446 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:43.802419    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"
Jul 06 01:36:43.898489 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:43.898456    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d33831b-5a3f-40c1-81b3-a40143c7c379-istio-podinfo\") pod \"0d33831b-5a3f-40c1-81b3-a40143c7c379\" (UID: \"0d33831b-5a3f-40c1-81b3-a40143c7c379\") "
Jul 06 01:36:43.898654 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:43.898499    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d33831b-5a3f-40c1-81b3-a40143c7c379-credential-socket\") pod \"0d33831b-5a3f-40c1-81b3-a40143c7c379\" (UID: \"0d33831b-5a3f-40c1-81b3-a40143c7c379\") "
Jul 06 01:36:43.898654 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:43.898564    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d33831b-5a3f-40c1-81b3-a40143c7c379-istio-data\") pod \"0d33831b-5a3f-40c1-81b3-a40143c7c379\" (UID: \"0d33831b-5a3f-40c1-81b3-a40143c7c379\") "
Jul 06 01:36:43.898654 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:43.898585    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d33831b-5a3f-40c1-81b3-a40143c7c379-workload-socket\") pod \"0d33831b-5a3f-40c1-81b3-a40143c7c379\" (UID: \"0d33831b-5a3f-40c1-81b3-a40143c7c379\") "
Jul 06 01:36:43.898654 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:43.898611    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d33831b-5a3f-40c1-81b3-a40143c7c379-istio-token\") pod \"0d33831b-5a3f-40c1-81b3-a40143c7c379\" (UID: \"0d33831b-5a3f-40c1-81b3-a40143c7c379\") "
Jul 06 01:36:43.898654 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:43.898635    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d33831b-5a3f-40c1-81b3-a40143c7c379-istiod-ca-cert\") pod \"0d33831b-5a3f-40c1-81b3-a40143c7c379\" (UID: \"0d33831b-5a3f-40c1-81b3-a40143c7c379\") "
Jul 06 01:36:43.898930 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:43.898691    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d33831b-5a3f-40c1-81b3-a40143c7c379-istio-envoy\") pod \"0d33831b-5a3f-40c1-81b3-a40143c7c379\" (UID: \"0d33831b-5a3f-40c1-81b3-a40143c7c379\") "
Jul 06 01:36:43.898930 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:43.898717    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d33831b-5a3f-40c1-81b3-a40143c7c379-workload-certs\") pod \"0d33831b-5a3f-40c1-81b3-a40143c7c379\" (UID: \"0d33831b-5a3f-40c1-81b3-a40143c7c379\") "
Jul 06 01:36:43.898930 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:43.898753    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sk6zk\" (UniqueName: \"kubernetes.io/projected/0d33831b-5a3f-40c1-81b3-a40143c7c379-kube-api-access-sk6zk\") pod \"0d33831b-5a3f-40c1-81b3-a40143c7c379\" (UID: \"0d33831b-5a3f-40c1-81b3-a40143c7c379\") "
Jul 06 01:36:43.898930 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:43.898849    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d33831b-5a3f-40c1-81b3-a40143c7c379-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0d33831b-5a3f-40c1-81b3-a40143c7c379" (UID: "0d33831b-5a3f-40c1-81b3-a40143c7c379"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:36:43.898930 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:43.898903    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d33831b-5a3f-40c1-81b3-a40143c7c379-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0d33831b-5a3f-40c1-81b3-a40143c7c379" (UID: "0d33831b-5a3f-40c1-81b3-a40143c7c379"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:36:43.899224 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:43.899097    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d33831b-5a3f-40c1-81b3-a40143c7c379-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0d33831b-5a3f-40c1-81b3-a40143c7c379" (UID: "0d33831b-5a3f-40c1-81b3-a40143c7c379"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:36:43.899224 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:43.899107    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d33831b-5a3f-40c1-81b3-a40143c7c379-workload-socket\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:36:43.899224 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:43.899124    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d33831b-5a3f-40c1-81b3-a40143c7c379-credential-socket\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:36:43.899224 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:43.899214    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d33831b-5a3f-40c1-81b3-a40143c7c379-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0d33831b-5a3f-40c1-81b3-a40143c7c379" (UID: "0d33831b-5a3f-40c1-81b3-a40143c7c379"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:36:43.899523 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:43.899496    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d33831b-5a3f-40c1-81b3-a40143c7c379-istio-data" (OuterVolumeSpecName: "istio-data") pod "0d33831b-5a3f-40c1-81b3-a40143c7c379" (UID: "0d33831b-5a3f-40c1-81b3-a40143c7c379"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:36:43.900889 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:43.900856    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d33831b-5a3f-40c1-81b3-a40143c7c379-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0d33831b-5a3f-40c1-81b3-a40143c7c379" (UID: "0d33831b-5a3f-40c1-81b3-a40143c7c379"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:36:43.900889 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:43.900862    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d33831b-5a3f-40c1-81b3-a40143c7c379-istio-token" (OuterVolumeSpecName: "istio-token") pod "0d33831b-5a3f-40c1-81b3-a40143c7c379" (UID: "0d33831b-5a3f-40c1-81b3-a40143c7c379"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:36:43.901039 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:43.900928    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0d33831b-5a3f-40c1-81b3-a40143c7c379-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0d33831b-5a3f-40c1-81b3-a40143c7c379" (UID: "0d33831b-5a3f-40c1-81b3-a40143c7c379"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 01:36:43.901039 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:43.900963    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d33831b-5a3f-40c1-81b3-a40143c7c379-kube-api-access-sk6zk" (OuterVolumeSpecName: "kube-api-access-sk6zk") pod "0d33831b-5a3f-40c1-81b3-a40143c7c379" (UID: "0d33831b-5a3f-40c1-81b3-a40143c7c379"). InnerVolumeSpecName "kube-api-access-sk6zk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:36:43.999621 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:43.999582    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d33831b-5a3f-40c1-81b3-a40143c7c379-istio-data\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:36:43.999621 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:43.999618    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d33831b-5a3f-40c1-81b3-a40143c7c379-istio-token\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:36:43.999810 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:43.999630    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d33831b-5a3f-40c1-81b3-a40143c7c379-istiod-ca-cert\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:36:43.999810 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:43.999643    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d33831b-5a3f-40c1-81b3-a40143c7c379-istio-envoy\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:36:43.999810 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:43.999654    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d33831b-5a3f-40c1-81b3-a40143c7c379-workload-certs\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:36:43.999810 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:43.999666    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sk6zk\" (UniqueName: \"kubernetes.io/projected/0d33831b-5a3f-40c1-81b3-a40143c7c379-kube-api-access-sk6zk\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:36:43.999810 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:43.999681    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d33831b-5a3f-40c1-81b3-a40143c7c379-istio-podinfo\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:36:44.256508 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:44.256413    2562 generic.go:356] "Generic (PLEG): container finished" podID="0d33831b-5a3f-40c1-81b3-a40143c7c379" containerID="b5690992d59ccb027989100ac95089c8be1bfe5e3389b2a613b9773207cb7265" exitCode=0
Jul 06 01:36:44.256508 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:44.256461    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"
Jul 06 01:36:44.256747 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:44.256495    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph" event={"ID":"0d33831b-5a3f-40c1-81b3-a40143c7c379","Type":"ContainerDied","Data":"b5690992d59ccb027989100ac95089c8be1bfe5e3389b2a613b9773207cb7265"}
Jul 06 01:36:44.256747 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:44.256559    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph" event={"ID":"0d33831b-5a3f-40c1-81b3-a40143c7c379","Type":"ContainerDied","Data":"c0fb151ec598ef407a0fbbcaa9d8fd44e33b2bb2ef80c33fd743d8857e123a46"}
Jul 06 01:36:44.256747 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:44.256589    2562 scope.go:117] "RemoveContainer" containerID="b5690992d59ccb027989100ac95089c8be1bfe5e3389b2a613b9773207cb7265"
Jul 06 01:36:44.258420 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:44.258394    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-7b5094-784cbb6db4-9pg6n" event={"ID":"11a557d1-0d05-4858-9f59-fd991a1bdc08","Type":"ContainerStarted","Data":"fcce0b092421e30161b5a8a0b0f49378ddff2b2a5667200daa56ce61c1684a31"}
Jul 06 01:36:44.258623 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:44.258601    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-7b5094-784cbb6db4-9pg6n"
Jul 06 01:36:44.266423 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:44.266406    2562 scope.go:117] "RemoveContainer" containerID="364f18c48c8459df878589496ab154ebe5c160510e6fcc520c7ff70202a0aea0"
Jul 06 01:36:44.274333 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:44.274316    2562 scope.go:117] "RemoveContainer" containerID="b5690992d59ccb027989100ac95089c8be1bfe5e3389b2a613b9773207cb7265"
Jul 06 01:36:44.274577 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:36:44.274559    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5690992d59ccb027989100ac95089c8be1bfe5e3389b2a613b9773207cb7265\": container with ID starting with b5690992d59ccb027989100ac95089c8be1bfe5e3389b2a613b9773207cb7265 not found: ID does not exist" containerID="b5690992d59ccb027989100ac95089c8be1bfe5e3389b2a613b9773207cb7265"
Jul 06 01:36:44.274645 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:44.274587    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5690992d59ccb027989100ac95089c8be1bfe5e3389b2a613b9773207cb7265"} err="failed to get container status \"b5690992d59ccb027989100ac95089c8be1bfe5e3389b2a613b9773207cb7265\": rpc error: code = NotFound desc = could not find container \"b5690992d59ccb027989100ac95089c8be1bfe5e3389b2a613b9773207cb7265\": container with ID starting with b5690992d59ccb027989100ac95089c8be1bfe5e3389b2a613b9773207cb7265 not found: ID does not exist"
Jul 06 01:36:44.274645 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:44.274642    2562 scope.go:117] "RemoveContainer" containerID="364f18c48c8459df878589496ab154ebe5c160510e6fcc520c7ff70202a0aea0"
Jul 06 01:36:44.274896 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:36:44.274877    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"364f18c48c8459df878589496ab154ebe5c160510e6fcc520c7ff70202a0aea0\": container with ID starting with 364f18c48c8459df878589496ab154ebe5c160510e6fcc520c7ff70202a0aea0 not found: ID does not exist" containerID="364f18c48c8459df878589496ab154ebe5c160510e6fcc520c7ff70202a0aea0"
Jul 06 01:36:44.275010 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:44.274907    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"364f18c48c8459df878589496ab154ebe5c160510e6fcc520c7ff70202a0aea0"} err="failed to get container status \"364f18c48c8459df878589496ab154ebe5c160510e6fcc520c7ff70202a0aea0\": rpc error: code = NotFound desc = could not find container \"364f18c48c8459df878589496ab154ebe5c160510e6fcc520c7ff70202a0aea0\": container with ID starting with 364f18c48c8459df878589496ab154ebe5c160510e6fcc520c7ff70202a0aea0 not found: ID does not exist"
Jul 06 01:36:44.276782 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:44.276746    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-7b5094-784cbb6db4-9pg6n" podStartSLOduration=1.9353028289999998 podStartE2EDuration="2.276733418s" totalImagesPullingTime="341.430589ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:36:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:36:44.274880243 +0000 UTC m=+2236.085855498" watchObservedRunningTime="2026-07-06 01:36:44.276733418 +0000 UTC m=+2236.087708659"
Jul 06 01:36:44.288410 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:44.288390    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"]
Jul 06 01:36:44.292393 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:44.292369    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-f76007-openshift-default-7f99899fc-vxqph"]
Jul 06 01:36:44.752448 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:44.752416    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d33831b-5a3f-40c1-81b3-a40143c7c379" path="/var/lib/kubelet/pods/0d33831b-5a3f-40c1-81b3-a40143c7c379/volumes"
Jul 06 01:36:47.313721 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:47.313682    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"]
Jul 06 01:36:47.314640 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:47.314606    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d33831b-5a3f-40c1-81b3-a40143c7c379" containerName="istio-proxy"
Jul 06 01:36:47.314640 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:47.314632    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d33831b-5a3f-40c1-81b3-a40143c7c379" containerName="istio-proxy"
Jul 06 01:36:47.314817 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:47.314678    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d33831b-5a3f-40c1-81b3-a40143c7c379" containerName="istio-proxy"
Jul 06 01:36:47.314817 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:47.314686    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d33831b-5a3f-40c1-81b3-a40143c7c379" containerName="istio-proxy"
Jul 06 01:36:47.314817 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:47.314780    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d33831b-5a3f-40c1-81b3-a40143c7c379" containerName="istio-proxy"
Jul 06 01:36:47.319441 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:47.319420    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"
Jul 06 01:36:47.321700 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:47.321677    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-fe3397-openshift-default-dockercfg-cjcfk\""
Jul 06 01:36:47.328784 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:47.328764    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"]
Jul 06 01:36:47.433487 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:47.433452    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-istio-token\") pod \"e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k\" (UID: \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\") " pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"
Jul 06 01:36:47.433699 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:47.433505    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-istio-data\") pod \"e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k\" (UID: \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\") " pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"
Jul 06 01:36:47.433699 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:47.433614    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-workload-socket\") pod \"e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k\" (UID: \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\") " pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"
Jul 06 01:36:47.433699 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:47.433640    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-istio-podinfo\") pod \"e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k\" (UID: \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\") " pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"
Jul 06 01:36:47.433699 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:47.433692    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-workload-certs\") pod \"e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k\" (UID: \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\") " pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"
Jul 06 01:36:47.433915 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:47.433732    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktg8g\" (UniqueName: \"kubernetes.io/projected/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-kube-api-access-ktg8g\") pod \"e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k\" (UID: \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\") " pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"
Jul 06 01:36:47.433915 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:47.433771    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-istio-envoy\") pod \"e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k\" (UID: \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\") " pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"
Jul 06 01:36:47.433915 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:47.433795    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-credential-socket\") pod \"e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k\" (UID: \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\") " pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"
Jul 06 01:36:47.433915 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:47.433826    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-istiod-ca-cert\") pod \"e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k\" (UID: \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\") " pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"
Jul 06 01:36:47.534619 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:47.534585    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-istio-token\") pod \"e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k\" (UID: \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\") " pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"
Jul 06 01:36:47.534821 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:47.534631    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-istio-data\") pod \"e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k\" (UID: \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\") " pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"
Jul 06 01:36:47.534821 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:47.534686    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-workload-socket\") pod \"e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k\" (UID: \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\") " pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"
Jul 06 01:36:47.534821 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:47.534709    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-istio-podinfo\") pod \"e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k\" (UID: \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\") " pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"
Jul 06 01:36:47.534821 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:47.534749    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-workload-certs\") pod \"e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k\" (UID: \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\") " pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"
Jul 06 01:36:47.534821 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:47.534794    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktg8g\" (UniqueName: \"kubernetes.io/projected/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-kube-api-access-ktg8g\") pod \"e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k\" (UID: \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\") " pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"
Jul 06 01:36:47.534821 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:47.534822    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-istio-envoy\") pod \"e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k\" (UID: \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\") " pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"
Jul 06 01:36:47.535165 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:47.534847    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-credential-socket\") pod \"e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k\" (UID: \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\") " pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"
Jul 06 01:36:47.535165 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:47.534879    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-istiod-ca-cert\") pod \"e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k\" (UID: \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\") " pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"
Jul 06 01:36:47.535165 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:47.535123    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-workload-socket\") pod \"e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k\" (UID: \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\") " pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"
Jul 06 01:36:47.535352 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:47.535202    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-workload-certs\") pod \"e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k\" (UID: \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\") " pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"
Jul 06 01:36:47.535621 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:47.535598    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-istiod-ca-cert\") pod \"e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k\" (UID: \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\") " pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"
Jul 06 01:36:47.535716 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:47.535597    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-credential-socket\") pod \"e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k\" (UID: \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\") " pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"
Jul 06 01:36:47.535716 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:47.535672    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-istio-data\") pod \"e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k\" (UID: \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\") " pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"
Jul 06 01:36:47.537295 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:47.537249    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-istio-envoy\") pod \"e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k\" (UID: \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\") " pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"
Jul 06 01:36:47.537410 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:47.537378    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-istio-podinfo\") pod \"e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k\" (UID: \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\") " pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"
Jul 06 01:36:47.542380 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:47.542359    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-istio-token\") pod \"e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k\" (UID: \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\") " pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"
Jul 06 01:36:47.542706 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:47.542687    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktg8g\" (UniqueName: \"kubernetes.io/projected/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-kube-api-access-ktg8g\") pod \"e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k\" (UID: \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\") " pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"
Jul 06 01:36:47.631823 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:47.631786    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"
Jul 06 01:36:47.784741 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:47.784710    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"]
Jul 06 01:36:47.788463 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:36:47.788432    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod229fc3d7_298c_44e4_93c2_6ee5a04f45a8.slice/crio-2a44db96222c1eee465a548231954fa193443027f227e1488dc0ebe0842ecb0c WatchSource:0}: Error finding container 2a44db96222c1eee465a548231954fa193443027f227e1488dc0ebe0842ecb0c: Status 404 returned error can't find the container with id 2a44db96222c1eee465a548231954fa193443027f227e1488dc0ebe0842ecb0c
Jul 06 01:36:47.790835 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:47.790794    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:36:47.790913 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:47.790888    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:36:47.790948 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:47.790936    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:36:48.281257 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:48.281211    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k" event={"ID":"229fc3d7-298c-44e4-93c2-6ee5a04f45a8","Type":"ContainerStarted","Data":"07cf7cd586f6f26a899d2fd68f76799be5c2d25e3399fbe41da1707c8deb35f6"}
Jul 06 01:36:48.281450 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:48.281297    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k" event={"ID":"229fc3d7-298c-44e4-93c2-6ee5a04f45a8","Type":"ContainerStarted","Data":"2a44db96222c1eee465a548231954fa193443027f227e1488dc0ebe0842ecb0c"}
Jul 06 01:36:48.300537 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:48.300480    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k" podStartSLOduration=1.3004643439999999 podStartE2EDuration="1.300464344s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:36:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:36:48.299200468 +0000 UTC m=+2240.110175799" watchObservedRunningTime="2026-07-06 01:36:48.300464344 +0000 UTC m=+2240.111439586"
Jul 06 01:36:48.634443 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:48.634405    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"
Jul 06 01:36:48.640065 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:48.640035    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"
Jul 06 01:36:49.286500 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:49.286469    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"
Jul 06 01:36:49.287602 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:49.287583    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"
Jul 06 01:36:50.269760 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:50.269730    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-7b5094-784cbb6db4-9pg6n"
Jul 06 01:36:50.351293 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:50.351260    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-fe3397-7d875d9567-qgsfg"]
Jul 06 01:36:50.351849 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:50.351825    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d33831b-5a3f-40c1-81b3-a40143c7c379" containerName="istio-proxy"
Jul 06 01:36:50.355051 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:50.355031    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-fe3397-7d875d9567-qgsfg"
Jul 06 01:36:50.357275 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:50.357256    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-fe3397-serving-cert\""
Jul 06 01:36:50.366035 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:50.366010    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-fe3397-7d875d9567-qgsfg"]
Jul 06 01:36:50.467562 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:50.467486    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffc19d54-1160-4516-b946-cd38ac60a51c-maas-api-tls\") pod \"maas-api-e2e-shared-b-fe3397-7d875d9567-qgsfg\" (UID: \"ffc19d54-1160-4516-b946-cd38ac60a51c\") " pod="opendatahub/maas-api-e2e-shared-b-fe3397-7d875d9567-qgsfg"
Jul 06 01:36:50.467562 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:50.467539    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffc19d54-1160-4516-b946-cd38ac60a51c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-fe3397-7d875d9567-qgsfg\" (UID: \"ffc19d54-1160-4516-b946-cd38ac60a51c\") " pod="opendatahub/maas-api-e2e-shared-b-fe3397-7d875d9567-qgsfg"
Jul 06 01:36:50.467757 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:50.467634    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggckn\" (UniqueName: \"kubernetes.io/projected/ffc19d54-1160-4516-b946-cd38ac60a51c-kube-api-access-ggckn\") pod \"maas-api-e2e-shared-b-fe3397-7d875d9567-qgsfg\" (UID: \"ffc19d54-1160-4516-b946-cd38ac60a51c\") " pod="opendatahub/maas-api-e2e-shared-b-fe3397-7d875d9567-qgsfg"
Jul 06 01:36:50.568726 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:50.568640    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffc19d54-1160-4516-b946-cd38ac60a51c-maas-api-tls\") pod \"maas-api-e2e-shared-b-fe3397-7d875d9567-qgsfg\" (UID: \"ffc19d54-1160-4516-b946-cd38ac60a51c\") " pod="opendatahub/maas-api-e2e-shared-b-fe3397-7d875d9567-qgsfg"
Jul 06 01:36:50.568726 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:50.568694    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffc19d54-1160-4516-b946-cd38ac60a51c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-fe3397-7d875d9567-qgsfg\" (UID: \"ffc19d54-1160-4516-b946-cd38ac60a51c\") " pod="opendatahub/maas-api-e2e-shared-b-fe3397-7d875d9567-qgsfg"
Jul 06 01:36:50.568923 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:50.568740    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggckn\" (UniqueName: \"kubernetes.io/projected/ffc19d54-1160-4516-b946-cd38ac60a51c-kube-api-access-ggckn\") pod \"maas-api-e2e-shared-b-fe3397-7d875d9567-qgsfg\" (UID: \"ffc19d54-1160-4516-b946-cd38ac60a51c\") " pod="opendatahub/maas-api-e2e-shared-b-fe3397-7d875d9567-qgsfg"
Jul 06 01:36:50.569490 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:50.569469    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffc19d54-1160-4516-b946-cd38ac60a51c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-fe3397-7d875d9567-qgsfg\" (UID: \"ffc19d54-1160-4516-b946-cd38ac60a51c\") " pod="opendatahub/maas-api-e2e-shared-b-fe3397-7d875d9567-qgsfg"
Jul 06 01:36:50.571181 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:50.571138    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffc19d54-1160-4516-b946-cd38ac60a51c-maas-api-tls\") pod \"maas-api-e2e-shared-b-fe3397-7d875d9567-qgsfg\" (UID: \"ffc19d54-1160-4516-b946-cd38ac60a51c\") " pod="opendatahub/maas-api-e2e-shared-b-fe3397-7d875d9567-qgsfg"
Jul 06 01:36:50.576400 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:50.576377    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggckn\" (UniqueName: \"kubernetes.io/projected/ffc19d54-1160-4516-b946-cd38ac60a51c-kube-api-access-ggckn\") pod \"maas-api-e2e-shared-b-fe3397-7d875d9567-qgsfg\" (UID: \"ffc19d54-1160-4516-b946-cd38ac60a51c\") " pod="opendatahub/maas-api-e2e-shared-b-fe3397-7d875d9567-qgsfg"
Jul 06 01:36:50.669044 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:50.669008    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-fe3397-7d875d9567-qgsfg"
Jul 06 01:36:50.845228 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:50.845116    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-fe3397-7d875d9567-qgsfg"]
Jul 06 01:36:50.849809 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:36:50.849780    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffc19d54_1160_4516_b946_cd38ac60a51c.slice/crio-9801d923e3351c1f4bd75e1e15cf2e2fa2e57dd321fca2758aaba32802107a30 WatchSource:0}: Error finding container 9801d923e3351c1f4bd75e1e15cf2e2fa2e57dd321fca2758aaba32802107a30: Status 404 returned error can't find the container with id 9801d923e3351c1f4bd75e1e15cf2e2fa2e57dd321fca2758aaba32802107a30
Jul 06 01:36:51.296932 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:51.296895    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-fe3397-7d875d9567-qgsfg" event={"ID":"ffc19d54-1160-4516-b946-cd38ac60a51c","Type":"ContainerStarted","Data":"025b26a894b165c3970ad763c037aaae91515587e70bc6ee911c29840cdc3e30"}
Jul 06 01:36:51.297370 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:51.296960    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-fe3397-7d875d9567-qgsfg" event={"ID":"ffc19d54-1160-4516-b946-cd38ac60a51c","Type":"ContainerStarted","Data":"9801d923e3351c1f4bd75e1e15cf2e2fa2e57dd321fca2758aaba32802107a30"}
Jul 06 01:36:51.297370 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:51.297179    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-fe3397-7d875d9567-qgsfg"
Jul 06 01:36:51.316163 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:51.316081    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-fe3397-7d875d9567-qgsfg" podStartSLOduration=0.999519237 podStartE2EDuration="1.316060223s" totalImagesPullingTime="316.540986ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:36:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:36:51.31528861 +0000 UTC m=+2243.126263864" watchObservedRunningTime="2026-07-06 01:36:51.316060223 +0000 UTC m=+2243.127035467"
Jul 06 01:36:56.234345 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:56.234311    2562 patch_prober.go:28] interesting pod/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 06 01:36:56.234796 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:56.234367    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2" podUID="aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 06 01:36:56.327207 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:56.327177    2562 generic.go:356] "Generic (PLEG): container finished" podID="aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83" containerID="b1c83a9efc87b4e15fcccdaa4d293ece6b723eb2ce97ac585274583fe5f53c65" exitCode=0
Jul 06 01:36:56.327370 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:56.327253    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2" event={"ID":"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83","Type":"ContainerDied","Data":"b1c83a9efc87b4e15fcccdaa4d293ece6b723eb2ce97ac585274583fe5f53c65"}
Jul 06 01:36:56.327651 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:56.327631    2562 scope.go:117] "RemoveContainer" containerID="b1c83a9efc87b4e15fcccdaa4d293ece6b723eb2ce97ac585274583fe5f53c65"
Jul 06 01:36:56.328653 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:56.328622    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:36:56.328707 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:56.328697    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:36:56.328751 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:56.328727    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:36:57.307516 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:57.307489    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-fe3397-7d875d9567-qgsfg"
Jul 06 01:36:57.344009 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:57.343974    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2" event={"ID":"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83","Type":"ContainerStarted","Data":"99713a4c23cf3cc2771c35a277bad49972a32622e1af2126d1ed4c58a04c5f16"}
Jul 06 01:36:57.720534 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:57.720492    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"
Jul 06 01:36:57.720756 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:57.720630    2562 patch_prober.go:28] interesting pod/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 06 01:36:57.720756 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:57.720682    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2" podUID="aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 06 01:36:58.720953 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:58.720445    2562 patch_prober.go:28] interesting pod/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 06 01:36:58.720953 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:58.720516    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2" podUID="aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 06 01:36:59.720754 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:59.720719    2562 patch_prober.go:28] interesting pod/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 06 01:36:59.721431 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:36:59.721012    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2" podUID="aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 06 01:37:00.720753 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:37:00.720705    2562 patch_prober.go:28] interesting pod/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 06 01:37:00.720949 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:37:00.720780    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2" podUID="aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 06 01:37:01.733712 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:37:01.733676    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"
Jul 06 01:37:01.734838 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:37:01.734817    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"
Jul 06 01:37:01.738473 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:37:01.738444    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"
Jul 06 01:37:05.329373 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:37:05.329313    2562 patch_prober.go:28] interesting pod/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 06 01:37:05.329857 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:37:05.329432    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k" podUID="229fc3d7-298c-44e4-93c2-6ee5a04f45a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 01:37:07.408895 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:37:07.408857    2562 generic.go:356] "Generic (PLEG): container finished" podID="229fc3d7-298c-44e4-93c2-6ee5a04f45a8" containerID="07cf7cd586f6f26a899d2fd68f76799be5c2d25e3399fbe41da1707c8deb35f6" exitCode=0
Jul 06 01:37:07.409339 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:37:07.408932    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k" event={"ID":"229fc3d7-298c-44e4-93c2-6ee5a04f45a8","Type":"ContainerDied","Data":"07cf7cd586f6f26a899d2fd68f76799be5c2d25e3399fbe41da1707c8deb35f6"}
Jul 06 01:37:07.409383 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:37:07.409367    2562 scope.go:117] "RemoveContainer" containerID="07cf7cd586f6f26a899d2fd68f76799be5c2d25e3399fbe41da1707c8deb35f6"
Jul 06 01:37:07.410451 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:37:07.410424    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:37:07.410521 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:37:07.410499    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:37:07.410560 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:37:07.410529    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 01:37:08.420173 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:37:08.419110    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k" event={"ID":"229fc3d7-298c-44e4-93c2-6ee5a04f45a8","Type":"ContainerStarted","Data":"10d735db08d41cb2803b37250cf45e4deb5f7f3f5443ae67988db1fadf9813d1"}
Jul 06 01:37:08.632314 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:37:08.632276    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"
Jul 06 01:37:08.632739 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:37:08.632706    2562 patch_prober.go:28] interesting pod/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 06 01:37:08.632874 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:37:08.632769    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k" podUID="229fc3d7-298c-44e4-93c2-6ee5a04f45a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 06 01:37:09.633226 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:37:09.633186    2562 patch_prober.go:28] interesting pod/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 06 01:37:09.633759 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:37:09.633257    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k" podUID="229fc3d7-298c-44e4-93c2-6ee5a04f45a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 06 01:37:10.633481 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:37:10.632999    2562 patch_prober.go:28] interesting pod/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 06 01:37:10.633481 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:37:10.633072    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k" podUID="229fc3d7-298c-44e4-93c2-6ee5a04f45a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 06 01:37:11.633236 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:37:11.633194    2562 patch_prober.go:28] interesting pod/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 06 01:37:11.633560 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:37:11.633527    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k" podUID="229fc3d7-298c-44e4-93c2-6ee5a04f45a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 06 01:37:12.635775 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:37:12.635744    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"
Jul 06 01:37:12.636161 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:37:12.636032    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"
Jul 06 01:37:12.636851 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:37:12.636836    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"
Jul 06 01:41:00.551774 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:41:00.551738    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-7b5094/rate-test-model-7b5094-kserve-75cb668cbc-5v7ln"]
Jul 06 01:41:00.555256 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:41:00.555236    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7b5094/rate-test-model-7b5094-kserve-75cb668cbc-5v7ln"
Jul 06 01:41:00.558628 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:41:00.558596    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-7b5094\"/\"kube-root-ca.crt\""
Jul 06 01:41:00.558747 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:41:00.558594    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7b5094\"/\"rate-test-model-7b5094-kserve-self-signed-certs\""
Jul 06 01:41:00.558747 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:41:00.558735    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-7b5094\"/\"openshift-service-ca.crt\""
Jul 06 01:41:00.558861 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:41:00.558793    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7b5094\"/\"default-dockercfg-skb6x\""
Jul 06 01:41:00.565448 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:41:00.565426    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7b5094/rate-test-model-7b5094-kserve-75cb668cbc-5v7ln"]
Jul 06 01:41:00.681964 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:41:00.681932    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d-home\") pod \"rate-test-model-7b5094-kserve-75cb668cbc-5v7ln\" (UID: \"56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d\") " pod="ai-tenant-e2e-shared-a-7b5094/rate-test-model-7b5094-kserve-75cb668cbc-5v7ln"
Jul 06 01:41:00.682128 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:41:00.682026    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d-tmp-dir\") pod \"rate-test-model-7b5094-kserve-75cb668cbc-5v7ln\" (UID: \"56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d\") " pod="ai-tenant-e2e-shared-a-7b5094/rate-test-model-7b5094-kserve-75cb668cbc-5v7ln"
Jul 06 01:41:00.682128 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:41:00.682067    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d-tls-certs\") pod \"rate-test-model-7b5094-kserve-75cb668cbc-5v7ln\" (UID: \"56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d\") " pod="ai-tenant-e2e-shared-a-7b5094/rate-test-model-7b5094-kserve-75cb668cbc-5v7ln"
Jul 06 01:41:00.682128 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:41:00.682108    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7mvq\" (UniqueName: \"kubernetes.io/projected/56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d-kube-api-access-z7mvq\") pod \"rate-test-model-7b5094-kserve-75cb668cbc-5v7ln\" (UID: \"56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d\") " pod="ai-tenant-e2e-shared-a-7b5094/rate-test-model-7b5094-kserve-75cb668cbc-5v7ln"
Jul 06 01:41:00.682275 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:41:00.682133    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d-model-cache\") pod \"rate-test-model-7b5094-kserve-75cb668cbc-5v7ln\" (UID: \"56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d\") " pod="ai-tenant-e2e-shared-a-7b5094/rate-test-model-7b5094-kserve-75cb668cbc-5v7ln"
Jul 06 01:41:00.682275 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:41:00.682213    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d-dshm\") pod \"rate-test-model-7b5094-kserve-75cb668cbc-5v7ln\" (UID: \"56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d\") " pod="ai-tenant-e2e-shared-a-7b5094/rate-test-model-7b5094-kserve-75cb668cbc-5v7ln"
Jul 06 01:41:00.782916 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:41:00.782883    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d-tmp-dir\") pod \"rate-test-model-7b5094-kserve-75cb668cbc-5v7ln\" (UID: \"56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d\") " pod="ai-tenant-e2e-shared-a-7b5094/rate-test-model-7b5094-kserve-75cb668cbc-5v7ln"
Jul 06 01:41:00.783107 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:41:00.782942    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d-tls-certs\") pod \"rate-test-model-7b5094-kserve-75cb668cbc-5v7ln\" (UID: \"56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d\") " pod="ai-tenant-e2e-shared-a-7b5094/rate-test-model-7b5094-kserve-75cb668cbc-5v7ln"
Jul 06 01:41:00.783107 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:41:00.782989    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7mvq\" (UniqueName: \"kubernetes.io/projected/56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d-kube-api-access-z7mvq\") pod \"rate-test-model-7b5094-kserve-75cb668cbc-5v7ln\" (UID: \"56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d\") " pod="ai-tenant-e2e-shared-a-7b5094/rate-test-model-7b5094-kserve-75cb668cbc-5v7ln"
Jul 06 01:41:00.783107 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:41:00.783012    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d-model-cache\") pod \"rate-test-model-7b5094-kserve-75cb668cbc-5v7ln\" (UID: \"56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d\") " pod="ai-tenant-e2e-shared-a-7b5094/rate-test-model-7b5094-kserve-75cb668cbc-5v7ln"
Jul 06 01:41:00.783107 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:41:00.783038    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d-dshm\") pod \"rate-test-model-7b5094-kserve-75cb668cbc-5v7ln\" (UID: \"56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d\") " pod="ai-tenant-e2e-shared-a-7b5094/rate-test-model-7b5094-kserve-75cb668cbc-5v7ln"
Jul 06 01:41:00.783107 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:41:00.783062    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d-home\") pod \"rate-test-model-7b5094-kserve-75cb668cbc-5v7ln\" (UID: \"56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d\") " pod="ai-tenant-e2e-shared-a-7b5094/rate-test-model-7b5094-kserve-75cb668cbc-5v7ln"
Jul 06 01:41:00.783424 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:41:00.783374    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d-tmp-dir\") pod \"rate-test-model-7b5094-kserve-75cb668cbc-5v7ln\" (UID: \"56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d\") " pod="ai-tenant-e2e-shared-a-7b5094/rate-test-model-7b5094-kserve-75cb668cbc-5v7ln"
Jul 06 01:41:00.783424 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:41:00.783384    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d-model-cache\") pod \"rate-test-model-7b5094-kserve-75cb668cbc-5v7ln\" (UID: \"56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d\") " pod="ai-tenant-e2e-shared-a-7b5094/rate-test-model-7b5094-kserve-75cb668cbc-5v7ln"
Jul 06 01:41:00.783530 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:41:00.783446    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d-home\") pod \"rate-test-model-7b5094-kserve-75cb668cbc-5v7ln\" (UID: \"56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d\") " pod="ai-tenant-e2e-shared-a-7b5094/rate-test-model-7b5094-kserve-75cb668cbc-5v7ln"
Jul 06 01:41:00.785358 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:41:00.785338    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d-dshm\") pod \"rate-test-model-7b5094-kserve-75cb668cbc-5v7ln\" (UID: \"56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d\") " pod="ai-tenant-e2e-shared-a-7b5094/rate-test-model-7b5094-kserve-75cb668cbc-5v7ln"
Jul 06 01:41:00.785525 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:41:00.785510    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d-tls-certs\") pod \"rate-test-model-7b5094-kserve-75cb668cbc-5v7ln\" (UID: \"56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d\") " pod="ai-tenant-e2e-shared-a-7b5094/rate-test-model-7b5094-kserve-75cb668cbc-5v7ln"
Jul 06 01:41:00.790647 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:41:00.790623    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7mvq\" (UniqueName: \"kubernetes.io/projected/56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d-kube-api-access-z7mvq\") pod \"rate-test-model-7b5094-kserve-75cb668cbc-5v7ln\" (UID: \"56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d\") " pod="ai-tenant-e2e-shared-a-7b5094/rate-test-model-7b5094-kserve-75cb668cbc-5v7ln"
Jul 06 01:41:00.866363 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:41:00.866325    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7b5094/rate-test-model-7b5094-kserve-75cb668cbc-5v7ln"
Jul 06 01:41:01.001777 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:41:01.001750    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7b5094/rate-test-model-7b5094-kserve-75cb668cbc-5v7ln"]
Jul 06 01:41:01.004278 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:41:01.004250    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod56e2bf3a_3ecd_4948_bb4e_7fe0f9d7727d.slice/crio-f64a3a7907e52f51d00755bf11f5846dbe5a761308f1b133c0c94c6be9809a2d WatchSource:0}: Error finding container f64a3a7907e52f51d00755bf11f5846dbe5a761308f1b133c0c94c6be9809a2d: Status 404 returned error can't find the container with id f64a3a7907e52f51d00755bf11f5846dbe5a761308f1b133c0c94c6be9809a2d
Jul 06 01:41:01.611531 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:41:01.611495    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7b5094/rate-test-model-7b5094-kserve-75cb668cbc-5v7ln" event={"ID":"56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d","Type":"ContainerStarted","Data":"bb51bcd30280d1aa9e94eb897d79daeff9c6388ca742e7a7a251eb3e5ccf41ba"}
Jul 06 01:41:01.611916 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:41:01.611542    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7b5094/rate-test-model-7b5094-kserve-75cb668cbc-5v7ln" event={"ID":"56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d","Type":"ContainerStarted","Data":"f64a3a7907e52f51d00755bf11f5846dbe5a761308f1b133c0c94c6be9809a2d"}
Jul 06 01:41:01.628119 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:41:01.628058    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-7b5094/rate-test-model-7b5094-kserve-75cb668cbc-5v7ln" podStartSLOduration=1.628037661 podStartE2EDuration="1.628037661s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:41:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:41:01.626956029 +0000 UTC m=+2493.437931274" watchObservedRunningTime="2026-07-06 01:41:01.628037661 +0000 UTC m=+2493.439012904"
Jul 06 01:41:10.866602 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:41:10.866561    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-7b5094/rate-test-model-7b5094-kserve-75cb668cbc-5v7ln"
Jul 06 01:41:10.866602 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:41:10.866610    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-7b5094/rate-test-model-7b5094-kserve-75cb668cbc-5v7ln"
Jul 06 01:41:10.879477 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:41:10.879446    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-7b5094/rate-test-model-7b5094-kserve-75cb668cbc-5v7ln"
Jul 06 01:41:11.671187 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:41:11.671141    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-7b5094/rate-test-model-7b5094-kserve-75cb668cbc-5v7ln"
Jul 06 01:42:10.796899 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:10.796863    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7b5094/rate-test-model-7b5094-kserve-75cb668cbc-5v7ln"]
Jul 06 01:42:13.449584 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:13.449550    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-7b5094-784cbb6db4-9pg6n"]
Jul 06 01:42:13.450066 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:13.449816    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-7b5094-784cbb6db4-9pg6n" podUID="11a557d1-0d05-4858-9f59-fd991a1bdc08" containerName="maas-api" containerID="cri-o://fcce0b092421e30161b5a8a0b0f49378ddff2b2a5667200daa56ce61c1684a31" gracePeriod=30
Jul 06 01:42:13.705191 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:13.705105    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-7b5094-784cbb6db4-9pg6n"
Jul 06 01:42:13.789036 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:13.788988    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jh8j9\" (UniqueName: \"kubernetes.io/projected/11a557d1-0d05-4858-9f59-fd991a1bdc08-kube-api-access-jh8j9\") pod \"11a557d1-0d05-4858-9f59-fd991a1bdc08\" (UID: \"11a557d1-0d05-4858-9f59-fd991a1bdc08\") "
Jul 06 01:42:13.789257 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:13.789054    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11a557d1-0d05-4858-9f59-fd991a1bdc08-maas-api-tls\") pod \"11a557d1-0d05-4858-9f59-fd991a1bdc08\" (UID: \"11a557d1-0d05-4858-9f59-fd991a1bdc08\") "
Jul 06 01:42:13.789257 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:13.789210    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11a557d1-0d05-4858-9f59-fd991a1bdc08-openshift-service-ca\") pod \"11a557d1-0d05-4858-9f59-fd991a1bdc08\" (UID: \"11a557d1-0d05-4858-9f59-fd991a1bdc08\") "
Jul 06 01:42:13.789548 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:13.789513    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11a557d1-0d05-4858-9f59-fd991a1bdc08-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "11a557d1-0d05-4858-9f59-fd991a1bdc08" (UID: "11a557d1-0d05-4858-9f59-fd991a1bdc08"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:42:13.791172 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:13.791132    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11a557d1-0d05-4858-9f59-fd991a1bdc08-kube-api-access-jh8j9" (OuterVolumeSpecName: "kube-api-access-jh8j9") pod "11a557d1-0d05-4858-9f59-fd991a1bdc08" (UID: "11a557d1-0d05-4858-9f59-fd991a1bdc08"). InnerVolumeSpecName "kube-api-access-jh8j9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:42:13.791252 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:13.791179    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11a557d1-0d05-4858-9f59-fd991a1bdc08-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "11a557d1-0d05-4858-9f59-fd991a1bdc08" (UID: "11a557d1-0d05-4858-9f59-fd991a1bdc08"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:42:13.890407 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:13.890369    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11a557d1-0d05-4858-9f59-fd991a1bdc08-openshift-service-ca\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:42:13.890407 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:13.890397    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jh8j9\" (UniqueName: \"kubernetes.io/projected/11a557d1-0d05-4858-9f59-fd991a1bdc08-kube-api-access-jh8j9\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:42:13.890407 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:13.890409    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11a557d1-0d05-4858-9f59-fd991a1bdc08-maas-api-tls\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:42:13.962572 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:13.962486    2562 generic.go:356] "Generic (PLEG): container finished" podID="11a557d1-0d05-4858-9f59-fd991a1bdc08" containerID="fcce0b092421e30161b5a8a0b0f49378ddff2b2a5667200daa56ce61c1684a31" exitCode=0
Jul 06 01:42:13.962572 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:13.962530    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-7b5094-784cbb6db4-9pg6n"
Jul 06 01:42:13.962572 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:13.962561    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-7b5094-784cbb6db4-9pg6n" event={"ID":"11a557d1-0d05-4858-9f59-fd991a1bdc08","Type":"ContainerDied","Data":"fcce0b092421e30161b5a8a0b0f49378ddff2b2a5667200daa56ce61c1684a31"}
Jul 06 01:42:13.962826 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:13.962604    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-7b5094-784cbb6db4-9pg6n" event={"ID":"11a557d1-0d05-4858-9f59-fd991a1bdc08","Type":"ContainerDied","Data":"4513bbe9f568c0b08401c4c4ccde43bfa5d99248878087747247462e2e5aad75"}
Jul 06 01:42:13.962826 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:13.962625    2562 scope.go:117] "RemoveContainer" containerID="fcce0b092421e30161b5a8a0b0f49378ddff2b2a5667200daa56ce61c1684a31"
Jul 06 01:42:13.973368 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:13.973350    2562 scope.go:117] "RemoveContainer" containerID="fcce0b092421e30161b5a8a0b0f49378ddff2b2a5667200daa56ce61c1684a31"
Jul 06 01:42:13.973677 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:42:13.973649    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcce0b092421e30161b5a8a0b0f49378ddff2b2a5667200daa56ce61c1684a31\": container with ID starting with fcce0b092421e30161b5a8a0b0f49378ddff2b2a5667200daa56ce61c1684a31 not found: ID does not exist" containerID="fcce0b092421e30161b5a8a0b0f49378ddff2b2a5667200daa56ce61c1684a31"
Jul 06 01:42:13.973732 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:13.973690    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcce0b092421e30161b5a8a0b0f49378ddff2b2a5667200daa56ce61c1684a31"} err="failed to get container status \"fcce0b092421e30161b5a8a0b0f49378ddff2b2a5667200daa56ce61c1684a31\": rpc error: code = NotFound desc = could not find container \"fcce0b092421e30161b5a8a0b0f49378ddff2b2a5667200daa56ce61c1684a31\": container with ID starting with fcce0b092421e30161b5a8a0b0f49378ddff2b2a5667200daa56ce61c1684a31 not found: ID does not exist"
Jul 06 01:42:13.984948 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:13.984921    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-7b5094-784cbb6db4-9pg6n"]
Jul 06 01:42:13.991081 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:13.991058    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-7b5094-784cbb6db4-9pg6n"]
Jul 06 01:42:14.752429 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:14.752394    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11a557d1-0d05-4858-9f59-fd991a1bdc08" path="/var/lib/kubelet/pods/11a557d1-0d05-4858-9f59-fd991a1bdc08/volumes"
Jul 06 01:42:25.817825 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:25.817778    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-7b5094/rate-test-model-7b5094-kserve-75cb668cbc-5v7ln" podUID="56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d" containerName="main" containerID="cri-o://bb51bcd30280d1aa9e94eb897d79daeff9c6388ca742e7a7a251eb3e5ccf41ba" gracePeriod=45
Jul 06 01:42:26.026107 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:26.026073    2562 generic.go:356] "Generic (PLEG): container finished" podID="56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d" containerID="bb51bcd30280d1aa9e94eb897d79daeff9c6388ca742e7a7a251eb3e5ccf41ba" exitCode=0
Jul 06 01:42:26.026311 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:26.026142    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7b5094/rate-test-model-7b5094-kserve-75cb668cbc-5v7ln" event={"ID":"56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d","Type":"ContainerDied","Data":"bb51bcd30280d1aa9e94eb897d79daeff9c6388ca742e7a7a251eb3e5ccf41ba"}
Jul 06 01:42:26.072828 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:26.072774    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7b5094/rate-test-model-7b5094-kserve-75cb668cbc-5v7ln"
Jul 06 01:42:26.206388 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:26.206349    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d-tmp-dir\") pod \"56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d\" (UID: \"56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d\") "
Jul 06 01:42:26.206594 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:26.206407    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d-tls-certs\") pod \"56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d\" (UID: \"56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d\") "
Jul 06 01:42:26.206594 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:26.206459    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d-dshm\") pod \"56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d\" (UID: \"56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d\") "
Jul 06 01:42:26.206594 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:26.206496    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d-home\") pod \"56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d\" (UID: \"56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d\") "
Jul 06 01:42:26.206776 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:26.206612    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d-model-cache\") pod \"56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d\" (UID: \"56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d\") "
Jul 06 01:42:26.206776 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:26.206651    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7mvq\" (UniqueName: \"kubernetes.io/projected/56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d-kube-api-access-z7mvq\") pod \"56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d\" (UID: \"56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d\") "
Jul 06 01:42:26.206776 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:26.206683    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d" (UID: "56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:42:26.206925 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:26.206843    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d-home" (OuterVolumeSpecName: "home") pod "56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d" (UID: "56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:42:26.206925 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:26.206857    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d-model-cache" (OuterVolumeSpecName: "model-cache") pod "56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d" (UID: "56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:42:26.206996 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:26.206977    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d-tmp-dir\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:42:26.206996 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:26.206992    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d-home\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:42:26.207104 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:26.207000    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d-model-cache\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:42:26.208816 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:26.208787    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d-dshm" (OuterVolumeSpecName: "dshm") pod "56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d" (UID: "56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:42:26.208816 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:26.208809    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d-kube-api-access-z7mvq" (OuterVolumeSpecName: "kube-api-access-z7mvq") pod "56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d" (UID: "56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d"). InnerVolumeSpecName "kube-api-access-z7mvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:42:26.208967 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:26.208824    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d" (UID: "56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:42:26.308212 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:26.308141    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7mvq\" (UniqueName: \"kubernetes.io/projected/56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d-kube-api-access-z7mvq\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:42:26.308212 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:26.308206    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d-tls-certs\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:42:26.308212 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:26.308219    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d-dshm\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:42:27.032379 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:27.032293    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7b5094/rate-test-model-7b5094-kserve-75cb668cbc-5v7ln"
Jul 06 01:42:27.032379 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:27.032330    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7b5094/rate-test-model-7b5094-kserve-75cb668cbc-5v7ln" event={"ID":"56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d","Type":"ContainerDied","Data":"f64a3a7907e52f51d00755bf11f5846dbe5a761308f1b133c0c94c6be9809a2d"}
Jul 06 01:42:27.032935 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:27.032388    2562 scope.go:117] "RemoveContainer" containerID="bb51bcd30280d1aa9e94eb897d79daeff9c6388ca742e7a7a251eb3e5ccf41ba"
Jul 06 01:42:27.050617 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:27.050588    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7b5094/rate-test-model-7b5094-kserve-75cb668cbc-5v7ln"]
Jul 06 01:42:27.055729 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:27.055706    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-7b5094/rate-test-model-7b5094-kserve-75cb668cbc-5v7ln"]
Jul 06 01:42:28.752945 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:28.752911    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d" path="/var/lib/kubelet/pods/56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d/volumes"
Jul 06 01:42:55.181952 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:55.181916    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"]
Jul 06 01:42:55.182403 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:55.182190    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2" podUID="aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83" containerName="istio-proxy" containerID="cri-o://99713a4c23cf3cc2771c35a277bad49972a32622e1af2126d1ed4c58a04c5f16" gracePeriod=30
Jul 06 01:42:56.334608 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:56.334571    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-fe3397-7d875d9567-qgsfg"]
Jul 06 01:42:56.335098 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:56.334845    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-fe3397-7d875d9567-qgsfg" podUID="ffc19d54-1160-4516-b946-cd38ac60a51c" containerName="maas-api" containerID="cri-o://025b26a894b165c3970ad763c037aaae91515587e70bc6ee911c29840cdc3e30" gracePeriod=30
Jul 06 01:42:56.584422 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:56.584396    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-fe3397-7d875d9567-qgsfg"
Jul 06 01:42:56.701415 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:56.701368    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffc19d54-1160-4516-b946-cd38ac60a51c-maas-api-tls\") pod \"ffc19d54-1160-4516-b946-cd38ac60a51c\" (UID: \"ffc19d54-1160-4516-b946-cd38ac60a51c\") "
Jul 06 01:42:56.701737 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:56.701503    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffc19d54-1160-4516-b946-cd38ac60a51c-openshift-service-ca\") pod \"ffc19d54-1160-4516-b946-cd38ac60a51c\" (UID: \"ffc19d54-1160-4516-b946-cd38ac60a51c\") "
Jul 06 01:42:56.701737 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:56.701551    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggckn\" (UniqueName: \"kubernetes.io/projected/ffc19d54-1160-4516-b946-cd38ac60a51c-kube-api-access-ggckn\") pod \"ffc19d54-1160-4516-b946-cd38ac60a51c\" (UID: \"ffc19d54-1160-4516-b946-cd38ac60a51c\") "
Jul 06 01:42:56.701889 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:56.701855    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffc19d54-1160-4516-b946-cd38ac60a51c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ffc19d54-1160-4516-b946-cd38ac60a51c" (UID: "ffc19d54-1160-4516-b946-cd38ac60a51c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:42:56.703608 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:56.703575    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffc19d54-1160-4516-b946-cd38ac60a51c-kube-api-access-ggckn" (OuterVolumeSpecName: "kube-api-access-ggckn") pod "ffc19d54-1160-4516-b946-cd38ac60a51c" (UID: "ffc19d54-1160-4516-b946-cd38ac60a51c"). InnerVolumeSpecName "kube-api-access-ggckn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:42:56.703608 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:56.703594    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffc19d54-1160-4516-b946-cd38ac60a51c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ffc19d54-1160-4516-b946-cd38ac60a51c" (UID: "ffc19d54-1160-4516-b946-cd38ac60a51c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 01:42:56.802949 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:56.802894    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffc19d54-1160-4516-b946-cd38ac60a51c-openshift-service-ca\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:42:56.802949 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:56.802950    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggckn\" (UniqueName: \"kubernetes.io/projected/ffc19d54-1160-4516-b946-cd38ac60a51c-kube-api-access-ggckn\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:42:56.803173 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:56.802963    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffc19d54-1160-4516-b946-cd38ac60a51c-maas-api-tls\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:42:57.190483 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:57.190449    2562 generic.go:356] "Generic (PLEG): container finished" podID="ffc19d54-1160-4516-b946-cd38ac60a51c" containerID="025b26a894b165c3970ad763c037aaae91515587e70bc6ee911c29840cdc3e30" exitCode=0
Jul 06 01:42:57.190665 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:57.190493    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-fe3397-7d875d9567-qgsfg"
Jul 06 01:42:57.190665 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:57.190543    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-fe3397-7d875d9567-qgsfg" event={"ID":"ffc19d54-1160-4516-b946-cd38ac60a51c","Type":"ContainerDied","Data":"025b26a894b165c3970ad763c037aaae91515587e70bc6ee911c29840cdc3e30"}
Jul 06 01:42:57.190665 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:57.190600    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-fe3397-7d875d9567-qgsfg" event={"ID":"ffc19d54-1160-4516-b946-cd38ac60a51c","Type":"ContainerDied","Data":"9801d923e3351c1f4bd75e1e15cf2e2fa2e57dd321fca2758aaba32802107a30"}
Jul 06 01:42:57.190665 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:57.190623    2562 scope.go:117] "RemoveContainer" containerID="025b26a894b165c3970ad763c037aaae91515587e70bc6ee911c29840cdc3e30"
Jul 06 01:42:57.199566 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:57.199549    2562 scope.go:117] "RemoveContainer" containerID="025b26a894b165c3970ad763c037aaae91515587e70bc6ee911c29840cdc3e30"
Jul 06 01:42:57.199814 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:42:57.199796    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"025b26a894b165c3970ad763c037aaae91515587e70bc6ee911c29840cdc3e30\": container with ID starting with 025b26a894b165c3970ad763c037aaae91515587e70bc6ee911c29840cdc3e30 not found: ID does not exist" containerID="025b26a894b165c3970ad763c037aaae91515587e70bc6ee911c29840cdc3e30"
Jul 06 01:42:57.199858 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:57.199822    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"025b26a894b165c3970ad763c037aaae91515587e70bc6ee911c29840cdc3e30"} err="failed to get container status \"025b26a894b165c3970ad763c037aaae91515587e70bc6ee911c29840cdc3e30\": rpc error: code = NotFound desc = could not find container \"025b26a894b165c3970ad763c037aaae91515587e70bc6ee911c29840cdc3e30\": container with ID starting with 025b26a894b165c3970ad763c037aaae91515587e70bc6ee911c29840cdc3e30 not found: ID does not exist"
Jul 06 01:42:57.206401 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:57.206371    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-fe3397-7d875d9567-qgsfg"]
Jul 06 01:42:57.208914 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:57.208894    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-fe3397-7d875d9567-qgsfg"]
Jul 06 01:42:58.752247 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:42:58.752217    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffc19d54-1160-4516-b946-cd38ac60a51c" path="/var/lib/kubelet/pods/ffc19d54-1160-4516-b946-cd38ac60a51c/volumes"
Jul 06 01:43:00.437818 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:00.437795    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"
Jul 06 01:43:00.540299 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:00.540201    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-istiod-ca-cert\") pod \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\" (UID: \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\") "
Jul 06 01:43:00.540299 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:00.540261    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rbhtz\" (UniqueName: \"kubernetes.io/projected/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-kube-api-access-rbhtz\") pod \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\" (UID: \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\") "
Jul 06 01:43:00.540532 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:00.540306    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-credential-socket\") pod \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\" (UID: \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\") "
Jul 06 01:43:00.540532 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:00.540371    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-workload-socket\") pod \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\" (UID: \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\") "
Jul 06 01:43:00.540532 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:00.540395    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-istio-data\") pod \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\" (UID: \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\") "
Jul 06 01:43:00.540532 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:00.540443    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-istio-envoy\") pod \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\" (UID: \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\") "
Jul 06 01:43:00.540532 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:00.540473    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-istio-podinfo\") pod \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\" (UID: \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\") "
Jul 06 01:43:00.540532 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:00.540517    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-istio-token\") pod \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\" (UID: \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\") "
Jul 06 01:43:00.540848 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:00.540616    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-workload-certs\") pod \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\" (UID: \"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83\") "
Jul 06 01:43:00.540848 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:00.540659    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83" (UID: "aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:43:00.540848 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:00.540693    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83" (UID: "aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:43:00.540848 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:00.540676    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83" (UID: "aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:43:00.541059 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:00.540936    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83" (UID: "aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:43:00.541059 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:00.541003    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-istiod-ca-cert\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:43:00.541059 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:00.541022    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-credential-socket\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:43:00.541059 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:00.541044    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-workload-socket\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:43:00.541590 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:00.541565    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-istio-data" (OuterVolumeSpecName: "istio-data") pod "aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83" (UID: "aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:43:00.542568 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:00.542547    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-kube-api-access-rbhtz" (OuterVolumeSpecName: "kube-api-access-rbhtz") pod "aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83" (UID: "aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83"). InnerVolumeSpecName "kube-api-access-rbhtz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:43:00.542808 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:00.542783    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83" (UID: "aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:43:00.543041 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:00.543026    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83" (UID: "aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 01:43:00.543138 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:00.543111    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-istio-token" (OuterVolumeSpecName: "istio-token") pod "aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83" (UID: "aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:43:00.641593 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:00.641559    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-istio-data\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:43:00.641593 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:00.641587    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-istio-envoy\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:43:00.641593 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:00.641595    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-istio-podinfo\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:43:00.641593 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:00.641603    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-istio-token\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:43:00.641895 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:00.641611    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-workload-certs\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:43:00.641895 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:00.641621    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbhtz\" (UniqueName: \"kubernetes.io/projected/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83-kube-api-access-rbhtz\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:43:01.212308 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:01.212271    2562 generic.go:356] "Generic (PLEG): container finished" podID="aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83" containerID="99713a4c23cf3cc2771c35a277bad49972a32622e1af2126d1ed4c58a04c5f16" exitCode=0
Jul 06 01:43:01.212490 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:01.212330    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"
Jul 06 01:43:01.212490 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:01.212349    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2" event={"ID":"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83","Type":"ContainerDied","Data":"99713a4c23cf3cc2771c35a277bad49972a32622e1af2126d1ed4c58a04c5f16"}
Jul 06 01:43:01.212490 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:01.212425    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2" event={"ID":"aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83","Type":"ContainerDied","Data":"67416f0691e8e58cfe33a80d7f5b9e706bd7f035fd1a1e722b58616146caff38"}
Jul 06 01:43:01.212490 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:01.212447    2562 scope.go:117] "RemoveContainer" containerID="99713a4c23cf3cc2771c35a277bad49972a32622e1af2126d1ed4c58a04c5f16"
Jul 06 01:43:01.221061 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:01.221038    2562 scope.go:117] "RemoveContainer" containerID="b1c83a9efc87b4e15fcccdaa4d293ece6b723eb2ce97ac585274583fe5f53c65"
Jul 06 01:43:01.228891 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:01.228864    2562 scope.go:117] "RemoveContainer" containerID="99713a4c23cf3cc2771c35a277bad49972a32622e1af2126d1ed4c58a04c5f16"
Jul 06 01:43:01.229587 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:43:01.229559    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99713a4c23cf3cc2771c35a277bad49972a32622e1af2126d1ed4c58a04c5f16\": container with ID starting with 99713a4c23cf3cc2771c35a277bad49972a32622e1af2126d1ed4c58a04c5f16 not found: ID does not exist" containerID="99713a4c23cf3cc2771c35a277bad49972a32622e1af2126d1ed4c58a04c5f16"
Jul 06 01:43:01.229687 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:01.229597    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99713a4c23cf3cc2771c35a277bad49972a32622e1af2126d1ed4c58a04c5f16"} err="failed to get container status \"99713a4c23cf3cc2771c35a277bad49972a32622e1af2126d1ed4c58a04c5f16\": rpc error: code = NotFound desc = could not find container \"99713a4c23cf3cc2771c35a277bad49972a32622e1af2126d1ed4c58a04c5f16\": container with ID starting with 99713a4c23cf3cc2771c35a277bad49972a32622e1af2126d1ed4c58a04c5f16 not found: ID does not exist"
Jul 06 01:43:01.229687 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:01.229616    2562 scope.go:117] "RemoveContainer" containerID="b1c83a9efc87b4e15fcccdaa4d293ece6b723eb2ce97ac585274583fe5f53c65"
Jul 06 01:43:01.229926 ip-10-0-131-116 kubenswrapper[2562]: E0706 01:43:01.229904    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1c83a9efc87b4e15fcccdaa4d293ece6b723eb2ce97ac585274583fe5f53c65\": container with ID starting with b1c83a9efc87b4e15fcccdaa4d293ece6b723eb2ce97ac585274583fe5f53c65 not found: ID does not exist" containerID="b1c83a9efc87b4e15fcccdaa4d293ece6b723eb2ce97ac585274583fe5f53c65"
Jul 06 01:43:01.229999 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:01.229935    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1c83a9efc87b4e15fcccdaa4d293ece6b723eb2ce97ac585274583fe5f53c65"} err="failed to get container status \"b1c83a9efc87b4e15fcccdaa4d293ece6b723eb2ce97ac585274583fe5f53c65\": rpc error: code = NotFound desc = could not find container \"b1c83a9efc87b4e15fcccdaa4d293ece6b723eb2ce97ac585274583fe5f53c65\": container with ID starting with b1c83a9efc87b4e15fcccdaa4d293ece6b723eb2ce97ac585274583fe5f53c65 not found: ID does not exist"
Jul 06 01:43:01.231445 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:01.231427    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"]
Jul 06 01:43:01.237001 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:01.236981    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-7b5094-openshift-default-c7b6c544c-pg8b2"]
Jul 06 01:43:02.122591 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:02.122560    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"]
Jul 06 01:43:02.123067 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:02.122823    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k" podUID="229fc3d7-298c-44e4-93c2-6ee5a04f45a8" containerName="istio-proxy" containerID="cri-o://10d735db08d41cb2803b37250cf45e4deb5f7f3f5443ae67988db1fadf9813d1" gracePeriod=30
Jul 06 01:43:02.752984 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:02.752951    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83" path="/var/lib/kubelet/pods/aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83/volumes"
Jul 06 01:43:07.243529 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:07.243496    2562 generic.go:356] "Generic (PLEG): container finished" podID="229fc3d7-298c-44e4-93c2-6ee5a04f45a8" containerID="10d735db08d41cb2803b37250cf45e4deb5f7f3f5443ae67988db1fadf9813d1" exitCode=0
Jul 06 01:43:07.243879 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:07.243559    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k" event={"ID":"229fc3d7-298c-44e4-93c2-6ee5a04f45a8","Type":"ContainerDied","Data":"10d735db08d41cb2803b37250cf45e4deb5f7f3f5443ae67988db1fadf9813d1"}
Jul 06 01:43:07.243879 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:07.243620    2562 scope.go:117] "RemoveContainer" containerID="07cf7cd586f6f26a899d2fd68f76799be5c2d25e3399fbe41da1707c8deb35f6"
Jul 06 01:43:07.377787 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:07.377761    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"
Jul 06 01:43:07.510946 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:07.510863    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-workload-socket\") pod \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\" (UID: \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\") "
Jul 06 01:43:07.510946 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:07.510917    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-istio-podinfo\") pod \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\" (UID: \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\") "
Jul 06 01:43:07.510946 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:07.510933    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-credential-socket\") pod \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\" (UID: \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\") "
Jul 06 01:43:07.511244 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:07.510976    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-istio-envoy\") pod \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\" (UID: \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\") "
Jul 06 01:43:07.511244 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:07.511015    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-istio-data\") pod \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\" (UID: \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\") "
Jul 06 01:43:07.511244 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:07.511049    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-istiod-ca-cert\") pod \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\" (UID: \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\") "
Jul 06 01:43:07.511244 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:07.511074    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-workload-certs\") pod \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\" (UID: \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\") "
Jul 06 01:43:07.511244 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:07.511111    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-istio-token\") pod \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\" (UID: \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\") "
Jul 06 01:43:07.511244 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:07.511178    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ktg8g\" (UniqueName: \"kubernetes.io/projected/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-kube-api-access-ktg8g\") pod \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\" (UID: \"229fc3d7-298c-44e4-93c2-6ee5a04f45a8\") "
Jul 06 01:43:07.511555 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:07.511348    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "229fc3d7-298c-44e4-93c2-6ee5a04f45a8" (UID: "229fc3d7-298c-44e4-93c2-6ee5a04f45a8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:43:07.511555 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:07.511502    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "229fc3d7-298c-44e4-93c2-6ee5a04f45a8" (UID: "229fc3d7-298c-44e4-93c2-6ee5a04f45a8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:43:07.511555 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:07.511518    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-credential-socket\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:43:07.511555 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:07.511530    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "229fc3d7-298c-44e4-93c2-6ee5a04f45a8" (UID: "229fc3d7-298c-44e4-93c2-6ee5a04f45a8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 01:43:07.511788 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:07.511754    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "229fc3d7-298c-44e4-93c2-6ee5a04f45a8" (UID: "229fc3d7-298c-44e4-93c2-6ee5a04f45a8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:43:07.511980 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:07.511957    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-istio-data" (OuterVolumeSpecName: "istio-data") pod "229fc3d7-298c-44e4-93c2-6ee5a04f45a8" (UID: "229fc3d7-298c-44e4-93c2-6ee5a04f45a8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:43:07.513545 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:07.513521    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-kube-api-access-ktg8g" (OuterVolumeSpecName: "kube-api-access-ktg8g") pod "229fc3d7-298c-44e4-93c2-6ee5a04f45a8" (UID: "229fc3d7-298c-44e4-93c2-6ee5a04f45a8"). InnerVolumeSpecName "kube-api-access-ktg8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:43:07.513695 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:07.513660    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "229fc3d7-298c-44e4-93c2-6ee5a04f45a8" (UID: "229fc3d7-298c-44e4-93c2-6ee5a04f45a8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 01:43:07.513695 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:07.513668    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-istio-token" (OuterVolumeSpecName: "istio-token") pod "229fc3d7-298c-44e4-93c2-6ee5a04f45a8" (UID: "229fc3d7-298c-44e4-93c2-6ee5a04f45a8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 01:43:07.513833 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:07.513708    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "229fc3d7-298c-44e4-93c2-6ee5a04f45a8" (UID: "229fc3d7-298c-44e4-93c2-6ee5a04f45a8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 01:43:07.612620 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:07.612576    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-istiod-ca-cert\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:43:07.612620 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:07.612611    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-workload-certs\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:43:07.612620 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:07.612622    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-istio-token\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:43:07.612869 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:07.612633    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ktg8g\" (UniqueName: \"kubernetes.io/projected/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-kube-api-access-ktg8g\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:43:07.612869 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:07.612647    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-workload-socket\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:43:07.612869 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:07.612659    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-istio-podinfo\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:43:07.612869 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:07.612670    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-istio-envoy\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:43:07.612869 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:07.612680    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/229fc3d7-298c-44e4-93c2-6ee5a04f45a8-istio-data\") on node \"ip-10-0-131-116.ec2.internal\" DevicePath \"\""
Jul 06 01:43:07.804037 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:07.803959    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29721675-k4qcc_29e61ada-30a1-4341-968d-7804bb8832b7/cleanup/0.log"
Jul 06 01:43:07.938267 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:07.938238    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29721690-hnrlr_e8089c5f-ef38-4619-9530-1def224f99ae/cleanup/0.log"
Jul 06 01:43:08.250652 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:08.250615    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k" event={"ID":"229fc3d7-298c-44e4-93c2-6ee5a04f45a8","Type":"ContainerDied","Data":"2a44db96222c1eee465a548231954fa193443027f227e1488dc0ebe0842ecb0c"}
Jul 06 01:43:08.250652 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:08.250637    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"
Jul 06 01:43:08.251224 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:08.250684    2562 scope.go:117] "RemoveContainer" containerID="10d735db08d41cb2803b37250cf45e4deb5f7f3f5443ae67988db1fadf9813d1"
Jul 06 01:43:08.273549 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:08.273526    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"]
Jul 06 01:43:08.277373 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:08.277350    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-fe3397-openshift-default-665f4cddbc-jt26k"]
Jul 06 01:43:08.520960 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:08.520886    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l_ad8bcc1e-2979-43e2-908a-760544f457b4/copy-manifests/0.log"
Jul 06 01:43:08.528258 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:08.528235    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l_ad8bcc1e-2979-43e2-908a-760544f457b4/manager/0.log"
Jul 06 01:43:08.753227 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:08.753198    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="229fc3d7-298c-44e4-93c2-6ee5a04f45a8" path="/var/lib/kubelet/pods/229fc3d7-298c-44e4-93c2-6ee5a04f45a8/volumes"
Jul 06 01:43:10.192769 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:10.192739    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-d7hct_c59e6d3f-b313-443d-a71f-512502e5945b/manager/0.log"
Jul 06 01:43:10.414540 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:10.414513    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-s4nw5_b00d8c4c-95c3-49a1-adef-cd375ee5cb01/kuadrant-console-plugin/0.log"
Jul 06 01:43:11.655360 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:11.655330    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-557bfcf777-sps77_1fe777b9-df8e-4ec8-b517-4cf6f0cd2160/kube-auth-proxy/0.log"
Jul 06 01:43:12.501934 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:12.501899    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-5sk8g_cb205dfa-8776-4a97-866c-2408d9bbb245/main/0.log"
Jul 06 01:43:12.617574 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:12.617533    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-jtd6q_c2dac909-bcef-4d85-98fe-4fe41f7ca6f4/main/0.log"
Jul 06 01:43:17.604622 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:17.604585    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gk2mn/must-gather-ttn6z"]
Jul 06 01:43:17.605019 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:17.604972    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11a557d1-0d05-4858-9f59-fd991a1bdc08" containerName="maas-api"
Jul 06 01:43:17.605019 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:17.604983    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="11a557d1-0d05-4858-9f59-fd991a1bdc08" containerName="maas-api"
Jul 06 01:43:17.605019 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:17.604990    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffc19d54-1160-4516-b946-cd38ac60a51c" containerName="maas-api"
Jul 06 01:43:17.605019 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:17.604996    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffc19d54-1160-4516-b946-cd38ac60a51c" containerName="maas-api"
Jul 06 01:43:17.605019 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:17.605010    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83" containerName="istio-proxy"
Jul 06 01:43:17.605019 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:17.605017    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83" containerName="istio-proxy"
Jul 06 01:43:17.605019 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:17.605022    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="229fc3d7-298c-44e4-93c2-6ee5a04f45a8" containerName="istio-proxy"
Jul 06 01:43:17.605275 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:17.605038    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="229fc3d7-298c-44e4-93c2-6ee5a04f45a8" containerName="istio-proxy"
Jul 06 01:43:17.605275 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:17.605048    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d" containerName="main"
Jul 06 01:43:17.605275 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:17.605053    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d" containerName="main"
Jul 06 01:43:17.605275 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:17.605064    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="229fc3d7-298c-44e4-93c2-6ee5a04f45a8" containerName="istio-proxy"
Jul 06 01:43:17.605275 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:17.605070    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="229fc3d7-298c-44e4-93c2-6ee5a04f45a8" containerName="istio-proxy"
Jul 06 01:43:17.605275 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:17.605076    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83" containerName="istio-proxy"
Jul 06 01:43:17.605275 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:17.605082    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83" containerName="istio-proxy"
Jul 06 01:43:17.605275 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:17.605137    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="56e2bf3a-3ecd-4948-bb4e-7fe0f9d7727d" containerName="main"
Jul 06 01:43:17.605275 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:17.605162    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="229fc3d7-298c-44e4-93c2-6ee5a04f45a8" containerName="istio-proxy"
Jul 06 01:43:17.605275 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:17.605169    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="11a557d1-0d05-4858-9f59-fd991a1bdc08" containerName="maas-api"
Jul 06 01:43:17.605275 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:17.605176    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffc19d54-1160-4516-b946-cd38ac60a51c" containerName="maas-api"
Jul 06 01:43:17.605275 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:17.605183    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83" containerName="istio-proxy"
Jul 06 01:43:17.605275 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:17.605188    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa936b60-e6cb-46eb-8f50-c1c0ec2d4c83" containerName="istio-proxy"
Jul 06 01:43:17.605662 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:17.605297    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="229fc3d7-298c-44e4-93c2-6ee5a04f45a8" containerName="istio-proxy"
Jul 06 01:43:17.609625 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:17.609607    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gk2mn/must-gather-ttn6z"
Jul 06 01:43:17.611819 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:17.611792    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gk2mn\"/\"default-dockercfg-nbpn6\""
Jul 06 01:43:17.611924 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:17.611823    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gk2mn\"/\"openshift-service-ca.crt\""
Jul 06 01:43:17.612820 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:17.612798    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gk2mn\"/\"kube-root-ca.crt\""
Jul 06 01:43:17.618319 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:17.618297    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gk2mn/must-gather-ttn6z"]
Jul 06 01:43:17.703239 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:17.703200    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zhfx\" (UniqueName: \"kubernetes.io/projected/cf308ae2-7cf5-4ce8-8f8c-806c81bcd463-kube-api-access-9zhfx\") pod \"must-gather-ttn6z\" (UID: \"cf308ae2-7cf5-4ce8-8f8c-806c81bcd463\") " pod="openshift-must-gather-gk2mn/must-gather-ttn6z"
Jul 06 01:43:17.703239 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:17.703240    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cf308ae2-7cf5-4ce8-8f8c-806c81bcd463-must-gather-output\") pod \"must-gather-ttn6z\" (UID: \"cf308ae2-7cf5-4ce8-8f8c-806c81bcd463\") " pod="openshift-must-gather-gk2mn/must-gather-ttn6z"
Jul 06 01:43:17.804162 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:17.804119    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zhfx\" (UniqueName: \"kubernetes.io/projected/cf308ae2-7cf5-4ce8-8f8c-806c81bcd463-kube-api-access-9zhfx\") pod \"must-gather-ttn6z\" (UID: \"cf308ae2-7cf5-4ce8-8f8c-806c81bcd463\") " pod="openshift-must-gather-gk2mn/must-gather-ttn6z"
Jul 06 01:43:17.804386 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:17.804196    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cf308ae2-7cf5-4ce8-8f8c-806c81bcd463-must-gather-output\") pod \"must-gather-ttn6z\" (UID: \"cf308ae2-7cf5-4ce8-8f8c-806c81bcd463\") " pod="openshift-must-gather-gk2mn/must-gather-ttn6z"
Jul 06 01:43:17.804514 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:17.804498    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cf308ae2-7cf5-4ce8-8f8c-806c81bcd463-must-gather-output\") pod \"must-gather-ttn6z\" (UID: \"cf308ae2-7cf5-4ce8-8f8c-806c81bcd463\") " pod="openshift-must-gather-gk2mn/must-gather-ttn6z"
Jul 06 01:43:17.811575 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:17.811550    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zhfx\" (UniqueName: \"kubernetes.io/projected/cf308ae2-7cf5-4ce8-8f8c-806c81bcd463-kube-api-access-9zhfx\") pod \"must-gather-ttn6z\" (UID: \"cf308ae2-7cf5-4ce8-8f8c-806c81bcd463\") " pod="openshift-must-gather-gk2mn/must-gather-ttn6z"
Jul 06 01:43:17.919553 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:17.919468    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gk2mn/must-gather-ttn6z"
Jul 06 01:43:18.053446 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:18.053378    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gk2mn/must-gather-ttn6z"]
Jul 06 01:43:18.056247 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:43:18.056218    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf308ae2_7cf5_4ce8_8f8c_806c81bcd463.slice/crio-8c18b5c5b067b69fcf3086128f2b82c94afa2952a20ab55d206e71fc5aa0d6ea WatchSource:0}: Error finding container 8c18b5c5b067b69fcf3086128f2b82c94afa2952a20ab55d206e71fc5aa0d6ea: Status 404 returned error can't find the container with id 8c18b5c5b067b69fcf3086128f2b82c94afa2952a20ab55d206e71fc5aa0d6ea
Jul 06 01:43:18.058286 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:18.058265    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 01:43:18.303306 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:18.303204    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gk2mn/must-gather-ttn6z" event={"ID":"cf308ae2-7cf5-4ce8-8f8c-806c81bcd463","Type":"ContainerStarted","Data":"8c18b5c5b067b69fcf3086128f2b82c94afa2952a20ab55d206e71fc5aa0d6ea"}
Jul 06 01:43:19.315184 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:19.315106    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gk2mn/must-gather-ttn6z" event={"ID":"cf308ae2-7cf5-4ce8-8f8c-806c81bcd463","Type":"ContainerStarted","Data":"25b565ffb99c131235f4d03fc46dfd95d59c9ee6083800e95cf568037c549fdd"}
Jul 06 01:43:19.315184 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:19.315188    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gk2mn/must-gather-ttn6z" event={"ID":"cf308ae2-7cf5-4ce8-8f8c-806c81bcd463","Type":"ContainerStarted","Data":"59e1f1cbc6e43e4cf1c71753d82fa7aefb31a770a2cbd08fe56eb581724bd08d"}
Jul 06 01:43:19.334581 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:19.334515    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gk2mn/must-gather-ttn6z" podStartSLOduration=1.7167904 podStartE2EDuration="2.334492594s" totalImagesPullingTime="617.702194ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:43:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:43:19.330911832 +0000 UTC m=+2631.141887077" watchObservedRunningTime="2026-07-06 01:43:19.334492594 +0000 UTC m=+2631.145467838"
Jul 06 01:43:20.269074 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:20.269039    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-k5tl7_031c56b1-8f37-41d8-b7a3-0b9ab95ca0e2/global-pull-secret-syncer/0.log"
Jul 06 01:43:20.408977 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:20.408938    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-db55n_7d19f25b-ac66-4e32-9ac9-2bccbbe89113/konnectivity-agent/0.log"
Jul 06 01:43:20.464689 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:20.464647    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-116.ec2.internal_2b0e7f033d28149e3cc1491a1bf5fe87/haproxy/0.log"
Jul 06 01:43:25.228478 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:25.228445    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-d7hct_c59e6d3f-b313-443d-a71f-512502e5945b/manager/0.log"
Jul 06 01:43:25.288445 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:25.288413    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-s4nw5_b00d8c4c-95c3-49a1-adef-cd375ee5cb01/kuadrant-console-plugin/0.log"
Jul 06 01:43:27.614762 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:27.614717    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_70c5457e-be63-488d-994a-41a4795e7084/alertmanager/0.log"
Jul 06 01:43:27.638443 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:27.638410    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_70c5457e-be63-488d-994a-41a4795e7084/config-reloader/0.log"
Jul 06 01:43:27.661340 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:27.661309    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_70c5457e-be63-488d-994a-41a4795e7084/kube-rbac-proxy-web/0.log"
Jul 06 01:43:27.687019 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:27.686986    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_70c5457e-be63-488d-994a-41a4795e7084/kube-rbac-proxy/0.log"
Jul 06 01:43:27.708437 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:27.708407    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_70c5457e-be63-488d-994a-41a4795e7084/kube-rbac-proxy-metric/0.log"
Jul 06 01:43:27.730858 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:27.730832    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_70c5457e-be63-488d-994a-41a4795e7084/prom-label-proxy/0.log"
Jul 06 01:43:27.757323 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:27.757294    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_70c5457e-be63-488d-994a-41a4795e7084/init-config-reloader/0.log"
Jul 06 01:43:27.820652 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:27.820620    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-h99km_5654f63c-8a47-47e6-8432-ead067ca8e57/kube-state-metrics/0.log"
Jul 06 01:43:27.851497 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:27.851468    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-h99km_5654f63c-8a47-47e6-8432-ead067ca8e57/kube-rbac-proxy-main/0.log"
Jul 06 01:43:27.877671 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:27.877592    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-h99km_5654f63c-8a47-47e6-8432-ead067ca8e57/kube-rbac-proxy-self/0.log"
Jul 06 01:43:27.904858 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:27.904816    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7d67fb6459-k6wnr_ded48176-1bb7-47cb-b939-14e34bbd5aec/metrics-server/0.log"
Jul 06 01:43:27.964655 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:27.964621    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g8m44_e499a182-9627-48dd-847c-5c141d2fc798/node-exporter/0.log"
Jul 06 01:43:27.985910 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:27.985877    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g8m44_e499a182-9627-48dd-847c-5c141d2fc798/kube-rbac-proxy/0.log"
Jul 06 01:43:28.006379 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:28.006347    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g8m44_e499a182-9627-48dd-847c-5c141d2fc798/init-textfile/0.log"
Jul 06 01:43:28.300268 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:28.300183    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ce5d2828-ce6b-4cef-8a5f-6412ca5234e3/prometheus/0.log"
Jul 06 01:43:28.321093 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:28.321060    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ce5d2828-ce6b-4cef-8a5f-6412ca5234e3/config-reloader/0.log"
Jul 06 01:43:28.344877 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:28.344846    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ce5d2828-ce6b-4cef-8a5f-6412ca5234e3/thanos-sidecar/0.log"
Jul 06 01:43:28.395040 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:28.395012    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ce5d2828-ce6b-4cef-8a5f-6412ca5234e3/kube-rbac-proxy-web/0.log"
Jul 06 01:43:28.445810 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:28.445754    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ce5d2828-ce6b-4cef-8a5f-6412ca5234e3/kube-rbac-proxy/0.log"
Jul 06 01:43:28.522193 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:28.522161    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ce5d2828-ce6b-4cef-8a5f-6412ca5234e3/kube-rbac-proxy-thanos/0.log"
Jul 06 01:43:28.550441 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:28.550334    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ce5d2828-ce6b-4cef-8a5f-6412ca5234e3/init-config-reloader/0.log"
Jul 06 01:43:28.627056 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:28.627017    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-lpdxf_2dadc431-36da-4e6e-bd52-366da0f4624c/prometheus-operator-admission-webhook/0.log"
Jul 06 01:43:28.659197 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:28.659166    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8575d6f685-xtcth_5f9e1df5-7c67-4761-955e-0219c2029393/telemeter-client/0.log"
Jul 06 01:43:28.682894 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:28.682862    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8575d6f685-xtcth_5f9e1df5-7c67-4761-955e-0219c2029393/reload/0.log"
Jul 06 01:43:28.703664 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:28.703626    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8575d6f685-xtcth_5f9e1df5-7c67-4761-955e-0219c2029393/kube-rbac-proxy/0.log"
Jul 06 01:43:30.074133 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:30.074093    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-wf4nz_5edeab24-165c-43b4-99bc-78ec365f9053/networking-console-plugin/0.log"
Jul 06 01:43:30.755218 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:30.755185    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gk2mn/perf-node-gather-daemonset-7k5ct"]
Jul 06 01:43:30.763332 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:30.763299    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gk2mn/perf-node-gather-daemonset-7k5ct"]
Jul 06 01:43:30.763571 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:30.763436    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7k5ct"
Jul 06 01:43:30.857122 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:30.857085    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrg6p\" (UniqueName: \"kubernetes.io/projected/fd2d5bc4-c4dc-4a0a-9a15-742cf1dc65c3-kube-api-access-vrg6p\") pod \"perf-node-gather-daemonset-7k5ct\" (UID: \"fd2d5bc4-c4dc-4a0a-9a15-742cf1dc65c3\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7k5ct"
Jul 06 01:43:30.857122 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:30.857126    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fd2d5bc4-c4dc-4a0a-9a15-742cf1dc65c3-podres\") pod \"perf-node-gather-daemonset-7k5ct\" (UID: \"fd2d5bc4-c4dc-4a0a-9a15-742cf1dc65c3\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7k5ct"
Jul 06 01:43:30.857408 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:30.857202    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fd2d5bc4-c4dc-4a0a-9a15-742cf1dc65c3-proc\") pod \"perf-node-gather-daemonset-7k5ct\" (UID: \"fd2d5bc4-c4dc-4a0a-9a15-742cf1dc65c3\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7k5ct"
Jul 06 01:43:30.857408 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:30.857256    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd2d5bc4-c4dc-4a0a-9a15-742cf1dc65c3-sys\") pod \"perf-node-gather-daemonset-7k5ct\" (UID: \"fd2d5bc4-c4dc-4a0a-9a15-742cf1dc65c3\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7k5ct"
Jul 06 01:43:30.857408 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:30.857287    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fd2d5bc4-c4dc-4a0a-9a15-742cf1dc65c3-lib-modules\") pod \"perf-node-gather-daemonset-7k5ct\" (UID: \"fd2d5bc4-c4dc-4a0a-9a15-742cf1dc65c3\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7k5ct"
Jul 06 01:43:30.958885 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:30.958847    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrg6p\" (UniqueName: \"kubernetes.io/projected/fd2d5bc4-c4dc-4a0a-9a15-742cf1dc65c3-kube-api-access-vrg6p\") pod \"perf-node-gather-daemonset-7k5ct\" (UID: \"fd2d5bc4-c4dc-4a0a-9a15-742cf1dc65c3\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7k5ct"
Jul 06 01:43:30.959261 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:30.959231    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fd2d5bc4-c4dc-4a0a-9a15-742cf1dc65c3-podres\") pod \"perf-node-gather-daemonset-7k5ct\" (UID: \"fd2d5bc4-c4dc-4a0a-9a15-742cf1dc65c3\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7k5ct"
Jul 06 01:43:30.959507 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:30.959269    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fd2d5bc4-c4dc-4a0a-9a15-742cf1dc65c3-podres\") pod \"perf-node-gather-daemonset-7k5ct\" (UID: \"fd2d5bc4-c4dc-4a0a-9a15-742cf1dc65c3\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7k5ct"
Jul 06 01:43:30.959619 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:30.959506    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fd2d5bc4-c4dc-4a0a-9a15-742cf1dc65c3-proc\") pod \"perf-node-gather-daemonset-7k5ct\" (UID: \"fd2d5bc4-c4dc-4a0a-9a15-742cf1dc65c3\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7k5ct"
Jul 06 01:43:30.959619 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:30.959560    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fd2d5bc4-c4dc-4a0a-9a15-742cf1dc65c3-proc\") pod \"perf-node-gather-daemonset-7k5ct\" (UID: \"fd2d5bc4-c4dc-4a0a-9a15-742cf1dc65c3\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7k5ct"
Jul 06 01:43:30.959619 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:30.959563    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd2d5bc4-c4dc-4a0a-9a15-742cf1dc65c3-sys\") pod \"perf-node-gather-daemonset-7k5ct\" (UID: \"fd2d5bc4-c4dc-4a0a-9a15-742cf1dc65c3\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7k5ct"
Jul 06 01:43:30.959619 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:30.959608    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fd2d5bc4-c4dc-4a0a-9a15-742cf1dc65c3-lib-modules\") pod \"perf-node-gather-daemonset-7k5ct\" (UID: \"fd2d5bc4-c4dc-4a0a-9a15-742cf1dc65c3\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7k5ct"
Jul 06 01:43:30.959763 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:30.959620    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd2d5bc4-c4dc-4a0a-9a15-742cf1dc65c3-sys\") pod \"perf-node-gather-daemonset-7k5ct\" (UID: \"fd2d5bc4-c4dc-4a0a-9a15-742cf1dc65c3\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7k5ct"
Jul 06 01:43:30.959763 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:30.959738    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fd2d5bc4-c4dc-4a0a-9a15-742cf1dc65c3-lib-modules\") pod \"perf-node-gather-daemonset-7k5ct\" (UID: \"fd2d5bc4-c4dc-4a0a-9a15-742cf1dc65c3\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7k5ct"
Jul 06 01:43:30.967811 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:30.967783    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrg6p\" (UniqueName: \"kubernetes.io/projected/fd2d5bc4-c4dc-4a0a-9a15-742cf1dc65c3-kube-api-access-vrg6p\") pod \"perf-node-gather-daemonset-7k5ct\" (UID: \"fd2d5bc4-c4dc-4a0a-9a15-742cf1dc65c3\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7k5ct"
Jul 06 01:43:31.080675 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:31.080584    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7k5ct"
Jul 06 01:43:31.250813 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:31.250781    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-kwskq_694f3a2a-bb7d-4089-8fd0-2810ac412f4a/download-server/0.log"
Jul 06 01:43:31.251731 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:31.251702    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gk2mn/perf-node-gather-daemonset-7k5ct"]
Jul 06 01:43:31.256778 ip-10-0-131-116 kubenswrapper[2562]: W0706 01:43:31.256742    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfd2d5bc4_c4dc_4a0a_9a15_742cf1dc65c3.slice/crio-6a1179acc99a09973206e53de3138139e64dadc0d9e9541f9e1ef317754f7d38 WatchSource:0}: Error finding container 6a1179acc99a09973206e53de3138139e64dadc0d9e9541f9e1ef317754f7d38: Status 404 returned error can't find the container with id 6a1179acc99a09973206e53de3138139e64dadc0d9e9541f9e1ef317754f7d38
Jul 06 01:43:31.399562 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:31.399525    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7k5ct" event={"ID":"fd2d5bc4-c4dc-4a0a-9a15-742cf1dc65c3","Type":"ContainerStarted","Data":"04415553a10971d37983fff56c8dcbdbcc944cc61a6f5e3eba077c4d9fb0c144"}
Jul 06 01:43:31.399721 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:31.399587    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7k5ct" event={"ID":"fd2d5bc4-c4dc-4a0a-9a15-742cf1dc65c3","Type":"ContainerStarted","Data":"6a1179acc99a09973206e53de3138139e64dadc0d9e9541f9e1ef317754f7d38"}
Jul 06 01:43:31.399721 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:31.399695    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7k5ct"
Jul 06 01:43:31.415870 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:31.415814    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7k5ct" podStartSLOduration=1.415798402 podStartE2EDuration="1.415798402s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 01:43:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:43:31.413458149 +0000 UTC m=+2643.224433395" watchObservedRunningTime="2026-07-06 01:43:31.415798402 +0000 UTC m=+2643.226773645"
Jul 06 01:43:31.886378 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:31.886347    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-fq752_09df05c1-c9be-4006-aed4-6d113691034a/volume-data-source-validator/0.log"
Jul 06 01:43:32.971487 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:32.971446    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wzts5_ed4b54f1-1212-4ce2-b731-13bca488ecb3/dns/0.log"
Jul 06 01:43:32.993251 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:32.993173    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wzts5_ed4b54f1-1212-4ce2-b731-13bca488ecb3/kube-rbac-proxy/0.log"
Jul 06 01:43:33.014600 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:33.014576    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4fmfs_f19b579f-765e-455e-92c2-602da92d5bb2/dns-node-resolver/0.log"
Jul 06 01:43:33.698472 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:33.698444    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9b7nw_794399e2-dfe6-4b25-8879-858657cb407b/node-ca/0.log"
Jul 06 01:43:34.800451 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:34.800418    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-557bfcf777-sps77_1fe777b9-df8e-4ec8-b517-4cf6f0cd2160/kube-auth-proxy/0.log"
Jul 06 01:43:35.706684 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:35.706650    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vv5dh_826bcf71-9bfe-418b-9d64-410edfad23df/serve-healthcheck-canary/0.log"
Jul 06 01:43:36.223344 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:36.223309    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-97znw_71387668-1da1-4db2-9861-0fb451b78703/kube-rbac-proxy/0.log"
Jul 06 01:43:36.247962 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:36.247936    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-97znw_71387668-1da1-4db2-9861-0fb451b78703/exporter/0.log"
Jul 06 01:43:36.271210 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:36.271188    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-97znw_71387668-1da1-4db2-9861-0fb451b78703/extractor/0.log"
Jul 06 01:43:37.417132 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:37.417097    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-7k5ct"
Jul 06 01:43:38.694998 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:38.694960    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29721675-k4qcc_29e61ada-30a1-4341-968d-7804bb8832b7/cleanup/0.log"
Jul 06 01:43:38.716187 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:38.716143    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29721690-hnrlr_e8089c5f-ef38-4619-9530-1def224f99ae/cleanup/0.log"
Jul 06 01:43:38.964958 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:38.964881    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l_ad8bcc1e-2979-43e2-908a-760544f457b4/manager/0.log"
Jul 06 01:43:38.985474 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:38.985442    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cdbc5c4f-6bh5l_ad8bcc1e-2979-43e2-908a-760544f457b4/copy-manifests/0.log"
Jul 06 01:43:40.712257 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:40.712221    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-fb6f5cd49-dcxdf_5c25d907-95d8-4332-9b20-c2e64c234ac1/manager/0.log"
Jul 06 01:43:41.547994 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:41.547964    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-557bfcf777-sps77_1fe777b9-df8e-4ec8-b517-4cf6f0cd2160/kube-auth-proxy/0.log"
Jul 06 01:43:42.995534 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:42.995451    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-557bfcf777-sps77_1fe777b9-df8e-4ec8-b517-4cf6f0cd2160/kube-auth-proxy/0.log"
Jul 06 01:43:47.239102 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:47.239072    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4tnqb_3056d6fb-5441-40ff-a0f9-98dbedab0677/kube-multus/0.log"
Jul 06 01:43:47.584769 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:47.584689    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nph2n_e0730ff2-6a66-4938-91d6-651e4cbdad5c/kube-multus-additional-cni-plugins/0.log"
Jul 06 01:43:47.608408 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:47.608380    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nph2n_e0730ff2-6a66-4938-91d6-651e4cbdad5c/egress-router-binary-copy/0.log"
Jul 06 01:43:47.629969 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:47.629945    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nph2n_e0730ff2-6a66-4938-91d6-651e4cbdad5c/cni-plugins/0.log"
Jul 06 01:43:47.650102 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:47.650079    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nph2n_e0730ff2-6a66-4938-91d6-651e4cbdad5c/bond-cni-plugin/0.log"
Jul 06 01:43:47.670352 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:47.670329    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nph2n_e0730ff2-6a66-4938-91d6-651e4cbdad5c/routeoverride-cni/0.log"
Jul 06 01:43:47.690653 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:47.690629    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nph2n_e0730ff2-6a66-4938-91d6-651e4cbdad5c/whereabouts-cni-bincopy/0.log"
Jul 06 01:43:47.710623 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:47.710603    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nph2n_e0730ff2-6a66-4938-91d6-651e4cbdad5c/whereabouts-cni/0.log"
Jul 06 01:43:47.865018 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:47.864987    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lw99t_ccf84e13-ab75-4168-9cb8-9a21cb959224/network-metrics-daemon/0.log"
Jul 06 01:43:47.881183 ip-10-0-131-116 kubenswrapper[2562]: I0706 01:43:47.881137    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lw99t_ccf84e13-ab75-4168-9cb8-9a21cb959224/kube-rbac-proxy/0.log"