Jul 03 09:43:19.014877 ip-10-0-131-117 systemd[1]: Starting Kubernetes Kubelet...
Jul 03 09:43:19.397859 ip-10-0-131-117 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 03 09:43:19.397859 ip-10-0-131-117 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 03 09:43:19.397859 ip-10-0-131-117 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 03 09:43:19.397859 ip-10-0-131-117 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 03 09:43:19.397859 ip-10-0-131-117 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 03 09:43:19.399769 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.399687    2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 03 09:43:19.404932 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.404903    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 03 09:43:19.404932 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.404926    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 03 09:43:19.404932 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.404932    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 03 09:43:19.404932 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.404936    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 03 09:43:19.404932 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.404940    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 03 09:43:19.405234 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.404944    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 03 09:43:19.405234 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.404948    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 03 09:43:19.405234 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.404952    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 03 09:43:19.405234 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.404955    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 03 09:43:19.405234 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.404959    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 03 09:43:19.405234 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.404962    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 03 09:43:19.405234 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.404966    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 03 09:43:19.405234 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.404969    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 03 09:43:19.405234 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.404973    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 03 09:43:19.405234 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.404976    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 03 09:43:19.405234 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.404980    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 03 09:43:19.405234 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.404984    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 03 09:43:19.405234 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.404987    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 03 09:43:19.405234 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.404992    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 03 09:43:19.405234 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.404996    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 03 09:43:19.405234 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.404999    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 03 09:43:19.405234 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405003    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 03 09:43:19.405234 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405008    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 03 09:43:19.405234 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405012    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 03 09:43:19.405994 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405016    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 03 09:43:19.405994 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405020    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 03 09:43:19.405994 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405024    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 03 09:43:19.405994 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405030    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 03 09:43:19.405994 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405036    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 03 09:43:19.405994 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405040    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 03 09:43:19.405994 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405044    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 03 09:43:19.405994 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405048    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 03 09:43:19.405994 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405053    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 03 09:43:19.405994 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405057    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 03 09:43:19.405994 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405061    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 03 09:43:19.405994 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405064    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 03 09:43:19.405994 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405069    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 03 09:43:19.405994 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405073    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 03 09:43:19.405994 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405078    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 03 09:43:19.405994 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405083    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 03 09:43:19.405994 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405087    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 03 09:43:19.405994 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405091    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 03 09:43:19.405994 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405095    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 03 09:43:19.406792 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405102    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 03 09:43:19.406792 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405108    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 03 09:43:19.406792 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405112    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 03 09:43:19.406792 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405116    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 03 09:43:19.406792 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405120    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 03 09:43:19.406792 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405124    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 03 09:43:19.406792 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405130    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 03 09:43:19.406792 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405144    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 03 09:43:19.406792 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405148    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 03 09:43:19.406792 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405152    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 03 09:43:19.406792 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405159    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 03 09:43:19.406792 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405165    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 03 09:43:19.406792 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405170    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 03 09:43:19.406792 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405174    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 03 09:43:19.406792 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405179    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 03 09:43:19.406792 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405184    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 03 09:43:19.406792 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405188    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 03 09:43:19.406792 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405193    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 03 09:43:19.406792 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405197    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 03 09:43:19.407572 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405202    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 03 09:43:19.407572 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405206    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 03 09:43:19.407572 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405211    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 03 09:43:19.407572 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405215    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 03 09:43:19.407572 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405219    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 03 09:43:19.407572 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405223    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 03 09:43:19.407572 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405228    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 03 09:43:19.407572 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405232    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 03 09:43:19.407572 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405236    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 03 09:43:19.407572 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405241    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 03 09:43:19.407572 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405245    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 03 09:43:19.407572 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405249    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 03 09:43:19.407572 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405253    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 03 09:43:19.407572 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405257    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 03 09:43:19.407572 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405261    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 03 09:43:19.407572 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405265    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 03 09:43:19.407572 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405270    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 03 09:43:19.407572 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405275    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 03 09:43:19.407572 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405279    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 03 09:43:19.407572 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405284    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 03 09:43:19.408413 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405288    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 03 09:43:19.408413 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405293    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 03 09:43:19.408413 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405297    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 03 09:43:19.408413 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405301    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 03 09:43:19.408413 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405305    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 03 09:43:19.408413 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405309    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 03 09:43:19.408413 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405313    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 03 09:43:19.408413 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405317    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 03 09:43:19.408413 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405321    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 03 09:43:19.408413 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405325    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 03 09:43:19.408413 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405330    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 03 09:43:19.408413 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405334    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 03 09:43:19.408413 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405338    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 03 09:43:19.408413 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405343    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 03 09:43:19.408413 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405347    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 03 09:43:19.408413 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405351    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 03 09:43:19.408413 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.405355    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 03 09:43:19.408413 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406571    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 03 09:43:19.408413 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406580    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 03 09:43:19.408413 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406586    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 03 09:43:19.409239 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406592    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 03 09:43:19.409239 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406596    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 03 09:43:19.409239 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406601    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 03 09:43:19.409239 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406605    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 03 09:43:19.409239 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406609    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 03 09:43:19.409239 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406616    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 03 09:43:19.409239 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406622    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 03 09:43:19.409239 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406627    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 03 09:43:19.409239 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406631    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 03 09:43:19.409239 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406635    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 03 09:43:19.409239 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406639    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 03 09:43:19.409239 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406643    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 03 09:43:19.409239 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406648    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 03 09:43:19.409239 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406652    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 03 09:43:19.409239 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406658    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 03 09:43:19.409239 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406662    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 03 09:43:19.409239 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406666    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 03 09:43:19.409239 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406670    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 03 09:43:19.409239 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406675    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 03 09:43:19.409719 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406679    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 03 09:43:19.409719 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406684    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 03 09:43:19.409719 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406688    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 03 09:43:19.409719 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406692    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 03 09:43:19.409719 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406696    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 03 09:43:19.409719 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406700    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 03 09:43:19.409719 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406704    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 03 09:43:19.409719 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406708    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 03 09:43:19.409719 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406712    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 03 09:43:19.409719 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406716    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 03 09:43:19.409719 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406720    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 03 09:43:19.409719 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406724    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 03 09:43:19.409719 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406729    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 03 09:43:19.409719 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406734    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 03 09:43:19.409719 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406739    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 03 09:43:19.409719 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406743    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 03 09:43:19.409719 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406747    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 03 09:43:19.409719 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406750    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 03 09:43:19.409719 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406754    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 03 09:43:19.409719 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406758    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 03 09:43:19.410208 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406763    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 03 09:43:19.410208 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406767    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 03 09:43:19.410208 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406771    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 03 09:43:19.410208 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406775    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 03 09:43:19.410208 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406779    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 03 09:43:19.410208 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406782    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 03 09:43:19.410208 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406786    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 03 09:43:19.410208 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406790    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 03 09:43:19.410208 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406795    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 03 09:43:19.410208 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406799    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 03 09:43:19.410208 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406802    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 03 09:43:19.410208 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406806    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 03 09:43:19.410208 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406812    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 03 09:43:19.410208 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406816    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 03 09:43:19.410208 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406820    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 03 09:43:19.410208 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406824    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 03 09:43:19.410208 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406829    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 03 09:43:19.410208 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406833    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 03 09:43:19.410208 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406837    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 03 09:43:19.410208 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406841    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 03 09:43:19.410939 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406845    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 03 09:43:19.410939 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406849    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 03 09:43:19.410939 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406853    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 03 09:43:19.410939 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406857    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 03 09:43:19.410939 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406863    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 03 09:43:19.410939 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406868    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 03 09:43:19.410939 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406872    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 03 09:43:19.410939 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406877    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 03 09:43:19.410939 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406881    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 03 09:43:19.410939 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406885    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 03 09:43:19.410939 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406890    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 03 09:43:19.410939 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406895    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 03 09:43:19.410939 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406900    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 03 09:43:19.410939 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406904    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 03 09:43:19.410939 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406908    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 03 09:43:19.410939 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406913    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 03 09:43:19.410939 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406917    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 03 09:43:19.410939 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406921    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 03 09:43:19.410939 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406928    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 03 09:43:19.411481 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406932    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 03 09:43:19.411481 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406936    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 03 09:43:19.411481 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406941    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 03 09:43:19.411481 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406945    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 03 09:43:19.411481 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406950    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 03 09:43:19.411481 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406954    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 03 09:43:19.411481 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406958    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 03 09:43:19.411481 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406962    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 03 09:43:19.411481 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406966    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 03 09:43:19.411481 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406970    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 03 09:43:19.411481 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406977    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 03 09:43:19.411481 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406982    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 03 09:43:19.411481 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406987    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 03 09:43:19.411481 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406991    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 03 09:43:19.411481 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.406997    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 03 09:43:19.411481 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407001    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 03 09:43:19.411481 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407006    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 03 09:43:19.411481 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407011    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 03 09:43:19.411481 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407651    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 03 09:43:19.412095 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407663    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 03 09:43:19.412095 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407669    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 03 09:43:19.412095 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407675    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 03 09:43:19.412095 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407681    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 03 09:43:19.412095 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407686    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 03 09:43:19.412095 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407691    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 03 09:43:19.412095 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407696    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 03 09:43:19.412095 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407701    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 03 09:43:19.412095 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407705    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 03 09:43:19.412095 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407709    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 03 09:43:19.412095 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407714    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 03 09:43:19.412095 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407718    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 03 09:43:19.412095 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407723    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 03 09:43:19.412095 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407727    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 03 09:43:19.412095 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407730    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 03 09:43:19.412095 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407736    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 03 09:43:19.412095 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407740    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 03 09:43:19.412095 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407744    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 03 09:43:19.412095 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407748    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 03 09:43:19.412756 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407753    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 03 09:43:19.412756 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407757    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 03 09:43:19.412756 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407761    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 03 09:43:19.412756 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407767    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 03 09:43:19.412756 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407773    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 03 09:43:19.412756 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407778    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 03 09:43:19.412756 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407782    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 03 09:43:19.412756 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407786    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 03 09:43:19.412756 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407790    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 03 09:43:19.412756 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407795    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 03 09:43:19.412756 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407799    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 03 09:43:19.412756 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407802    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 03 09:43:19.412756 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407816    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 03 09:43:19.412756 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407821    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 03 09:43:19.412756 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407825    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 03 09:43:19.412756 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407829    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 03 09:43:19.412756 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407833    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 03 09:43:19.412756 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407838    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 03 09:43:19.412756 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407842    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 03 09:43:19.412756 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407846    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 03 09:43:19.413230 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407850    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 03 09:43:19.413230 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407854    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 03 09:43:19.413230 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407857    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 03 09:43:19.413230 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407883    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 03 09:43:19.413230 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407887    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 03 09:43:19.413230 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407891    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 03 09:43:19.413230 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407895    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 03 09:43:19.413230 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407899    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 03 09:43:19.413230 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407903    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 03 09:43:19.413230 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407909    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 03 09:43:19.413230 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407913    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 03 09:43:19.413230 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407917    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 03 09:43:19.413230 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407922    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 03 09:43:19.413230 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407926    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 03 09:43:19.413230 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407930    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 03 09:43:19.413230 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407934    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 03 09:43:19.413230 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407937    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 03 09:43:19.413230 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407941    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 03 09:43:19.413230 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407946    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 03 09:43:19.413230 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407950    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 03 09:43:19.413779 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407954    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 03 09:43:19.413779 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407959    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 03 09:43:19.413779 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407963    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 03 09:43:19.413779 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407967    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 03 09:43:19.413779 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407971    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 03 09:43:19.413779 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407977    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 03 09:43:19.413779 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407982    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 03 09:43:19.413779 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407986    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 03 09:43:19.413779 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407990    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 03 09:43:19.413779 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407994    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 03 09:43:19.413779 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.407998    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 03 09:43:19.413779 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.408002    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 03 09:43:19.413779 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.408006    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 03 09:43:19.413779 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.408010    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 03 09:43:19.413779 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.408014    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 03 09:43:19.413779 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.408017    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 03 09:43:19.413779 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.408021    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 03 09:43:19.413779 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.408025    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 03 09:43:19.413779 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.408030    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 03 09:43:19.413779 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.408034    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 03 09:43:19.414316 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.408038    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 03 09:43:19.414316 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.408042    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 03 09:43:19.414316 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.408047    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 03 09:43:19.414316 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.408051    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 03 09:43:19.414316 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.408055    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 03 09:43:19.414316 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.408059    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 03 09:43:19.414316 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.408064    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 03 09:43:19.414316 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.408069    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 03 09:43:19.414316 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.408073    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 03 09:43:19.414316 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.408076    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 03 09:43:19.414316 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.408080    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 03 09:43:19.414316 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.408085    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 03 09:43:19.414316 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.408089    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 03 09:43:19.414316 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.408093    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 03 09:43:19.414316 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.408097    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 03 09:43:19.414316 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.408101    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 03 09:43:19.414316 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.408105    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 03 09:43:19.414316 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.408109    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 03 09:43:19.414316 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.408113    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 03 09:43:19.414316 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408212    2559 flags.go:64] FLAG: --address="0.0.0.0"
Jul 03 09:43:19.414316 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408223    2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 03 09:43:19.414899 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408235    2559 flags.go:64] FLAG: --anonymous-auth="true"
Jul 03 09:43:19.414899 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408241    2559 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 03 09:43:19.414899 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408247    2559 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 03 09:43:19.414899 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408252    2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 03 09:43:19.414899 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408258    2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 03 09:43:19.414899 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408265    2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 03 09:43:19.414899 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408270    2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 03 09:43:19.414899 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408275    2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 03 09:43:19.414899 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408280    2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 03 09:43:19.414899 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408285    2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 03 09:43:19.414899 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408290    2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 03 09:43:19.414899 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408295    2559 flags.go:64] FLAG: --cgroup-root=""
Jul 03 09:43:19.414899 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408299    2559 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 03 09:43:19.414899 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408304    2559 flags.go:64] FLAG: --client-ca-file=""
Jul 03 09:43:19.414899 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408309    2559 flags.go:64] FLAG: --cloud-provider="external"
Jul 03 09:43:19.414899 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408334    2559 flags.go:64] FLAG: --cluster-dns="[]"
Jul 03 09:43:19.414899 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408342    2559 flags.go:64] FLAG: --cluster-domain=""
Jul 03 09:43:19.414899 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408349    2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 03 09:43:19.414899 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408355    2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 03 09:43:19.414899 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408360    2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 03 09:43:19.414899 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408367    2559 flags.go:64] FLAG: --container-log-max-files="5"
Jul 03 09:43:19.414899 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408373    2559 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 03 09:43:19.414899 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408379    2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 03 09:43:19.415453 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408384    2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 03 09:43:19.415453 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408389    2559 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 03 09:43:19.415453 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408394    2559 flags.go:64] FLAG: --contention-profiling="false"
Jul 03 09:43:19.415453 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408398    2559 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 03 09:43:19.415453 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408403    2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 03 09:43:19.415453 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408408    2559 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 03 09:43:19.415453 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408412    2559 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 03 09:43:19.415453 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408418    2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 03 09:43:19.415453 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408423    2559 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 03 09:43:19.415453 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408427    2559 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 03 09:43:19.415453 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408431    2559 flags.go:64] FLAG: --enable-load-reader="false"
Jul 03 09:43:19.415453 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408436    2559 flags.go:64] FLAG: --enable-server="true"
Jul 03 09:43:19.415453 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408440    2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 03 09:43:19.415453 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408448    2559 flags.go:64] FLAG: --event-burst="100"
Jul 03 09:43:19.415453 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408453    2559 flags.go:64] FLAG: --event-qps="50"
Jul 03 09:43:19.415453 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408457    2559 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 03 09:43:19.415453 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408462    2559 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 03 09:43:19.415453 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408466    2559 flags.go:64] FLAG: --eviction-hard=""
Jul 03 09:43:19.415453 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408472    2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 03 09:43:19.415453 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408477    2559 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 03 09:43:19.415453 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408481    2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 03 09:43:19.415453 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408486    2559 flags.go:64] FLAG: --eviction-soft=""
Jul 03 09:43:19.415453 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408490    2559 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 03 09:43:19.415453 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408495    2559 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 03 09:43:19.415453 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408500    2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 03 09:43:19.416117 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408505    2559 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 03 09:43:19.416117 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408511    2559 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 03 09:43:19.416117 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408516    2559 flags.go:64] FLAG: --fail-swap-on="true"
Jul 03 09:43:19.416117 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408520    2559 flags.go:64] FLAG: --feature-gates=""
Jul 03 09:43:19.416117 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408526    2559 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 03 09:43:19.416117 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408531    2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 03 09:43:19.416117 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408537    2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 03 09:43:19.416117 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408560    2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 03 09:43:19.416117 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408566    2559 flags.go:64] FLAG: --healthz-port="10248"
Jul 03 09:43:19.416117 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408571    2559 flags.go:64] FLAG: --help="false"
Jul 03 09:43:19.416117 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408575    2559 flags.go:64] FLAG: --hostname-override="ip-10-0-131-117.ec2.internal"
Jul 03 09:43:19.416117 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408580    2559 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 03 09:43:19.416117 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408585    2559 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 03 09:43:19.416117 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408590    2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 03 09:43:19.416117 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408595    2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 03 09:43:19.416117 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408600    2559 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 03 09:43:19.416117 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408605    2559 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 03 09:43:19.416117 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408609    2559 flags.go:64] FLAG: --image-service-endpoint=""
Jul 03 09:43:19.416117 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408613    2559 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 03 09:43:19.416117 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408618    2559 flags.go:64] FLAG: --kube-api-burst="100"
Jul 03 09:43:19.416117 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408623    2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 03 09:43:19.416117 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408627    2559 flags.go:64] FLAG: --kube-api-qps="50"
Jul 03 09:43:19.416117 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408632    2559 flags.go:64] FLAG: --kube-reserved=""
Jul 03 09:43:19.416117 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408636    2559 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 03 09:43:19.416724 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408640    2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 03 09:43:19.416724 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408645    2559 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 03 09:43:19.416724 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408650    2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 03 09:43:19.416724 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408654    2559 flags.go:64] FLAG: --lock-file=""
Jul 03 09:43:19.416724 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408659    2559 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 03 09:43:19.416724 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408663    2559 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 03 09:43:19.416724 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408668    2559 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 03 09:43:19.416724 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408676    2559 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 03 09:43:19.416724 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408682    2559 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 03 09:43:19.416724 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408690    2559 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 03 09:43:19.416724 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408695    2559 flags.go:64] FLAG: --logging-format="text"
Jul 03 09:43:19.416724 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408700    2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 03 09:43:19.416724 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408705    2559 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 03 09:43:19.416724 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408709    2559 flags.go:64] FLAG: --manifest-url=""
Jul 03 09:43:19.416724 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408715    2559 flags.go:64] FLAG: --manifest-url-header=""
Jul 03 09:43:19.416724 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408721    2559 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 03 09:43:19.416724 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408726    2559 flags.go:64] FLAG: --max-open-files="1000000"
Jul 03 09:43:19.416724 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408733    2559 flags.go:64] FLAG: --max-pods="110"
Jul 03 09:43:19.416724 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408737    2559 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 03 09:43:19.416724 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408742    2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 03 09:43:19.416724 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408747    2559 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 03 09:43:19.416724 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408751    2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 03 09:43:19.416724 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408756    2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 03 09:43:19.416724 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408760    2559 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 03 09:43:19.416724 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408765    2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 03 09:43:19.417430 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408777    2559 flags.go:64] FLAG: --node-status-max-images="50"
Jul 03 09:43:19.417430 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408781    2559 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 03 09:43:19.417430 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408786    2559 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 03 09:43:19.417430 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408791    2559 flags.go:64] FLAG: --pod-cidr=""
Jul 03 09:43:19.417430 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408795    2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 03 09:43:19.417430 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408802    2559 flags.go:64] FLAG: --pod-manifest-path=""
Jul 03 09:43:19.417430 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408807    2559 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 03 09:43:19.417430 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408813    2559 flags.go:64] FLAG: --pods-per-core="0"
Jul 03 09:43:19.417430 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408817    2559 flags.go:64] FLAG: --port="10250"
Jul 03 09:43:19.417430 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408822    2559 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 03 09:43:19.417430 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408826    2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01ab047dd94aea7b3"
Jul 03 09:43:19.417430 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408831    2559 flags.go:64] FLAG: --qos-reserved=""
Jul 03 09:43:19.417430 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408836    2559 flags.go:64] FLAG: --read-only-port="10255"
Jul 03 09:43:19.417430 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408840    2559 flags.go:64] FLAG: --register-node="true"
Jul 03 09:43:19.417430 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408845    2559 flags.go:64] FLAG: --register-with-taints=""
Jul 03 09:43:19.417430 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408851    2559 flags.go:64] FLAG: --registry-burst="10"
Jul 03 09:43:19.417430 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408857    2559 flags.go:64] FLAG: --registry-qps="5"
Jul 03 09:43:19.417430 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408862    2559 flags.go:64] FLAG: --reserved-cpus=""
Jul 03 09:43:19.417430 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408867    2559 flags.go:64] FLAG: --reserved-memory=""
Jul 03 09:43:19.417430 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408876    2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 03 09:43:19.417430 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408881    2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 03 09:43:19.417430 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408885    2559 flags.go:64] FLAG: --rotate-certificates="false"
Jul 03 09:43:19.417430 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408894    2559 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 03 09:43:19.417430 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408899    2559 flags.go:64] FLAG: --runonce="false"
Jul 03 09:43:19.417430 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408903    2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 03 09:43:19.418064 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408908    2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 03 09:43:19.418064 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408912    2559 flags.go:64] FLAG: --seccomp-default="false"
Jul 03 09:43:19.418064 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408917    2559 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 03 09:43:19.418064 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408921    2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 03 09:43:19.418064 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408925    2559 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 03 09:43:19.418064 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408930    2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 03 09:43:19.418064 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408935    2559 flags.go:64] FLAG: --storage-driver-password="root"
Jul 03 09:43:19.418064 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408939    2559 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 03 09:43:19.418064 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408944    2559 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 03 09:43:19.418064 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408948    2559 flags.go:64] FLAG: --storage-driver-user="root"
Jul 03 09:43:19.418064 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408953    2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 03 09:43:19.418064 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408957    2559 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 03 09:43:19.418064 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408962    2559 flags.go:64] FLAG: --system-cgroups=""
Jul 03 09:43:19.418064 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408966    2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 03 09:43:19.418064 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408975    2559 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 03 09:43:19.418064 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408979    2559 flags.go:64] FLAG: --tls-cert-file=""
Jul 03 09:43:19.418064 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408983    2559 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 03 09:43:19.418064 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408989    2559 flags.go:64] FLAG: --tls-min-version=""
Jul 03 09:43:19.418064 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408994    2559 flags.go:64] FLAG: --tls-private-key-file=""
Jul 03 09:43:19.418064 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.408998    2559 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 03 09:43:19.418064 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.409002    2559 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 03 09:43:19.418064 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.409007    2559 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 03 09:43:19.418064 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.409012    2559 flags.go:64] FLAG: --v="2"
Jul 03 09:43:19.418064 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.409020    2559 flags.go:64] FLAG: --version="false"
Jul 03 09:43:19.418064 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.409027    2559 flags.go:64] FLAG: --vmodule=""
Jul 03 09:43:19.418686 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.409033    2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 03 09:43:19.418686 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.409038    2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 03 09:43:19.418686 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410504    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 03 09:43:19.418686 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410516    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 03 09:43:19.418686 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410523    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 03 09:43:19.418686 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410527    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 03 09:43:19.418686 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410532    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 03 09:43:19.418686 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410536    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 03 09:43:19.418686 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410540    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 03 09:43:19.418686 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410560    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 03 09:43:19.418686 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410565    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 03 09:43:19.418686 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410569    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 03 09:43:19.418686 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410573    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 03 09:43:19.418686 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410576    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 03 09:43:19.418686 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410581    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 03 09:43:19.418686 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410585    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 03 09:43:19.418686 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410590    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 03 09:43:19.418686 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410594    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 03 09:43:19.418686 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410601    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 03 09:43:19.418686 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410607    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 03 09:43:19.419199 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410611    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 03 09:43:19.419199 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410615    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 03 09:43:19.419199 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410619    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 03 09:43:19.419199 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410623    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 03 09:43:19.419199 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410628    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 03 09:43:19.419199 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410632    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 03 09:43:19.419199 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410636    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 03 09:43:19.419199 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410640    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 03 09:43:19.419199 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410644    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 03 09:43:19.419199 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410648    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 03 09:43:19.419199 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410655    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 03 09:43:19.419199 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410660    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 03 09:43:19.419199 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410665    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 03 09:43:19.419199 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410670    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 03 09:43:19.419199 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410674    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 03 09:43:19.419199 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410678    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 03 09:43:19.419199 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410684    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 03 09:43:19.419199 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410688    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 03 09:43:19.419199 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410692    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 03 09:43:19.419718 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410696    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 03 09:43:19.419718 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410701    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 03 09:43:19.419718 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410705    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 03 09:43:19.419718 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410709    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 03 09:43:19.419718 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410713    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 03 09:43:19.419718 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410717    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 03 09:43:19.419718 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410722    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 03 09:43:19.419718 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410726    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 03 09:43:19.419718 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410730    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 03 09:43:19.419718 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410734    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 03 09:43:19.419718 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410738    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 03 09:43:19.419718 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410742    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 03 09:43:19.419718 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410747    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 03 09:43:19.419718 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410751    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 03 09:43:19.419718 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410754    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 03 09:43:19.419718 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410758    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 03 09:43:19.419718 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410763    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 03 09:43:19.419718 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410769    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 03 09:43:19.419718 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410775    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 03 09:43:19.419718 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410779    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 03 09:43:19.420303 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410783    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 03 09:43:19.420303 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410787    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 03 09:43:19.420303 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410791    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 03 09:43:19.420303 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410797    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 03 09:43:19.420303 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410801    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 03 09:43:19.420303 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410805    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 03 09:43:19.420303 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410810    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 03 09:43:19.420303 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410815    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 03 09:43:19.420303 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410818    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 03 09:43:19.420303 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410824    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 03 09:43:19.420303 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410829    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 03 09:43:19.420303 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410833    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 03 09:43:19.420303 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410837    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 03 09:43:19.420303 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410841    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 03 09:43:19.420303 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410845    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 03 09:43:19.420303 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410849    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 03 09:43:19.420303 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410854    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 03 09:43:19.420303 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410858    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 03 09:43:19.420303 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410862    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 03 09:43:19.420303 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410867    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 03 09:43:19.420807 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410870    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 03 09:43:19.420807 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410875    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 03 09:43:19.420807 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410879    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 03 09:43:19.420807 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410883    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 03 09:43:19.420807 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410887    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 03 09:43:19.420807 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410891    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 03 09:43:19.420807 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410898    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 03 09:43:19.420807 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410903    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 03 09:43:19.420807 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410908    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 03 09:43:19.420807 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410913    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 03 09:43:19.420807 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410917    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 03 09:43:19.420807 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410921    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 03 09:43:19.420807 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410925    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 03 09:43:19.420807 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410930    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 03 09:43:19.420807 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410934    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 03 09:43:19.420807 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410939    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 03 09:43:19.420807 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410943    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 03 09:43:19.420807 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410947    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 03 09:43:19.420807 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410951    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 03 09:43:19.421265 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410957    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 03 09:43:19.421265 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410961    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 03 09:43:19.421265 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.410966    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 03 09:43:19.421265 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.410974    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 03 09:43:19.421265 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.418526    2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 03 09:43:19.421265 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.418555    2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 03 09:43:19.421265 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.420105    2559 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 03 09:43:19.421265 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.420116    2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 03 09:43:19.421265 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420178    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 03 09:43:19.421265 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420183    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 03 09:43:19.421265 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420186    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 03 09:43:19.421265 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420189    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 03 09:43:19.421265 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420193    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 03 09:43:19.421265 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420196    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 03 09:43:19.421636 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420199    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 03 09:43:19.421636 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420201    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 03 09:43:19.421636 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420204    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 03 09:43:19.421636 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420207    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 03 09:43:19.421636 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420209    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 03 09:43:19.421636 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420212    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 03 09:43:19.421636 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420214    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 03 09:43:19.421636 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420219    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 03 09:43:19.421636 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420223    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 03 09:43:19.421636 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420226    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 03 09:43:19.421636 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420228    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 03 09:43:19.421636 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420231    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 03 09:43:19.421636 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420234    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 03 09:43:19.421636 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420236    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 03 09:43:19.421636 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420239    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 03 09:43:19.421636 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420241    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 03 09:43:19.421636 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420244    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 03 09:43:19.421636 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420247    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 03 09:43:19.421636 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420250    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 03 09:43:19.421636 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420253    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 03 09:43:19.422123 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420256    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 03 09:43:19.422123 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420259    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 03 09:43:19.422123 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420261    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 03 09:43:19.422123 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420264    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 03 09:43:19.422123 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420266    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 03 09:43:19.422123 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420269    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 03 09:43:19.422123 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420271    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 03 09:43:19.422123 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420274    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 03 09:43:19.422123 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420276    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 03 09:43:19.422123 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420279    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 03 09:43:19.422123 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420283    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 03 09:43:19.422123 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420286    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 03 09:43:19.422123 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420289    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 03 09:43:19.422123 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420292    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 03 09:43:19.422123 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420294    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 03 09:43:19.422123 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420297    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 03 09:43:19.422123 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420299    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 03 09:43:19.422123 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420301    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 03 09:43:19.422123 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420304    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 03 09:43:19.422594 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420307    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 03 09:43:19.422594 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420310    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 03 09:43:19.422594 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420313    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 03 09:43:19.422594 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420316    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 03 09:43:19.422594 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420318    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 03 09:43:19.422594 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420321    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 03 09:43:19.422594 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420323    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 03 09:43:19.422594 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420326    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 03 09:43:19.422594 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420329    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 03 09:43:19.422594 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420331    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 03 09:43:19.422594 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420334    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 03 09:43:19.422594 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420336    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 03 09:43:19.422594 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420339    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 03 09:43:19.422594 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420341    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 03 09:43:19.422594 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420345    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 03 09:43:19.422594 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420349    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 03 09:43:19.422594 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420352    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 03 09:43:19.422594 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420355    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 03 09:43:19.422594 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420357    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 03 09:43:19.422594 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420360    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 03 09:43:19.423066 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420363    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 03 09:43:19.423066 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420365    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 03 09:43:19.423066 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420367    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 03 09:43:19.423066 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420370    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 03 09:43:19.423066 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420372    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 03 09:43:19.423066 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420374    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 03 09:43:19.423066 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420377    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 03 09:43:19.423066 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420380    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 03 09:43:19.423066 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420382    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 03 09:43:19.423066 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420395    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 03 09:43:19.423066 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420399    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 03 09:43:19.423066 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420402    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 03 09:43:19.423066 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420405    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 03 09:43:19.423066 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420408    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 03 09:43:19.423066 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420410    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 03 09:43:19.423066 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420413    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 03 09:43:19.423066 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420415    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 03 09:43:19.423066 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420418    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 03 09:43:19.423066 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420420    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 03 09:43:19.423513 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420423    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 03 09:43:19.423513 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420425    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 03 09:43:19.423513 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420427    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 03 09:43:19.423513 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420430    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 03 09:43:19.423513 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420432    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 03 09:43:19.423513 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420435    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 03 09:43:19.423513 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420437    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 03 09:43:19.423513 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420440    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 03 09:43:19.423513 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420442    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 03 09:43:19.423513 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420445    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 03 09:43:19.423513 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420447    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 03 09:43:19.423513 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420449    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 03 09:43:19.423513 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420452    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 03 09:43:19.423513 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420454    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 03 09:43:19.423513 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420456    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 03 09:43:19.423891 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.420461    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 03 09:43:19.423891 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420587    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 03 09:43:19.423891 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420592    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 03 09:43:19.423891 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420595    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 03 09:43:19.423891 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420598    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 03 09:43:19.423891 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420600    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 03 09:43:19.423891 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420603    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 03 09:43:19.423891 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420606    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 03 09:43:19.423891 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420608    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 03 09:43:19.423891 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420610    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 03 09:43:19.423891 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420614    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 03 09:43:19.423891 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420616    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 03 09:43:19.423891 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420619    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 03 09:43:19.423891 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420621    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 03 09:43:19.423891 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420623    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 03 09:43:19.424272 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420626    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 03 09:43:19.424272 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420628    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 03 09:43:19.424272 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420631    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 03 09:43:19.424272 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420633    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 03 09:43:19.424272 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420635    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 03 09:43:19.424272 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420638    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 03 09:43:19.424272 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420640    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 03 09:43:19.424272 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420642    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 03 09:43:19.424272 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420645    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 03 09:43:19.424272 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420648    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 03 09:43:19.424272 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420650    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 03 09:43:19.424272 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420652    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 03 09:43:19.424272 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420655    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 03 09:43:19.424272 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420657    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 03 09:43:19.424272 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420659    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 03 09:43:19.424272 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420662    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 03 09:43:19.424272 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420664    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 03 09:43:19.424272 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420667    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 03 09:43:19.424272 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420669    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 03 09:43:19.424272 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420671    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 03 09:43:19.424790 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420674    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 03 09:43:19.424790 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420676    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 03 09:43:19.424790 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420679    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 03 09:43:19.424790 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420681    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 03 09:43:19.424790 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420683    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 03 09:43:19.424790 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420686    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 03 09:43:19.424790 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420688    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 03 09:43:19.424790 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420691    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 03 09:43:19.424790 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420693    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 03 09:43:19.424790 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420696    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 03 09:43:19.424790 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420699    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 03 09:43:19.424790 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420701    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 03 09:43:19.424790 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420704    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 03 09:43:19.424790 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420706    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 03 09:43:19.424790 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420709    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 03 09:43:19.424790 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420711    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 03 09:43:19.424790 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420713    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 03 09:43:19.424790 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420715    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 03 09:43:19.424790 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420718    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 03 09:43:19.424790 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420720    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 03 09:43:19.425299 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420723    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 03 09:43:19.425299 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420725    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 03 09:43:19.425299 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420728    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 03 09:43:19.425299 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420730    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 03 09:43:19.425299 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420733    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 03 09:43:19.425299 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420735    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 03 09:43:19.425299 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420739    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 03 09:43:19.425299 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420742    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 03 09:43:19.425299 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420745    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 03 09:43:19.425299 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420748    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 03 09:43:19.425299 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420751    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 03 09:43:19.425299 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420754    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 03 09:43:19.425299 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420757    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 03 09:43:19.425299 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420760    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 03 09:43:19.425299 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420762    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 03 09:43:19.425299 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420765    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 03 09:43:19.425299 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420768    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 03 09:43:19.425299 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420770    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 03 09:43:19.425792 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420773    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 03 09:43:19.425792 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420776    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 03 09:43:19.425792 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420778    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 03 09:43:19.425792 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420781    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 03 09:43:19.425792 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420783    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 03 09:43:19.425792 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420786    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 03 09:43:19.425792 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420789    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 03 09:43:19.425792 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420792    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 03 09:43:19.425792 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420795    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 03 09:43:19.425792 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420797    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 03 09:43:19.425792 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420800    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 03 09:43:19.425792 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420802    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 03 09:43:19.425792 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420805    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 03 09:43:19.425792 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420807    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 03 09:43:19.425792 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420810    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 03 09:43:19.425792 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420812    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 03 09:43:19.425792 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420815    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 03 09:43:19.425792 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420818    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 03 09:43:19.425792 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420821    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 03 09:43:19.426235 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420823    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 03 09:43:19.426235 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420826    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 03 09:43:19.426235 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420828    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 03 09:43:19.426235 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420830    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 03 09:43:19.426235 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420833    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 03 09:43:19.426235 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420835    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 03 09:43:19.426235 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420837    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 03 09:43:19.426235 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:19.420840    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 03 09:43:19.426235 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.420844    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 03 09:43:19.426235 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.420953    2559 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 03 09:43:19.426235 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.424192    2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 03 09:43:19.426235 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.425378    2559 server.go:1019] "Starting client certificate rotation"
Jul 03 09:43:19.426235 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.425473    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 03 09:43:19.426235 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.425511    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 03 09:43:19.427633 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.427619    2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 03 09:43:19.428795 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.428768    2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 03 09:43:19.441322 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.441303    2559 log.go:25] "Validated CRI v1 runtime API"
Jul 03 09:43:19.443612 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.443594    2559 log.go:25] "Validated CRI v1 image API"
Jul 03 09:43:19.444404 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.444386    2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 03 09:43:19.448245 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.448222    2559 fs.go:135] Filesystem UUIDs: map[030d8155-1e02-46b6-9ae5-8cdba554c86a:/dev/nvme0n1p4 546565c6-437c-4d75-869e-ae8dc3caa7dd:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 03 09:43:19.448339 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.448243    2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 03 09:43:19.450605 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.450582    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 03 09:43:19.453258 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.453142    2559 manager.go:216] Machine: {Timestamp:2026-07-03 09:43:19.451967874 +0000 UTC m=+0.322633494 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100266 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2497aaefcaf04481779869db1dac2e SystemUUID:ec2497aa-efca-f044-8177-9869db1dac2e BootID:7b272288-f623-491e-9397-cf32e7857f41 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:cb:52:de:b9:47 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:cb:52:de:b9:47 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:b4:4c:12:b5:7b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 03 09:43:19.453258 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.453251    2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 03 09:43:19.453401 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.453358    2559 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 03 09:43:19.456586 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.456538    2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 03 09:43:19.456755 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.456587    2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-117.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 03 09:43:19.457415 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.457402    2559 topology_manager.go:138] "Creating topology manager with none policy"
Jul 03 09:43:19.457472 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.457419    2559 container_manager_linux.go:309] "Creating device plugin manager"
Jul 03 09:43:19.457472 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.457429    2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 03 09:43:19.458232 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.458220    2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 03 09:43:19.460239 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.460226    2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 03 09:43:19.463852 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.463838    2559 state_mem.go:36] "Initialized new in-memory state store"
Jul 03 09:43:19.463983 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.463971    2559 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 03 09:43:19.464045 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.464010    2559 kubelet.go:486] "Attempting to sync node with API server"
Jul 03 09:43:19.464045 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.464025    2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 03 09:43:19.464045 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.464039    2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 03 09:43:19.464166 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.464053    2559 kubelet.go:398] "Adding apiserver pod source"
Jul 03 09:43:19.464166 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.464073    2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 03 09:43:19.464429 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.464415    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 03 09:43:19.464493 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.464437    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 03 09:43:19.466648 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.466627    2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 03 09:43:19.469028 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.469015    2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 03 09:43:19.469084 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.469046    2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 03 09:43:19.470291 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.470278    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 03 09:43:19.470343 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.470284    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6qzrz"
Jul 03 09:43:19.470343 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.470300    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 03 09:43:19.470343 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.470306    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 03 09:43:19.470343 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.470312    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 03 09:43:19.470343 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.470321    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 03 09:43:19.470343 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.470326    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 03 09:43:19.470343 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.470334    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 03 09:43:19.470343 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.470340    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 03 09:43:19.470343 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.470346    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 03 09:43:19.470603 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.470351    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 03 09:43:19.470603 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.470367    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 03 09:43:19.470603 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.470372    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 03 09:43:19.471116 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.471107    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 03 09:43:19.471116 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.471116    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 03 09:43:19.474166 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.474153    2559 server.go:1268] "Started kubelet"
Jul 03 09:43:19.474306 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.474254    2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 03 09:43:19.474445 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.474403    2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 03 09:43:19.474577 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.474460    2559 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 03 09:43:19.475001 ip-10-0-131-117 systemd[1]: Started Kubernetes Kubelet.
Jul 03 09:43:19.478744 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.478714    2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-117.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 03 09:43:19.478931 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:19.478905    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-117.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 03 09:43:19.479012 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.478938    2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 03 09:43:19.479068 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:19.479018    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 03 09:43:19.479571 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.479535    2559 server.go:310] "Adding debug handlers to kubelet server"
Jul 03 09:43:19.479781 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.479762    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6qzrz"
Jul 03 09:43:19.481777 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:19.481756    2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 03 09:43:19.487764 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:19.486864    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-117.ec2.internal.18bebe5ac0abe5df  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-117.ec2.internal,UID:ip-10-0-131-117.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-117.ec2.internal,},FirstTimestamp:2026-07-03 09:43:19.474120159 +0000 UTC m=+0.344785780,LastTimestamp:2026-07-03 09:43:19.474120159 +0000 UTC m=+0.344785780,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-117.ec2.internal,}"
Jul 03 09:43:19.488328 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.488304    2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 03 09:43:19.488407 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.488327    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 03 09:43:19.488407 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:19.488381    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-117.ec2.internal\" not found"
Jul 03 09:43:19.489018 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.488988    2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 03 09:43:19.489018 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.488989    2559 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 03 09:43:19.489158 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.489031    2559 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 03 09:43:19.489158 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.489144    2559 reconstruct.go:97] "Volume reconstruction finished"
Jul 03 09:43:19.489158 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.489152    2559 reconciler.go:29] "Reconciler: start to sync state"
Jul 03 09:43:19.489282 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.489212    2559 factory.go:55] Registering systemd factory
Jul 03 09:43:19.489282 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.489227    2559 factory.go:223] Registration of the systemd container factory successfully
Jul 03 09:43:19.489451 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.489438    2559 factory.go:153] Registering CRI-O factory
Jul 03 09:43:19.489509 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.489455    2559 factory.go:223] Registration of the crio container factory successfully
Jul 03 09:43:19.489509 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.489504    2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 03 09:43:19.489643 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.489528    2559 factory.go:103] Registering Raw factory
Jul 03 09:43:19.489643 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.489563    2559 manager.go:1196] Started watching for new ooms in manager
Jul 03 09:43:19.490182 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.490166    2559 manager.go:349] Starting recovery of all containers
Jul 03 09:43:19.497590 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.497569    2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 03 09:43:19.499501 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.499484    2559 manager.go:354] Recovery completed
Jul 03 09:43:19.500244 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:19.500225    2559 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-131-117.ec2.internal\" not found" node="ip-10-0-131-117.ec2.internal"
Jul 03 09:43:19.503730 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.503716    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 09:43:19.506465 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.506451    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 09:43:19.506523 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.506480    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 09:43:19.506523 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.506489    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasSufficientPID"
Jul 03 09:43:19.507114 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.507101    2559 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 03 09:43:19.507114 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.507113    2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 03 09:43:19.507233 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.507117    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 09:43:19.507233 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.507129    2559 state_mem.go:36] "Initialized new in-memory state store"
Jul 03 09:43:19.507801 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.507786    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 09:43:19.507889 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.507819    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 09:43:19.507889 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.507830    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasSufficientPID"
Jul 03 09:43:19.508473 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.508462    2559 policy_none.go:49] "None policy: Start"
Jul 03 09:43:19.508507 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.508478    2559 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 03 09:43:19.508507 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.508489    2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 03 09:43:19.509558 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.509532    2559 policy_none.go:47] "Start"
Jul 03 09:43:19.540256 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.540121    2559 manager.go:337] "Starting Device Plugin manager"
Jul 03 09:43:19.540354 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:19.540272    2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 03 09:43:19.540354 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.540284    2559 server.go:87] "Starting device plugin registration server"
Jul 03 09:43:19.540519 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.540509    2559 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 03 09:43:19.540574 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.540523    2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 03 09:43:19.540651 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.540637    2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 03 09:43:19.540773 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.540713    2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 03 09:43:19.540773 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.540723    2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 03 09:43:19.541231 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:19.541209    2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 03 09:43:19.541312 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:19.541265    2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-117.ec2.internal\" not found"
Jul 03 09:43:19.640909 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.640868    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 09:43:19.642066 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.641858    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 09:43:19.642066 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.641890    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 09:43:19.642066 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.641902    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasSufficientPID"
Jul 03 09:43:19.642066 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.641928    2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-117.ec2.internal"
Jul 03 09:43:19.649928 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.649882    2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-117.ec2.internal"
Jul 03 09:43:19.649928 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:19.649907    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-117.ec2.internal\": node \"ip-10-0-131-117.ec2.internal\" not found"
Jul 03 09:43:19.664505 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:19.664483    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-117.ec2.internal\" not found"
Jul 03 09:43:19.683402 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.683369    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 03 09:43:19.684720 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.684691    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 03 09:43:19.684828 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.684727    2559 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 03 09:43:19.684828 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.684745    2559 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 03 09:43:19.684828 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:19.684777    2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 03 09:43:19.686883 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.686866    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 03 09:43:19.764983 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:19.764936    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-117.ec2.internal\" not found"
Jul 03 09:43:19.785121 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.785088    2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-117.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal"]
Jul 03 09:43:19.785194 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.785164    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 09:43:19.786180 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.786164    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 09:43:19.786253 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.786197    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 09:43:19.786253 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.786207    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasSufficientPID"
Jul 03 09:43:19.787637 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.787625    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 09:43:19.787744 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.787730    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-117.ec2.internal"
Jul 03 09:43:19.787783 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.787758    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 09:43:19.788368 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.788351    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 09:43:19.788446 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.788384    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 09:43:19.788446 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.788400    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasSufficientPID"
Jul 03 09:43:19.788446 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.788349    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 09:43:19.788602 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.788452    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 09:43:19.788602 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.788463    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasSufficientPID"
Jul 03 09:43:19.789690 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.789674    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal"
Jul 03 09:43:19.789774 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.789705    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 09:43:19.789841 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.789826    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0caf382ca9eb296da259b7ea66c7880a-config\") pod \"kube-apiserver-proxy-ip-10-0-131-117.ec2.internal\" (UID: \"0caf382ca9eb296da259b7ea66c7880a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-117.ec2.internal"
Jul 03 09:43:19.789896 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.789855    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1375989dc36f18a986154f7263a01ba9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal\" (UID: \"1375989dc36f18a986154f7263a01ba9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal"
Jul 03 09:43:19.789942 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.789880    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1375989dc36f18a986154f7263a01ba9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal\" (UID: \"1375989dc36f18a986154f7263a01ba9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal"
Jul 03 09:43:19.790327 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.790314    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 09:43:19.790460 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.790341    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 09:43:19.790460 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.790355    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasSufficientPID"
Jul 03 09:43:19.818180 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:19.818158    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-117.ec2.internal\" not found" node="ip-10-0-131-117.ec2.internal"
Jul 03 09:43:19.822481 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:19.822464    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-117.ec2.internal\" not found" node="ip-10-0-131-117.ec2.internal"
Jul 03 09:43:19.865759 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:19.865736    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-117.ec2.internal\" not found"
Jul 03 09:43:19.890382 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.890361    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0caf382ca9eb296da259b7ea66c7880a-config\") pod \"kube-apiserver-proxy-ip-10-0-131-117.ec2.internal\" (UID: \"0caf382ca9eb296da259b7ea66c7880a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-117.ec2.internal"
Jul 03 09:43:19.890498 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.890387    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1375989dc36f18a986154f7263a01ba9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal\" (UID: \"1375989dc36f18a986154f7263a01ba9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal"
Jul 03 09:43:19.890498 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.890406    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1375989dc36f18a986154f7263a01ba9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal\" (UID: \"1375989dc36f18a986154f7263a01ba9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal"
Jul 03 09:43:19.890498 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.890457    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1375989dc36f18a986154f7263a01ba9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal\" (UID: \"1375989dc36f18a986154f7263a01ba9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal"
Jul 03 09:43:19.890498 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.890459    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0caf382ca9eb296da259b7ea66c7880a-config\") pod \"kube-apiserver-proxy-ip-10-0-131-117.ec2.internal\" (UID: \"0caf382ca9eb296da259b7ea66c7880a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-117.ec2.internal"
Jul 03 09:43:19.890668 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:19.890649    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1375989dc36f18a986154f7263a01ba9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal\" (UID: \"1375989dc36f18a986154f7263a01ba9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal"
Jul 03 09:43:19.966142 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:19.966068    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-117.ec2.internal\" not found"
Jul 03 09:43:20.066615 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:20.066566    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-117.ec2.internal\" not found"
Jul 03 09:43:20.125077 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:20.125046    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-117.ec2.internal"
Jul 03 09:43:20.127186 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:20.127172    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal"
Jul 03 09:43:20.167614 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:20.167582    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-117.ec2.internal\" not found"
Jul 03 09:43:20.268198 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:20.268109    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-117.ec2.internal\" not found"
Jul 03 09:43:20.368617 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:20.368582    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-117.ec2.internal\" not found"
Jul 03 09:43:20.426123 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:20.426097    2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 03 09:43:20.426537 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:20.426244    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 03 09:43:20.426537 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:20.426254    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 03 09:43:20.469614 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:20.469583    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-117.ec2.internal\" not found"
Jul 03 09:43:20.487510 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:20.487469    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-02 09:38:19 +0000 UTC" deadline="2027-12-04 19:56:50.143396631 +0000 UTC"
Jul 03 09:43:20.487510 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:20.487505    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12466h13m29.65589476s"
Jul 03 09:43:20.570556 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:20.570525    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-117.ec2.internal\" not found"
Jul 03 09:43:20.659512 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:20.659473    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1375989dc36f18a986154f7263a01ba9.slice/crio-7b3b7119179cbaed46c641ded92e8a279151f59d622d5b68e3313c958806009f WatchSource:0}: Error finding container 7b3b7119179cbaed46c641ded92e8a279151f59d622d5b68e3313c958806009f: Status 404 returned error can't find the container with id 7b3b7119179cbaed46c641ded92e8a279151f59d622d5b68e3313c958806009f
Jul 03 09:43:20.659865 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:20.659846    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0caf382ca9eb296da259b7ea66c7880a.slice/crio-3347cba73c65c34ba744f4a833f04999fc6995224e09d23cc84ee8b8287594b7 WatchSource:0}: Error finding container 3347cba73c65c34ba744f4a833f04999fc6995224e09d23cc84ee8b8287594b7: Status 404 returned error can't find the container with id 3347cba73c65c34ba744f4a833f04999fc6995224e09d23cc84ee8b8287594b7
Jul 03 09:43:20.666173 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:20.666153    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 03 09:43:20.670857 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:20.670840    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-117.ec2.internal\" not found"
Jul 03 09:43:20.688407 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:20.688361    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-117.ec2.internal" event={"ID":"0caf382ca9eb296da259b7ea66c7880a","Type":"ContainerStarted","Data":"3347cba73c65c34ba744f4a833f04999fc6995224e09d23cc84ee8b8287594b7"}
Jul 03 09:43:20.689348 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:20.689329    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal" event={"ID":"1375989dc36f18a986154f7263a01ba9","Type":"ContainerStarted","Data":"7b3b7119179cbaed46c641ded92e8a279151f59d622d5b68e3313c958806009f"}
Jul 03 09:43:20.707423 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:20.707404    2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 03 09:43:20.788689 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:20.788655    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal"
Jul 03 09:43:20.799493 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:20.799474    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 03 09:43:20.801388 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:20.801375    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-117.ec2.internal"
Jul 03 09:43:20.812016 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:20.811977    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 03 09:43:21.007456 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.007418    2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 03 09:43:21.398903 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.398874    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 03 09:43:21.465122 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.465094    2559 apiserver.go:52] "Watching apiserver"
Jul 03 09:43:21.473595 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.473570    2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 03 09:43:21.476407 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.476382    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-hcgmr","openshift-network-operator/iptables-alerter-njzlg","openshift-ovn-kubernetes/ovnkube-node-mbxdl","kube-system/global-pull-secret-syncer-pwxt9","kube-system/kube-apiserver-proxy-ip-10-0-131-117.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p66g9","openshift-dns/node-resolver-nx222","openshift-image-registry/node-ca-xljb6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal","openshift-multus/multus-additional-cni-plugins-hcwzh","openshift-multus/multus-gznr6","kube-system/konnectivity-agent-gm79x","openshift-cluster-node-tuning-operator/tuned-bt2x4","openshift-multus/network-metrics-daemon-grmvl"]
Jul 03 09:43:21.477814 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.477794    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nx222"
Jul 03 09:43:21.479224 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.479206    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.480063 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.480043    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 03 09:43:21.480160 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.480068    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 03 09:43:21.480160 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.480118    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4cvf7\""
Jul 03 09:43:21.481582 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.481536    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 03 09:43:21.481870 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.481786    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pxtss\""
Jul 03 09:43:21.481870 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.481816    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 03 09:43:21.481997 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.481886    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 03 09:43:21.482084 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.482068    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.482131 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.482089    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 03 09:43:21.483716 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.483529    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pwxt9"
Jul 03 09:43:21.483716 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:21.483636    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pwxt9" podUID="20bf6cc8-63bc-4ac8-be3b-948848a5755c"
Jul 03 09:43:21.484367 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.484341    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 03 09:43:21.485512 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.484966    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 03 09:43:21.485512 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.485026    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 03 09:43:21.485512 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.485232    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 03 09:43:21.485512 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.485252    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 03 09:43:21.485703 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.485579    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grmvl"
Jul 03 09:43:21.485994 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:21.485960    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grmvl" podUID="65bd85a9-57d3-4ff1-bae1-9f3727371a28"
Jul 03 09:43:21.486123 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.486019    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 03 09:43:21.486123 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.486075    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-v7wm5\""
Jul 03 09:43:21.487112 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.487092    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p66g9"
Jul 03 09:43:21.488529 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.488500    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 03 09:43:21.488529 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.488529    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xljb6"
Jul 03 09:43:21.489101 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.489084    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 03 09:43:21.489209 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.489187    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 03 09:43:21.489363 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.489342    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-f2fqb\""
Jul 03 09:43:21.489443 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.489419    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 03 09:43:21.489903 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.489883    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.491238 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.491217    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-njzlg"
Jul 03 09:43:21.491457 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.491426    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 03 09:43:21.491629 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.491612    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 03 09:43:21.491719 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.491704    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8fzsq\""
Jul 03 09:43:21.491761 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.491704    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 03 09:43:21.492615 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.492528    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 03 09:43:21.492713 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.492623    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8jlqr\""
Jul 03 09:43:21.492820 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.492731    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hcwzh"
Jul 03 09:43:21.492820 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.492633    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 03 09:43:21.493371 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.493357    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 03 09:43:21.493632 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.493614    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ws686\""
Jul 03 09:43:21.493848 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.493835    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 03 09:43:21.493912 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.493879    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 03 09:43:21.494331 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.494313    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcgmr"
Jul 03 09:43:21.494409 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:21.494386    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcgmr" podUID="ad626d77-caf4-4081-8ac3-c6e2c9a970f6"
Jul 03 09:43:21.494817 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.494789    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 03 09:43:21.494886 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.494846    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hq9mx\""
Jul 03 09:43:21.494952 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.494935    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 03 09:43:21.495728 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.495712    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gm79x"
Jul 03 09:43:21.497805 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.497787    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 03 09:43:21.497895 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.497794    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8pvr2\""
Jul 03 09:43:21.497895 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.497859    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 03 09:43:21.499436 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.499415    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9879e537-1d96-485c-90d2-d4b540fb1f31-host-var-lib-cni-bin\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.499529 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.499456    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9879e537-1d96-485c-90d2-d4b540fb1f31-etc-kubernetes\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.499529 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.499481    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b86f\" (UniqueName: \"kubernetes.io/projected/b8d41b5d-027e-4958-bf3e-422ce5ba511c-kube-api-access-9b86f\") pod \"node-ca-xljb6\" (UID: \"b8d41b5d-027e-4958-bf3e-422ce5ba511c\") " pod="openshift-image-registry/node-ca-xljb6"
Jul 03 09:43:21.499529 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.499509    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be5a24fe-b125-41cc-899c-cc09ce3c2277-tmp\") pod \"tuned-bt2x4\" (UID: \"be5a24fe-b125-41cc-899c-cc09ce3c2277\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.499704 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.499540    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7c4b\" (UniqueName: \"kubernetes.io/projected/be5a24fe-b125-41cc-899c-cc09ce3c2277-kube-api-access-z7c4b\") pod \"tuned-bt2x4\" (UID: \"be5a24fe-b125-41cc-899c-cc09ce3c2277\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.499704 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.499603    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7ad0ecde-3110-4f76-8c0e-f296a67153e8-hosts-file\") pod \"node-resolver-nx222\" (UID: \"7ad0ecde-3110-4f76-8c0e-f296a67153e8\") " pod="openshift-dns/node-resolver-nx222"
Jul 03 09:43:21.499704 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.499635    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8160d110-2f6d-41db-a996-8235a758f77f-socket-dir\") pod \"aws-ebs-csi-driver-node-p66g9\" (UID: \"8160d110-2f6d-41db-a996-8235a758f77f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p66g9"
Jul 03 09:43:21.499704 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.499657    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/be5a24fe-b125-41cc-899c-cc09ce3c2277-sys\") pod \"tuned-bt2x4\" (UID: \"be5a24fe-b125-41cc-899c-cc09ce3c2277\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.499704 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.499679    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-systemd-units\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.499938 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.499715    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.499938 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.499741    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-run-ovn\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.499938 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.499763    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-node-log\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.499938 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.499816    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-host-cni-netd\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.499938 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.499841    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-827vh\" (UniqueName: \"kubernetes.io/projected/9879e537-1d96-485c-90d2-d4b540fb1f31-kube-api-access-827vh\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.499938 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.499863    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/be5a24fe-b125-41cc-899c-cc09ce3c2277-etc-modprobe-d\") pod \"tuned-bt2x4\" (UID: \"be5a24fe-b125-41cc-899c-cc09ce3c2277\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.499938 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.499902    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/be5a24fe-b125-41cc-899c-cc09ce3c2277-etc-sysctl-d\") pod \"tuned-bt2x4\" (UID: \"be5a24fe-b125-41cc-899c-cc09ce3c2277\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.499938 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.499932    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9879e537-1d96-485c-90d2-d4b540fb1f31-multus-daemon-config\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.500284 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.499978    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be5a24fe-b125-41cc-899c-cc09ce3c2277-etc-kubernetes\") pod \"tuned-bt2x4\" (UID: \"be5a24fe-b125-41cc-899c-cc09ce3c2277\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.500284 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.500024    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ad0ecde-3110-4f76-8c0e-f296a67153e8-tmp-dir\") pod \"node-resolver-nx222\" (UID: \"7ad0ecde-3110-4f76-8c0e-f296a67153e8\") " pod="openshift-dns/node-resolver-nx222"
Jul 03 09:43:21.500284 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.500068    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-host-slash\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.500284 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.500097    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-host-run-ovn-kubernetes\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.500284 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.500124    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65bd85a9-57d3-4ff1-bae1-9f3727371a28-metrics-certs\") pod \"network-metrics-daemon-grmvl\" (UID: \"65bd85a9-57d3-4ff1-bae1-9f3727371a28\") " pod="openshift-multus/network-metrics-daemon-grmvl"
Jul 03 09:43:21.500284 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.500150    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9879e537-1d96-485c-90d2-d4b540fb1f31-host-var-lib-cni-multus\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.500284 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.500171    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9879e537-1d96-485c-90d2-d4b540fb1f31-host-run-multus-certs\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.500284 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.500189    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8160d110-2f6d-41db-a996-8235a758f77f-etc-selinux\") pod \"aws-ebs-csi-driver-node-p66g9\" (UID: \"8160d110-2f6d-41db-a996-8235a758f77f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p66g9"
Jul 03 09:43:21.500284 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.500212    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-etc-openvswitch\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.500284 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.500239    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b8d41b5d-027e-4958-bf3e-422ce5ba511c-serviceca\") pod \"node-ca-xljb6\" (UID: \"b8d41b5d-027e-4958-bf3e-422ce5ba511c\") " pod="openshift-image-registry/node-ca-xljb6"
Jul 03 09:43:21.500284 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.500260    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk2qt\" (UniqueName: \"kubernetes.io/projected/7ad0ecde-3110-4f76-8c0e-f296a67153e8-kube-api-access-sk2qt\") pod \"node-resolver-nx222\" (UID: \"7ad0ecde-3110-4f76-8c0e-f296a67153e8\") " pod="openshift-dns/node-resolver-nx222"
Jul 03 09:43:21.500284 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.500278    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-host-kubelet\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.500746 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.500300    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-host-cni-bin\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.500746 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.500316    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/20bf6cc8-63bc-4ac8-be3b-948848a5755c-kubelet-config\") pod \"global-pull-secret-syncer-pwxt9\" (UID: \"20bf6cc8-63bc-4ac8-be3b-948848a5755c\") " pod="kube-system/global-pull-secret-syncer-pwxt9"
Jul 03 09:43:21.500746 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.500366    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b8d41b5d-027e-4958-bf3e-422ce5ba511c-host\") pod \"node-ca-xljb6\" (UID: \"b8d41b5d-027e-4958-bf3e-422ce5ba511c\") " pod="openshift-image-registry/node-ca-xljb6"
Jul 03 09:43:21.500746 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.500388    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/be5a24fe-b125-41cc-899c-cc09ce3c2277-etc-systemd\") pod \"tuned-bt2x4\" (UID: \"be5a24fe-b125-41cc-899c-cc09ce3c2277\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.500746 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.500408    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be5a24fe-b125-41cc-899c-cc09ce3c2277-host\") pod \"tuned-bt2x4\" (UID: \"be5a24fe-b125-41cc-899c-cc09ce3c2277\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.500746 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.500437    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-log-socket\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.500746 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.500452    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8f614573-e4a3-491b-a6f5-bd502f0f8245-ovn-node-metrics-cert\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.500746 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.500475    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8f614573-e4a3-491b-a6f5-bd502f0f8245-ovnkube-script-lib\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.500746 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.500496    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9879e537-1d96-485c-90d2-d4b540fb1f31-cnibin\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.500746 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.500515    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9879e537-1d96-485c-90d2-d4b540fb1f31-os-release\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.500746 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.500578    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9879e537-1d96-485c-90d2-d4b540fb1f31-multus-conf-dir\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.500746 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.500598    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64trd\" (UniqueName: \"kubernetes.io/projected/65bd85a9-57d3-4ff1-bae1-9f3727371a28-kube-api-access-64trd\") pod \"network-metrics-daemon-grmvl\" (UID: \"65bd85a9-57d3-4ff1-bae1-9f3727371a28\") " pod="openshift-multus/network-metrics-daemon-grmvl"
Jul 03 09:43:21.500746 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.500613    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be5a24fe-b125-41cc-899c-cc09ce3c2277-var-lib-kubelet\") pod \"tuned-bt2x4\" (UID: \"be5a24fe-b125-41cc-899c-cc09ce3c2277\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.500746 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.500629    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/be5a24fe-b125-41cc-899c-cc09ce3c2277-etc-tuned\") pod \"tuned-bt2x4\" (UID: \"be5a24fe-b125-41cc-899c-cc09ce3c2277\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.500746 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.500664    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-var-lib-openvswitch\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.500746 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.500689    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-run-openvswitch\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.500746 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.500711    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9879e537-1d96-485c-90d2-d4b540fb1f31-multus-cni-dir\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.501432 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.500744    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9879e537-1d96-485c-90d2-d4b540fb1f31-hostroot\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.501432 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.500767    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8160d110-2f6d-41db-a996-8235a758f77f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p66g9\" (UID: \"8160d110-2f6d-41db-a996-8235a758f77f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p66g9"
Jul 03 09:43:21.501432 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.500790    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8160d110-2f6d-41db-a996-8235a758f77f-device-dir\") pod \"aws-ebs-csi-driver-node-p66g9\" (UID: \"8160d110-2f6d-41db-a996-8235a758f77f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p66g9"
Jul 03 09:43:21.501432 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.500819    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l77kx\" (UniqueName: \"kubernetes.io/projected/8f614573-e4a3-491b-a6f5-bd502f0f8245-kube-api-access-l77kx\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.501432 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.500842    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9879e537-1d96-485c-90d2-d4b540fb1f31-system-cni-dir\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.501432 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.500857    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9879e537-1d96-485c-90d2-d4b540fb1f31-host-var-lib-kubelet\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.501432 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.500877    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/be5a24fe-b125-41cc-899c-cc09ce3c2277-etc-sysconfig\") pod \"tuned-bt2x4\" (UID: \"be5a24fe-b125-41cc-899c-cc09ce3c2277\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.501432 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.500898    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/be5a24fe-b125-41cc-899c-cc09ce3c2277-etc-sysctl-conf\") pod \"tuned-bt2x4\" (UID: \"be5a24fe-b125-41cc-899c-cc09ce3c2277\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.501432 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.500936    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-host-run-netns\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.501432 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.500983    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-run-systemd\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.501432 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.501029    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8f614573-e4a3-491b-a6f5-bd502f0f8245-ovnkube-config\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.501432 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.501052    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/20bf6cc8-63bc-4ac8-be3b-948848a5755c-dbus\") pod \"global-pull-secret-syncer-pwxt9\" (UID: \"20bf6cc8-63bc-4ac8-be3b-948848a5755c\") " pod="kube-system/global-pull-secret-syncer-pwxt9"
Jul 03 09:43:21.501432 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.501077    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8160d110-2f6d-41db-a996-8235a758f77f-registration-dir\") pod \"aws-ebs-csi-driver-node-p66g9\" (UID: \"8160d110-2f6d-41db-a996-8235a758f77f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p66g9"
Jul 03 09:43:21.501432 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.501100    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/be5a24fe-b125-41cc-899c-cc09ce3c2277-run\") pod \"tuned-bt2x4\" (UID: \"be5a24fe-b125-41cc-899c-cc09ce3c2277\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.501432 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.501123    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20bf6cc8-63bc-4ac8-be3b-948848a5755c-original-pull-secret\") pod \"global-pull-secret-syncer-pwxt9\" (UID: \"20bf6cc8-63bc-4ac8-be3b-948848a5755c\") " pod="kube-system/global-pull-secret-syncer-pwxt9"
Jul 03 09:43:21.501432 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.501145    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9879e537-1d96-485c-90d2-d4b540fb1f31-multus-socket-dir-parent\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.501975 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.501177    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9879e537-1d96-485c-90d2-d4b540fb1f31-host-run-k8s-cni-cncf-io\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.501975 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.501204    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8160d110-2f6d-41db-a996-8235a758f77f-sys-fs\") pod \"aws-ebs-csi-driver-node-p66g9\" (UID: \"8160d110-2f6d-41db-a996-8235a758f77f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p66g9"
Jul 03 09:43:21.501975 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.501256    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/be5a24fe-b125-41cc-899c-cc09ce3c2277-lib-modules\") pod \"tuned-bt2x4\" (UID: \"be5a24fe-b125-41cc-899c-cc09ce3c2277\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.501975 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.501284    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58g6d\" (UniqueName: \"kubernetes.io/projected/8160d110-2f6d-41db-a996-8235a758f77f-kube-api-access-58g6d\") pod \"aws-ebs-csi-driver-node-p66g9\" (UID: \"8160d110-2f6d-41db-a996-8235a758f77f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p66g9"
Jul 03 09:43:21.501975 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.501307    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8f614573-e4a3-491b-a6f5-bd502f0f8245-env-overrides\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.501975 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.501328    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9879e537-1d96-485c-90d2-d4b540fb1f31-cni-binary-copy\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.501975 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.501348    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9879e537-1d96-485c-90d2-d4b540fb1f31-host-run-netns\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.502321 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.502301    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 03 09:43:21.523023 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.523004    2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 03 09:43:21.550643 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.550607    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9dfm4"
Jul 03 09:43:21.558770 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.558752    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9dfm4"
Jul 03 09:43:21.591101 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.591068    2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 03 09:43:21.602272 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.602245    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9879e537-1d96-485c-90d2-d4b540fb1f31-cni-binary-copy\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.602272 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.602276    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9879e537-1d96-485c-90d2-d4b540fb1f31-host-run-netns\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.602490 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.602302    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9879e537-1d96-485c-90d2-d4b540fb1f31-host-var-lib-cni-bin\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.602490 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.602326    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9879e537-1d96-485c-90d2-d4b540fb1f31-etc-kubernetes\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.602490 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.602350    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b86f\" (UniqueName: \"kubernetes.io/projected/b8d41b5d-027e-4958-bf3e-422ce5ba511c-kube-api-access-9b86f\") pod \"node-ca-xljb6\" (UID: \"b8d41b5d-027e-4958-bf3e-422ce5ba511c\") " pod="openshift-image-registry/node-ca-xljb6"
Jul 03 09:43:21.602490 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.602375    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be5a24fe-b125-41cc-899c-cc09ce3c2277-tmp\") pod \"tuned-bt2x4\" (UID: \"be5a24fe-b125-41cc-899c-cc09ce3c2277\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.602490 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.602384    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9879e537-1d96-485c-90d2-d4b540fb1f31-host-run-netns\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.602490 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.602400    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7c4b\" (UniqueName: \"kubernetes.io/projected/be5a24fe-b125-41cc-899c-cc09ce3c2277-kube-api-access-z7c4b\") pod \"tuned-bt2x4\" (UID: \"be5a24fe-b125-41cc-899c-cc09ce3c2277\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.602490 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.602445    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7ad0ecde-3110-4f76-8c0e-f296a67153e8-hosts-file\") pod \"node-resolver-nx222\" (UID: \"7ad0ecde-3110-4f76-8c0e-f296a67153e8\") " pod="openshift-dns/node-resolver-nx222"
Jul 03 09:43:21.602490 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.602466    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8160d110-2f6d-41db-a996-8235a758f77f-socket-dir\") pod \"aws-ebs-csi-driver-node-p66g9\" (UID: \"8160d110-2f6d-41db-a996-8235a758f77f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p66g9"
Jul 03 09:43:21.602490 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.602490    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/be5a24fe-b125-41cc-899c-cc09ce3c2277-sys\") pod \"tuned-bt2x4\" (UID: \"be5a24fe-b125-41cc-899c-cc09ce3c2277\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.602985 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.602516    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-systemd-units\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.602985 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.602545    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.602985 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.602603    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0dc3ba3d-94cf-420a-863c-d9f286479320-iptables-alerter-script\") pod \"iptables-alerter-njzlg\" (UID: \"0dc3ba3d-94cf-420a-863c-d9f286479320\") " pod="openshift-network-operator/iptables-alerter-njzlg"
Jul 03 09:43:21.602985 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.602633    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-run-ovn\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.602985 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.602668    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9879e537-1d96-485c-90d2-d4b540fb1f31-host-var-lib-cni-bin\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.602985 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.602659    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-node-log\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.602985 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.602715    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-node-log\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.602985 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.602718    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-host-cni-netd\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.602985 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.602741    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-host-cni-netd\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.602985 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.602761    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0dc3ba3d-94cf-420a-863c-d9f286479320-host-slash\") pod \"iptables-alerter-njzlg\" (UID: \"0dc3ba3d-94cf-420a-863c-d9f286479320\") " pod="openshift-network-operator/iptables-alerter-njzlg"
Jul 03 09:43:21.602985 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.602784    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93420c77-4dcb-4e57-b717-c1c03274b63f-system-cni-dir\") pod \"multus-additional-cni-plugins-hcwzh\" (UID: \"93420c77-4dcb-4e57-b717-c1c03274b63f\") " pod="openshift-multus/multus-additional-cni-plugins-hcwzh"
Jul 03 09:43:21.602985 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.602801    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/93420c77-4dcb-4e57-b717-c1c03274b63f-cnibin\") pod \"multus-additional-cni-plugins-hcwzh\" (UID: \"93420c77-4dcb-4e57-b717-c1c03274b63f\") " pod="openshift-multus/multus-additional-cni-plugins-hcwzh"
Jul 03 09:43:21.602985 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.602837    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-827vh\" (UniqueName: \"kubernetes.io/projected/9879e537-1d96-485c-90d2-d4b540fb1f31-kube-api-access-827vh\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.602985 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.602861    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/be5a24fe-b125-41cc-899c-cc09ce3c2277-etc-modprobe-d\") pod \"tuned-bt2x4\" (UID: \"be5a24fe-b125-41cc-899c-cc09ce3c2277\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.602985 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.602885    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/be5a24fe-b125-41cc-899c-cc09ce3c2277-etc-sysctl-d\") pod \"tuned-bt2x4\" (UID: \"be5a24fe-b125-41cc-899c-cc09ce3c2277\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.602985 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.602903    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t6lr\" (UniqueName: \"kubernetes.io/projected/ad626d77-caf4-4081-8ac3-c6e2c9a970f6-kube-api-access-4t6lr\") pod \"network-check-target-hcgmr\" (UID: \"ad626d77-caf4-4081-8ac3-c6e2c9a970f6\") " pod="openshift-network-diagnostics/network-check-target-hcgmr"
Jul 03 09:43:21.602985 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.602954    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9879e537-1d96-485c-90d2-d4b540fb1f31-multus-daemon-config\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.603745 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.602977    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be5a24fe-b125-41cc-899c-cc09ce3c2277-etc-kubernetes\") pod \"tuned-bt2x4\" (UID: \"be5a24fe-b125-41cc-899c-cc09ce3c2277\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.603745 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.602981    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9879e537-1d96-485c-90d2-d4b540fb1f31-cni-binary-copy\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.603745 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.602998    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ad0ecde-3110-4f76-8c0e-f296a67153e8-tmp-dir\") pod \"node-resolver-nx222\" (UID: \"7ad0ecde-3110-4f76-8c0e-f296a67153e8\") " pod="openshift-dns/node-resolver-nx222"
Jul 03 09:43:21.603745 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603016    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-host-slash\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.603745 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603038    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-host-run-ovn-kubernetes\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.603745 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603060    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65bd85a9-57d3-4ff1-bae1-9f3727371a28-metrics-certs\") pod \"network-metrics-daemon-grmvl\" (UID: \"65bd85a9-57d3-4ff1-bae1-9f3727371a28\") " pod="openshift-multus/network-metrics-daemon-grmvl"
Jul 03 09:43:21.603745 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603082    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9879e537-1d96-485c-90d2-d4b540fb1f31-host-var-lib-cni-multus\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.603745 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603110    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9879e537-1d96-485c-90d2-d4b540fb1f31-host-run-multus-certs\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.603745 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603136    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8160d110-2f6d-41db-a996-8235a758f77f-etc-selinux\") pod \"aws-ebs-csi-driver-node-p66g9\" (UID: \"8160d110-2f6d-41db-a996-8235a758f77f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p66g9"
Jul 03 09:43:21.603745 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603155    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8160d110-2f6d-41db-a996-8235a758f77f-socket-dir\") pod \"aws-ebs-csi-driver-node-p66g9\" (UID: \"8160d110-2f6d-41db-a996-8235a758f77f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p66g9"
Jul 03 09:43:21.603745 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603162    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-etc-openvswitch\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.603745 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603183    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b8d41b5d-027e-4958-bf3e-422ce5ba511c-serviceca\") pod \"node-ca-xljb6\" (UID: \"b8d41b5d-027e-4958-bf3e-422ce5ba511c\") " pod="openshift-image-registry/node-ca-xljb6"
Jul 03 09:43:21.603745 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603196    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/be5a24fe-b125-41cc-899c-cc09ce3c2277-sys\") pod \"tuned-bt2x4\" (UID: \"be5a24fe-b125-41cc-899c-cc09ce3c2277\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.603745 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603209    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk2qt\" (UniqueName: \"kubernetes.io/projected/7ad0ecde-3110-4f76-8c0e-f296a67153e8-kube-api-access-sk2qt\") pod \"node-resolver-nx222\" (UID: \"7ad0ecde-3110-4f76-8c0e-f296a67153e8\") " pod="openshift-dns/node-resolver-nx222"
Jul 03 09:43:21.603745 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603237    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-systemd-units\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.603745 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603247    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-host-kubelet\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.603745 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603250    2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 03 09:43:21.603745 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603267    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-host-cni-bin\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.604695 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603298    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-host-run-ovn-kubernetes\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.604695 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603316    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/93420c77-4dcb-4e57-b717-c1c03274b63f-cni-binary-copy\") pod \"multus-additional-cni-plugins-hcwzh\" (UID: \"93420c77-4dcb-4e57-b717-c1c03274b63f\") " pod="openshift-multus/multus-additional-cni-plugins-hcwzh"
Jul 03 09:43:21.604695 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603348    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/20bf6cc8-63bc-4ac8-be3b-948848a5755c-kubelet-config\") pod \"global-pull-secret-syncer-pwxt9\" (UID: \"20bf6cc8-63bc-4ac8-be3b-948848a5755c\") " pod="kube-system/global-pull-secret-syncer-pwxt9"
Jul 03 09:43:21.604695 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603369    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be5a24fe-b125-41cc-899c-cc09ce3c2277-etc-kubernetes\") pod \"tuned-bt2x4\" (UID: \"be5a24fe-b125-41cc-899c-cc09ce3c2277\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.604695 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603384    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/93420c77-4dcb-4e57-b717-c1c03274b63f-os-release\") pod \"multus-additional-cni-plugins-hcwzh\" (UID: \"93420c77-4dcb-4e57-b717-c1c03274b63f\") " pod="openshift-multus/multus-additional-cni-plugins-hcwzh"
Jul 03 09:43:21.604695 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603401    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b8d41b5d-027e-4958-bf3e-422ce5ba511c-host\") pod \"node-ca-xljb6\" (UID: \"b8d41b5d-027e-4958-bf3e-422ce5ba511c\") " pod="openshift-image-registry/node-ca-xljb6"
Jul 03 09:43:21.604695 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603421    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-host-slash\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.604695 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.602784    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9879e537-1d96-485c-90d2-d4b540fb1f31-etc-kubernetes\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.604695 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603424    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/be5a24fe-b125-41cc-899c-cc09ce3c2277-etc-systemd\") pod \"tuned-bt2x4\" (UID: \"be5a24fe-b125-41cc-899c-cc09ce3c2277\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.604695 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603471    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be5a24fe-b125-41cc-899c-cc09ce3c2277-host\") pod \"tuned-bt2x4\" (UID: \"be5a24fe-b125-41cc-899c-cc09ce3c2277\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.604695 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603480    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/be5a24fe-b125-41cc-899c-cc09ce3c2277-etc-systemd\") pod \"tuned-bt2x4\" (UID: \"be5a24fe-b125-41cc-899c-cc09ce3c2277\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.604695 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:21.603494    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 09:43:21.604695 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603499    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-log-socket\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.604695 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603526    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8f614573-e4a3-491b-a6f5-bd502f0f8245-ovn-node-metrics-cert\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.604695 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:21.603570    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65bd85a9-57d3-4ff1-bae1-9f3727371a28-metrics-certs podName:65bd85a9-57d3-4ff1-bae1-9f3727371a28 nodeName:}" failed. No retries permitted until 2026-07-03 09:43:22.103540671 +0000 UTC m=+2.974206301 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65bd85a9-57d3-4ff1-bae1-9f3727371a28-metrics-certs") pod "network-metrics-daemon-grmvl" (UID: "65bd85a9-57d3-4ff1-bae1-9f3727371a28") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 09:43:21.604695 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603590    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8f614573-e4a3-491b-a6f5-bd502f0f8245-ovnkube-script-lib\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.604695 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603613    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9879e537-1d96-485c-90d2-d4b540fb1f31-cnibin\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.605515 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603645    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9879e537-1d96-485c-90d2-d4b540fb1f31-os-release\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.605515 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603663    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9879e537-1d96-485c-90d2-d4b540fb1f31-multus-conf-dir\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.605515 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603690    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64trd\" (UniqueName: \"kubernetes.io/projected/65bd85a9-57d3-4ff1-bae1-9f3727371a28-kube-api-access-64trd\") pod \"network-metrics-daemon-grmvl\" (UID: \"65bd85a9-57d3-4ff1-bae1-9f3727371a28\") " pod="openshift-multus/network-metrics-daemon-grmvl"
Jul 03 09:43:21.605515 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603710    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/93420c77-4dcb-4e57-b717-c1c03274b63f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hcwzh\" (UID: \"93420c77-4dcb-4e57-b717-c1c03274b63f\") " pod="openshift-multus/multus-additional-cni-plugins-hcwzh"
Jul 03 09:43:21.605515 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603728    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7d19e4da-d529-40d3-a8af-a0e97b870a19-agent-certs\") pod \"konnectivity-agent-gm79x\" (UID: \"7d19e4da-d529-40d3-a8af-a0e97b870a19\") " pod="kube-system/konnectivity-agent-gm79x"
Jul 03 09:43:21.605515 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603748    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be5a24fe-b125-41cc-899c-cc09ce3c2277-var-lib-kubelet\") pod \"tuned-bt2x4\" (UID: \"be5a24fe-b125-41cc-899c-cc09ce3c2277\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.605515 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603790    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/be5a24fe-b125-41cc-899c-cc09ce3c2277-etc-tuned\") pod \"tuned-bt2x4\" (UID: \"be5a24fe-b125-41cc-899c-cc09ce3c2277\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.605515 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603809    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-var-lib-openvswitch\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.605515 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603817    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/be5a24fe-b125-41cc-899c-cc09ce3c2277-etc-modprobe-d\") pod \"tuned-bt2x4\" (UID: \"be5a24fe-b125-41cc-899c-cc09ce3c2277\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.605515 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603827    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-run-openvswitch\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.605515 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603855    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/93420c77-4dcb-4e57-b717-c1c03274b63f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hcwzh\" (UID: \"93420c77-4dcb-4e57-b717-c1c03274b63f\") " pod="openshift-multus/multus-additional-cni-plugins-hcwzh"
Jul 03 09:43:21.605515 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603871    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-run-openvswitch\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.605515 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603887    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9879e537-1d96-485c-90d2-d4b540fb1f31-multus-cni-dir\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.605515 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603903    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9879e537-1d96-485c-90d2-d4b540fb1f31-host-var-lib-cni-multus\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.605515 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603907    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9879e537-1d96-485c-90d2-d4b540fb1f31-hostroot\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.605515 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603081    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7ad0ecde-3110-4f76-8c0e-f296a67153e8-hosts-file\") pod \"node-resolver-nx222\" (UID: \"7ad0ecde-3110-4f76-8c0e-f296a67153e8\") " pod="openshift-dns/node-resolver-nx222"
Jul 03 09:43:21.605515 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603924    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8160d110-2f6d-41db-a996-8235a758f77f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p66g9\" (UID: \"8160d110-2f6d-41db-a996-8235a758f77f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p66g9"
Jul 03 09:43:21.606388 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603942    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8160d110-2f6d-41db-a996-8235a758f77f-device-dir\") pod \"aws-ebs-csi-driver-node-p66g9\" (UID: \"8160d110-2f6d-41db-a996-8235a758f77f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p66g9"
Jul 03 09:43:21.606388 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603959    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l77kx\" (UniqueName: \"kubernetes.io/projected/8f614573-e4a3-491b-a6f5-bd502f0f8245-kube-api-access-l77kx\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.606388 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603976    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9879e537-1d96-485c-90d2-d4b540fb1f31-system-cni-dir\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.606388 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603993    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9879e537-1d96-485c-90d2-d4b540fb1f31-host-var-lib-kubelet\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.606388 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.604009    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8160d110-2f6d-41db-a996-8235a758f77f-etc-selinux\") pod \"aws-ebs-csi-driver-node-p66g9\" (UID: \"8160d110-2f6d-41db-a996-8235a758f77f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p66g9"
Jul 03 09:43:21.606388 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.604011    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/be5a24fe-b125-41cc-899c-cc09ce3c2277-etc-sysconfig\") pod \"tuned-bt2x4\" (UID: \"be5a24fe-b125-41cc-899c-cc09ce3c2277\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.606388 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.604039    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/be5a24fe-b125-41cc-899c-cc09ce3c2277-etc-sysctl-conf\") pod \"tuned-bt2x4\" (UID: \"be5a24fe-b125-41cc-899c-cc09ce3c2277\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.606388 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.604088    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-host-run-netns\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.606388 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.604105    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-run-systemd\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.606388 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.604121    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8f614573-e4a3-491b-a6f5-bd502f0f8245-ovnkube-config\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.606388 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.604138    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/20bf6cc8-63bc-4ac8-be3b-948848a5755c-dbus\") pod \"global-pull-secret-syncer-pwxt9\" (UID: \"20bf6cc8-63bc-4ac8-be3b-948848a5755c\") " pod="kube-system/global-pull-secret-syncer-pwxt9"
Jul 03 09:43:21.606388 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.604154    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8160d110-2f6d-41db-a996-8235a758f77f-registration-dir\") pod \"aws-ebs-csi-driver-node-p66g9\" (UID: \"8160d110-2f6d-41db-a996-8235a758f77f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p66g9"
Jul 03 09:43:21.606388 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.604171    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/be5a24fe-b125-41cc-899c-cc09ce3c2277-run\") pod \"tuned-bt2x4\" (UID: \"be5a24fe-b125-41cc-899c-cc09ce3c2277\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.606388 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.604188    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20bf6cc8-63bc-4ac8-be3b-948848a5755c-original-pull-secret\") pod \"global-pull-secret-syncer-pwxt9\" (UID: \"20bf6cc8-63bc-4ac8-be3b-948848a5755c\") " pod="kube-system/global-pull-secret-syncer-pwxt9"
Jul 03 09:43:21.606388 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.604206    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z49ml\" (UniqueName: \"kubernetes.io/projected/0dc3ba3d-94cf-420a-863c-d9f286479320-kube-api-access-z49ml\") pod \"iptables-alerter-njzlg\" (UID: \"0dc3ba3d-94cf-420a-863c-d9f286479320\") " pod="openshift-network-operator/iptables-alerter-njzlg"
Jul 03 09:43:21.606388 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.604220    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be5a24fe-b125-41cc-899c-cc09ce3c2277-host\") pod \"tuned-bt2x4\" (UID: \"be5a24fe-b125-41cc-899c-cc09ce3c2277\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.606388 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.604230    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9879e537-1d96-485c-90d2-d4b540fb1f31-multus-socket-dir-parent\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.607218 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.604251    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9879e537-1d96-485c-90d2-d4b540fb1f31-host-run-k8s-cni-cncf-io\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.607218 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.604268    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8160d110-2f6d-41db-a996-8235a758f77f-sys-fs\") pod \"aws-ebs-csi-driver-node-p66g9\" (UID: \"8160d110-2f6d-41db-a996-8235a758f77f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p66g9"
Jul 03 09:43:21.607218 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.604271    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-log-socket\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.607218 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.604287    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/be5a24fe-b125-41cc-899c-cc09ce3c2277-lib-modules\") pod \"tuned-bt2x4\" (UID: \"be5a24fe-b125-41cc-899c-cc09ce3c2277\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.607218 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.604310    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-etc-openvswitch\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.607218 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.604361    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-run-systemd\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.607218 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.604363    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-host-run-netns\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.607218 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.604415    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8160d110-2f6d-41db-a996-8235a758f77f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p66g9\" (UID: \"8160d110-2f6d-41db-a996-8235a758f77f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p66g9"
Jul 03 09:43:21.607218 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.604416    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b8d41b5d-027e-4958-bf3e-422ce5ba511c-serviceca\") pod \"node-ca-xljb6\" (UID: \"b8d41b5d-027e-4958-bf3e-422ce5ba511c\") " pod="openshift-image-registry/node-ca-xljb6"
Jul 03 09:43:21.607218 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603940    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9879e537-1d96-485c-90d2-d4b540fb1f31-host-run-multus-certs\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.607218 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603277    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.607218 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.604311    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/93420c77-4dcb-4e57-b717-c1c03274b63f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hcwzh\" (UID: \"93420c77-4dcb-4e57-b717-c1c03274b63f\") " pod="openshift-multus/multus-additional-cni-plugins-hcwzh"
Jul 03 09:43:21.607218 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.603399    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/be5a24fe-b125-41cc-899c-cc09ce3c2277-etc-sysctl-d\") pod \"tuned-bt2x4\" (UID: \"be5a24fe-b125-41cc-899c-cc09ce3c2277\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.607218 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.604759    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ad0ecde-3110-4f76-8c0e-f296a67153e8-tmp-dir\") pod \"node-resolver-nx222\" (UID: \"7ad0ecde-3110-4f76-8c0e-f296a67153e8\") " pod="openshift-dns/node-resolver-nx222"
Jul 03 09:43:21.607218 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.604772    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9879e537-1d96-485c-90d2-d4b540fb1f31-hostroot\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.607218 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.604850    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8f614573-e4a3-491b-a6f5-bd502f0f8245-ovnkube-config\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.607218 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.604895    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-host-kubelet\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.607218 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.604956    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9879e537-1d96-485c-90d2-d4b540fb1f31-os-release\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.607887 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.605043    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8160d110-2f6d-41db-a996-8235a758f77f-device-dir\") pod \"aws-ebs-csi-driver-node-p66g9\" (UID: \"8160d110-2f6d-41db-a996-8235a758f77f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p66g9"
Jul 03 09:43:21.607887 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.605093    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8160d110-2f6d-41db-a996-8235a758f77f-registration-dir\") pod \"aws-ebs-csi-driver-node-p66g9\" (UID: \"8160d110-2f6d-41db-a996-8235a758f77f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p66g9"
Jul 03 09:43:21.607887 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.605100    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/20bf6cc8-63bc-4ac8-be3b-948848a5755c-dbus\") pod \"global-pull-secret-syncer-pwxt9\" (UID: \"20bf6cc8-63bc-4ac8-be3b-948848a5755c\") " pod="kube-system/global-pull-secret-syncer-pwxt9"
Jul 03 09:43:21.607887 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.605121    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/be5a24fe-b125-41cc-899c-cc09ce3c2277-run\") pod \"tuned-bt2x4\" (UID: \"be5a24fe-b125-41cc-899c-cc09ce3c2277\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.607887 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.605149    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be5a24fe-b125-41cc-899c-cc09ce3c2277-var-lib-kubelet\") pod \"tuned-bt2x4\" (UID: \"be5a24fe-b125-41cc-899c-cc09ce3c2277\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.607887 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:21.605168    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 03 09:43:21.607887 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:21.605221    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20bf6cc8-63bc-4ac8-be3b-948848a5755c-original-pull-secret podName:20bf6cc8-63bc-4ac8-be3b-948848a5755c nodeName:}" failed. No retries permitted until 2026-07-03 09:43:22.105209222 +0000 UTC m=+2.975874830 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20bf6cc8-63bc-4ac8-be3b-948848a5755c-original-pull-secret") pod "global-pull-secret-syncer-pwxt9" (UID: "20bf6cc8-63bc-4ac8-be3b-948848a5755c") : object "kube-system"/"original-pull-secret" not registered
Jul 03 09:43:21.607887 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.605231    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/be5a24fe-b125-41cc-899c-cc09ce3c2277-lib-modules\") pod \"tuned-bt2x4\" (UID: \"be5a24fe-b125-41cc-899c-cc09ce3c2277\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.607887 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.605235    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9879e537-1d96-485c-90d2-d4b540fb1f31-multus-daemon-config\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.607887 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.605280    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9879e537-1d96-485c-90d2-d4b540fb1f31-multus-socket-dir-parent\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.607887 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.605291    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-run-ovn\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.607887 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.605318    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-var-lib-openvswitch\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.607887 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.605354    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9879e537-1d96-485c-90d2-d4b540fb1f31-host-run-k8s-cni-cncf-io\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.607887 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.605396    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9879e537-1d96-485c-90d2-d4b540fb1f31-host-var-lib-kubelet\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.607887 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.605399    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8f614573-e4a3-491b-a6f5-bd502f0f8245-ovnkube-script-lib\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.607887 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.605430    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f614573-e4a3-491b-a6f5-bd502f0f8245-host-cni-bin\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.607887 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.605449    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7d19e4da-d529-40d3-a8af-a0e97b870a19-konnectivity-ca\") pod \"konnectivity-agent-gm79x\" (UID: \"7d19e4da-d529-40d3-a8af-a0e97b870a19\") " pod="kube-system/konnectivity-agent-gm79x"
Jul 03 09:43:21.608692 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.605461    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/20bf6cc8-63bc-4ac8-be3b-948848a5755c-kubelet-config\") pod \"global-pull-secret-syncer-pwxt9\" (UID: \"20bf6cc8-63bc-4ac8-be3b-948848a5755c\") " pod="kube-system/global-pull-secret-syncer-pwxt9"
Jul 03 09:43:21.608692 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.605476    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9879e537-1d96-485c-90d2-d4b540fb1f31-system-cni-dir\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.608692 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.605485    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58g6d\" (UniqueName: \"kubernetes.io/projected/8160d110-2f6d-41db-a996-8235a758f77f-kube-api-access-58g6d\") pod \"aws-ebs-csi-driver-node-p66g9\" (UID: \"8160d110-2f6d-41db-a996-8235a758f77f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p66g9"
Jul 03 09:43:21.608692 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.605514    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/be5a24fe-b125-41cc-899c-cc09ce3c2277-etc-sysconfig\") pod \"tuned-bt2x4\" (UID: \"be5a24fe-b125-41cc-899c-cc09ce3c2277\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.608692 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.605521    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b8d41b5d-027e-4958-bf3e-422ce5ba511c-host\") pod \"node-ca-xljb6\" (UID: \"b8d41b5d-027e-4958-bf3e-422ce5ba511c\") " pod="openshift-image-registry/node-ca-xljb6"
Jul 03 09:43:21.608692 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.605533    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8f614573-e4a3-491b-a6f5-bd502f0f8245-env-overrides\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.608692 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.605567    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9879e537-1d96-485c-90d2-d4b540fb1f31-multus-conf-dir\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.608692 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.605633    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/be5a24fe-b125-41cc-899c-cc09ce3c2277-etc-sysctl-conf\") pod \"tuned-bt2x4\" (UID: \"be5a24fe-b125-41cc-899c-cc09ce3c2277\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.608692 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.605638    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq4jg\" (UniqueName: \"kubernetes.io/projected/93420c77-4dcb-4e57-b717-c1c03274b63f-kube-api-access-lq4jg\") pod \"multus-additional-cni-plugins-hcwzh\" (UID: \"93420c77-4dcb-4e57-b717-c1c03274b63f\") " pod="openshift-multus/multus-additional-cni-plugins-hcwzh"
Jul 03 09:43:21.608692 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.605692    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9879e537-1d96-485c-90d2-d4b540fb1f31-multus-cni-dir\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.608692 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.605744    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8160d110-2f6d-41db-a996-8235a758f77f-sys-fs\") pod \"aws-ebs-csi-driver-node-p66g9\" (UID: \"8160d110-2f6d-41db-a996-8235a758f77f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p66g9"
Jul 03 09:43:21.608692 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.605751    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9879e537-1d96-485c-90d2-d4b540fb1f31-cnibin\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.608692 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.606081    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8f614573-e4a3-491b-a6f5-bd502f0f8245-env-overrides\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.608692 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.607869    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be5a24fe-b125-41cc-899c-cc09ce3c2277-tmp\") pod \"tuned-bt2x4\" (UID: \"be5a24fe-b125-41cc-899c-cc09ce3c2277\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.608692 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.608003    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/be5a24fe-b125-41cc-899c-cc09ce3c2277-etc-tuned\") pod \"tuned-bt2x4\" (UID: \"be5a24fe-b125-41cc-899c-cc09ce3c2277\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.608692 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.608017    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8f614573-e4a3-491b-a6f5-bd502f0f8245-ovn-node-metrics-cert\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.616623 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.616599    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58g6d\" (UniqueName: \"kubernetes.io/projected/8160d110-2f6d-41db-a996-8235a758f77f-kube-api-access-58g6d\") pod \"aws-ebs-csi-driver-node-p66g9\" (UID: \"8160d110-2f6d-41db-a996-8235a758f77f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p66g9"
Jul 03 09:43:21.616623 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.616611    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk2qt\" (UniqueName: \"kubernetes.io/projected/7ad0ecde-3110-4f76-8c0e-f296a67153e8-kube-api-access-sk2qt\") pod \"node-resolver-nx222\" (UID: \"7ad0ecde-3110-4f76-8c0e-f296a67153e8\") " pod="openshift-dns/node-resolver-nx222"
Jul 03 09:43:21.617050 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.617030    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-827vh\" (UniqueName: \"kubernetes.io/projected/9879e537-1d96-485c-90d2-d4b540fb1f31-kube-api-access-827vh\") pod \"multus-gznr6\" (UID: \"9879e537-1d96-485c-90d2-d4b540fb1f31\") " pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.617736 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.617706    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b86f\" (UniqueName: \"kubernetes.io/projected/b8d41b5d-027e-4958-bf3e-422ce5ba511c-kube-api-access-9b86f\") pod \"node-ca-xljb6\" (UID: \"b8d41b5d-027e-4958-bf3e-422ce5ba511c\") " pod="openshift-image-registry/node-ca-xljb6"
Jul 03 09:43:21.618526 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.618506    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7c4b\" (UniqueName: \"kubernetes.io/projected/be5a24fe-b125-41cc-899c-cc09ce3c2277-kube-api-access-z7c4b\") pod \"tuned-bt2x4\" (UID: \"be5a24fe-b125-41cc-899c-cc09ce3c2277\") " pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.618526 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.618519    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l77kx\" (UniqueName: \"kubernetes.io/projected/8f614573-e4a3-491b-a6f5-bd502f0f8245-kube-api-access-l77kx\") pod \"ovnkube-node-mbxdl\" (UID: \"8f614573-e4a3-491b-a6f5-bd502f0f8245\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.618949 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.618922    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64trd\" (UniqueName: \"kubernetes.io/projected/65bd85a9-57d3-4ff1-bae1-9f3727371a28-kube-api-access-64trd\") pod \"network-metrics-daemon-grmvl\" (UID: \"65bd85a9-57d3-4ff1-bae1-9f3727371a28\") " pod="openshift-multus/network-metrics-daemon-grmvl"
Jul 03 09:43:21.706932 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.706842    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/93420c77-4dcb-4e57-b717-c1c03274b63f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hcwzh\" (UID: \"93420c77-4dcb-4e57-b717-c1c03274b63f\") " pod="openshift-multus/multus-additional-cni-plugins-hcwzh"
Jul 03 09:43:21.706932 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.706914    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z49ml\" (UniqueName: \"kubernetes.io/projected/0dc3ba3d-94cf-420a-863c-d9f286479320-kube-api-access-z49ml\") pod \"iptables-alerter-njzlg\" (UID: \"0dc3ba3d-94cf-420a-863c-d9f286479320\") " pod="openshift-network-operator/iptables-alerter-njzlg"
Jul 03 09:43:21.707138 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.706940    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/93420c77-4dcb-4e57-b717-c1c03274b63f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hcwzh\" (UID: \"93420c77-4dcb-4e57-b717-c1c03274b63f\") " pod="openshift-multus/multus-additional-cni-plugins-hcwzh"
Jul 03 09:43:21.707138 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.706959    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7d19e4da-d529-40d3-a8af-a0e97b870a19-konnectivity-ca\") pod \"konnectivity-agent-gm79x\" (UID: \"7d19e4da-d529-40d3-a8af-a0e97b870a19\") " pod="kube-system/konnectivity-agent-gm79x"
Jul 03 09:43:21.707138 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.706976    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq4jg\" (UniqueName: \"kubernetes.io/projected/93420c77-4dcb-4e57-b717-c1c03274b63f-kube-api-access-lq4jg\") pod \"multus-additional-cni-plugins-hcwzh\" (UID: \"93420c77-4dcb-4e57-b717-c1c03274b63f\") " pod="openshift-multus/multus-additional-cni-plugins-hcwzh"
Jul 03 09:43:21.707138 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.707005    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0dc3ba3d-94cf-420a-863c-d9f286479320-iptables-alerter-script\") pod \"iptables-alerter-njzlg\" (UID: \"0dc3ba3d-94cf-420a-863c-d9f286479320\") " pod="openshift-network-operator/iptables-alerter-njzlg"
Jul 03 09:43:21.707138 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.707023    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0dc3ba3d-94cf-420a-863c-d9f286479320-host-slash\") pod \"iptables-alerter-njzlg\" (UID: \"0dc3ba3d-94cf-420a-863c-d9f286479320\") " pod="openshift-network-operator/iptables-alerter-njzlg"
Jul 03 09:43:21.707138 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.707041    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93420c77-4dcb-4e57-b717-c1c03274b63f-system-cni-dir\") pod \"multus-additional-cni-plugins-hcwzh\" (UID: \"93420c77-4dcb-4e57-b717-c1c03274b63f\") " pod="openshift-multus/multus-additional-cni-plugins-hcwzh"
Jul 03 09:43:21.707138 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.707066    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/93420c77-4dcb-4e57-b717-c1c03274b63f-cnibin\") pod \"multus-additional-cni-plugins-hcwzh\" (UID: \"93420c77-4dcb-4e57-b717-c1c03274b63f\") " pod="openshift-multus/multus-additional-cni-plugins-hcwzh"
Jul 03 09:43:21.707138 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.707094    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t6lr\" (UniqueName: \"kubernetes.io/projected/ad626d77-caf4-4081-8ac3-c6e2c9a970f6-kube-api-access-4t6lr\") pod \"network-check-target-hcgmr\" (UID: \"ad626d77-caf4-4081-8ac3-c6e2c9a970f6\") " pod="openshift-network-diagnostics/network-check-target-hcgmr"
Jul 03 09:43:21.707529 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.707191    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93420c77-4dcb-4e57-b717-c1c03274b63f-system-cni-dir\") pod \"multus-additional-cni-plugins-hcwzh\" (UID: \"93420c77-4dcb-4e57-b717-c1c03274b63f\") " pod="openshift-multus/multus-additional-cni-plugins-hcwzh"
Jul 03 09:43:21.707529 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.707259    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0dc3ba3d-94cf-420a-863c-d9f286479320-host-slash\") pod \"iptables-alerter-njzlg\" (UID: \"0dc3ba3d-94cf-420a-863c-d9f286479320\") " pod="openshift-network-operator/iptables-alerter-njzlg"
Jul 03 09:43:21.707529 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.707293    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/93420c77-4dcb-4e57-b717-c1c03274b63f-cnibin\") pod \"multus-additional-cni-plugins-hcwzh\" (UID: \"93420c77-4dcb-4e57-b717-c1c03274b63f\") " pod="openshift-multus/multus-additional-cni-plugins-hcwzh"
Jul 03 09:43:21.707529 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.707321    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/93420c77-4dcb-4e57-b717-c1c03274b63f-cni-binary-copy\") pod \"multus-additional-cni-plugins-hcwzh\" (UID: \"93420c77-4dcb-4e57-b717-c1c03274b63f\") " pod="openshift-multus/multus-additional-cni-plugins-hcwzh"
Jul 03 09:43:21.707529 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.707350    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/93420c77-4dcb-4e57-b717-c1c03274b63f-os-release\") pod \"multus-additional-cni-plugins-hcwzh\" (UID: \"93420c77-4dcb-4e57-b717-c1c03274b63f\") " pod="openshift-multus/multus-additional-cni-plugins-hcwzh"
Jul 03 09:43:21.707529 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.707386    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/93420c77-4dcb-4e57-b717-c1c03274b63f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hcwzh\" (UID: \"93420c77-4dcb-4e57-b717-c1c03274b63f\") " pod="openshift-multus/multus-additional-cni-plugins-hcwzh"
Jul 03 09:43:21.707529 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.707414    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7d19e4da-d529-40d3-a8af-a0e97b870a19-agent-certs\") pod \"konnectivity-agent-gm79x\" (UID: \"7d19e4da-d529-40d3-a8af-a0e97b870a19\") " pod="kube-system/konnectivity-agent-gm79x"
Jul 03 09:43:21.707529 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.707451    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/93420c77-4dcb-4e57-b717-c1c03274b63f-os-release\") pod \"multus-additional-cni-plugins-hcwzh\" (UID: \"93420c77-4dcb-4e57-b717-c1c03274b63f\") " pod="openshift-multus/multus-additional-cni-plugins-hcwzh"
Jul 03 09:43:21.707904 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.707643    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/93420c77-4dcb-4e57-b717-c1c03274b63f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hcwzh\" (UID: \"93420c77-4dcb-4e57-b717-c1c03274b63f\") " pod="openshift-multus/multus-additional-cni-plugins-hcwzh"
Jul 03 09:43:21.707904 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.707649    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7d19e4da-d529-40d3-a8af-a0e97b870a19-konnectivity-ca\") pod \"konnectivity-agent-gm79x\" (UID: \"7d19e4da-d529-40d3-a8af-a0e97b870a19\") " pod="kube-system/konnectivity-agent-gm79x"
Jul 03 09:43:21.707904 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.707671    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/93420c77-4dcb-4e57-b717-c1c03274b63f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hcwzh\" (UID: \"93420c77-4dcb-4e57-b717-c1c03274b63f\") " pod="openshift-multus/multus-additional-cni-plugins-hcwzh"
Jul 03 09:43:21.707904 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.707689    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/93420c77-4dcb-4e57-b717-c1c03274b63f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hcwzh\" (UID: \"93420c77-4dcb-4e57-b717-c1c03274b63f\") " pod="openshift-multus/multus-additional-cni-plugins-hcwzh"
Jul 03 09:43:21.707904 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.707859    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0dc3ba3d-94cf-420a-863c-d9f286479320-iptables-alerter-script\") pod \"iptables-alerter-njzlg\" (UID: \"0dc3ba3d-94cf-420a-863c-d9f286479320\") " pod="openshift-network-operator/iptables-alerter-njzlg"
Jul 03 09:43:21.707904 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.707874    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/93420c77-4dcb-4e57-b717-c1c03274b63f-cni-binary-copy\") pod \"multus-additional-cni-plugins-hcwzh\" (UID: \"93420c77-4dcb-4e57-b717-c1c03274b63f\") " pod="openshift-multus/multus-additional-cni-plugins-hcwzh"
Jul 03 09:43:21.710474 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.710448    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7d19e4da-d529-40d3-a8af-a0e97b870a19-agent-certs\") pod \"konnectivity-agent-gm79x\" (UID: \"7d19e4da-d529-40d3-a8af-a0e97b870a19\") " pod="kube-system/konnectivity-agent-gm79x"
Jul 03 09:43:21.713142 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:21.713121    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 03 09:43:21.713253 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:21.713151    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 03 09:43:21.713253 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:21.713162    2559 projected.go:196] Error preparing data for projected volume kube-api-access-4t6lr for pod openshift-network-diagnostics/network-check-target-hcgmr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 09:43:21.713253 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:21.713240    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad626d77-caf4-4081-8ac3-c6e2c9a970f6-kube-api-access-4t6lr podName:ad626d77-caf4-4081-8ac3-c6e2c9a970f6 nodeName:}" failed. No retries permitted until 2026-07-03 09:43:22.213225654 +0000 UTC m=+3.083891278 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4t6lr" (UniqueName: "kubernetes.io/projected/ad626d77-caf4-4081-8ac3-c6e2c9a970f6-kube-api-access-4t6lr") pod "network-check-target-hcgmr" (UID: "ad626d77-caf4-4081-8ac3-c6e2c9a970f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 09:43:21.715874 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.715853    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z49ml\" (UniqueName: \"kubernetes.io/projected/0dc3ba3d-94cf-420a-863c-d9f286479320-kube-api-access-z49ml\") pod \"iptables-alerter-njzlg\" (UID: \"0dc3ba3d-94cf-420a-863c-d9f286479320\") " pod="openshift-network-operator/iptables-alerter-njzlg"
Jul 03 09:43:21.715980 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.715934    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq4jg\" (UniqueName: \"kubernetes.io/projected/93420c77-4dcb-4e57-b717-c1c03274b63f-kube-api-access-lq4jg\") pod \"multus-additional-cni-plugins-hcwzh\" (UID: \"93420c77-4dcb-4e57-b717-c1c03274b63f\") " pod="openshift-multus/multus-additional-cni-plugins-hcwzh"
Jul 03 09:43:21.793263 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.793226    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nx222"
Jul 03 09:43:21.800777 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.800747    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gznr6"
Jul 03 09:43:21.807896 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.807872    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:21.811878 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.811861    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p66g9"
Jul 03 09:43:21.818899 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.818874    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xljb6"
Jul 03 09:43:21.826129 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.826108    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bt2x4"
Jul 03 09:43:21.836388 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.836368    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-njzlg"
Jul 03 09:43:21.847440 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.847415    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hcwzh"
Jul 03 09:43:21.852484 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:21.852462    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gm79x"
Jul 03 09:43:22.110524 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:22.110440    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20bf6cc8-63bc-4ac8-be3b-948848a5755c-original-pull-secret\") pod \"global-pull-secret-syncer-pwxt9\" (UID: \"20bf6cc8-63bc-4ac8-be3b-948848a5755c\") " pod="kube-system/global-pull-secret-syncer-pwxt9"
Jul 03 09:43:22.110524 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:22.110502    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65bd85a9-57d3-4ff1-bae1-9f3727371a28-metrics-certs\") pod \"network-metrics-daemon-grmvl\" (UID: \"65bd85a9-57d3-4ff1-bae1-9f3727371a28\") " pod="openshift-multus/network-metrics-daemon-grmvl"
Jul 03 09:43:22.110739 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:22.110649    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 03 09:43:22.110739 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:22.110724    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20bf6cc8-63bc-4ac8-be3b-948848a5755c-original-pull-secret podName:20bf6cc8-63bc-4ac8-be3b-948848a5755c nodeName:}" failed. No retries permitted until 2026-07-03 09:43:23.110703041 +0000 UTC m=+3.981368656 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20bf6cc8-63bc-4ac8-be3b-948848a5755c-original-pull-secret") pod "global-pull-secret-syncer-pwxt9" (UID: "20bf6cc8-63bc-4ac8-be3b-948848a5755c") : object "kube-system"/"original-pull-secret" not registered
Jul 03 09:43:22.110841 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:22.110653    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 09:43:22.110841 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:22.110797    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65bd85a9-57d3-4ff1-bae1-9f3727371a28-metrics-certs podName:65bd85a9-57d3-4ff1-bae1-9f3727371a28 nodeName:}" failed. No retries permitted until 2026-07-03 09:43:23.110782951 +0000 UTC m=+3.981448560 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65bd85a9-57d3-4ff1-bae1-9f3727371a28-metrics-certs") pod "network-metrics-daemon-grmvl" (UID: "65bd85a9-57d3-4ff1-bae1-9f3727371a28") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 09:43:22.312060 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:22.312026    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t6lr\" (UniqueName: \"kubernetes.io/projected/ad626d77-caf4-4081-8ac3-c6e2c9a970f6-kube-api-access-4t6lr\") pod \"network-check-target-hcgmr\" (UID: \"ad626d77-caf4-4081-8ac3-c6e2c9a970f6\") " pod="openshift-network-diagnostics/network-check-target-hcgmr"
Jul 03 09:43:22.312244 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:22.312220    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 03 09:43:22.312301 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:22.312252    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 03 09:43:22.312301 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:22.312268    2559 projected.go:196] Error preparing data for projected volume kube-api-access-4t6lr for pod openshift-network-diagnostics/network-check-target-hcgmr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 09:43:22.312386 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:22.312336    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad626d77-caf4-4081-8ac3-c6e2c9a970f6-kube-api-access-4t6lr podName:ad626d77-caf4-4081-8ac3-c6e2c9a970f6 nodeName:}" failed. No retries permitted until 2026-07-03 09:43:23.312315667 +0000 UTC m=+4.182981294 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4t6lr" (UniqueName: "kubernetes.io/projected/ad626d77-caf4-4081-8ac3-c6e2c9a970f6-kube-api-access-4t6lr") pod "network-check-target-hcgmr" (UID: "ad626d77-caf4-4081-8ac3-c6e2c9a970f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 09:43:22.561725 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:22.561694    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-02 09:38:21 +0000 UTC" deadline="2028-02-08 09:58:23.763273565 +0000 UTC"
Jul 03 09:43:22.561725 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:22.561723    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14040h15m1.201553562s"
Jul 03 09:43:22.585270 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:22.585083    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f614573_e4a3_491b_a6f5_bd502f0f8245.slice/crio-eda91f18730206976e136696f2d9c438019d2f1aacc9c522a54301451d54f0dd WatchSource:0}: Error finding container eda91f18730206976e136696f2d9c438019d2f1aacc9c522a54301451d54f0dd: Status 404 returned error can't find the container with id eda91f18730206976e136696f2d9c438019d2f1aacc9c522a54301451d54f0dd
Jul 03 09:43:22.587721 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:22.587697    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93420c77_4dcb_4e57_b717_c1c03274b63f.slice/crio-27903b94c3dbec680e9ed6f33ab64313c24ef61d66bdeab768c48c7acb639cda WatchSource:0}: Error finding container 27903b94c3dbec680e9ed6f33ab64313c24ef61d66bdeab768c48c7acb639cda: Status 404 returned error can't find the container with id 27903b94c3dbec680e9ed6f33ab64313c24ef61d66bdeab768c48c7acb639cda
Jul 03 09:43:22.591316 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:22.591294    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ad0ecde_3110_4f76_8c0e_f296a67153e8.slice/crio-02db22f96d647c586451bd0727c0e150f92c2fb1f7bac999e7b50a94493076dc WatchSource:0}: Error finding container 02db22f96d647c586451bd0727c0e150f92c2fb1f7bac999e7b50a94493076dc: Status 404 returned error can't find the container with id 02db22f96d647c586451bd0727c0e150f92c2fb1f7bac999e7b50a94493076dc
Jul 03 09:43:22.592530 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:22.592506    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dc3ba3d_94cf_420a_863c_d9f286479320.slice/crio-c689644b0f6c8837f588a12fe9800fa40139310374c63b954b757813dd3b5928 WatchSource:0}: Error finding container c689644b0f6c8837f588a12fe9800fa40139310374c63b954b757813dd3b5928: Status 404 returned error can't find the container with id c689644b0f6c8837f588a12fe9800fa40139310374c63b954b757813dd3b5928
Jul 03 09:43:22.594651 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:22.594538    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe5a24fe_b125_41cc_899c_cc09ce3c2277.slice/crio-378b4f16d7eb5681ed9cf5e0836765818f4191ea613c7581a2d0c6e4f1aaf058 WatchSource:0}: Error finding container 378b4f16d7eb5681ed9cf5e0836765818f4191ea613c7581a2d0c6e4f1aaf058: Status 404 returned error can't find the container with id 378b4f16d7eb5681ed9cf5e0836765818f4191ea613c7581a2d0c6e4f1aaf058
Jul 03 09:43:22.595443 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:22.595413    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8160d110_2f6d_41db_a996_8235a758f77f.slice/crio-26d29447076d6ccb45e275d761faecc75b07a1d84e1ef6eeb0aaac634e09602d WatchSource:0}: Error finding container 26d29447076d6ccb45e275d761faecc75b07a1d84e1ef6eeb0aaac634e09602d: Status 404 returned error can't find the container with id 26d29447076d6ccb45e275d761faecc75b07a1d84e1ef6eeb0aaac634e09602d
Jul 03 09:43:22.597322 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:22.597215    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9879e537_1d96_485c_90d2_d4b540fb1f31.slice/crio-2dc380c8e75ab02ff7a9072b2835813b9a29e04e554ac5b4d4245a6d09a54e9e WatchSource:0}: Error finding container 2dc380c8e75ab02ff7a9072b2835813b9a29e04e554ac5b4d4245a6d09a54e9e: Status 404 returned error can't find the container with id 2dc380c8e75ab02ff7a9072b2835813b9a29e04e554ac5b4d4245a6d09a54e9e
Jul 03 09:43:22.600100 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:22.599086    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d19e4da_d529_40d3_a8af_a0e97b870a19.slice/crio-dfba199d6ccd2137a827b4962fea884e09afa8b851ca8371f436faf3a8dd1f90 WatchSource:0}: Error finding container dfba199d6ccd2137a827b4962fea884e09afa8b851ca8371f436faf3a8dd1f90: Status 404 returned error can't find the container with id dfba199d6ccd2137a827b4962fea884e09afa8b851ca8371f436faf3a8dd1f90
Jul 03 09:43:22.685466 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:22.685322    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcgmr"
Jul 03 09:43:22.685587 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:22.685536    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcgmr" podUID="ad626d77-caf4-4081-8ac3-c6e2c9a970f6"
Jul 03 09:43:22.695238 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:22.694856    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-117.ec2.internal" event={"ID":"0caf382ca9eb296da259b7ea66c7880a","Type":"ContainerStarted","Data":"4ad4b295cc840048eb40614a80149bd10846514e0f7e37451fd8460dd112d86c"}
Jul 03 09:43:22.696080 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:22.696054    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gm79x" event={"ID":"7d19e4da-d529-40d3-a8af-a0e97b870a19","Type":"ContainerStarted","Data":"dfba199d6ccd2137a827b4962fea884e09afa8b851ca8371f436faf3a8dd1f90"}
Jul 03 09:43:22.697342 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:22.697317    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcwzh" event={"ID":"93420c77-4dcb-4e57-b717-c1c03274b63f","Type":"ContainerStarted","Data":"27903b94c3dbec680e9ed6f33ab64313c24ef61d66bdeab768c48c7acb639cda"}
Jul 03 09:43:22.698757 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:22.698732    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl" event={"ID":"8f614573-e4a3-491b-a6f5-bd502f0f8245","Type":"ContainerStarted","Data":"eda91f18730206976e136696f2d9c438019d2f1aacc9c522a54301451d54f0dd"}
Jul 03 09:43:22.699928 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:22.699905    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gznr6" event={"ID":"9879e537-1d96-485c-90d2-d4b540fb1f31","Type":"ContainerStarted","Data":"2dc380c8e75ab02ff7a9072b2835813b9a29e04e554ac5b4d4245a6d09a54e9e"}
Jul 03 09:43:22.701015 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:22.700986    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xljb6" event={"ID":"b8d41b5d-027e-4958-bf3e-422ce5ba511c","Type":"ContainerStarted","Data":"be033e21d5969e598b293f5cb84da6ad2bd85ff90920895373c47f646a2793f2"}
Jul 03 09:43:22.702210 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:22.702189    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p66g9" event={"ID":"8160d110-2f6d-41db-a996-8235a758f77f","Type":"ContainerStarted","Data":"26d29447076d6ccb45e275d761faecc75b07a1d84e1ef6eeb0aaac634e09602d"}
Jul 03 09:43:22.703479 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:22.703457    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bt2x4" event={"ID":"be5a24fe-b125-41cc-899c-cc09ce3c2277","Type":"ContainerStarted","Data":"378b4f16d7eb5681ed9cf5e0836765818f4191ea613c7581a2d0c6e4f1aaf058"}
Jul 03 09:43:22.704745 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:22.704722    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-njzlg" event={"ID":"0dc3ba3d-94cf-420a-863c-d9f286479320","Type":"ContainerStarted","Data":"c689644b0f6c8837f588a12fe9800fa40139310374c63b954b757813dd3b5928"}
Jul 03 09:43:22.705717 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:22.705696    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nx222" event={"ID":"7ad0ecde-3110-4f76-8c0e-f296a67153e8","Type":"ContainerStarted","Data":"02db22f96d647c586451bd0727c0e150f92c2fb1f7bac999e7b50a94493076dc"}
Jul 03 09:43:23.121673 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:23.120862    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20bf6cc8-63bc-4ac8-be3b-948848a5755c-original-pull-secret\") pod \"global-pull-secret-syncer-pwxt9\" (UID: \"20bf6cc8-63bc-4ac8-be3b-948848a5755c\") " pod="kube-system/global-pull-secret-syncer-pwxt9"
Jul 03 09:43:23.121673 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:23.120926    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65bd85a9-57d3-4ff1-bae1-9f3727371a28-metrics-certs\") pod \"network-metrics-daemon-grmvl\" (UID: \"65bd85a9-57d3-4ff1-bae1-9f3727371a28\") " pod="openshift-multus/network-metrics-daemon-grmvl"
Jul 03 09:43:23.121673 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:23.121059    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 09:43:23.121673 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:23.121121    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65bd85a9-57d3-4ff1-bae1-9f3727371a28-metrics-certs podName:65bd85a9-57d3-4ff1-bae1-9f3727371a28 nodeName:}" failed. No retries permitted until 2026-07-03 09:43:25.121100665 +0000 UTC m=+5.991766279 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65bd85a9-57d3-4ff1-bae1-9f3727371a28-metrics-certs") pod "network-metrics-daemon-grmvl" (UID: "65bd85a9-57d3-4ff1-bae1-9f3727371a28") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 09:43:23.121673 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:23.121509    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 03 09:43:23.121673 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:23.121562    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20bf6cc8-63bc-4ac8-be3b-948848a5755c-original-pull-secret podName:20bf6cc8-63bc-4ac8-be3b-948848a5755c nodeName:}" failed. No retries permitted until 2026-07-03 09:43:25.121545583 +0000 UTC m=+5.992211217 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20bf6cc8-63bc-4ac8-be3b-948848a5755c-original-pull-secret") pod "global-pull-secret-syncer-pwxt9" (UID: "20bf6cc8-63bc-4ac8-be3b-948848a5755c") : object "kube-system"/"original-pull-secret" not registered
Jul 03 09:43:23.324943 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:23.324872    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t6lr\" (UniqueName: \"kubernetes.io/projected/ad626d77-caf4-4081-8ac3-c6e2c9a970f6-kube-api-access-4t6lr\") pod \"network-check-target-hcgmr\" (UID: \"ad626d77-caf4-4081-8ac3-c6e2c9a970f6\") " pod="openshift-network-diagnostics/network-check-target-hcgmr"
Jul 03 09:43:23.325146 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:23.325127    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 03 09:43:23.325215 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:23.325155    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 03 09:43:23.325215 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:23.325168    2559 projected.go:196] Error preparing data for projected volume kube-api-access-4t6lr for pod openshift-network-diagnostics/network-check-target-hcgmr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 09:43:23.325323 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:23.325227    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad626d77-caf4-4081-8ac3-c6e2c9a970f6-kube-api-access-4t6lr podName:ad626d77-caf4-4081-8ac3-c6e2c9a970f6 nodeName:}" failed. No retries permitted until 2026-07-03 09:43:25.325206425 +0000 UTC m=+6.195872039 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4t6lr" (UniqueName: "kubernetes.io/projected/ad626d77-caf4-4081-8ac3-c6e2c9a970f6-kube-api-access-4t6lr") pod "network-check-target-hcgmr" (UID: "ad626d77-caf4-4081-8ac3-c6e2c9a970f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 09:43:23.562070 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:23.561920    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-02 09:38:21 +0000 UTC" deadline="2028-03-07 13:17:20.191597776 +0000 UTC"
Jul 03 09:43:23.562070 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:23.561985    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14715h33m56.629616669s"
Jul 03 09:43:23.685619 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:23.685331    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pwxt9"
Jul 03 09:43:23.685619 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:23.685469    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pwxt9" podUID="20bf6cc8-63bc-4ac8-be3b-948848a5755c"
Jul 03 09:43:23.685859 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:23.685835    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grmvl"
Jul 03 09:43:23.686029 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:23.685973    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grmvl" podUID="65bd85a9-57d3-4ff1-bae1-9f3727371a28"
Jul 03 09:43:23.730293 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:23.730252    2559 generic.go:356] "Generic (PLEG): container finished" podID="1375989dc36f18a986154f7263a01ba9" containerID="5728ee76277db3fec152117432bda35beb8128d125797efb91d437be11080d4c" exitCode=0
Jul 03 09:43:23.730727 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:23.730698    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal" event={"ID":"1375989dc36f18a986154f7263a01ba9","Type":"ContainerDied","Data":"5728ee76277db3fec152117432bda35beb8128d125797efb91d437be11080d4c"}
Jul 03 09:43:23.747642 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:23.747447    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-117.ec2.internal" podStartSLOduration=2.747424521 podStartE2EDuration="2.747424521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 09:43:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:43:22.708486889 +0000 UTC m=+3.579152522" watchObservedRunningTime="2026-07-03 09:43:23.747424521 +0000 UTC m=+4.618090154"
Jul 03 09:43:24.685422 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:24.685384    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcgmr"
Jul 03 09:43:24.685944 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:24.685517    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcgmr" podUID="ad626d77-caf4-4081-8ac3-c6e2c9a970f6"
Jul 03 09:43:24.743988 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:24.743940    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal" event={"ID":"1375989dc36f18a986154f7263a01ba9","Type":"ContainerStarted","Data":"ea99217e147a363550ef1b018621fc3a600785aca580bcd7ef9f42d13b4f6eb5"}
Jul 03 09:43:24.762665 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:24.762588    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal" podStartSLOduration=3.762565123 podStartE2EDuration="3.762565123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 09:43:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:43:24.761642056 +0000 UTC m=+5.632307691" watchObservedRunningTime="2026-07-03 09:43:24.762565123 +0000 UTC m=+5.633230757"
Jul 03 09:43:25.140046 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:25.139956    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65bd85a9-57d3-4ff1-bae1-9f3727371a28-metrics-certs\") pod \"network-metrics-daemon-grmvl\" (UID: \"65bd85a9-57d3-4ff1-bae1-9f3727371a28\") " pod="openshift-multus/network-metrics-daemon-grmvl"
Jul 03 09:43:25.140046 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:25.140037    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20bf6cc8-63bc-4ac8-be3b-948848a5755c-original-pull-secret\") pod \"global-pull-secret-syncer-pwxt9\" (UID: \"20bf6cc8-63bc-4ac8-be3b-948848a5755c\") " pod="kube-system/global-pull-secret-syncer-pwxt9"
Jul 03 09:43:25.140278 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:25.140179    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 03 09:43:25.140278 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:25.140245    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20bf6cc8-63bc-4ac8-be3b-948848a5755c-original-pull-secret podName:20bf6cc8-63bc-4ac8-be3b-948848a5755c nodeName:}" failed. No retries permitted until 2026-07-03 09:43:29.140225496 +0000 UTC m=+10.010891110 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20bf6cc8-63bc-4ac8-be3b-948848a5755c-original-pull-secret") pod "global-pull-secret-syncer-pwxt9" (UID: "20bf6cc8-63bc-4ac8-be3b-948848a5755c") : object "kube-system"/"original-pull-secret" not registered
Jul 03 09:43:25.140704 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:25.140683    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 09:43:25.140818 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:25.140742    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65bd85a9-57d3-4ff1-bae1-9f3727371a28-metrics-certs podName:65bd85a9-57d3-4ff1-bae1-9f3727371a28 nodeName:}" failed. No retries permitted until 2026-07-03 09:43:29.140725014 +0000 UTC m=+10.011390630 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65bd85a9-57d3-4ff1-bae1-9f3727371a28-metrics-certs") pod "network-metrics-daemon-grmvl" (UID: "65bd85a9-57d3-4ff1-bae1-9f3727371a28") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 09:43:25.342323 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:25.341657    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t6lr\" (UniqueName: \"kubernetes.io/projected/ad626d77-caf4-4081-8ac3-c6e2c9a970f6-kube-api-access-4t6lr\") pod \"network-check-target-hcgmr\" (UID: \"ad626d77-caf4-4081-8ac3-c6e2c9a970f6\") " pod="openshift-network-diagnostics/network-check-target-hcgmr"
Jul 03 09:43:25.342323 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:25.341838    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 03 09:43:25.342323 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:25.341861    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 03 09:43:25.342323 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:25.341874    2559 projected.go:196] Error preparing data for projected volume kube-api-access-4t6lr for pod openshift-network-diagnostics/network-check-target-hcgmr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 09:43:25.342323 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:25.341947    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad626d77-caf4-4081-8ac3-c6e2c9a970f6-kube-api-access-4t6lr podName:ad626d77-caf4-4081-8ac3-c6e2c9a970f6 nodeName:}" failed. No retries permitted until 2026-07-03 09:43:29.341925829 +0000 UTC m=+10.212591441 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4t6lr" (UniqueName: "kubernetes.io/projected/ad626d77-caf4-4081-8ac3-c6e2c9a970f6-kube-api-access-4t6lr") pod "network-check-target-hcgmr" (UID: "ad626d77-caf4-4081-8ac3-c6e2c9a970f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 09:43:25.700190 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:25.700141    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pwxt9"
Jul 03 09:43:25.700727 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:25.700677    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pwxt9" podUID="20bf6cc8-63bc-4ac8-be3b-948848a5755c"
Jul 03 09:43:25.700829 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:25.700811    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grmvl"
Jul 03 09:43:25.700996 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:25.700972    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grmvl" podUID="65bd85a9-57d3-4ff1-bae1-9f3727371a28"
Jul 03 09:43:26.684959 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:26.684927    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcgmr"
Jul 03 09:43:26.685135 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:26.685093    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcgmr" podUID="ad626d77-caf4-4081-8ac3-c6e2c9a970f6"
Jul 03 09:43:27.686578 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:27.686188    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pwxt9"
Jul 03 09:43:27.686578 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:27.686310    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pwxt9" podUID="20bf6cc8-63bc-4ac8-be3b-948848a5755c"
Jul 03 09:43:27.686578 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:27.686394    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grmvl"
Jul 03 09:43:27.686578 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:27.686522    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grmvl" podUID="65bd85a9-57d3-4ff1-bae1-9f3727371a28"
Jul 03 09:43:28.685879 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:28.685377    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcgmr"
Jul 03 09:43:28.685879 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:28.685504    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcgmr" podUID="ad626d77-caf4-4081-8ac3-c6e2c9a970f6"
Jul 03 09:43:29.177022 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:29.176231    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65bd85a9-57d3-4ff1-bae1-9f3727371a28-metrics-certs\") pod \"network-metrics-daemon-grmvl\" (UID: \"65bd85a9-57d3-4ff1-bae1-9f3727371a28\") " pod="openshift-multus/network-metrics-daemon-grmvl"
Jul 03 09:43:29.177022 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:29.176303    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20bf6cc8-63bc-4ac8-be3b-948848a5755c-original-pull-secret\") pod \"global-pull-secret-syncer-pwxt9\" (UID: \"20bf6cc8-63bc-4ac8-be3b-948848a5755c\") " pod="kube-system/global-pull-secret-syncer-pwxt9"
Jul 03 09:43:29.177022 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:29.176432    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 03 09:43:29.177022 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:29.176494    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20bf6cc8-63bc-4ac8-be3b-948848a5755c-original-pull-secret podName:20bf6cc8-63bc-4ac8-be3b-948848a5755c nodeName:}" failed. No retries permitted until 2026-07-03 09:43:37.176476399 +0000 UTC m=+18.047142011 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20bf6cc8-63bc-4ac8-be3b-948848a5755c-original-pull-secret") pod "global-pull-secret-syncer-pwxt9" (UID: "20bf6cc8-63bc-4ac8-be3b-948848a5755c") : object "kube-system"/"original-pull-secret" not registered
Jul 03 09:43:29.177022 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:29.176894    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 09:43:29.177022 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:29.176944    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65bd85a9-57d3-4ff1-bae1-9f3727371a28-metrics-certs podName:65bd85a9-57d3-4ff1-bae1-9f3727371a28 nodeName:}" failed. No retries permitted until 2026-07-03 09:43:37.176929092 +0000 UTC m=+18.047594705 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65bd85a9-57d3-4ff1-bae1-9f3727371a28-metrics-certs") pod "network-metrics-daemon-grmvl" (UID: "65bd85a9-57d3-4ff1-bae1-9f3727371a28") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 09:43:29.378109 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:29.378065    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t6lr\" (UniqueName: \"kubernetes.io/projected/ad626d77-caf4-4081-8ac3-c6e2c9a970f6-kube-api-access-4t6lr\") pod \"network-check-target-hcgmr\" (UID: \"ad626d77-caf4-4081-8ac3-c6e2c9a970f6\") " pod="openshift-network-diagnostics/network-check-target-hcgmr"
Jul 03 09:43:29.378275 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:29.378226    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 03 09:43:29.378275 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:29.378250    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 03 09:43:29.378275 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:29.378262    2559 projected.go:196] Error preparing data for projected volume kube-api-access-4t6lr for pod openshift-network-diagnostics/network-check-target-hcgmr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 09:43:29.378437 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:29.378324    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad626d77-caf4-4081-8ac3-c6e2c9a970f6-kube-api-access-4t6lr podName:ad626d77-caf4-4081-8ac3-c6e2c9a970f6 nodeName:}" failed. No retries permitted until 2026-07-03 09:43:37.378303933 +0000 UTC m=+18.248969560 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4t6lr" (UniqueName: "kubernetes.io/projected/ad626d77-caf4-4081-8ac3-c6e2c9a970f6-kube-api-access-4t6lr") pod "network-check-target-hcgmr" (UID: "ad626d77-caf4-4081-8ac3-c6e2c9a970f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 09:43:29.697608 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:29.696629    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pwxt9"
Jul 03 09:43:29.697608 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:29.696776    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pwxt9" podUID="20bf6cc8-63bc-4ac8-be3b-948848a5755c"
Jul 03 09:43:29.697608 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:29.697216    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcgmr"
Jul 03 09:43:29.697608 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:29.697344    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grmvl"
Jul 03 09:43:29.697608 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:29.697500    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grmvl" podUID="65bd85a9-57d3-4ff1-bae1-9f3727371a28"
Jul 03 09:43:29.697608 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:29.697501    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcgmr" podUID="ad626d77-caf4-4081-8ac3-c6e2c9a970f6"
Jul 03 09:43:31.685896 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:31.685283    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grmvl"
Jul 03 09:43:31.685896 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:31.685301    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pwxt9"
Jul 03 09:43:31.685896 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:31.685417    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcgmr"
Jul 03 09:43:31.685896 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:31.685425    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grmvl" podUID="65bd85a9-57d3-4ff1-bae1-9f3727371a28"
Jul 03 09:43:31.685896 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:31.685479    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcgmr" podUID="ad626d77-caf4-4081-8ac3-c6e2c9a970f6"
Jul 03 09:43:31.685896 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:31.685573    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pwxt9" podUID="20bf6cc8-63bc-4ac8-be3b-948848a5755c"
Jul 03 09:43:33.685502 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:33.684991    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grmvl"
Jul 03 09:43:33.685502 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:33.685011    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pwxt9"
Jul 03 09:43:33.685502 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:33.685129    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcgmr"
Jul 03 09:43:33.685502 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:33.685129    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grmvl" podUID="65bd85a9-57d3-4ff1-bae1-9f3727371a28"
Jul 03 09:43:33.685502 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:33.685211    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pwxt9" podUID="20bf6cc8-63bc-4ac8-be3b-948848a5755c"
Jul 03 09:43:33.685502 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:33.685269    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcgmr" podUID="ad626d77-caf4-4081-8ac3-c6e2c9a970f6"
Jul 03 09:43:35.685386 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:35.685349    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grmvl"
Jul 03 09:43:35.685852 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:35.685349    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcgmr"
Jul 03 09:43:35.685852 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:35.685494    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pwxt9"
Jul 03 09:43:35.685852 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:35.685487    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grmvl" podUID="65bd85a9-57d3-4ff1-bae1-9f3727371a28"
Jul 03 09:43:35.685852 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:35.685623    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcgmr" podUID="ad626d77-caf4-4081-8ac3-c6e2c9a970f6"
Jul 03 09:43:35.685852 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:35.685701    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pwxt9" podUID="20bf6cc8-63bc-4ac8-be3b-948848a5755c"
Jul 03 09:43:37.239022 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:37.238977    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65bd85a9-57d3-4ff1-bae1-9f3727371a28-metrics-certs\") pod \"network-metrics-daemon-grmvl\" (UID: \"65bd85a9-57d3-4ff1-bae1-9f3727371a28\") " pod="openshift-multus/network-metrics-daemon-grmvl"
Jul 03 09:43:37.239495 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:37.239049    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20bf6cc8-63bc-4ac8-be3b-948848a5755c-original-pull-secret\") pod \"global-pull-secret-syncer-pwxt9\" (UID: \"20bf6cc8-63bc-4ac8-be3b-948848a5755c\") " pod="kube-system/global-pull-secret-syncer-pwxt9"
Jul 03 09:43:37.239495 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:37.239145    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 09:43:37.239495 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:37.239154    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 03 09:43:37.239495 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:37.239203    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65bd85a9-57d3-4ff1-bae1-9f3727371a28-metrics-certs podName:65bd85a9-57d3-4ff1-bae1-9f3727371a28 nodeName:}" failed. No retries permitted until 2026-07-03 09:43:53.23918646 +0000 UTC m=+34.109852067 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65bd85a9-57d3-4ff1-bae1-9f3727371a28-metrics-certs") pod "network-metrics-daemon-grmvl" (UID: "65bd85a9-57d3-4ff1-bae1-9f3727371a28") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 09:43:37.239495 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:37.239218    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20bf6cc8-63bc-4ac8-be3b-948848a5755c-original-pull-secret podName:20bf6cc8-63bc-4ac8-be3b-948848a5755c nodeName:}" failed. No retries permitted until 2026-07-03 09:43:53.239211458 +0000 UTC m=+34.109877065 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20bf6cc8-63bc-4ac8-be3b-948848a5755c-original-pull-secret") pod "global-pull-secret-syncer-pwxt9" (UID: "20bf6cc8-63bc-4ac8-be3b-948848a5755c") : object "kube-system"/"original-pull-secret" not registered
Jul 03 09:43:37.441449 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:37.441413    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t6lr\" (UniqueName: \"kubernetes.io/projected/ad626d77-caf4-4081-8ac3-c6e2c9a970f6-kube-api-access-4t6lr\") pod \"network-check-target-hcgmr\" (UID: \"ad626d77-caf4-4081-8ac3-c6e2c9a970f6\") " pod="openshift-network-diagnostics/network-check-target-hcgmr"
Jul 03 09:43:37.441621 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:37.441564    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 03 09:43:37.441621 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:37.441579    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 03 09:43:37.441621 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:37.441589    2559 projected.go:196] Error preparing data for projected volume kube-api-access-4t6lr for pod openshift-network-diagnostics/network-check-target-hcgmr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 09:43:37.441766 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:37.441649    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad626d77-caf4-4081-8ac3-c6e2c9a970f6-kube-api-access-4t6lr podName:ad626d77-caf4-4081-8ac3-c6e2c9a970f6 nodeName:}" failed. No retries permitted until 2026-07-03 09:43:53.44163081 +0000 UTC m=+34.312296417 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4t6lr" (UniqueName: "kubernetes.io/projected/ad626d77-caf4-4081-8ac3-c6e2c9a970f6-kube-api-access-4t6lr") pod "network-check-target-hcgmr" (UID: "ad626d77-caf4-4081-8ac3-c6e2c9a970f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 09:43:37.685194 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:37.685160    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pwxt9"
Jul 03 09:43:37.685368 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:37.685167    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grmvl"
Jul 03 09:43:37.685368 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:37.685291    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pwxt9" podUID="20bf6cc8-63bc-4ac8-be3b-948848a5755c"
Jul 03 09:43:37.685480 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:37.685373    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcgmr"
Jul 03 09:43:37.685530 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:37.685374    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grmvl" podUID="65bd85a9-57d3-4ff1-bae1-9f3727371a28"
Jul 03 09:43:37.685530 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:37.685494    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcgmr" podUID="ad626d77-caf4-4081-8ac3-c6e2c9a970f6"
Jul 03 09:43:39.685907 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:39.685874    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pwxt9"
Jul 03 09:43:39.686392 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:39.685952    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pwxt9" podUID="20bf6cc8-63bc-4ac8-be3b-948848a5755c"
Jul 03 09:43:39.686392 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:39.685995    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcgmr"
Jul 03 09:43:39.686392 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:39.686048    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcgmr" podUID="ad626d77-caf4-4081-8ac3-c6e2c9a970f6"
Jul 03 09:43:39.686392 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:39.686390    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grmvl"
Jul 03 09:43:39.686630 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:39.686461    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grmvl" podUID="65bd85a9-57d3-4ff1-bae1-9f3727371a28"
Jul 03 09:43:41.685830 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:41.685788    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pwxt9"
Jul 03 09:43:41.686281 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:41.685788    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grmvl"
Jul 03 09:43:41.686281 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:41.685924    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pwxt9" podUID="20bf6cc8-63bc-4ac8-be3b-948848a5755c"
Jul 03 09:43:41.686281 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:41.685996    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grmvl" podUID="65bd85a9-57d3-4ff1-bae1-9f3727371a28"
Jul 03 09:43:41.686281 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:41.685788    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcgmr"
Jul 03 09:43:41.686281 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:41.686072    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcgmr" podUID="ad626d77-caf4-4081-8ac3-c6e2c9a970f6"
Jul 03 09:43:42.782979 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:42.782583    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gm79x" event={"ID":"7d19e4da-d529-40d3-a8af-a0e97b870a19","Type":"ContainerStarted","Data":"79d053f235965c30c1973fb2b1e26eb3a06a99925b6772d680535b6370b7e982"}
Jul 03 09:43:42.784323 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:42.784298    2559 generic.go:356] "Generic (PLEG): container finished" podID="93420c77-4dcb-4e57-b717-c1c03274b63f" containerID="2455c73958be0ffd08902ecf1434c29d68745f1e03828dc60882295b1c1003bf" exitCode=0
Jul 03 09:43:42.784445 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:42.784360    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcwzh" event={"ID":"93420c77-4dcb-4e57-b717-c1c03274b63f","Type":"ContainerDied","Data":"2455c73958be0ffd08902ecf1434c29d68745f1e03828dc60882295b1c1003bf"}
Jul 03 09:43:42.787918 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:42.787893    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl" event={"ID":"8f614573-e4a3-491b-a6f5-bd502f0f8245","Type":"ContainerStarted","Data":"9e459091a55e19cb8611f9de99a25e01e46b222929e2737a08f90d83720ae281"}
Jul 03 09:43:42.788034 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:42.787967    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl" event={"ID":"8f614573-e4a3-491b-a6f5-bd502f0f8245","Type":"ContainerStarted","Data":"f716d476b9728a851d5d3f76a00b02eddf97abc513459ddf3211a1cff74d3774"}
Jul 03 09:43:42.788034 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:42.788027    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl" event={"ID":"8f614573-e4a3-491b-a6f5-bd502f0f8245","Type":"ContainerStarted","Data":"3b560f66f6331c7936f340ce93326e8db7d8d097fcfd1dfc5d83fd4eb4a31cad"}
Jul 03 09:43:42.788127 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:42.788061    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl" event={"ID":"8f614573-e4a3-491b-a6f5-bd502f0f8245","Type":"ContainerStarted","Data":"1da6282c06aab8956e42ec8f234f000798739da66a437a73a707fb08acee9e61"}
Jul 03 09:43:42.788168 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:42.788131    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl" event={"ID":"8f614573-e4a3-491b-a6f5-bd502f0f8245","Type":"ContainerStarted","Data":"cbfb9495b2749a26c7820fecb2ac48ad7098decd84b4a63fe50c71e13c6f261c"}
Jul 03 09:43:42.788219 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:42.788183    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl" event={"ID":"8f614573-e4a3-491b-a6f5-bd502f0f8245","Type":"ContainerStarted","Data":"2b2ef29b4f7ac18d5ca99b539c16ea37affb1b9ca665cbffd49ee31b3003531f"}
Jul 03 09:43:42.789771 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:42.789366    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gznr6" event={"ID":"9879e537-1d96-485c-90d2-d4b540fb1f31","Type":"ContainerStarted","Data":"e0dd51298d3673bc05f8f4dc65a1b598d261ea23bee8c337e018e07d617483ae"}
Jul 03 09:43:42.790885 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:42.790850    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xljb6" event={"ID":"b8d41b5d-027e-4958-bf3e-422ce5ba511c","Type":"ContainerStarted","Data":"f2ccb76d91231dfe290e34e783b6a744cd9673edd77adaba61154ec2a2e02011"}
Jul 03 09:43:42.792265 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:42.792242    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p66g9" event={"ID":"8160d110-2f6d-41db-a996-8235a758f77f","Type":"ContainerStarted","Data":"c9296ffe99322fb7b852a6e94a41052878b165053cc7c40f8c5099a89bf429de"}
Jul 03 09:43:42.793843 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:42.793814    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bt2x4" event={"ID":"be5a24fe-b125-41cc-899c-cc09ce3c2277","Type":"ContainerStarted","Data":"a8ac5e5234759f6f09cf8a80f4863800989689277043b5471b77de110e70a273"}
Jul 03 09:43:42.795406 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:42.795384    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nx222" event={"ID":"7ad0ecde-3110-4f76-8c0e-f296a67153e8","Type":"ContainerStarted","Data":"2c0793744bdedf1102a08f1b1dd9d076cb8ecca5821f8bf1b6b6f2880632efce"}
Jul 03 09:43:42.797355 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:42.797312    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gm79x" podStartSLOduration=3.514155943 podStartE2EDuration="22.797300543s" totalImagesPullingTime="19.2831446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:43:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:43:42.79713315 +0000 UTC m=+23.667798780" watchObservedRunningTime="2026-07-03 09:43:42.797300543 +0000 UTC m=+23.667966172"
Jul 03 09:43:42.815678 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:42.815628    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gznr6" podStartSLOduration=3.442637791 podStartE2EDuration="22.815613304s" totalImagesPullingTime="19.372975513s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 09:43:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:43:42.8152233 +0000 UTC m=+23.685888936" watchObservedRunningTime="2026-07-03 09:43:42.815613304 +0000 UTC m=+23.686278932"
Jul 03 09:43:42.829316 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:42.829269    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xljb6" podStartSLOduration=3.545281481 podStartE2EDuration="22.829248993s" totalImagesPullingTime="19.283967512s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 09:43:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:43:42.82914144 +0000 UTC m=+23.699807070" watchObservedRunningTime="2026-07-03 09:43:42.829248993 +0000 UTC m=+23.699914621"
Jul 03 09:43:42.879069 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:42.878154    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bt2x4" podStartSLOduration=3.560002042 podStartE2EDuration="22.878138235s" totalImagesPullingTime="19.318136193s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 09:43:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:43:42.87756401 +0000 UTC m=+23.748229635" watchObservedRunningTime="2026-07-03 09:43:42.878138235 +0000 UTC m=+23.748803868"
Jul 03 09:43:42.914382 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:42.914336    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-nx222" podStartSLOduration=3.612178036 podStartE2EDuration="22.914322633s" totalImagesPullingTime="19.302144597s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 09:43:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:43:42.914302888 +0000 UTC m=+23.784968517" watchObservedRunningTime="2026-07-03 09:43:42.914322633 +0000 UTC m=+23.784988261"
Jul 03 09:43:43.393760 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:43.393732    2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 03 09:43:43.554959 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:43.554851    2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-03T09:43:43.393755939Z","UUID":"2f7f5f1d-fd2c-460d-9ec2-3c6b7b67a724","Handler":null,"Name":"","Endpoint":""}
Jul 03 09:43:43.556337 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:43.556304    2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 03 09:43:43.556496 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:43.556351    2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 03 09:43:43.686395 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:43.685969    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grmvl"
Jul 03 09:43:43.686395 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:43.685999    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcgmr"
Jul 03 09:43:43.686395 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:43.685967    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pwxt9"
Jul 03 09:43:43.686395 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:43.686091    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grmvl" podUID="65bd85a9-57d3-4ff1-bae1-9f3727371a28"
Jul 03 09:43:43.686395 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:43.686165    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pwxt9" podUID="20bf6cc8-63bc-4ac8-be3b-948848a5755c"
Jul 03 09:43:43.686395 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:43.686214    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcgmr" podUID="ad626d77-caf4-4081-8ac3-c6e2c9a970f6"
Jul 03 09:43:43.799582 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:43.799536    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p66g9" event={"ID":"8160d110-2f6d-41db-a996-8235a758f77f","Type":"ContainerStarted","Data":"c311afa1608b2b81890980b5c432fce7d99aff5d96c678e08e3381ce2931f8de"}
Jul 03 09:43:43.801146 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:43.801084    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-njzlg" event={"ID":"0dc3ba3d-94cf-420a-863c-d9f286479320","Type":"ContainerStarted","Data":"4ea00f201dedda1277c1e93e6e49ef18cf5cbae78f894cdba1aa51a9f8b9f7a0"}
Jul 03 09:43:44.806197 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:44.806160    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p66g9" event={"ID":"8160d110-2f6d-41db-a996-8235a758f77f","Type":"ContainerStarted","Data":"25d228646bf39a3744f15b1dda3da818a8e42f16c9aa0d0f5557b0fe1b59ec09"}
Jul 03 09:43:44.812772 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:44.812738    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl" event={"ID":"8f614573-e4a3-491b-a6f5-bd502f0f8245","Type":"ContainerStarted","Data":"131bc30d94172b8fad394da2b84670479afbff22a27de9b00696539e79fd65dd"}
Jul 03 09:43:44.825347 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:44.825304    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p66g9" podStartSLOduration=3.409366508 podStartE2EDuration="24.825291454s" totalImagesPullingTime="21.415924946s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 09:43:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:43:44.825039741 +0000 UTC m=+25.695705398" watchObservedRunningTime="2026-07-03 09:43:44.825291454 +0000 UTC m=+25.695957083"
Jul 03 09:43:44.825840 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:44.825814    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-njzlg" podStartSLOduration=5.531750178 podStartE2EDuration="24.825806392s" totalImagesPullingTime="19.294056214s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 09:43:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:43:43.819765736 +0000 UTC m=+24.690431368" watchObservedRunningTime="2026-07-03 09:43:44.825806392 +0000 UTC m=+25.696472021"
Jul 03 09:43:45.392514 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:45.392482    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gm79x"
Jul 03 09:43:45.393117 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:45.393091    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gm79x"
Jul 03 09:43:45.685342 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:45.685234    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pwxt9"
Jul 03 09:43:45.685517 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:45.685237    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grmvl"
Jul 03 09:43:45.685517 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:45.685367    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcgmr"
Jul 03 09:43:45.685517 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:45.685349    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pwxt9" podUID="20bf6cc8-63bc-4ac8-be3b-948848a5755c"
Jul 03 09:43:45.685517 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:45.685448    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grmvl" podUID="65bd85a9-57d3-4ff1-bae1-9f3727371a28"
Jul 03 09:43:45.685757 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:45.685516    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcgmr" podUID="ad626d77-caf4-4081-8ac3-c6e2c9a970f6"
Jul 03 09:43:45.815119 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:45.815091    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gm79x"
Jul 03 09:43:45.815798 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:45.815781    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gm79x"
Jul 03 09:43:47.688140 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:47.687955    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcgmr"
Jul 03 09:43:47.688921 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:47.688005    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pwxt9"
Jul 03 09:43:47.688921 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:47.688233    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcgmr" podUID="ad626d77-caf4-4081-8ac3-c6e2c9a970f6"
Jul 03 09:43:47.688921 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:47.688028    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grmvl"
Jul 03 09:43:47.688921 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:47.688307    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pwxt9" podUID="20bf6cc8-63bc-4ac8-be3b-948848a5755c"
Jul 03 09:43:47.688921 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:47.688379    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grmvl" podUID="65bd85a9-57d3-4ff1-bae1-9f3727371a28"
Jul 03 09:43:47.820738 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:47.820699    2559 generic.go:356] "Generic (PLEG): container finished" podID="93420c77-4dcb-4e57-b717-c1c03274b63f" containerID="5a1a2b8286119dd2ab8a7315edeeccb4f997e6f95a770360c1d7a54c80334a50" exitCode=0
Jul 03 09:43:47.820927 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:47.820770    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcwzh" event={"ID":"93420c77-4dcb-4e57-b717-c1c03274b63f","Type":"ContainerDied","Data":"5a1a2b8286119dd2ab8a7315edeeccb4f997e6f95a770360c1d7a54c80334a50"}
Jul 03 09:43:47.825257 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:47.825228    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl" event={"ID":"8f614573-e4a3-491b-a6f5-bd502f0f8245","Type":"ContainerStarted","Data":"af92fbeb3a1e4cbe8286be42d3757093d8efba667584d5d45599e21031505b03"}
Jul 03 09:43:47.825520 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:47.825503    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:47.825635 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:47.825579    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:47.825635 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:47.825627    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:47.842303 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:47.842277    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:47.842415 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:47.842381    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:43:47.869558 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:47.869507    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl" podStartSLOduration=8.509841924 podStartE2EDuration="27.869492776s" totalImagesPullingTime="19.359650852s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 09:43:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:43:47.869262254 +0000 UTC m=+28.739927885" watchObservedRunningTime="2026-07-03 09:43:47.869492776 +0000 UTC m=+28.740158405"
Jul 03 09:43:48.937628 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:48.937454    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hcgmr"]
Jul 03 09:43:48.938048 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:48.937736    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcgmr"
Jul 03 09:43:48.938048 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:48.937873    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcgmr" podUID="ad626d77-caf4-4081-8ac3-c6e2c9a970f6"
Jul 03 09:43:48.940620 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:48.940594    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pwxt9"]
Jul 03 09:43:48.940717 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:48.940695    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pwxt9"
Jul 03 09:43:48.940811 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:48.940792    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pwxt9" podUID="20bf6cc8-63bc-4ac8-be3b-948848a5755c"
Jul 03 09:43:48.941203 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:48.941184    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-grmvl"]
Jul 03 09:43:48.941278 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:48.941266    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grmvl"
Jul 03 09:43:48.941374 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:48.941351    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grmvl" podUID="65bd85a9-57d3-4ff1-bae1-9f3727371a28"
Jul 03 09:43:49.831143 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:49.831110    2559 generic.go:356] "Generic (PLEG): container finished" podID="93420c77-4dcb-4e57-b717-c1c03274b63f" containerID="deb6ef091916c1dd7c6f099fc489b6b0edf588c1f3a2b16864b036bcfff222ca" exitCode=0
Jul 03 09:43:49.831323 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:49.831185    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcwzh" event={"ID":"93420c77-4dcb-4e57-b717-c1c03274b63f","Type":"ContainerDied","Data":"deb6ef091916c1dd7c6f099fc489b6b0edf588c1f3a2b16864b036bcfff222ca"}
Jul 03 09:43:50.685634 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:50.685605    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcgmr"
Jul 03 09:43:50.685985 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:50.685697    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pwxt9"
Jul 03 09:43:50.685985 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:50.685788    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pwxt9" podUID="20bf6cc8-63bc-4ac8-be3b-948848a5755c"
Jul 03 09:43:50.685985 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:50.685702    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcgmr" podUID="ad626d77-caf4-4081-8ac3-c6e2c9a970f6"
Jul 03 09:43:50.685985 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:50.685704    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grmvl"
Jul 03 09:43:50.685985 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:50.685867    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grmvl" podUID="65bd85a9-57d3-4ff1-bae1-9f3727371a28"
Jul 03 09:43:51.838036 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:51.837867    2559 generic.go:356] "Generic (PLEG): container finished" podID="93420c77-4dcb-4e57-b717-c1c03274b63f" containerID="8f73eae2b945b82cf1f0168e90a900a5060bc02e2ee0c63862c97fad22dd851a" exitCode=0
Jul 03 09:43:51.838036 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:51.837956    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcwzh" event={"ID":"93420c77-4dcb-4e57-b717-c1c03274b63f","Type":"ContainerDied","Data":"8f73eae2b945b82cf1f0168e90a900a5060bc02e2ee0c63862c97fad22dd851a"}
Jul 03 09:43:52.685715 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:52.685682    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcgmr"
Jul 03 09:43:52.685904 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:52.685793    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pwxt9"
Jul 03 09:43:52.685904 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:52.685804    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcgmr" podUID="ad626d77-caf4-4081-8ac3-c6e2c9a970f6"
Jul 03 09:43:52.685904 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:52.685823    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grmvl"
Jul 03 09:43:52.685904 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:52.685899    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pwxt9" podUID="20bf6cc8-63bc-4ac8-be3b-948848a5755c"
Jul 03 09:43:52.686104 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:52.685959    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grmvl" podUID="65bd85a9-57d3-4ff1-bae1-9f3727371a28"
Jul 03 09:43:53.253809 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:53.253731    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65bd85a9-57d3-4ff1-bae1-9f3727371a28-metrics-certs\") pod \"network-metrics-daemon-grmvl\" (UID: \"65bd85a9-57d3-4ff1-bae1-9f3727371a28\") " pod="openshift-multus/network-metrics-daemon-grmvl"
Jul 03 09:43:53.253809 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:53.253800    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20bf6cc8-63bc-4ac8-be3b-948848a5755c-original-pull-secret\") pod \"global-pull-secret-syncer-pwxt9\" (UID: \"20bf6cc8-63bc-4ac8-be3b-948848a5755c\") " pod="kube-system/global-pull-secret-syncer-pwxt9"
Jul 03 09:43:53.254261 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:53.253903    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 03 09:43:53.254261 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:53.253904    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 09:43:53.254261 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:53.253971    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20bf6cc8-63bc-4ac8-be3b-948848a5755c-original-pull-secret podName:20bf6cc8-63bc-4ac8-be3b-948848a5755c nodeName:}" failed. No retries permitted until 2026-07-03 09:44:25.253952386 +0000 UTC m=+66.124618025 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20bf6cc8-63bc-4ac8-be3b-948848a5755c-original-pull-secret") pod "global-pull-secret-syncer-pwxt9" (UID: "20bf6cc8-63bc-4ac8-be3b-948848a5755c") : object "kube-system"/"original-pull-secret" not registered
Jul 03 09:43:53.254261 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:53.253990    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65bd85a9-57d3-4ff1-bae1-9f3727371a28-metrics-certs podName:65bd85a9-57d3-4ff1-bae1-9f3727371a28 nodeName:}" failed. No retries permitted until 2026-07-03 09:44:25.253980203 +0000 UTC m=+66.124645825 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65bd85a9-57d3-4ff1-bae1-9f3727371a28-metrics-certs") pod "network-metrics-daemon-grmvl" (UID: "65bd85a9-57d3-4ff1-bae1-9f3727371a28") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 09:43:53.455221 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:53.455177    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t6lr\" (UniqueName: \"kubernetes.io/projected/ad626d77-caf4-4081-8ac3-c6e2c9a970f6-kube-api-access-4t6lr\") pod \"network-check-target-hcgmr\" (UID: \"ad626d77-caf4-4081-8ac3-c6e2c9a970f6\") " pod="openshift-network-diagnostics/network-check-target-hcgmr"
Jul 03 09:43:53.455396 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:53.455317    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 03 09:43:53.455396 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:53.455338    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 03 09:43:53.455396 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:53.455357    2559 projected.go:196] Error preparing data for projected volume kube-api-access-4t6lr for pod openshift-network-diagnostics/network-check-target-hcgmr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 09:43:53.455515 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:53.455415    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad626d77-caf4-4081-8ac3-c6e2c9a970f6-kube-api-access-4t6lr podName:ad626d77-caf4-4081-8ac3-c6e2c9a970f6 nodeName:}" failed. No retries permitted until 2026-07-03 09:44:25.455398647 +0000 UTC m=+66.326064260 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4t6lr" (UniqueName: "kubernetes.io/projected/ad626d77-caf4-4081-8ac3-c6e2c9a970f6-kube-api-access-4t6lr") pod "network-check-target-hcgmr" (UID: "ad626d77-caf4-4081-8ac3-c6e2c9a970f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 09:43:54.685293 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:54.685267    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pwxt9"
Jul 03 09:43:54.685679 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:54.685269    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcgmr"
Jul 03 09:43:54.685679 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:54.685381    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pwxt9" podUID="20bf6cc8-63bc-4ac8-be3b-948848a5755c"
Jul 03 09:43:54.685679 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:54.685269    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grmvl"
Jul 03 09:43:54.685679 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:54.685444    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hcgmr" podUID="ad626d77-caf4-4081-8ac3-c6e2c9a970f6"
Jul 03 09:43:54.685679 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:54.685571    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grmvl" podUID="65bd85a9-57d3-4ff1-bae1-9f3727371a28"
Jul 03 09:43:54.909189 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:54.909163    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeReady"
Jul 03 09:43:54.909363 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:54.909294    2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 03 09:43:54.960674 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:54.960598    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vq4dk"]
Jul 03 09:43:54.963409 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:54.963388    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vq4dk"
Jul 03 09:43:54.964029 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:54.964007    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-b7g2w"]
Jul 03 09:43:54.965924 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:54.965904    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 03 09:43:54.966255 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:54.966238    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 03 09:43:54.966350 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:54.966241    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7ckvl\""
Jul 03 09:43:54.967123 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:54.967094    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-b7g2w"
Jul 03 09:43:54.969423 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:54.969393    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 03 09:43:54.970228 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:54.969963    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bjlsv\""
Jul 03 09:43:54.970228 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:54.969969    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 03 09:43:54.970228 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:54.969971    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 03 09:43:54.975623 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:54.975603    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vq4dk"]
Jul 03 09:43:54.980228 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:54.980204    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-b7g2w"]
Jul 03 09:43:55.067677 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:55.067638    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn4cb\" (UniqueName: \"kubernetes.io/projected/0f15a368-feb7-4b3d-829a-d49e7474445b-kube-api-access-gn4cb\") pod \"dns-default-vq4dk\" (UID: \"0f15a368-feb7-4b3d-829a-d49e7474445b\") " pod="openshift-dns/dns-default-vq4dk"
Jul 03 09:43:55.067863 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:55.067684    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/66226c20-f210-473d-854b-b6c369884a01-cert\") pod \"ingress-canary-b7g2w\" (UID: \"66226c20-f210-473d-854b-b6c369884a01\") " pod="openshift-ingress-canary/ingress-canary-b7g2w"
Jul 03 09:43:55.067863 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:55.067782    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbtgk\" (UniqueName: \"kubernetes.io/projected/66226c20-f210-473d-854b-b6c369884a01-kube-api-access-nbtgk\") pod \"ingress-canary-b7g2w\" (UID: \"66226c20-f210-473d-854b-b6c369884a01\") " pod="openshift-ingress-canary/ingress-canary-b7g2w"
Jul 03 09:43:55.067960 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:55.067860    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f15a368-feb7-4b3d-829a-d49e7474445b-metrics-tls\") pod \"dns-default-vq4dk\" (UID: \"0f15a368-feb7-4b3d-829a-d49e7474445b\") " pod="openshift-dns/dns-default-vq4dk"
Jul 03 09:43:55.067960 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:55.067902    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0f15a368-feb7-4b3d-829a-d49e7474445b-config-volume\") pod \"dns-default-vq4dk\" (UID: \"0f15a368-feb7-4b3d-829a-d49e7474445b\") " pod="openshift-dns/dns-default-vq4dk"
Jul 03 09:43:55.067960 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:55.067950    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f15a368-feb7-4b3d-829a-d49e7474445b-tmp-dir\") pod \"dns-default-vq4dk\" (UID: \"0f15a368-feb7-4b3d-829a-d49e7474445b\") " pod="openshift-dns/dns-default-vq4dk"
Jul 03 09:43:55.170498 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:55.169485    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbtgk\" (UniqueName: \"kubernetes.io/projected/66226c20-f210-473d-854b-b6c369884a01-kube-api-access-nbtgk\") pod \"ingress-canary-b7g2w\" (UID: \"66226c20-f210-473d-854b-b6c369884a01\") " pod="openshift-ingress-canary/ingress-canary-b7g2w"
Jul 03 09:43:55.170498 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:55.169623    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f15a368-feb7-4b3d-829a-d49e7474445b-metrics-tls\") pod \"dns-default-vq4dk\" (UID: \"0f15a368-feb7-4b3d-829a-d49e7474445b\") " pod="openshift-dns/dns-default-vq4dk"
Jul 03 09:43:55.170498 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:55.169652    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0f15a368-feb7-4b3d-829a-d49e7474445b-config-volume\") pod \"dns-default-vq4dk\" (UID: \"0f15a368-feb7-4b3d-829a-d49e7474445b\") " pod="openshift-dns/dns-default-vq4dk"
Jul 03 09:43:55.170498 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:55.169697    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f15a368-feb7-4b3d-829a-d49e7474445b-tmp-dir\") pod \"dns-default-vq4dk\" (UID: \"0f15a368-feb7-4b3d-829a-d49e7474445b\") " pod="openshift-dns/dns-default-vq4dk"
Jul 03 09:43:55.170498 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:55.169756    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn4cb\" (UniqueName: \"kubernetes.io/projected/0f15a368-feb7-4b3d-829a-d49e7474445b-kube-api-access-gn4cb\") pod \"dns-default-vq4dk\" (UID: \"0f15a368-feb7-4b3d-829a-d49e7474445b\") " pod="openshift-dns/dns-default-vq4dk"
Jul 03 09:43:55.170498 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:55.169778    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/66226c20-f210-473d-854b-b6c369884a01-cert\") pod \"ingress-canary-b7g2w\" (UID: \"66226c20-f210-473d-854b-b6c369884a01\") " pod="openshift-ingress-canary/ingress-canary-b7g2w"
Jul 03 09:43:55.172135 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:55.172027    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 03 09:43:55.172271 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:55.172247    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f15a368-feb7-4b3d-829a-d49e7474445b-metrics-tls podName:0f15a368-feb7-4b3d-829a-d49e7474445b nodeName:}" failed. No retries permitted until 2026-07-03 09:43:55.672093775 +0000 UTC m=+36.542759382 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0f15a368-feb7-4b3d-829a-d49e7474445b-metrics-tls") pod "dns-default-vq4dk" (UID: "0f15a368-feb7-4b3d-829a-d49e7474445b") : secret "dns-default-metrics-tls" not found
Jul 03 09:43:55.172374 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:55.172344    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f15a368-feb7-4b3d-829a-d49e7474445b-tmp-dir\") pod \"dns-default-vq4dk\" (UID: \"0f15a368-feb7-4b3d-829a-d49e7474445b\") " pod="openshift-dns/dns-default-vq4dk"
Jul 03 09:43:55.172591 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:55.172568    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0f15a368-feb7-4b3d-829a-d49e7474445b-config-volume\") pod \"dns-default-vq4dk\" (UID: \"0f15a368-feb7-4b3d-829a-d49e7474445b\") " pod="openshift-dns/dns-default-vq4dk"
Jul 03 09:43:55.175464 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:55.175438    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/66226c20-f210-473d-854b-b6c369884a01-cert\") pod \"ingress-canary-b7g2w\" (UID: \"66226c20-f210-473d-854b-b6c369884a01\") " pod="openshift-ingress-canary/ingress-canary-b7g2w"
Jul 03 09:43:55.181783 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:55.181758    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn4cb\" (UniqueName: \"kubernetes.io/projected/0f15a368-feb7-4b3d-829a-d49e7474445b-kube-api-access-gn4cb\") pod \"dns-default-vq4dk\" (UID: \"0f15a368-feb7-4b3d-829a-d49e7474445b\") " pod="openshift-dns/dns-default-vq4dk"
Jul 03 09:43:55.181915 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:55.181858    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbtgk\" (UniqueName: \"kubernetes.io/projected/66226c20-f210-473d-854b-b6c369884a01-kube-api-access-nbtgk\") pod \"ingress-canary-b7g2w\" (UID: \"66226c20-f210-473d-854b-b6c369884a01\") " pod="openshift-ingress-canary/ingress-canary-b7g2w"
Jul 03 09:43:55.284171 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:55.284096    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-b7g2w"
Jul 03 09:43:55.673878 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:55.673845    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f15a368-feb7-4b3d-829a-d49e7474445b-metrics-tls\") pod \"dns-default-vq4dk\" (UID: \"0f15a368-feb7-4b3d-829a-d49e7474445b\") " pod="openshift-dns/dns-default-vq4dk"
Jul 03 09:43:55.674037 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:55.674013    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 03 09:43:55.674097 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:55.674077    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f15a368-feb7-4b3d-829a-d49e7474445b-metrics-tls podName:0f15a368-feb7-4b3d-829a-d49e7474445b nodeName:}" failed. No retries permitted until 2026-07-03 09:43:56.674061427 +0000 UTC m=+37.544727033 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0f15a368-feb7-4b3d-829a-d49e7474445b-metrics-tls") pod "dns-default-vq4dk" (UID: "0f15a368-feb7-4b3d-829a-d49e7474445b") : secret "dns-default-metrics-tls" not found
Jul 03 09:43:55.813918 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:55.813692    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-b7g2w"]
Jul 03 09:43:55.816254 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:43:55.816225    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66226c20_f210_473d_854b_b6c369884a01.slice/crio-d35509aef8f068ea781536b7a764f237b4ca0410c9225fc2304fe49b664925f6 WatchSource:0}: Error finding container d35509aef8f068ea781536b7a764f237b4ca0410c9225fc2304fe49b664925f6: Status 404 returned error can't find the container with id d35509aef8f068ea781536b7a764f237b4ca0410c9225fc2304fe49b664925f6
Jul 03 09:43:55.851035 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:55.851008    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcwzh" event={"ID":"93420c77-4dcb-4e57-b717-c1c03274b63f","Type":"ContainerStarted","Data":"339329cb1fa072976e2f4c3255e14a732b07af5e7c5973f69fb77269c311279d"}
Jul 03 09:43:55.852266 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:55.852238    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-b7g2w" event={"ID":"66226c20-f210-473d-854b-b6c369884a01","Type":"ContainerStarted","Data":"d35509aef8f068ea781536b7a764f237b4ca0410c9225fc2304fe49b664925f6"}
Jul 03 09:43:56.682030 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:56.681993    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f15a368-feb7-4b3d-829a-d49e7474445b-metrics-tls\") pod \"dns-default-vq4dk\" (UID: \"0f15a368-feb7-4b3d-829a-d49e7474445b\") " pod="openshift-dns/dns-default-vq4dk"
Jul 03 09:43:56.682206 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:56.682133    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 03 09:43:56.682206 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:56.682201    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f15a368-feb7-4b3d-829a-d49e7474445b-metrics-tls podName:0f15a368-feb7-4b3d-829a-d49e7474445b nodeName:}" failed. No retries permitted until 2026-07-03 09:43:58.682182451 +0000 UTC m=+39.552848061 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0f15a368-feb7-4b3d-829a-d49e7474445b-metrics-tls") pod "dns-default-vq4dk" (UID: "0f15a368-feb7-4b3d-829a-d49e7474445b") : secret "dns-default-metrics-tls" not found
Jul 03 09:43:56.685990 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:56.685961    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcgmr"
Jul 03 09:43:56.686123 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:56.686051    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pwxt9"
Jul 03 09:43:56.686268 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:56.686248    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grmvl"
Jul 03 09:43:56.688700 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:56.688677    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 03 09:43:56.689878 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:56.689620    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 03 09:43:56.689878 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:56.689631    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-98cbg\""
Jul 03 09:43:56.689878 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:56.689651    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 03 09:43:56.689878 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:56.689634    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 03 09:43:56.689878 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:56.689731    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bb7nd\""
Jul 03 09:43:56.858233 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:56.858196    2559 generic.go:356] "Generic (PLEG): container finished" podID="93420c77-4dcb-4e57-b717-c1c03274b63f" containerID="339329cb1fa072976e2f4c3255e14a732b07af5e7c5973f69fb77269c311279d" exitCode=0
Jul 03 09:43:56.858619 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:56.858250    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcwzh" event={"ID":"93420c77-4dcb-4e57-b717-c1c03274b63f","Type":"ContainerDied","Data":"339329cb1fa072976e2f4c3255e14a732b07af5e7c5973f69fb77269c311279d"}
Jul 03 09:43:57.864376 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:57.864328    2559 generic.go:356] "Generic (PLEG): container finished" podID="93420c77-4dcb-4e57-b717-c1c03274b63f" containerID="799a75431ce5c84109fa96c83fbe8f1d37bf45c3935ecdd57a6256c670010692" exitCode=0
Jul 03 09:43:57.864868 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:57.864389    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcwzh" event={"ID":"93420c77-4dcb-4e57-b717-c1c03274b63f","Type":"ContainerDied","Data":"799a75431ce5c84109fa96c83fbe8f1d37bf45c3935ecdd57a6256c670010692"}
Jul 03 09:43:58.697710 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:58.697525    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f15a368-feb7-4b3d-829a-d49e7474445b-metrics-tls\") pod \"dns-default-vq4dk\" (UID: \"0f15a368-feb7-4b3d-829a-d49e7474445b\") " pod="openshift-dns/dns-default-vq4dk"
Jul 03 09:43:58.697710 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:58.697685    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 03 09:43:58.697896 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:43:58.697764    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f15a368-feb7-4b3d-829a-d49e7474445b-metrics-tls podName:0f15a368-feb7-4b3d-829a-d49e7474445b nodeName:}" failed. No retries permitted until 2026-07-03 09:44:02.697750351 +0000 UTC m=+43.568415959 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0f15a368-feb7-4b3d-829a-d49e7474445b-metrics-tls") pod "dns-default-vq4dk" (UID: "0f15a368-feb7-4b3d-829a-d49e7474445b") : secret "dns-default-metrics-tls" not found
Jul 03 09:43:58.868488 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:58.868407    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-b7g2w" event={"ID":"66226c20-f210-473d-854b-b6c369884a01","Type":"ContainerStarted","Data":"3686dafb0be2e114b47ff806f5ff74ea98c9cc5920896620b2a004df398f6b94"}
Jul 03 09:43:58.871425 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:58.871399    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hcwzh" event={"ID":"93420c77-4dcb-4e57-b717-c1c03274b63f","Type":"ContainerStarted","Data":"bde6670fd5185f7f69fa73b832a7df55d2afeff72a0470b56b772606bd1b7045"}
Jul 03 09:43:58.883865 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:58.883813    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-b7g2w" podStartSLOduration=2.6098463819999997 podStartE2EDuration="4.883796587s" totalImagesPullingTime="2.273950205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:43:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:43:58.883092323 +0000 UTC m=+39.753757977" watchObservedRunningTime="2026-07-03 09:43:58.883796587 +0000 UTC m=+39.754462217"
Jul 03 09:43:58.905350 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:43:58.905209    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hcwzh" podStartSLOduration=13.132077784 podStartE2EDuration="38.905190508s" totalImagesPullingTime="25.773112724s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 09:43:20 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:43:58.903678243 +0000 UTC m=+39.774343871" watchObservedRunningTime="2026-07-03 09:43:58.905190508 +0000 UTC m=+39.775856136"
Jul 03 09:44:02.729424 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:02.729384    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f15a368-feb7-4b3d-829a-d49e7474445b-metrics-tls\") pod \"dns-default-vq4dk\" (UID: \"0f15a368-feb7-4b3d-829a-d49e7474445b\") " pod="openshift-dns/dns-default-vq4dk"
Jul 03 09:44:02.729918 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:44:02.729502    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 03 09:44:02.729918 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:44:02.729576    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f15a368-feb7-4b3d-829a-d49e7474445b-metrics-tls podName:0f15a368-feb7-4b3d-829a-d49e7474445b nodeName:}" failed. No retries permitted until 2026-07-03 09:44:10.729561436 +0000 UTC m=+51.600227056 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0f15a368-feb7-4b3d-829a-d49e7474445b-metrics-tls") pod "dns-default-vq4dk" (UID: "0f15a368-feb7-4b3d-829a-d49e7474445b") : secret "dns-default-metrics-tls" not found
Jul 03 09:44:10.782603 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:10.782571    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f15a368-feb7-4b3d-829a-d49e7474445b-metrics-tls\") pod \"dns-default-vq4dk\" (UID: \"0f15a368-feb7-4b3d-829a-d49e7474445b\") " pod="openshift-dns/dns-default-vq4dk"
Jul 03 09:44:10.783090 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:44:10.782701    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 03 09:44:10.783090 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:44:10.782764    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f15a368-feb7-4b3d-829a-d49e7474445b-metrics-tls podName:0f15a368-feb7-4b3d-829a-d49e7474445b nodeName:}" failed. No retries permitted until 2026-07-03 09:44:26.782749865 +0000 UTC m=+67.653415472 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0f15a368-feb7-4b3d-829a-d49e7474445b-metrics-tls") pod "dns-default-vq4dk" (UID: "0f15a368-feb7-4b3d-829a-d49e7474445b") : secret "dns-default-metrics-tls" not found
Jul 03 09:44:19.850140 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:19.850115    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mbxdl"
Jul 03 09:44:25.277754 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:25.277702    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20bf6cc8-63bc-4ac8-be3b-948848a5755c-original-pull-secret\") pod \"global-pull-secret-syncer-pwxt9\" (UID: \"20bf6cc8-63bc-4ac8-be3b-948848a5755c\") " pod="kube-system/global-pull-secret-syncer-pwxt9"
Jul 03 09:44:25.278281 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:25.277774    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65bd85a9-57d3-4ff1-bae1-9f3727371a28-metrics-certs\") pod \"network-metrics-daemon-grmvl\" (UID: \"65bd85a9-57d3-4ff1-bae1-9f3727371a28\") " pod="openshift-multus/network-metrics-daemon-grmvl"
Jul 03 09:44:25.280470 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:25.280452    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 03 09:44:25.280702 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:25.280684    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 03 09:44:25.288746 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:44:25.288726    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 03 09:44:25.288831 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:44:25.288799    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65bd85a9-57d3-4ff1-bae1-9f3727371a28-metrics-certs podName:65bd85a9-57d3-4ff1-bae1-9f3727371a28 nodeName:}" failed. No retries permitted until 2026-07-03 09:45:29.288782598 +0000 UTC m=+130.159448206 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65bd85a9-57d3-4ff1-bae1-9f3727371a28-metrics-certs") pod "network-metrics-daemon-grmvl" (UID: "65bd85a9-57d3-4ff1-bae1-9f3727371a28") : secret "metrics-daemon-secret" not found
Jul 03 09:44:25.292393 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:25.292371    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20bf6cc8-63bc-4ac8-be3b-948848a5755c-original-pull-secret\") pod \"global-pull-secret-syncer-pwxt9\" (UID: \"20bf6cc8-63bc-4ac8-be3b-948848a5755c\") " pod="kube-system/global-pull-secret-syncer-pwxt9"
Jul 03 09:44:25.479016 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:25.478972    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t6lr\" (UniqueName: \"kubernetes.io/projected/ad626d77-caf4-4081-8ac3-c6e2c9a970f6-kube-api-access-4t6lr\") pod \"network-check-target-hcgmr\" (UID: \"ad626d77-caf4-4081-8ac3-c6e2c9a970f6\") " pod="openshift-network-diagnostics/network-check-target-hcgmr"
Jul 03 09:44:25.481726 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:25.481704    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 03 09:44:25.491641 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:25.491624    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 03 09:44:25.502146 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:25.502124    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t6lr\" (UniqueName: \"kubernetes.io/projected/ad626d77-caf4-4081-8ac3-c6e2c9a970f6-kube-api-access-4t6lr\") pod \"network-check-target-hcgmr\" (UID: \"ad626d77-caf4-4081-8ac3-c6e2c9a970f6\") " pod="openshift-network-diagnostics/network-check-target-hcgmr"
Jul 03 09:44:25.505951 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:25.505929    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pwxt9"
Jul 03 09:44:25.626350 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:25.626322    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pwxt9"]
Jul 03 09:44:25.629179 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:44:25.629150    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20bf6cc8_63bc_4ac8_be3b_948848a5755c.slice/crio-15e1cb5e946056b8be99dae2c39457d66190651f9217f8d07d7210b3c3918636 WatchSource:0}: Error finding container 15e1cb5e946056b8be99dae2c39457d66190651f9217f8d07d7210b3c3918636: Status 404 returned error can't find the container with id 15e1cb5e946056b8be99dae2c39457d66190651f9217f8d07d7210b3c3918636
Jul 03 09:44:25.801098 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:25.801071    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bb7nd\""
Jul 03 09:44:25.809172 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:25.809122    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hcgmr"
Jul 03 09:44:25.929073 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:25.929003    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hcgmr"]
Jul 03 09:44:25.931562 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:44:25.931514    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad626d77_caf4_4081_8ac3_c6e2c9a970f6.slice/crio-e4ea558e77a3f4e5231244734918b579302cc4b8d9d2fd1bc9e8944748c02b28 WatchSource:0}: Error finding container e4ea558e77a3f4e5231244734918b579302cc4b8d9d2fd1bc9e8944748c02b28: Status 404 returned error can't find the container with id e4ea558e77a3f4e5231244734918b579302cc4b8d9d2fd1bc9e8944748c02b28
Jul 03 09:44:25.934798 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:25.934769    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pwxt9" event={"ID":"20bf6cc8-63bc-4ac8-be3b-948848a5755c","Type":"ContainerStarted","Data":"15e1cb5e946056b8be99dae2c39457d66190651f9217f8d07d7210b3c3918636"}
Jul 03 09:44:26.789203 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:26.789160    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f15a368-feb7-4b3d-829a-d49e7474445b-metrics-tls\") pod \"dns-default-vq4dk\" (UID: \"0f15a368-feb7-4b3d-829a-d49e7474445b\") " pod="openshift-dns/dns-default-vq4dk"
Jul 03 09:44:26.789633 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:44:26.789326    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 03 09:44:26.789633 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:44:26.789395    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f15a368-feb7-4b3d-829a-d49e7474445b-metrics-tls podName:0f15a368-feb7-4b3d-829a-d49e7474445b nodeName:}" failed. No retries permitted until 2026-07-03 09:44:58.789379078 +0000 UTC m=+99.660044689 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0f15a368-feb7-4b3d-829a-d49e7474445b-metrics-tls") pod "dns-default-vq4dk" (UID: "0f15a368-feb7-4b3d-829a-d49e7474445b") : secret "dns-default-metrics-tls" not found
Jul 03 09:44:26.939466 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:26.939424    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hcgmr" event={"ID":"ad626d77-caf4-4081-8ac3-c6e2c9a970f6","Type":"ContainerStarted","Data":"e4ea558e77a3f4e5231244734918b579302cc4b8d9d2fd1bc9e8944748c02b28"}
Jul 03 09:44:30.951241 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:30.951209    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pwxt9" event={"ID":"20bf6cc8-63bc-4ac8-be3b-948848a5755c","Type":"ContainerStarted","Data":"e539321c48034903404f8db6bc98b63955faeaf7cb870cf489c8a773eb282b54"}
Jul 03 09:44:30.952528 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:30.952502    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hcgmr" event={"ID":"ad626d77-caf4-4081-8ac3-c6e2c9a970f6","Type":"ContainerStarted","Data":"c65de341a46827d425574751ebb72c633628d14fc7b552de73bb764402fb6a79"}
Jul 03 09:44:30.952659 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:30.952579    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hcgmr"
Jul 03 09:44:30.968097 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:30.968040    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-pwxt9" podStartSLOduration=66.297087391 podStartE2EDuration="1m10.968025562s" totalImagesPullingTime="4.670938171s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 09:43:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:44:30.967818257 +0000 UTC m=+71.838483898" watchObservedRunningTime="2026-07-03 09:44:30.968025562 +0000 UTC m=+71.838691183"
Jul 03 09:44:30.983248 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:30.983205    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hcgmr" podStartSLOduration=66.61865378 podStartE2EDuration="1m10.983193163s" totalImagesPullingTime="4.364539383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:43:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:44:30.982644596 +0000 UTC m=+71.853310225" watchObservedRunningTime="2026-07-03 09:44:30.983193163 +0000 UTC m=+71.853858806"
Jul 03 09:44:58.443625 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:58.443499    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77dbfcc48b-ksts9"]
Jul 03 09:44:58.446067 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:58.446051    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77dbfcc48b-ksts9"
Jul 03 09:44:58.448882 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:58.448850    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 03 09:44:58.449596 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:58.449567    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 03 09:44:58.449720 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:58.449614    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 03 09:44:58.449720 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:58.449614    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-6l8ff\""
Jul 03 09:44:58.449720 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:58.449702    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 03 09:44:58.459231 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:58.459212    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77dbfcc48b-ksts9"]
Jul 03 09:44:58.502309 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:58.502279    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/84bdfef2-dee3-4c83-bf28-7a1b1c39beea-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-77dbfcc48b-ksts9\" (UID: \"84bdfef2-dee3-4c83-bf28-7a1b1c39beea\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77dbfcc48b-ksts9"
Jul 03 09:44:58.502459 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:58.502327    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhvwf\" (UniqueName: \"kubernetes.io/projected/84bdfef2-dee3-4c83-bf28-7a1b1c39beea-kube-api-access-mhvwf\") pod \"managed-serviceaccount-addon-agent-77dbfcc48b-ksts9\" (UID: \"84bdfef2-dee3-4c83-bf28-7a1b1c39beea\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77dbfcc48b-ksts9"
Jul 03 09:44:58.603523 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:58.603489    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/84bdfef2-dee3-4c83-bf28-7a1b1c39beea-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-77dbfcc48b-ksts9\" (UID: \"84bdfef2-dee3-4c83-bf28-7a1b1c39beea\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77dbfcc48b-ksts9"
Jul 03 09:44:58.603696 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:58.603532    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhvwf\" (UniqueName: \"kubernetes.io/projected/84bdfef2-dee3-4c83-bf28-7a1b1c39beea-kube-api-access-mhvwf\") pod \"managed-serviceaccount-addon-agent-77dbfcc48b-ksts9\" (UID: \"84bdfef2-dee3-4c83-bf28-7a1b1c39beea\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77dbfcc48b-ksts9"
Jul 03 09:44:58.606046 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:58.606025    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/84bdfef2-dee3-4c83-bf28-7a1b1c39beea-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-77dbfcc48b-ksts9\" (UID: \"84bdfef2-dee3-4c83-bf28-7a1b1c39beea\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77dbfcc48b-ksts9"
Jul 03 09:44:58.612841 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:58.612817    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhvwf\" (UniqueName: \"kubernetes.io/projected/84bdfef2-dee3-4c83-bf28-7a1b1c39beea-kube-api-access-mhvwf\") pod \"managed-serviceaccount-addon-agent-77dbfcc48b-ksts9\" (UID: \"84bdfef2-dee3-4c83-bf28-7a1b1c39beea\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77dbfcc48b-ksts9"
Jul 03 09:44:58.774206 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:58.774106    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77dbfcc48b-ksts9"
Jul 03 09:44:58.804274 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:58.804246    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f15a368-feb7-4b3d-829a-d49e7474445b-metrics-tls\") pod \"dns-default-vq4dk\" (UID: \"0f15a368-feb7-4b3d-829a-d49e7474445b\") " pod="openshift-dns/dns-default-vq4dk"
Jul 03 09:44:58.804458 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:44:58.804434    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 03 09:44:58.804568 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:44:58.804536    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f15a368-feb7-4b3d-829a-d49e7474445b-metrics-tls podName:0f15a368-feb7-4b3d-829a-d49e7474445b nodeName:}" failed. No retries permitted until 2026-07-03 09:46:02.804511768 +0000 UTC m=+163.675177380 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0f15a368-feb7-4b3d-829a-d49e7474445b-metrics-tls") pod "dns-default-vq4dk" (UID: "0f15a368-feb7-4b3d-829a-d49e7474445b") : secret "dns-default-metrics-tls" not found
Jul 03 09:44:58.893389 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:58.893361    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77dbfcc48b-ksts9"]
Jul 03 09:44:58.896902 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:44:58.896872    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod84bdfef2_dee3_4c83_bf28_7a1b1c39beea.slice/crio-2691cc7db051953e46c5c5f6a7728f0b7a733ccdc2977280f22ec0576879680c WatchSource:0}: Error finding container 2691cc7db051953e46c5c5f6a7728f0b7a733ccdc2977280f22ec0576879680c: Status 404 returned error can't find the container with id 2691cc7db051953e46c5c5f6a7728f0b7a733ccdc2977280f22ec0576879680c
Jul 03 09:44:59.017392 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:44:59.017355    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77dbfcc48b-ksts9" event={"ID":"84bdfef2-dee3-4c83-bf28-7a1b1c39beea","Type":"ContainerStarted","Data":"2691cc7db051953e46c5c5f6a7728f0b7a733ccdc2977280f22ec0576879680c"}
Jul 03 09:45:01.956863 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:45:01.956835    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hcgmr"
Jul 03 09:45:02.026012 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:45:02.025976    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77dbfcc48b-ksts9" event={"ID":"84bdfef2-dee3-4c83-bf28-7a1b1c39beea","Type":"ContainerStarted","Data":"20801c51126749fc2818558abb64ad87d77501a4b34349584ec6fa284e8c54cd"}
Jul 03 09:45:02.043203 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:45:02.043157    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77dbfcc48b-ksts9" podStartSLOduration=1.44482156 podStartE2EDuration="4.043144936s" totalImagesPullingTime="2.598323376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:44:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:45:02.042785951 +0000 UTC m=+102.913451585" watchObservedRunningTime="2026-07-03 09:45:02.043144936 +0000 UTC m=+102.913810564"
Jul 03 09:45:29.313668 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:45:29.313632    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65bd85a9-57d3-4ff1-bae1-9f3727371a28-metrics-certs\") pod \"network-metrics-daemon-grmvl\" (UID: \"65bd85a9-57d3-4ff1-bae1-9f3727371a28\") " pod="openshift-multus/network-metrics-daemon-grmvl"
Jul 03 09:45:29.314124 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:45:29.313736    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 03 09:45:29.314124 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:45:29.313797    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65bd85a9-57d3-4ff1-bae1-9f3727371a28-metrics-certs podName:65bd85a9-57d3-4ff1-bae1-9f3727371a28 nodeName:}" failed. No retries permitted until 2026-07-03 09:47:31.313782707 +0000 UTC m=+252.184448314 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65bd85a9-57d3-4ff1-bae1-9f3727371a28-metrics-certs") pod "network-metrics-daemon-grmvl" (UID: "65bd85a9-57d3-4ff1-bae1-9f3727371a28") : secret "metrics-daemon-secret" not found
Jul 03 09:45:57.975842 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:45:57.975795    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vq4dk" podUID="0f15a368-feb7-4b3d-829a-d49e7474445b"
Jul 03 09:45:58.154789 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:45:58.154763    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vq4dk"
Jul 03 09:45:59.711330 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:45:59.711283    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-grmvl" podUID="65bd85a9-57d3-4ff1-bae1-9f3727371a28"
Jul 03 09:46:02.836833 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:46:02.836777    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f15a368-feb7-4b3d-829a-d49e7474445b-metrics-tls\") pod \"dns-default-vq4dk\" (UID: \"0f15a368-feb7-4b3d-829a-d49e7474445b\") " pod="openshift-dns/dns-default-vq4dk"
Jul 03 09:46:02.837296 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:46:02.836898    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 03 09:46:02.837296 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:46:02.836953    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f15a368-feb7-4b3d-829a-d49e7474445b-metrics-tls podName:0f15a368-feb7-4b3d-829a-d49e7474445b nodeName:}" failed. No retries permitted until 2026-07-03 09:48:04.836940328 +0000 UTC m=+285.707605935 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0f15a368-feb7-4b3d-829a-d49e7474445b-metrics-tls") pod "dns-default-vq4dk" (UID: "0f15a368-feb7-4b3d-829a-d49e7474445b") : secret "dns-default-metrics-tls" not found
Jul 03 09:46:12.685526 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:46:12.685446    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grmvl"
Jul 03 09:47:02.302491 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:02.302454    2559 generic.go:356] "Generic (PLEG): container finished" podID="84bdfef2-dee3-4c83-bf28-7a1b1c39beea" containerID="20801c51126749fc2818558abb64ad87d77501a4b34349584ec6fa284e8c54cd" exitCode=255
Jul 03 09:47:02.302938 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:02.302527    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77dbfcc48b-ksts9" event={"ID":"84bdfef2-dee3-4c83-bf28-7a1b1c39beea","Type":"ContainerDied","Data":"20801c51126749fc2818558abb64ad87d77501a4b34349584ec6fa284e8c54cd"}
Jul 03 09:47:02.307971 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:02.307953    2559 scope.go:117] "RemoveContainer" containerID="20801c51126749fc2818558abb64ad87d77501a4b34349584ec6fa284e8c54cd"
Jul 03 09:47:03.306876 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:03.306840    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77dbfcc48b-ksts9" event={"ID":"84bdfef2-dee3-4c83-bf28-7a1b1c39beea","Type":"ContainerStarted","Data":"9c0643c60255af0800017daef8219fe6fefd3c24b5b038149ae31c86e41b4f4b"}
Jul 03 09:47:31.392366 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:31.392334    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65bd85a9-57d3-4ff1-bae1-9f3727371a28-metrics-certs\") pod \"network-metrics-daemon-grmvl\" (UID: \"65bd85a9-57d3-4ff1-bae1-9f3727371a28\") " pod="openshift-multus/network-metrics-daemon-grmvl"
Jul 03 09:47:31.392831 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:31.392453    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 03 09:47:31.392831 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:31.392515    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65bd85a9-57d3-4ff1-bae1-9f3727371a28-metrics-certs podName:65bd85a9-57d3-4ff1-bae1-9f3727371a28 nodeName:}" failed. No retries permitted until 2026-07-03 09:49:33.392500948 +0000 UTC m=+374.263166555 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65bd85a9-57d3-4ff1-bae1-9f3727371a28-metrics-certs") pod "network-metrics-daemon-grmvl" (UID: "65bd85a9-57d3-4ff1-bae1-9f3727371a28") : secret "metrics-daemon-secret" not found
Jul 03 09:47:36.446925 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.446893    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-c4mdt"]
Jul 03 09:47:36.449934 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.449918    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8dx"]
Jul 03 09:47:36.450059 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.450044    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-c4mdt"
Jul 03 09:47:36.452754 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.452731    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fgclw"]
Jul 03 09:47:36.452894 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.452833    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8dx"
Jul 03 09:47:36.453401 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.453382    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-6v5ds\""
Jul 03 09:47:36.453497 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.453415    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 03 09:47:36.453497 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.453426    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 03 09:47:36.453497 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.453488    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 03 09:47:36.454348 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.454332    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 03 09:47:36.455381 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.455363    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 03 09:47:36.455494 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.455480    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fgclw"
Jul 03 09:47:36.457994 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.457975    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 03 09:47:36.458141 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.458118    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 03 09:47:36.458207 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.458137    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 03 09:47:36.458207 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.458063    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rmr7q\""
Jul 03 09:47:36.458521 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.458506    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 03 09:47:36.458598 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.458569    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 03 09:47:36.458643 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.458627    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 03 09:47:36.459197 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.459180    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-mntmg\""
Jul 03 09:47:36.460622 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.460606    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 03 09:47:36.463693 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.463671    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-c4mdt"]
Jul 03 09:47:36.465594 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.465575    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fgclw"]
Jul 03 09:47:36.470626 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.470605    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8dx"]
Jul 03 09:47:36.527991 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.527954    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9df3435e-f10d-4b2c-9007-6123c9baabb2-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fgclw\" (UID: \"9df3435e-f10d-4b2c-9007-6123c9baabb2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fgclw"
Jul 03 09:47:36.527991 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.527994    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3ebcec7-5b7d-40ad-8375-911427c94cbb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qg8dx\" (UID: \"c3ebcec7-5b7d-40ad-8375-911427c94cbb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8dx"
Jul 03 09:47:36.528150 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.528013    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d052bc8-d41a-494c-9523-5bfdcfb29ec2-serving-cert\") pod \"console-operator-68b757fb67-c4mdt\" (UID: \"9d052bc8-d41a-494c-9523-5bfdcfb29ec2\") " pod="openshift-console-operator/console-operator-68b757fb67-c4mdt"
Jul 03 09:47:36.528150 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.528071    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d052bc8-d41a-494c-9523-5bfdcfb29ec2-config\") pod \"console-operator-68b757fb67-c4mdt\" (UID: \"9d052bc8-d41a-494c-9523-5bfdcfb29ec2\") " pod="openshift-console-operator/console-operator-68b757fb67-c4mdt"
Jul 03 09:47:36.528150 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.528089    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnwph\" (UniqueName: \"kubernetes.io/projected/9df3435e-f10d-4b2c-9007-6123c9baabb2-kube-api-access-fnwph\") pod \"cluster-samples-operator-56fcf86bf-fgclw\" (UID: \"9df3435e-f10d-4b2c-9007-6123c9baabb2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fgclw"
Jul 03 09:47:36.528150 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.528107    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckzdh\" (UniqueName: \"kubernetes.io/projected/9d052bc8-d41a-494c-9523-5bfdcfb29ec2-kube-api-access-ckzdh\") pod \"console-operator-68b757fb67-c4mdt\" (UID: \"9d052bc8-d41a-494c-9523-5bfdcfb29ec2\") " pod="openshift-console-operator/console-operator-68b757fb67-c4mdt"
Jul 03 09:47:36.528312 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.528157    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj9f5\" (UniqueName: \"kubernetes.io/projected/c3ebcec7-5b7d-40ad-8375-911427c94cbb-kube-api-access-xj9f5\") pod \"cluster-monitoring-operator-64786d9cbb-qg8dx\" (UID: \"c3ebcec7-5b7d-40ad-8375-911427c94cbb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8dx"
Jul 03 09:47:36.528312 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.528185    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d052bc8-d41a-494c-9523-5bfdcfb29ec2-trusted-ca\") pod \"console-operator-68b757fb67-c4mdt\" (UID: \"9d052bc8-d41a-494c-9523-5bfdcfb29ec2\") " pod="openshift-console-operator/console-operator-68b757fb67-c4mdt"
Jul 03 09:47:36.528312 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.528230    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c3ebcec7-5b7d-40ad-8375-911427c94cbb-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-qg8dx\" (UID: \"c3ebcec7-5b7d-40ad-8375-911427c94cbb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8dx"
Jul 03 09:47:36.538143 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.538121    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-7jjl2"]
Jul 03 09:47:36.540916 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.540901    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tpwdg"]
Jul 03 09:47:36.541030 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.541016    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-7jjl2"
Jul 03 09:47:36.543207 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.543190    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 03 09:47:36.543309 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.543279    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tpwdg"
Jul 03 09:47:36.543655 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.543636    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 03 09:47:36.543744 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.543637    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 03 09:47:36.544056 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.544040    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 03 09:47:36.544113 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.544086    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-ng2sg\""
Jul 03 09:47:36.546470 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.546336    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 03 09:47:36.546470 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.546361    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 03 09:47:36.546470 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.546462    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 03 09:47:36.546693 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.546474    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 03 09:47:36.546818 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.546803    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-kdmgz\""
Jul 03 09:47:36.554092 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.554068    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-7jjl2"]
Jul 03 09:47:36.554311 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.554292    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 03 09:47:36.568532 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.568513    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tpwdg"]
Jul 03 09:47:36.629480 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.629457    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c3ebcec7-5b7d-40ad-8375-911427c94cbb-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-qg8dx\" (UID: \"c3ebcec7-5b7d-40ad-8375-911427c94cbb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8dx"
Jul 03 09:47:36.629624 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.629486    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c80c9446-f8d7-4e4e-bdda-e0467cab85ed-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-tpwdg\" (UID: \"c80c9446-f8d7-4e4e-bdda-e0467cab85ed\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tpwdg"
Jul 03 09:47:36.629624 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.629509    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9df3435e-f10d-4b2c-9007-6123c9baabb2-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fgclw\" (UID: \"9df3435e-f10d-4b2c-9007-6123c9baabb2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fgclw"
Jul 03 09:47:36.629624 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.629526    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3ebcec7-5b7d-40ad-8375-911427c94cbb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qg8dx\" (UID: \"c3ebcec7-5b7d-40ad-8375-911427c94cbb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8dx"
Jul 03 09:47:36.629624 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.629561    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d052bc8-d41a-494c-9523-5bfdcfb29ec2-serving-cert\") pod \"console-operator-68b757fb67-c4mdt\" (UID: \"9d052bc8-d41a-494c-9523-5bfdcfb29ec2\") " pod="openshift-console-operator/console-operator-68b757fb67-c4mdt"
Jul 03 09:47:36.629774 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.629704    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b40d22c-95af-41b3-a18e-d1cda05b4999-tmp\") pod \"insights-operator-5c847dcfc4-7jjl2\" (UID: \"3b40d22c-95af-41b3-a18e-d1cda05b4999\") " pod="openshift-insights/insights-operator-5c847dcfc4-7jjl2"
Jul 03 09:47:36.629774 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:36.629722    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 03 09:47:36.629774 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.629733    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g49k9\" (UniqueName: \"kubernetes.io/projected/c80c9446-f8d7-4e4e-bdda-e0467cab85ed-kube-api-access-g49k9\") pod \"service-ca-operator-5d46d9ffd4-tpwdg\" (UID: \"c80c9446-f8d7-4e4e-bdda-e0467cab85ed\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tpwdg"
Jul 03 09:47:36.629774 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:36.629734    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 03 09:47:36.629906 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.629779    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3b40d22c-95af-41b3-a18e-d1cda05b4999-snapshots\") pod \"insights-operator-5c847dcfc4-7jjl2\" (UID: \"3b40d22c-95af-41b3-a18e-d1cda05b4999\") " pod="openshift-insights/insights-operator-5c847dcfc4-7jjl2"
Jul 03 09:47:36.629906 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:36.629800    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3ebcec7-5b7d-40ad-8375-911427c94cbb-cluster-monitoring-operator-tls podName:c3ebcec7-5b7d-40ad-8375-911427c94cbb nodeName:}" failed. No retries permitted until 2026-07-03 09:47:37.129777736 +0000 UTC m=+258.000443364 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c3ebcec7-5b7d-40ad-8375-911427c94cbb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-qg8dx" (UID: "c3ebcec7-5b7d-40ad-8375-911427c94cbb") : secret "cluster-monitoring-operator-tls" not found
Jul 03 09:47:36.629906 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:36.629836    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9df3435e-f10d-4b2c-9007-6123c9baabb2-samples-operator-tls podName:9df3435e-f10d-4b2c-9007-6123c9baabb2 nodeName:}" failed. No retries permitted until 2026-07-03 09:47:37.129824177 +0000 UTC m=+258.000489784 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9df3435e-f10d-4b2c-9007-6123c9baabb2-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-fgclw" (UID: "9df3435e-f10d-4b2c-9007-6123c9baabb2") : secret "samples-operator-tls" not found
Jul 03 09:47:36.629906 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.629865    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b40d22c-95af-41b3-a18e-d1cda05b4999-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-7jjl2\" (UID: \"3b40d22c-95af-41b3-a18e-d1cda05b4999\") " pod="openshift-insights/insights-operator-5c847dcfc4-7jjl2"
Jul 03 09:47:36.629906 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.629890    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c80c9446-f8d7-4e4e-bdda-e0467cab85ed-config\") pod \"service-ca-operator-5d46d9ffd4-tpwdg\" (UID: \"c80c9446-f8d7-4e4e-bdda-e0467cab85ed\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tpwdg"
Jul 03 09:47:36.630136 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.629910    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d052bc8-d41a-494c-9523-5bfdcfb29ec2-config\") pod \"console-operator-68b757fb67-c4mdt\" (UID: \"9d052bc8-d41a-494c-9523-5bfdcfb29ec2\") " pod="openshift-console-operator/console-operator-68b757fb67-c4mdt"
Jul 03 09:47:36.630136 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.629924    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b40d22c-95af-41b3-a18e-d1cda05b4999-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-7jjl2\" (UID: \"3b40d22c-95af-41b3-a18e-d1cda05b4999\") " pod="openshift-insights/insights-operator-5c847dcfc4-7jjl2"
Jul 03 09:47:36.630136 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.629953    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnwph\" (UniqueName: \"kubernetes.io/projected/9df3435e-f10d-4b2c-9007-6123c9baabb2-kube-api-access-fnwph\") pod \"cluster-samples-operator-56fcf86bf-fgclw\" (UID: \"9df3435e-f10d-4b2c-9007-6123c9baabb2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fgclw"
Jul 03 09:47:36.630136 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.629973    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3b40d22c-95af-41b3-a18e-d1cda05b4999-serving-cert\") pod \"insights-operator-5c847dcfc4-7jjl2\" (UID: \"3b40d22c-95af-41b3-a18e-d1cda05b4999\") " pod="openshift-insights/insights-operator-5c847dcfc4-7jjl2"
Jul 03 09:47:36.630136 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.630032    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckzdh\" (UniqueName: \"kubernetes.io/projected/9d052bc8-d41a-494c-9523-5bfdcfb29ec2-kube-api-access-ckzdh\") pod \"console-operator-68b757fb67-c4mdt\" (UID: \"9d052bc8-d41a-494c-9523-5bfdcfb29ec2\") " pod="openshift-console-operator/console-operator-68b757fb67-c4mdt"
Jul 03 09:47:36.630136 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.630097    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4l7x\" (UniqueName: \"kubernetes.io/projected/3b40d22c-95af-41b3-a18e-d1cda05b4999-kube-api-access-m4l7x\") pod \"insights-operator-5c847dcfc4-7jjl2\" (UID: \"3b40d22c-95af-41b3-a18e-d1cda05b4999\") " pod="openshift-insights/insights-operator-5c847dcfc4-7jjl2"
Jul 03 09:47:36.630426 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.630172    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj9f5\" (UniqueName: \"kubernetes.io/projected/c3ebcec7-5b7d-40ad-8375-911427c94cbb-kube-api-access-xj9f5\") pod \"cluster-monitoring-operator-64786d9cbb-qg8dx\" (UID: \"c3ebcec7-5b7d-40ad-8375-911427c94cbb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8dx"
Jul 03 09:47:36.630426 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.630200    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d052bc8-d41a-494c-9523-5bfdcfb29ec2-trusted-ca\") pod \"console-operator-68b757fb67-c4mdt\" (UID: \"9d052bc8-d41a-494c-9523-5bfdcfb29ec2\") " pod="openshift-console-operator/console-operator-68b757fb67-c4mdt"
Jul 03 09:47:36.630426 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.630278    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c3ebcec7-5b7d-40ad-8375-911427c94cbb-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-qg8dx\" (UID: \"c3ebcec7-5b7d-40ad-8375-911427c94cbb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8dx"
Jul 03 09:47:36.630762 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.630741    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d052bc8-d41a-494c-9523-5bfdcfb29ec2-config\") pod \"console-operator-68b757fb67-c4mdt\" (UID: \"9d052bc8-d41a-494c-9523-5bfdcfb29ec2\") " pod="openshift-console-operator/console-operator-68b757fb67-c4mdt"
Jul 03 09:47:36.630946 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.630929    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d052bc8-d41a-494c-9523-5bfdcfb29ec2-trusted-ca\") pod \"console-operator-68b757fb67-c4mdt\" (UID: \"9d052bc8-d41a-494c-9523-5bfdcfb29ec2\") " pod="openshift-console-operator/console-operator-68b757fb67-c4mdt"
Jul 03 09:47:36.632062 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.632037    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d052bc8-d41a-494c-9523-5bfdcfb29ec2-serving-cert\") pod \"console-operator-68b757fb67-c4mdt\" (UID: \"9d052bc8-d41a-494c-9523-5bfdcfb29ec2\") " pod="openshift-console-operator/console-operator-68b757fb67-c4mdt"
Jul 03 09:47:36.641514 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.641484    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckzdh\" (UniqueName: \"kubernetes.io/projected/9d052bc8-d41a-494c-9523-5bfdcfb29ec2-kube-api-access-ckzdh\") pod \"console-operator-68b757fb67-c4mdt\" (UID: \"9d052bc8-d41a-494c-9523-5bfdcfb29ec2\") " pod="openshift-console-operator/console-operator-68b757fb67-c4mdt"
Jul 03 09:47:36.642269 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.642249    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj9f5\" (UniqueName: \"kubernetes.io/projected/c3ebcec7-5b7d-40ad-8375-911427c94cbb-kube-api-access-xj9f5\") pod \"cluster-monitoring-operator-64786d9cbb-qg8dx\" (UID: \"c3ebcec7-5b7d-40ad-8375-911427c94cbb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8dx"
Jul 03 09:47:36.642781 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.642764    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnwph\" (UniqueName: \"kubernetes.io/projected/9df3435e-f10d-4b2c-9007-6123c9baabb2-kube-api-access-fnwph\") pod \"cluster-samples-operator-56fcf86bf-fgclw\" (UID: \"9df3435e-f10d-4b2c-9007-6123c9baabb2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fgclw"
Jul 03 09:47:36.730463 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.730399    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c80c9446-f8d7-4e4e-bdda-e0467cab85ed-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-tpwdg\" (UID: \"c80c9446-f8d7-4e4e-bdda-e0467cab85ed\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tpwdg"
Jul 03 09:47:36.730463 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.730445    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b40d22c-95af-41b3-a18e-d1cda05b4999-tmp\") pod \"insights-operator-5c847dcfc4-7jjl2\" (UID: \"3b40d22c-95af-41b3-a18e-d1cda05b4999\") " pod="openshift-insights/insights-operator-5c847dcfc4-7jjl2"
Jul 03 09:47:36.730463 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.730461    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g49k9\" (UniqueName: \"kubernetes.io/projected/c80c9446-f8d7-4e4e-bdda-e0467cab85ed-kube-api-access-g49k9\") pod \"service-ca-operator-5d46d9ffd4-tpwdg\" (UID: \"c80c9446-f8d7-4e4e-bdda-e0467cab85ed\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tpwdg"
Jul 03 09:47:36.730668 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.730494    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3b40d22c-95af-41b3-a18e-d1cda05b4999-snapshots\") pod \"insights-operator-5c847dcfc4-7jjl2\" (UID: \"3b40d22c-95af-41b3-a18e-d1cda05b4999\") " pod="openshift-insights/insights-operator-5c847dcfc4-7jjl2"
Jul 03 09:47:36.730668 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.730518    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b40d22c-95af-41b3-a18e-d1cda05b4999-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-7jjl2\" (UID: \"3b40d22c-95af-41b3-a18e-d1cda05b4999\") " pod="openshift-insights/insights-operator-5c847dcfc4-7jjl2"
Jul 03 09:47:36.730668 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.730535    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c80c9446-f8d7-4e4e-bdda-e0467cab85ed-config\") pod \"service-ca-operator-5d46d9ffd4-tpwdg\" (UID: \"c80c9446-f8d7-4e4e-bdda-e0467cab85ed\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tpwdg"
Jul 03 09:47:36.730668 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.730572    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b40d22c-95af-41b3-a18e-d1cda05b4999-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-7jjl2\" (UID: \"3b40d22c-95af-41b3-a18e-d1cda05b4999\") " pod="openshift-insights/insights-operator-5c847dcfc4-7jjl2"
Jul 03 09:47:36.730668 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.730611    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3b40d22c-95af-41b3-a18e-d1cda05b4999-serving-cert\") pod \"insights-operator-5c847dcfc4-7jjl2\" (UID: \"3b40d22c-95af-41b3-a18e-d1cda05b4999\") " pod="openshift-insights/insights-operator-5c847dcfc4-7jjl2"
Jul 03 09:47:36.730668 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.730643    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4l7x\" (UniqueName: \"kubernetes.io/projected/3b40d22c-95af-41b3-a18e-d1cda05b4999-kube-api-access-m4l7x\") pod \"insights-operator-5c847dcfc4-7jjl2\" (UID: \"3b40d22c-95af-41b3-a18e-d1cda05b4999\") " pod="openshift-insights/insights-operator-5c847dcfc4-7jjl2"
Jul 03 09:47:36.730953 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.730821    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b40d22c-95af-41b3-a18e-d1cda05b4999-tmp\") pod \"insights-operator-5c847dcfc4-7jjl2\" (UID: \"3b40d22c-95af-41b3-a18e-d1cda05b4999\") " pod="openshift-insights/insights-operator-5c847dcfc4-7jjl2"
Jul 03 09:47:36.731180 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.731118    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/3b40d22c-95af-41b3-a18e-d1cda05b4999-snapshots\") pod \"insights-operator-5c847dcfc4-7jjl2\" (UID: \"3b40d22c-95af-41b3-a18e-d1cda05b4999\") " pod="openshift-insights/insights-operator-5c847dcfc4-7jjl2"
Jul 03 09:47:36.731269 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.731189    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c80c9446-f8d7-4e4e-bdda-e0467cab85ed-config\") pod \"service-ca-operator-5d46d9ffd4-tpwdg\" (UID: \"c80c9446-f8d7-4e4e-bdda-e0467cab85ed\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tpwdg"
Jul 03 09:47:36.731491 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.731467    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b40d22c-95af-41b3-a18e-d1cda05b4999-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-7jjl2\" (UID: \"3b40d22c-95af-41b3-a18e-d1cda05b4999\") " pod="openshift-insights/insights-operator-5c847dcfc4-7jjl2"
Jul 03 09:47:36.731622 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.731605    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b40d22c-95af-41b3-a18e-d1cda05b4999-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-7jjl2\" (UID: \"3b40d22c-95af-41b3-a18e-d1cda05b4999\") " pod="openshift-insights/insights-operator-5c847dcfc4-7jjl2"
Jul 03 09:47:36.732675 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.732659    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c80c9446-f8d7-4e4e-bdda-e0467cab85ed-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-tpwdg\" (UID: \"c80c9446-f8d7-4e4e-bdda-e0467cab85ed\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tpwdg"
Jul 03 09:47:36.733111 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.733092    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3b40d22c-95af-41b3-a18e-d1cda05b4999-serving-cert\") pod \"insights-operator-5c847dcfc4-7jjl2\" (UID: \"3b40d22c-95af-41b3-a18e-d1cda05b4999\") " pod="openshift-insights/insights-operator-5c847dcfc4-7jjl2"
Jul 03 09:47:36.738848 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.738824    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4l7x\" (UniqueName: \"kubernetes.io/projected/3b40d22c-95af-41b3-a18e-d1cda05b4999-kube-api-access-m4l7x\") pod \"insights-operator-5c847dcfc4-7jjl2\" (UID: \"3b40d22c-95af-41b3-a18e-d1cda05b4999\") " pod="openshift-insights/insights-operator-5c847dcfc4-7jjl2"
Jul 03 09:47:36.739082 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.739062    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g49k9\" (UniqueName: \"kubernetes.io/projected/c80c9446-f8d7-4e4e-bdda-e0467cab85ed-kube-api-access-g49k9\") pod \"service-ca-operator-5d46d9ffd4-tpwdg\" (UID: \"c80c9446-f8d7-4e4e-bdda-e0467cab85ed\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tpwdg"
Jul 03 09:47:36.760922 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.760905    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-c4mdt"
Jul 03 09:47:36.853606 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.853580    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-7jjl2"
Jul 03 09:47:36.858772 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.858755    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tpwdg"
Jul 03 09:47:36.884211 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.884183    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-c4mdt"]
Jul 03 09:47:36.888527 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:47:36.888484    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d052bc8_d41a_494c_9523_5bfdcfb29ec2.slice/crio-33c0844a8f8b8503759819f8b2bae1220727f066674e26732c37220c3298563d WatchSource:0}: Error finding container 33c0844a8f8b8503759819f8b2bae1220727f066674e26732c37220c3298563d: Status 404 returned error can't find the container with id 33c0844a8f8b8503759819f8b2bae1220727f066674e26732c37220c3298563d
Jul 03 09:47:36.987687 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:36.987610    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-7jjl2"]
Jul 03 09:47:36.990850 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:47:36.990828    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b40d22c_95af_41b3_a18e_d1cda05b4999.slice/crio-f230e492796a8fedcd5ee9a0fd5b06610adec7746f39aa4ccf1af65d8a922aed WatchSource:0}: Error finding container f230e492796a8fedcd5ee9a0fd5b06610adec7746f39aa4ccf1af65d8a922aed: Status 404 returned error can't find the container with id f230e492796a8fedcd5ee9a0fd5b06610adec7746f39aa4ccf1af65d8a922aed
Jul 03 09:47:37.001632 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:37.001609    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tpwdg"]
Jul 03 09:47:37.003995 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:47:37.003969    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc80c9446_f8d7_4e4e_bdda_e0467cab85ed.slice/crio-9154cdbcdef53ab55a19992f84e6729cf2daf68e20269d0e45a1d800a204a43c WatchSource:0}: Error finding container 9154cdbcdef53ab55a19992f84e6729cf2daf68e20269d0e45a1d800a204a43c: Status 404 returned error can't find the container with id 9154cdbcdef53ab55a19992f84e6729cf2daf68e20269d0e45a1d800a204a43c
Jul 03 09:47:37.134879 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:37.134851    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9df3435e-f10d-4b2c-9007-6123c9baabb2-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fgclw\" (UID: \"9df3435e-f10d-4b2c-9007-6123c9baabb2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fgclw"
Jul 03 09:47:37.135034 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:37.134885    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3ebcec7-5b7d-40ad-8375-911427c94cbb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qg8dx\" (UID: \"c3ebcec7-5b7d-40ad-8375-911427c94cbb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8dx"
Jul 03 09:47:37.135034 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:37.134997    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 03 09:47:37.135034 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:37.135007    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 03 09:47:37.135145 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:37.135053    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3ebcec7-5b7d-40ad-8375-911427c94cbb-cluster-monitoring-operator-tls podName:c3ebcec7-5b7d-40ad-8375-911427c94cbb nodeName:}" failed. No retries permitted until 2026-07-03 09:47:38.135041006 +0000 UTC m=+259.005706617 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c3ebcec7-5b7d-40ad-8375-911427c94cbb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-qg8dx" (UID: "c3ebcec7-5b7d-40ad-8375-911427c94cbb") : secret "cluster-monitoring-operator-tls" not found
Jul 03 09:47:37.135145 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:37.135070    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9df3435e-f10d-4b2c-9007-6123c9baabb2-samples-operator-tls podName:9df3435e-f10d-4b2c-9007-6123c9baabb2 nodeName:}" failed. No retries permitted until 2026-07-03 09:47:38.135061351 +0000 UTC m=+259.005726958 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9df3435e-f10d-4b2c-9007-6123c9baabb2-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-fgclw" (UID: "9df3435e-f10d-4b2c-9007-6123c9baabb2") : secret "samples-operator-tls" not found
Jul 03 09:47:37.387680 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:37.387599    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tpwdg" event={"ID":"c80c9446-f8d7-4e4e-bdda-e0467cab85ed","Type":"ContainerStarted","Data":"9154cdbcdef53ab55a19992f84e6729cf2daf68e20269d0e45a1d800a204a43c"}
Jul 03 09:47:37.388688 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:37.388657    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-c4mdt" event={"ID":"9d052bc8-d41a-494c-9523-5bfdcfb29ec2","Type":"ContainerStarted","Data":"33c0844a8f8b8503759819f8b2bae1220727f066674e26732c37220c3298563d"}
Jul 03 09:47:37.389735 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:37.389712    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-7jjl2" event={"ID":"3b40d22c-95af-41b3-a18e-d1cda05b4999","Type":"ContainerStarted","Data":"f230e492796a8fedcd5ee9a0fd5b06610adec7746f39aa4ccf1af65d8a922aed"}
Jul 03 09:47:38.142516 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:38.142474    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9df3435e-f10d-4b2c-9007-6123c9baabb2-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fgclw\" (UID: \"9df3435e-f10d-4b2c-9007-6123c9baabb2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fgclw"
Jul 03 09:47:38.142992 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:38.142523    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3ebcec7-5b7d-40ad-8375-911427c94cbb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qg8dx\" (UID: \"c3ebcec7-5b7d-40ad-8375-911427c94cbb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8dx"
Jul 03 09:47:38.142992 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:38.142717    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 03 09:47:38.142992 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:38.142720    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 03 09:47:38.142992 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:38.142785    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3ebcec7-5b7d-40ad-8375-911427c94cbb-cluster-monitoring-operator-tls podName:c3ebcec7-5b7d-40ad-8375-911427c94cbb nodeName:}" failed. No retries permitted until 2026-07-03 09:47:40.142765926 +0000 UTC m=+261.013431543 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c3ebcec7-5b7d-40ad-8375-911427c94cbb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-qg8dx" (UID: "c3ebcec7-5b7d-40ad-8375-911427c94cbb") : secret "cluster-monitoring-operator-tls" not found
Jul 03 09:47:38.142992 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:38.142859    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9df3435e-f10d-4b2c-9007-6123c9baabb2-samples-operator-tls podName:9df3435e-f10d-4b2c-9007-6123c9baabb2 nodeName:}" failed. No retries permitted until 2026-07-03 09:47:40.142839373 +0000 UTC m=+261.013504983 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9df3435e-f10d-4b2c-9007-6123c9baabb2-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-fgclw" (UID: "9df3435e-f10d-4b2c-9007-6123c9baabb2") : secret "samples-operator-tls" not found
Jul 03 09:47:40.159793 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:40.159767    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9df3435e-f10d-4b2c-9007-6123c9baabb2-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fgclw\" (UID: \"9df3435e-f10d-4b2c-9007-6123c9baabb2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fgclw"
Jul 03 09:47:40.160166 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:40.159809    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3ebcec7-5b7d-40ad-8375-911427c94cbb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qg8dx\" (UID: \"c3ebcec7-5b7d-40ad-8375-911427c94cbb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8dx"
Jul 03 09:47:40.160166 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:40.160024    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 03 09:47:40.160166 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:40.160082    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3ebcec7-5b7d-40ad-8375-911427c94cbb-cluster-monitoring-operator-tls podName:c3ebcec7-5b7d-40ad-8375-911427c94cbb nodeName:}" failed. No retries permitted until 2026-07-03 09:47:44.16006227 +0000 UTC m=+265.030727878 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c3ebcec7-5b7d-40ad-8375-911427c94cbb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-qg8dx" (UID: "c3ebcec7-5b7d-40ad-8375-911427c94cbb") : secret "cluster-monitoring-operator-tls" not found
Jul 03 09:47:40.160482 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:40.160409    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 03 09:47:40.160482 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:40.160465    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9df3435e-f10d-4b2c-9007-6123c9baabb2-samples-operator-tls podName:9df3435e-f10d-4b2c-9007-6123c9baabb2 nodeName:}" failed. No retries permitted until 2026-07-03 09:47:44.160450633 +0000 UTC m=+265.031116259 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9df3435e-f10d-4b2c-9007-6123c9baabb2-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-fgclw" (UID: "9df3435e-f10d-4b2c-9007-6123c9baabb2") : secret "samples-operator-tls" not found
Jul 03 09:47:40.403821 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:40.403753    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c4mdt_9d052bc8-d41a-494c-9523-5bfdcfb29ec2/console-operator/0.log"
Jul 03 09:47:40.403821 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:40.403797    2559 generic.go:356] "Generic (PLEG): container finished" podID="9d052bc8-d41a-494c-9523-5bfdcfb29ec2" containerID="deb29fafca78a28418eaeab8e49e1dbce753b5682d653b9345a70328183bfb71" exitCode=255
Jul 03 09:47:40.404030 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:40.403886    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-c4mdt" event={"ID":"9d052bc8-d41a-494c-9523-5bfdcfb29ec2","Type":"ContainerDied","Data":"deb29fafca78a28418eaeab8e49e1dbce753b5682d653b9345a70328183bfb71"}
Jul 03 09:47:40.404127 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:40.404099    2559 scope.go:117] "RemoveContainer" containerID="deb29fafca78a28418eaeab8e49e1dbce753b5682d653b9345a70328183bfb71"
Jul 03 09:47:40.405462 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:40.405436    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-7jjl2" event={"ID":"3b40d22c-95af-41b3-a18e-d1cda05b4999","Type":"ContainerStarted","Data":"68fa8bcb2093392ef3ab96c10bc61fc59913c0c151e0f85d0d69ab17016cb76a"}
Jul 03 09:47:40.406913 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:40.406892    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tpwdg" event={"ID":"c80c9446-f8d7-4e4e-bdda-e0467cab85ed","Type":"ContainerStarted","Data":"c7fcd2fdb264491aa87a8d991ff946f73c15a20a8bd1f3aa092c9cf6e533fb39"}
Jul 03 09:47:40.413429 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:40.413410    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-qkmpr"]
Jul 03 09:47:40.416282 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:40.416269    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-qkmpr"
Jul 03 09:47:40.419201 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:40.419186    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 03 09:47:40.419515 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:40.419494    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-b7zw2\""
Jul 03 09:47:40.419639 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:40.419520    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 03 09:47:40.427938 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:40.427540    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-qkmpr"]
Jul 03 09:47:40.446642 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:40.446596    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-7jjl2" podStartSLOduration=1.294463938 podStartE2EDuration="4.446579975s" totalImagesPullingTime="3.152116037s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:47:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:47:40.44582293 +0000 UTC m=+261.316488583" watchObservedRunningTime="2026-07-03 09:47:40.446579975 +0000 UTC m=+261.317245604"
Jul 03 09:47:40.460975 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:40.460931    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tpwdg" podStartSLOduration=1.3183970999999999 podStartE2EDuration="4.460913397s" totalImagesPullingTime="3.142516297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:47:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:47:40.46013424 +0000 UTC m=+261.330799886" watchObservedRunningTime="2026-07-03 09:47:40.460913397 +0000 UTC m=+261.331579028"
Jul 03 09:47:40.462233 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:40.462214    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j7cs\" (UniqueName: \"kubernetes.io/projected/4859de3e-ece9-46d0-8db9-3b73d7075cd4-kube-api-access-9j7cs\") pod \"migrator-d57d58cc9-qkmpr\" (UID: \"4859de3e-ece9-46d0-8db9-3b73d7075cd4\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-qkmpr"
Jul 03 09:47:40.563099 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:40.563068    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j7cs\" (UniqueName: \"kubernetes.io/projected/4859de3e-ece9-46d0-8db9-3b73d7075cd4-kube-api-access-9j7cs\") pod \"migrator-d57d58cc9-qkmpr\" (UID: \"4859de3e-ece9-46d0-8db9-3b73d7075cd4\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-qkmpr"
Jul 03 09:47:40.572091 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:40.572060    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j7cs\" (UniqueName: \"kubernetes.io/projected/4859de3e-ece9-46d0-8db9-3b73d7075cd4-kube-api-access-9j7cs\") pod \"migrator-d57d58cc9-qkmpr\" (UID: \"4859de3e-ece9-46d0-8db9-3b73d7075cd4\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-qkmpr"
Jul 03 09:47:40.748069 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:40.748032    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-qkmpr"
Jul 03 09:47:40.873874 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:40.873846    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-qkmpr"]
Jul 03 09:47:40.877035 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:47:40.877007    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4859de3e_ece9_46d0_8db9_3b73d7075cd4.slice/crio-d97479566f8d524e94810c103f566ddb7b279d8735d7a65b1eba78cb1f202ca3 WatchSource:0}: Error finding container d97479566f8d524e94810c103f566ddb7b279d8735d7a65b1eba78cb1f202ca3: Status 404 returned error can't find the container with id d97479566f8d524e94810c103f566ddb7b279d8735d7a65b1eba78cb1f202ca3
Jul 03 09:47:41.411493 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:41.411467    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c4mdt_9d052bc8-d41a-494c-9523-5bfdcfb29ec2/console-operator/1.log"
Jul 03 09:47:41.411958 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:41.411900    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c4mdt_9d052bc8-d41a-494c-9523-5bfdcfb29ec2/console-operator/0.log"
Jul 03 09:47:41.411958 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:41.411940    2559 generic.go:356] "Generic (PLEG): container finished" podID="9d052bc8-d41a-494c-9523-5bfdcfb29ec2" containerID="ed5b45332c32b078f0e29cbac452afaa5572c9788998b7e10fc3af0ccec315aa" exitCode=255
Jul 03 09:47:41.412068 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:41.412026    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-c4mdt" event={"ID":"9d052bc8-d41a-494c-9523-5bfdcfb29ec2","Type":"ContainerDied","Data":"ed5b45332c32b078f0e29cbac452afaa5572c9788998b7e10fc3af0ccec315aa"}
Jul 03 09:47:41.412120 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:41.412078    2559 scope.go:117] "RemoveContainer" containerID="deb29fafca78a28418eaeab8e49e1dbce753b5682d653b9345a70328183bfb71"
Jul 03 09:47:41.412400 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:41.412378    2559 scope.go:117] "RemoveContainer" containerID="ed5b45332c32b078f0e29cbac452afaa5572c9788998b7e10fc3af0ccec315aa"
Jul 03 09:47:41.412629 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:41.412612    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-c4mdt_openshift-console-operator(9d052bc8-d41a-494c-9523-5bfdcfb29ec2)\"" pod="openshift-console-operator/console-operator-68b757fb67-c4mdt" podUID="9d052bc8-d41a-494c-9523-5bfdcfb29ec2"
Jul 03 09:47:41.413477 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:41.413140    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-qkmpr" event={"ID":"4859de3e-ece9-46d0-8db9-3b73d7075cd4","Type":"ContainerStarted","Data":"d97479566f8d524e94810c103f566ddb7b279d8735d7a65b1eba78cb1f202ca3"}
Jul 03 09:47:42.321457 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:42.321423    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4nbhr"]
Jul 03 09:47:42.324709 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:42.324686    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4nbhr"
Jul 03 09:47:42.327272 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:42.327195    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 03 09:47:42.327421 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:42.327298    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 03 09:47:42.328112 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:42.328090    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-c78n8\""
Jul 03 09:47:42.335979 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:42.335957    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4nbhr"]
Jul 03 09:47:42.380393 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:42.380365    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/08d5db5b-4963-4c26-95e6-e7a134a87299-crio-socket\") pod \"insights-runtime-extractor-4nbhr\" (UID: \"08d5db5b-4963-4c26-95e6-e7a134a87299\") " pod="openshift-insights/insights-runtime-extractor-4nbhr"
Jul 03 09:47:42.380504 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:42.380423    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/08d5db5b-4963-4c26-95e6-e7a134a87299-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4nbhr\" (UID: \"08d5db5b-4963-4c26-95e6-e7a134a87299\") " pod="openshift-insights/insights-runtime-extractor-4nbhr"
Jul 03 09:47:42.380504 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:42.380493    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7q2g\" (UniqueName: \"kubernetes.io/projected/08d5db5b-4963-4c26-95e6-e7a134a87299-kube-api-access-s7q2g\") pod \"insights-runtime-extractor-4nbhr\" (UID: \"08d5db5b-4963-4c26-95e6-e7a134a87299\") " pod="openshift-insights/insights-runtime-extractor-4nbhr"
Jul 03 09:47:42.380614 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:42.380520    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/08d5db5b-4963-4c26-95e6-e7a134a87299-data-volume\") pod \"insights-runtime-extractor-4nbhr\" (UID: \"08d5db5b-4963-4c26-95e6-e7a134a87299\") " pod="openshift-insights/insights-runtime-extractor-4nbhr"
Jul 03 09:47:42.380652 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:42.380619    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/08d5db5b-4963-4c26-95e6-e7a134a87299-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4nbhr\" (UID: \"08d5db5b-4963-4c26-95e6-e7a134a87299\") " pod="openshift-insights/insights-runtime-extractor-4nbhr"
Jul 03 09:47:42.420703 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:42.420674    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c4mdt_9d052bc8-d41a-494c-9523-5bfdcfb29ec2/console-operator/1.log"
Jul 03 09:47:42.421070 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:42.421031    2559 scope.go:117] "RemoveContainer" containerID="ed5b45332c32b078f0e29cbac452afaa5572c9788998b7e10fc3af0ccec315aa"
Jul 03 09:47:42.421302 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:42.421210    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-c4mdt_openshift-console-operator(9d052bc8-d41a-494c-9523-5bfdcfb29ec2)\"" pod="openshift-console-operator/console-operator-68b757fb67-c4mdt" podUID="9d052bc8-d41a-494c-9523-5bfdcfb29ec2"
Jul 03 09:47:42.422803 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:42.422772    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-qkmpr" event={"ID":"4859de3e-ece9-46d0-8db9-3b73d7075cd4","Type":"ContainerStarted","Data":"bd2b3bc0bd4dd1a7cf94320b498b6e45ed8d8492fd4227ca18a2c9330831819b"}
Jul 03 09:47:42.422892 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:42.422846    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-qkmpr" event={"ID":"4859de3e-ece9-46d0-8db9-3b73d7075cd4","Type":"ContainerStarted","Data":"f48f0e65ba373f425ae286c45c0f5cfb5143071c7980a3e0102db9d7990f7f01"}
Jul 03 09:47:42.455493 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:42.455451    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-qkmpr" podStartSLOduration=1.253950198 podStartE2EDuration="2.455436764s" totalImagesPullingTime="1.201486566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:47:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:47:42.455141657 +0000 UTC m=+263.325807280" watchObservedRunningTime="2026-07-03 09:47:42.455436764 +0000 UTC m=+263.326102393"
Jul 03 09:47:42.481913 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:42.481887    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/08d5db5b-4963-4c26-95e6-e7a134a87299-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4nbhr\" (UID: \"08d5db5b-4963-4c26-95e6-e7a134a87299\") " pod="openshift-insights/insights-runtime-extractor-4nbhr"
Jul 03 09:47:42.481988 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:42.481942    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7q2g\" (UniqueName: \"kubernetes.io/projected/08d5db5b-4963-4c26-95e6-e7a134a87299-kube-api-access-s7q2g\") pod \"insights-runtime-extractor-4nbhr\" (UID: \"08d5db5b-4963-4c26-95e6-e7a134a87299\") " pod="openshift-insights/insights-runtime-extractor-4nbhr"
Jul 03 09:47:42.482044 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:42.481987    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/08d5db5b-4963-4c26-95e6-e7a134a87299-data-volume\") pod \"insights-runtime-extractor-4nbhr\" (UID: \"08d5db5b-4963-4c26-95e6-e7a134a87299\") " pod="openshift-insights/insights-runtime-extractor-4nbhr"
Jul 03 09:47:42.482044 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:42.481999    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 03 09:47:42.482134 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:42.482058    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/08d5db5b-4963-4c26-95e6-e7a134a87299-kube-rbac-proxy-cm podName:08d5db5b-4963-4c26-95e6-e7a134a87299 nodeName:}" failed. No retries permitted until 2026-07-03 09:47:42.982044292 +0000 UTC m=+263.852709904 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/08d5db5b-4963-4c26-95e6-e7a134a87299-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4nbhr" (UID: "08d5db5b-4963-4c26-95e6-e7a134a87299") : configmap "kube-rbac-proxy" not found
Jul 03 09:47:42.482293 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:42.482276    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/08d5db5b-4963-4c26-95e6-e7a134a87299-data-volume\") pod \"insights-runtime-extractor-4nbhr\" (UID: \"08d5db5b-4963-4c26-95e6-e7a134a87299\") " pod="openshift-insights/insights-runtime-extractor-4nbhr"
Jul 03 09:47:42.482373 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:42.482355    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/08d5db5b-4963-4c26-95e6-e7a134a87299-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4nbhr\" (UID: \"08d5db5b-4963-4c26-95e6-e7a134a87299\") " pod="openshift-insights/insights-runtime-extractor-4nbhr"
Jul 03 09:47:42.482426 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:42.482394    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/08d5db5b-4963-4c26-95e6-e7a134a87299-crio-socket\") pod \"insights-runtime-extractor-4nbhr\" (UID: \"08d5db5b-4963-4c26-95e6-e7a134a87299\") " pod="openshift-insights/insights-runtime-extractor-4nbhr"
Jul 03 09:47:42.482474 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:42.482438    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 03 09:47:42.482474 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:42.482473    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08d5db5b-4963-4c26-95e6-e7a134a87299-insights-runtime-extractor-tls podName:08d5db5b-4963-4c26-95e6-e7a134a87299 nodeName:}" failed. No retries permitted until 2026-07-03 09:47:42.982462794 +0000 UTC m=+263.853128404 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/08d5db5b-4963-4c26-95e6-e7a134a87299-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4nbhr" (UID: "08d5db5b-4963-4c26-95e6-e7a134a87299") : secret "insights-runtime-extractor-tls" not found
Jul 03 09:47:42.482635 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:42.482490    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/08d5db5b-4963-4c26-95e6-e7a134a87299-crio-socket\") pod \"insights-runtime-extractor-4nbhr\" (UID: \"08d5db5b-4963-4c26-95e6-e7a134a87299\") " pod="openshift-insights/insights-runtime-extractor-4nbhr"
Jul 03 09:47:42.491144 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:42.491114    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7q2g\" (UniqueName: \"kubernetes.io/projected/08d5db5b-4963-4c26-95e6-e7a134a87299-kube-api-access-s7q2g\") pod \"insights-runtime-extractor-4nbhr\" (UID: \"08d5db5b-4963-4c26-95e6-e7a134a87299\") " pod="openshift-insights/insights-runtime-extractor-4nbhr"
Jul 03 09:47:42.985833 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:42.985797    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/08d5db5b-4963-4c26-95e6-e7a134a87299-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4nbhr\" (UID: \"08d5db5b-4963-4c26-95e6-e7a134a87299\") " pod="openshift-insights/insights-runtime-extractor-4nbhr"
Jul 03 09:47:42.985992 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:42.985850    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/08d5db5b-4963-4c26-95e6-e7a134a87299-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4nbhr\" (UID: \"08d5db5b-4963-4c26-95e6-e7a134a87299\") " pod="openshift-insights/insights-runtime-extractor-4nbhr"
Jul 03 09:47:42.985992 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:42.985914    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 03 09:47:42.985992 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:42.985948    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 03 09:47:42.985992 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:42.985968    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/08d5db5b-4963-4c26-95e6-e7a134a87299-kube-rbac-proxy-cm podName:08d5db5b-4963-4c26-95e6-e7a134a87299 nodeName:}" failed. No retries permitted until 2026-07-03 09:47:43.985949109 +0000 UTC m=+264.856614719 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/08d5db5b-4963-4c26-95e6-e7a134a87299-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4nbhr" (UID: "08d5db5b-4963-4c26-95e6-e7a134a87299") : configmap "kube-rbac-proxy" not found
Jul 03 09:47:42.986127 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:42.986023    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08d5db5b-4963-4c26-95e6-e7a134a87299-insights-runtime-extractor-tls podName:08d5db5b-4963-4c26-95e6-e7a134a87299 nodeName:}" failed. No retries permitted until 2026-07-03 09:47:43.986005398 +0000 UTC m=+264.856671004 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/08d5db5b-4963-4c26-95e6-e7a134a87299-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4nbhr" (UID: "08d5db5b-4963-4c26-95e6-e7a134a87299") : secret "insights-runtime-extractor-tls" not found
Jul 03 09:47:43.992669 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:43.992636    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/08d5db5b-4963-4c26-95e6-e7a134a87299-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4nbhr\" (UID: \"08d5db5b-4963-4c26-95e6-e7a134a87299\") " pod="openshift-insights/insights-runtime-extractor-4nbhr"
Jul 03 09:47:43.993023 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:43.992684    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/08d5db5b-4963-4c26-95e6-e7a134a87299-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4nbhr\" (UID: \"08d5db5b-4963-4c26-95e6-e7a134a87299\") " pod="openshift-insights/insights-runtime-extractor-4nbhr"
Jul 03 09:47:43.993023 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:43.992782    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 03 09:47:43.993023 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:43.992783    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 03 09:47:43.993023 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:43.992846    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08d5db5b-4963-4c26-95e6-e7a134a87299-insights-runtime-extractor-tls podName:08d5db5b-4963-4c26-95e6-e7a134a87299 nodeName:}" failed. No retries permitted until 2026-07-03 09:47:45.992829429 +0000 UTC m=+266.863495035 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/08d5db5b-4963-4c26-95e6-e7a134a87299-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4nbhr" (UID: "08d5db5b-4963-4c26-95e6-e7a134a87299") : secret "insights-runtime-extractor-tls" not found
Jul 03 09:47:43.993023 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:43.992860    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/08d5db5b-4963-4c26-95e6-e7a134a87299-kube-rbac-proxy-cm podName:08d5db5b-4963-4c26-95e6-e7a134a87299 nodeName:}" failed. No retries permitted until 2026-07-03 09:47:45.992854703 +0000 UTC m=+266.863520310 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/08d5db5b-4963-4c26-95e6-e7a134a87299-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4nbhr" (UID: "08d5db5b-4963-4c26-95e6-e7a134a87299") : configmap "kube-rbac-proxy" not found
Jul 03 09:47:44.193724 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:44.193691    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9df3435e-f10d-4b2c-9007-6123c9baabb2-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fgclw\" (UID: \"9df3435e-f10d-4b2c-9007-6123c9baabb2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fgclw"
Jul 03 09:47:44.193893 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:44.193753    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3ebcec7-5b7d-40ad-8375-911427c94cbb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qg8dx\" (UID: \"c3ebcec7-5b7d-40ad-8375-911427c94cbb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8dx"
Jul 03 09:47:44.193893 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:44.193834    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 03 09:47:44.193893 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:44.193839    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 03 09:47:44.193991 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:44.193898    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9df3435e-f10d-4b2c-9007-6123c9baabb2-samples-operator-tls podName:9df3435e-f10d-4b2c-9007-6123c9baabb2 nodeName:}" failed. No retries permitted until 2026-07-03 09:47:52.193883095 +0000 UTC m=+273.064548702 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9df3435e-f10d-4b2c-9007-6123c9baabb2-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-fgclw" (UID: "9df3435e-f10d-4b2c-9007-6123c9baabb2") : secret "samples-operator-tls" not found
Jul 03 09:47:44.193991 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:44.193911    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3ebcec7-5b7d-40ad-8375-911427c94cbb-cluster-monitoring-operator-tls podName:c3ebcec7-5b7d-40ad-8375-911427c94cbb nodeName:}" failed. No retries permitted until 2026-07-03 09:47:52.193905563 +0000 UTC m=+273.064571169 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c3ebcec7-5b7d-40ad-8375-911427c94cbb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-qg8dx" (UID: "c3ebcec7-5b7d-40ad-8375-911427c94cbb") : secret "cluster-monitoring-operator-tls" not found
Jul 03 09:47:45.115100 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:45.115069    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nx222_7ad0ecde-3110-4f76-8c0e-f296a67153e8/dns-node-resolver/0.log"
Jul 03 09:47:46.007193 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:46.007145    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/08d5db5b-4963-4c26-95e6-e7a134a87299-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4nbhr\" (UID: \"08d5db5b-4963-4c26-95e6-e7a134a87299\") " pod="openshift-insights/insights-runtime-extractor-4nbhr"
Jul 03 09:47:46.007343 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:46.007218    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/08d5db5b-4963-4c26-95e6-e7a134a87299-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4nbhr\" (UID: \"08d5db5b-4963-4c26-95e6-e7a134a87299\") " pod="openshift-insights/insights-runtime-extractor-4nbhr"
Jul 03 09:47:46.007343 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:46.007304    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 03 09:47:46.007343 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:46.007335    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 03 09:47:46.007453 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:46.007365    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08d5db5b-4963-4c26-95e6-e7a134a87299-insights-runtime-extractor-tls podName:08d5db5b-4963-4c26-95e6-e7a134a87299 nodeName:}" failed. No retries permitted until 2026-07-03 09:47:50.007348916 +0000 UTC m=+270.878014523 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/08d5db5b-4963-4c26-95e6-e7a134a87299-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4nbhr" (UID: "08d5db5b-4963-4c26-95e6-e7a134a87299") : secret "insights-runtime-extractor-tls" not found
Jul 03 09:47:46.007453 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:46.007385    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/08d5db5b-4963-4c26-95e6-e7a134a87299-kube-rbac-proxy-cm podName:08d5db5b-4963-4c26-95e6-e7a134a87299 nodeName:}" failed. No retries permitted until 2026-07-03 09:47:50.007372011 +0000 UTC m=+270.878037618 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/08d5db5b-4963-4c26-95e6-e7a134a87299-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4nbhr" (UID: "08d5db5b-4963-4c26-95e6-e7a134a87299") : configmap "kube-rbac-proxy" not found
Jul 03 09:47:46.315304 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:46.315236    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xljb6_b8d41b5d-027e-4958-bf3e-422ce5ba511c/node-ca/0.log"
Jul 03 09:47:46.714062 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:46.714035    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-b7g2w_66226c20-f210-473d-854b-b6c369884a01/serve-healthcheck-canary/0.log"
Jul 03 09:47:46.761946 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:46.761921    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-c4mdt"
Jul 03 09:47:46.762068 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:46.761974    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-c4mdt"
Jul 03 09:47:46.762265 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:46.762254    2559 scope.go:117] "RemoveContainer" containerID="ed5b45332c32b078f0e29cbac452afaa5572c9788998b7e10fc3af0ccec315aa"
Jul 03 09:47:46.762408 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:46.762390    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-c4mdt_openshift-console-operator(9d052bc8-d41a-494c-9523-5bfdcfb29ec2)\"" pod="openshift-console-operator/console-operator-68b757fb67-c4mdt" podUID="9d052bc8-d41a-494c-9523-5bfdcfb29ec2"
Jul 03 09:47:47.316659 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:47.316628    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-qkmpr_4859de3e-ece9-46d0-8db9-3b73d7075cd4/migrator/0.log"
Jul 03 09:47:47.519380 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:47.519346    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-qkmpr_4859de3e-ece9-46d0-8db9-3b73d7075cd4/graceful-termination/0.log"
Jul 03 09:47:50.036144 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:50.036103    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/08d5db5b-4963-4c26-95e6-e7a134a87299-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4nbhr\" (UID: \"08d5db5b-4963-4c26-95e6-e7a134a87299\") " pod="openshift-insights/insights-runtime-extractor-4nbhr"
Jul 03 09:47:50.036515 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:50.036173    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/08d5db5b-4963-4c26-95e6-e7a134a87299-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4nbhr\" (UID: \"08d5db5b-4963-4c26-95e6-e7a134a87299\") " pod="openshift-insights/insights-runtime-extractor-4nbhr"
Jul 03 09:47:50.036515 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:50.036257    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 03 09:47:50.036515 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:50.036333    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08d5db5b-4963-4c26-95e6-e7a134a87299-insights-runtime-extractor-tls podName:08d5db5b-4963-4c26-95e6-e7a134a87299 nodeName:}" failed. No retries permitted until 2026-07-03 09:47:58.0363159 +0000 UTC m=+278.906981509 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/08d5db5b-4963-4c26-95e6-e7a134a87299-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4nbhr" (UID: "08d5db5b-4963-4c26-95e6-e7a134a87299") : secret "insights-runtime-extractor-tls" not found
Jul 03 09:47:50.036741 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:50.036711    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/08d5db5b-4963-4c26-95e6-e7a134a87299-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4nbhr\" (UID: \"08d5db5b-4963-4c26-95e6-e7a134a87299\") " pod="openshift-insights/insights-runtime-extractor-4nbhr"
Jul 03 09:47:52.251650 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:52.251617    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9df3435e-f10d-4b2c-9007-6123c9baabb2-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fgclw\" (UID: \"9df3435e-f10d-4b2c-9007-6123c9baabb2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fgclw"
Jul 03 09:47:52.252217 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:52.251675    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3ebcec7-5b7d-40ad-8375-911427c94cbb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qg8dx\" (UID: \"c3ebcec7-5b7d-40ad-8375-911427c94cbb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8dx"
Jul 03 09:47:52.252217 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:52.251774    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 03 09:47:52.252217 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:47:52.251825    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3ebcec7-5b7d-40ad-8375-911427c94cbb-cluster-monitoring-operator-tls podName:c3ebcec7-5b7d-40ad-8375-911427c94cbb nodeName:}" failed. No retries permitted until 2026-07-03 09:48:08.251812032 +0000 UTC m=+289.122477640 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c3ebcec7-5b7d-40ad-8375-911427c94cbb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-qg8dx" (UID: "c3ebcec7-5b7d-40ad-8375-911427c94cbb") : secret "cluster-monitoring-operator-tls" not found
Jul 03 09:47:52.254250 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:52.254223    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9df3435e-f10d-4b2c-9007-6123c9baabb2-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-fgclw\" (UID: \"9df3435e-f10d-4b2c-9007-6123c9baabb2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fgclw"
Jul 03 09:47:52.374580 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:52.374528    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fgclw"
Jul 03 09:47:52.501743 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:52.501592    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fgclw"]
Jul 03 09:47:53.458650 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:53.458611    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fgclw" event={"ID":"9df3435e-f10d-4b2c-9007-6123c9baabb2","Type":"ContainerStarted","Data":"eced6da5adbaef23929f9fd6c62c3ad7ff975922521cef22e48e355dc6e2e88f"}
Jul 03 09:47:54.463608 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:54.463578    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fgclw" event={"ID":"9df3435e-f10d-4b2c-9007-6123c9baabb2","Type":"ContainerStarted","Data":"04593c225b0ad1ec2b01f403961f6b83873b34fb756eec76530e35b31e0f8265"}
Jul 03 09:47:54.464053 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:54.463639    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fgclw" event={"ID":"9df3435e-f10d-4b2c-9007-6123c9baabb2","Type":"ContainerStarted","Data":"a53050782be77707dd180e6b7db28bf8b437d06af13521280ad20cc370ea217e"}
Jul 03 09:47:54.482097 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:54.482058    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-fgclw" podStartSLOduration=16.859427246 podStartE2EDuration="18.482044782s" totalImagesPullingTime="1.622617536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:47:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:47:54.48188642 +0000 UTC m=+275.352552051" watchObservedRunningTime="2026-07-03 09:47:54.482044782 +0000 UTC m=+275.352710410"
Jul 03 09:47:58.098457 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:58.098421    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/08d5db5b-4963-4c26-95e6-e7a134a87299-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4nbhr\" (UID: \"08d5db5b-4963-4c26-95e6-e7a134a87299\") " pod="openshift-insights/insights-runtime-extractor-4nbhr"
Jul 03 09:47:58.100843 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:58.100812    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/08d5db5b-4963-4c26-95e6-e7a134a87299-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4nbhr\" (UID: \"08d5db5b-4963-4c26-95e6-e7a134a87299\") " pod="openshift-insights/insights-runtime-extractor-4nbhr"
Jul 03 09:47:58.233993 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:58.233964    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4nbhr"
Jul 03 09:47:58.355295 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:58.355214    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4nbhr"]
Jul 03 09:47:58.358029 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:47:58.357993    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08d5db5b_4963_4c26_95e6_e7a134a87299.slice/crio-6133b17a4ef328f891e61e293c6e2d9f3a9ab3eb7bf185f9036dab3d07f6345c WatchSource:0}: Error finding container 6133b17a4ef328f891e61e293c6e2d9f3a9ab3eb7bf185f9036dab3d07f6345c: Status 404 returned error can't find the container with id 6133b17a4ef328f891e61e293c6e2d9f3a9ab3eb7bf185f9036dab3d07f6345c
Jul 03 09:47:58.477286 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:58.477255    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4nbhr" event={"ID":"08d5db5b-4963-4c26-95e6-e7a134a87299","Type":"ContainerStarted","Data":"6133b17a4ef328f891e61e293c6e2d9f3a9ab3eb7bf185f9036dab3d07f6345c"}
Jul 03 09:47:59.687030 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:47:59.686997    2559 scope.go:117] "RemoveContainer" containerID="ed5b45332c32b078f0e29cbac452afaa5572c9788998b7e10fc3af0ccec315aa"
Jul 03 09:48:00.487069 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:00.487031    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c4mdt_9d052bc8-d41a-494c-9523-5bfdcfb29ec2/console-operator/1.log"
Jul 03 09:48:00.487258 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:00.487131    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-c4mdt" event={"ID":"9d052bc8-d41a-494c-9523-5bfdcfb29ec2","Type":"ContainerStarted","Data":"5b34eadeb5fc60665351b0581b39dafd2bfb8392d0ca86679e51e62c8d461bc6"}
Jul 03 09:48:00.488069 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:00.488045    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-c4mdt"
Jul 03 09:48:00.489678 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:00.489639    2559 patch_prober.go:28] interesting pod/console-operator-68b757fb67-c4mdt container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.134.0.9:8443/readyz\": dial tcp 10.134.0.9:8443: connect: connection refused" start-of-body=
Jul 03 09:48:00.489794 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:00.489704    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-68b757fb67-c4mdt" podUID="9d052bc8-d41a-494c-9523-5bfdcfb29ec2" containerName="console-operator" probeResult="failure" output="Get \"https://10.134.0.9:8443/readyz\": dial tcp 10.134.0.9:8443: connect: connection refused"
Jul 03 09:48:00.505799 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:00.505752    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-c4mdt" podStartSLOduration=21.253040108 podStartE2EDuration="24.505738848s" totalImagesPullingTime="3.25269874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:47:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:48:00.503710535 +0000 UTC m=+281.374376181" watchObservedRunningTime="2026-07-03 09:48:00.505738848 +0000 UTC m=+281.376404476"
Jul 03 09:48:01.155505 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:48:01.155463    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vq4dk" podUID="0f15a368-feb7-4b3d-829a-d49e7474445b"
Jul 03 09:48:01.490771 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:01.490737    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vq4dk"
Jul 03 09:48:01.491275 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:01.491243    2559 patch_prober.go:28] interesting pod/console-operator-68b757fb67-c4mdt container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.134.0.9:8443/readyz\": dial tcp 10.134.0.9:8443: connect: connection refused" start-of-body=
Jul 03 09:48:01.491397 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:01.491300    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-68b757fb67-c4mdt" podUID="9d052bc8-d41a-494c-9523-5bfdcfb29ec2" containerName="console-operator" probeResult="failure" output="Get \"https://10.134.0.9:8443/readyz\": dial tcp 10.134.0.9:8443: connect: connection refused"
Jul 03 09:48:02.496169 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:02.496133    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4nbhr" event={"ID":"08d5db5b-4963-4c26-95e6-e7a134a87299","Type":"ContainerStarted","Data":"24c91b6698ff66de4cb1a95cf7361ae6df42cbcd90f7428c405af929abf5a1b2"}
Jul 03 09:48:02.497952 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:02.497928    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c4mdt_9d052bc8-d41a-494c-9523-5bfdcfb29ec2/console-operator/2.log"
Jul 03 09:48:02.498382 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:02.498361    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c4mdt_9d052bc8-d41a-494c-9523-5bfdcfb29ec2/console-operator/1.log"
Jul 03 09:48:02.498515 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:02.498402    2559 generic.go:356] "Generic (PLEG): container finished" podID="9d052bc8-d41a-494c-9523-5bfdcfb29ec2" containerID="5b34eadeb5fc60665351b0581b39dafd2bfb8392d0ca86679e51e62c8d461bc6" exitCode=255
Jul 03 09:48:02.498515 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:02.498437    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-c4mdt" event={"ID":"9d052bc8-d41a-494c-9523-5bfdcfb29ec2","Type":"ContainerDied","Data":"5b34eadeb5fc60665351b0581b39dafd2bfb8392d0ca86679e51e62c8d461bc6"}
Jul 03 09:48:02.498515 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:02.498496    2559 scope.go:117] "RemoveContainer" containerID="ed5b45332c32b078f0e29cbac452afaa5572c9788998b7e10fc3af0ccec315aa"
Jul 03 09:48:02.498914 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:02.498898    2559 scope.go:117] "RemoveContainer" containerID="5b34eadeb5fc60665351b0581b39dafd2bfb8392d0ca86679e51e62c8d461bc6"
Jul 03 09:48:02.499106 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:48:02.499083    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-c4mdt_openshift-console-operator(9d052bc8-d41a-494c-9523-5bfdcfb29ec2)\"" pod="openshift-console-operator/console-operator-68b757fb67-c4mdt" podUID="9d052bc8-d41a-494c-9523-5bfdcfb29ec2"
Jul 03 09:48:03.503077 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:03.503053    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c4mdt_9d052bc8-d41a-494c-9523-5bfdcfb29ec2/console-operator/2.log"
Jul 03 09:48:03.504568 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:03.504531    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4nbhr" event={"ID":"08d5db5b-4963-4c26-95e6-e7a134a87299","Type":"ContainerStarted","Data":"2735886e2c998604356190cb39dae5d7adfc95d9e736d47d170eca0b21174a67"}
Jul 03 09:48:04.853477 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:04.853436    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f15a368-feb7-4b3d-829a-d49e7474445b-metrics-tls\") pod \"dns-default-vq4dk\" (UID: \"0f15a368-feb7-4b3d-829a-d49e7474445b\") " pod="openshift-dns/dns-default-vq4dk"
Jul 03 09:48:04.855935 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:04.855912    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0f15a368-feb7-4b3d-829a-d49e7474445b-metrics-tls\") pod \"dns-default-vq4dk\" (UID: \"0f15a368-feb7-4b3d-829a-d49e7474445b\") " pod="openshift-dns/dns-default-vq4dk"
Jul 03 09:48:05.094518 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:05.094480    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7ckvl\""
Jul 03 09:48:05.102603 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:05.102577    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vq4dk"
Jul 03 09:48:05.490983 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:05.490961    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vq4dk"]
Jul 03 09:48:05.493857 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:48:05.493824    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f15a368_feb7_4b3d_829a_d49e7474445b.slice/crio-8a8777cf9b528e1d6979bc9af7794bd8a4a45fb9bd3f647ff63f74f1330da500 WatchSource:0}: Error finding container 8a8777cf9b528e1d6979bc9af7794bd8a4a45fb9bd3f647ff63f74f1330da500: Status 404 returned error can't find the container with id 8a8777cf9b528e1d6979bc9af7794bd8a4a45fb9bd3f647ff63f74f1330da500
Jul 03 09:48:05.510913 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:05.510889    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vq4dk" event={"ID":"0f15a368-feb7-4b3d-829a-d49e7474445b","Type":"ContainerStarted","Data":"8a8777cf9b528e1d6979bc9af7794bd8a4a45fb9bd3f647ff63f74f1330da500"}
Jul 03 09:48:05.512728 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:05.512703    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4nbhr" event={"ID":"08d5db5b-4963-4c26-95e6-e7a134a87299","Type":"ContainerStarted","Data":"2a8346d1002b31cd4c2d913cbb4354ae0a777db80a95533c06eda0f7aebc60a0"}
Jul 03 09:48:05.532981 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:05.532934    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4nbhr" podStartSLOduration=16.580625862 podStartE2EDuration="23.532921599s" totalImagesPullingTime="6.952295737s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 09:47:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:48:05.531476311 +0000 UTC m=+286.402141953" watchObservedRunningTime="2026-07-03 09:48:05.532921599 +0000 UTC m=+286.403587228"
Jul 03 09:48:06.762038 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:06.762003    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-c4mdt"
Jul 03 09:48:06.762505 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:06.762467    2559 scope.go:117] "RemoveContainer" containerID="5b34eadeb5fc60665351b0581b39dafd2bfb8392d0ca86679e51e62c8d461bc6"
Jul 03 09:48:06.762698 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:48:06.762674    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-c4mdt_openshift-console-operator(9d052bc8-d41a-494c-9523-5bfdcfb29ec2)\"" pod="openshift-console-operator/console-operator-68b757fb67-c4mdt" podUID="9d052bc8-d41a-494c-9523-5bfdcfb29ec2"
Jul 03 09:48:07.521038 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:07.521009    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vq4dk" event={"ID":"0f15a368-feb7-4b3d-829a-d49e7474445b","Type":"ContainerStarted","Data":"4d53634f8e0a6f30137894d31056fe4896f252126b5a4116d1d85321d452c615"}
Jul 03 09:48:07.521188 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:07.521064    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vq4dk" event={"ID":"0f15a368-feb7-4b3d-829a-d49e7474445b","Type":"ContainerStarted","Data":"57c7300d54f02b36f98f765aabb60b1d3e2f4b6e6867d20e2b5afb4c8ea90e78"}
Jul 03 09:48:07.521188 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:07.521146    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vq4dk"
Jul 03 09:48:07.540002 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:07.539957    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vq4dk" podStartSLOduration=252.118837312 podStartE2EDuration="4m13.539941848s" totalImagesPullingTime="1.421104536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:43:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:48:07.538430269 +0000 UTC m=+288.409095897" watchObservedRunningTime="2026-07-03 09:48:07.539941848 +0000 UTC m=+288.410607515"
Jul 03 09:48:07.959403 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:07.959366    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-58f58d4cf8-slxhx"]
Jul 03 09:48:07.963518 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:07.963501    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58f58d4cf8-slxhx"
Jul 03 09:48:07.966218 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:07.966196    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 03 09:48:07.966355 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:07.966335    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 03 09:48:07.966455 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:07.966443    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 03 09:48:07.967428 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:07.967401    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7jhcf\""
Jul 03 09:48:07.971594 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:07.971576    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 03 09:48:07.984691 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:07.984670    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58f58d4cf8-slxhx"]
Jul 03 09:48:08.077868 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:08.077840    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a52d0d8d-584b-4b2e-95b3-59986aef8d4e-bound-sa-token\") pod \"image-registry-58f58d4cf8-slxhx\" (UID: \"a52d0d8d-584b-4b2e-95b3-59986aef8d4e\") " pod="openshift-image-registry/image-registry-58f58d4cf8-slxhx"
Jul 03 09:48:08.078034 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:08.077875    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a52d0d8d-584b-4b2e-95b3-59986aef8d4e-image-registry-private-configuration\") pod \"image-registry-58f58d4cf8-slxhx\" (UID: \"a52d0d8d-584b-4b2e-95b3-59986aef8d4e\") " pod="openshift-image-registry/image-registry-58f58d4cf8-slxhx"
Jul 03 09:48:08.078034 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:08.077918    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a52d0d8d-584b-4b2e-95b3-59986aef8d4e-registry-certificates\") pod \"image-registry-58f58d4cf8-slxhx\" (UID: \"a52d0d8d-584b-4b2e-95b3-59986aef8d4e\") " pod="openshift-image-registry/image-registry-58f58d4cf8-slxhx"
Jul 03 09:48:08.078034 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:08.077945    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a52d0d8d-584b-4b2e-95b3-59986aef8d4e-registry-tls\") pod \"image-registry-58f58d4cf8-slxhx\" (UID: \"a52d0d8d-584b-4b2e-95b3-59986aef8d4e\") " pod="openshift-image-registry/image-registry-58f58d4cf8-slxhx"
Jul 03 09:48:08.078034 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:08.077961    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a52d0d8d-584b-4b2e-95b3-59986aef8d4e-ca-trust-extracted\") pod \"image-registry-58f58d4cf8-slxhx\" (UID: \"a52d0d8d-584b-4b2e-95b3-59986aef8d4e\") " pod="openshift-image-registry/image-registry-58f58d4cf8-slxhx"
Jul 03 09:48:08.078034 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:08.077978    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a52d0d8d-584b-4b2e-95b3-59986aef8d4e-trusted-ca\") pod \"image-registry-58f58d4cf8-slxhx\" (UID: \"a52d0d8d-584b-4b2e-95b3-59986aef8d4e\") " pod="openshift-image-registry/image-registry-58f58d4cf8-slxhx"
Jul 03 09:48:08.078034 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:08.078014    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k2f2\" (UniqueName: \"kubernetes.io/projected/a52d0d8d-584b-4b2e-95b3-59986aef8d4e-kube-api-access-4k2f2\") pod \"image-registry-58f58d4cf8-slxhx\" (UID: \"a52d0d8d-584b-4b2e-95b3-59986aef8d4e\") " pod="openshift-image-registry/image-registry-58f58d4cf8-slxhx"
Jul 03 09:48:08.078213 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:08.078050    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a52d0d8d-584b-4b2e-95b3-59986aef8d4e-installation-pull-secrets\") pod \"image-registry-58f58d4cf8-slxhx\" (UID: \"a52d0d8d-584b-4b2e-95b3-59986aef8d4e\") " pod="openshift-image-registry/image-registry-58f58d4cf8-slxhx"
Jul 03 09:48:08.178708 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:08.178675    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a52d0d8d-584b-4b2e-95b3-59986aef8d4e-image-registry-private-configuration\") pod \"image-registry-58f58d4cf8-slxhx\" (UID: \"a52d0d8d-584b-4b2e-95b3-59986aef8d4e\") " pod="openshift-image-registry/image-registry-58f58d4cf8-slxhx"
Jul 03 09:48:08.178879 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:08.178727    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a52d0d8d-584b-4b2e-95b3-59986aef8d4e-registry-certificates\") pod \"image-registry-58f58d4cf8-slxhx\" (UID: \"a52d0d8d-584b-4b2e-95b3-59986aef8d4e\") " pod="openshift-image-registry/image-registry-58f58d4cf8-slxhx"
Jul 03 09:48:08.178879 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:08.178756    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a52d0d8d-584b-4b2e-95b3-59986aef8d4e-registry-tls\") pod \"image-registry-58f58d4cf8-slxhx\" (UID: \"a52d0d8d-584b-4b2e-95b3-59986aef8d4e\") " pod="openshift-image-registry/image-registry-58f58d4cf8-slxhx"
Jul 03 09:48:08.178879 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:08.178777    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a52d0d8d-584b-4b2e-95b3-59986aef8d4e-ca-trust-extracted\") pod \"image-registry-58f58d4cf8-slxhx\" (UID: \"a52d0d8d-584b-4b2e-95b3-59986aef8d4e\") " pod="openshift-image-registry/image-registry-58f58d4cf8-slxhx"
Jul 03 09:48:08.178879 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:08.178804    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a52d0d8d-584b-4b2e-95b3-59986aef8d4e-trusted-ca\") pod \"image-registry-58f58d4cf8-slxhx\" (UID: \"a52d0d8d-584b-4b2e-95b3-59986aef8d4e\") " pod="openshift-image-registry/image-registry-58f58d4cf8-slxhx"
Jul 03 09:48:08.178879 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:08.178842    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k2f2\" (UniqueName: \"kubernetes.io/projected/a52d0d8d-584b-4b2e-95b3-59986aef8d4e-kube-api-access-4k2f2\") pod \"image-registry-58f58d4cf8-slxhx\" (UID: \"a52d0d8d-584b-4b2e-95b3-59986aef8d4e\") " pod="openshift-image-registry/image-registry-58f58d4cf8-slxhx"
Jul 03 09:48:08.178879 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:08.178879    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a52d0d8d-584b-4b2e-95b3-59986aef8d4e-installation-pull-secrets\") pod \"image-registry-58f58d4cf8-slxhx\" (UID: \"a52d0d8d-584b-4b2e-95b3-59986aef8d4e\") " pod="openshift-image-registry/image-registry-58f58d4cf8-slxhx"
Jul 03 09:48:08.179152 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:08.178928    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a52d0d8d-584b-4b2e-95b3-59986aef8d4e-bound-sa-token\") pod \"image-registry-58f58d4cf8-slxhx\" (UID: \"a52d0d8d-584b-4b2e-95b3-59986aef8d4e\") " pod="openshift-image-registry/image-registry-58f58d4cf8-slxhx"
Jul 03 09:48:08.179397 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:08.179371    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a52d0d8d-584b-4b2e-95b3-59986aef8d4e-ca-trust-extracted\") pod \"image-registry-58f58d4cf8-slxhx\" (UID: \"a52d0d8d-584b-4b2e-95b3-59986aef8d4e\") " pod="openshift-image-registry/image-registry-58f58d4cf8-slxhx"
Jul 03 09:48:08.179750 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:08.179732    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a52d0d8d-584b-4b2e-95b3-59986aef8d4e-registry-certificates\") pod \"image-registry-58f58d4cf8-slxhx\" (UID: \"a52d0d8d-584b-4b2e-95b3-59986aef8d4e\") " pod="openshift-image-registry/image-registry-58f58d4cf8-slxhx"
Jul 03 09:48:08.180255 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:08.180200    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a52d0d8d-584b-4b2e-95b3-59986aef8d4e-trusted-ca\") pod \"image-registry-58f58d4cf8-slxhx\" (UID: \"a52d0d8d-584b-4b2e-95b3-59986aef8d4e\") " pod="openshift-image-registry/image-registry-58f58d4cf8-slxhx"
Jul 03 09:48:08.181614 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:08.181596    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a52d0d8d-584b-4b2e-95b3-59986aef8d4e-registry-tls\") pod \"image-registry-58f58d4cf8-slxhx\" (UID: \"a52d0d8d-584b-4b2e-95b3-59986aef8d4e\") " pod="openshift-image-registry/image-registry-58f58d4cf8-slxhx"
Jul 03 09:48:08.181841 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:08.181823    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a52d0d8d-584b-4b2e-95b3-59986aef8d4e-installation-pull-secrets\") pod \"image-registry-58f58d4cf8-slxhx\" (UID: \"a52d0d8d-584b-4b2e-95b3-59986aef8d4e\") " pod="openshift-image-registry/image-registry-58f58d4cf8-slxhx"
Jul 03 09:48:08.181879 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:08.181863    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a52d0d8d-584b-4b2e-95b3-59986aef8d4e-image-registry-private-configuration\") pod \"image-registry-58f58d4cf8-slxhx\" (UID: \"a52d0d8d-584b-4b2e-95b3-59986aef8d4e\") " pod="openshift-image-registry/image-registry-58f58d4cf8-slxhx"
Jul 03 09:48:08.187713 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:08.187692    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a52d0d8d-584b-4b2e-95b3-59986aef8d4e-bound-sa-token\") pod \"image-registry-58f58d4cf8-slxhx\" (UID: \"a52d0d8d-584b-4b2e-95b3-59986aef8d4e\") " pod="openshift-image-registry/image-registry-58f58d4cf8-slxhx"
Jul 03 09:48:08.188444 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:08.188421    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k2f2\" (UniqueName: \"kubernetes.io/projected/a52d0d8d-584b-4b2e-95b3-59986aef8d4e-kube-api-access-4k2f2\") pod \"image-registry-58f58d4cf8-slxhx\" (UID: \"a52d0d8d-584b-4b2e-95b3-59986aef8d4e\") " pod="openshift-image-registry/image-registry-58f58d4cf8-slxhx"
Jul 03 09:48:08.273776 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:08.273699    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58f58d4cf8-slxhx"
Jul 03 09:48:08.280017 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:08.279996    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3ebcec7-5b7d-40ad-8375-911427c94cbb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qg8dx\" (UID: \"c3ebcec7-5b7d-40ad-8375-911427c94cbb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8dx"
Jul 03 09:48:08.282371 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:08.282345    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3ebcec7-5b7d-40ad-8375-911427c94cbb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-qg8dx\" (UID: \"c3ebcec7-5b7d-40ad-8375-911427c94cbb\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8dx"
Jul 03 09:48:08.416872 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:08.416849    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58f58d4cf8-slxhx"]
Jul 03 09:48:08.419344 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:48:08.419318    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda52d0d8d_584b_4b2e_95b3_59986aef8d4e.slice/crio-6e9dc9129639a1f6e4d4e8a992ea38c008307761447e712b5daffd52a9ffd108 WatchSource:0}: Error finding container 6e9dc9129639a1f6e4d4e8a992ea38c008307761447e712b5daffd52a9ffd108: Status 404 returned error can't find the container with id 6e9dc9129639a1f6e4d4e8a992ea38c008307761447e712b5daffd52a9ffd108
Jul 03 09:48:08.528734 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:08.528645    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58f58d4cf8-slxhx" event={"ID":"a52d0d8d-584b-4b2e-95b3-59986aef8d4e","Type":"ContainerStarted","Data":"b8090ecf13bb257d3b084c9680bd642c747bf6c28ba2542969b128873bce62f9"}
Jul 03 09:48:08.528734 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:08.528705    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58f58d4cf8-slxhx" event={"ID":"a52d0d8d-584b-4b2e-95b3-59986aef8d4e","Type":"ContainerStarted","Data":"6e9dc9129639a1f6e4d4e8a992ea38c008307761447e712b5daffd52a9ffd108"}
Jul 03 09:48:08.548751 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:08.548700    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-58f58d4cf8-slxhx" podStartSLOduration=1.5486856530000002 podStartE2EDuration="1.548685653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:48:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:48:08.54783715 +0000 UTC m=+289.418502789" watchObservedRunningTime="2026-07-03 09:48:08.548685653 +0000 UTC m=+289.419351281"
Jul 03 09:48:08.568124 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:08.568089    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8dx"
Jul 03 09:48:08.692398 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:08.692355    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8dx"]
Jul 03 09:48:08.695197 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:48:08.695170    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3ebcec7_5b7d_40ad_8375_911427c94cbb.slice/crio-971817d0b83e7d5847c4f8e11b587c8a98ad5e00ace25bd2c9b7edb03ecc54a2 WatchSource:0}: Error finding container 971817d0b83e7d5847c4f8e11b587c8a98ad5e00ace25bd2c9b7edb03ecc54a2: Status 404 returned error can't find the container with id 971817d0b83e7d5847c4f8e11b587c8a98ad5e00ace25bd2c9b7edb03ecc54a2
Jul 03 09:48:09.533371 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:09.533328    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8dx" event={"ID":"c3ebcec7-5b7d-40ad-8375-911427c94cbb","Type":"ContainerStarted","Data":"971817d0b83e7d5847c4f8e11b587c8a98ad5e00ace25bd2c9b7edb03ecc54a2"}
Jul 03 09:48:09.533840 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:09.533540    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-58f58d4cf8-slxhx"
Jul 03 09:48:11.541581 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:11.541527    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8dx" event={"ID":"c3ebcec7-5b7d-40ad-8375-911427c94cbb","Type":"ContainerStarted","Data":"9a85b34abd6395a169d60234796957a6ded3237565b2771f8a3bc32d94e47419"}
Jul 03 09:48:11.557219 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:11.557171    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-qg8dx" podStartSLOduration=33.690904868 podStartE2EDuration="35.557157974s" totalImagesPullingTime="1.866253106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:47:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:48:11.557032551 +0000 UTC m=+292.427698187" watchObservedRunningTime="2026-07-03 09:48:11.557157974 +0000 UTC m=+292.427823649"
Jul 03 09:48:15.686775 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:48:15.686737    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-grmvl" podUID="65bd85a9-57d3-4ff1-bae1-9f3727371a28"
Jul 03 09:48:17.530507 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:17.530481    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vq4dk"
Jul 03 09:48:17.685391 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:17.685364    2559 scope.go:117] "RemoveContainer" containerID="5b34eadeb5fc60665351b0581b39dafd2bfb8392d0ca86679e51e62c8d461bc6"
Jul 03 09:48:17.685571 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:48:17.685531    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-c4mdt_openshift-console-operator(9d052bc8-d41a-494c-9523-5bfdcfb29ec2)\"" pod="openshift-console-operator/console-operator-68b757fb67-c4mdt" podUID="9d052bc8-d41a-494c-9523-5bfdcfb29ec2"
Jul 03 09:48:18.466150 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.466115    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-shhkl"]
Jul 03 09:48:18.469417 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.469400    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-r724b"]
Jul 03 09:48:18.469535 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.469518    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-shhkl"
Jul 03 09:48:18.471559 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.471531    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r724b"
Jul 03 09:48:18.472000 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.471980    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 03 09:48:18.472100 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.472017    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 03 09:48:18.472100 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.472028    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 03 09:48:18.472298 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.472285    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-xlvzj\""
Jul 03 09:48:18.473099 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.473084    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 03 09:48:18.475639 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.475615    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 03 09:48:18.475639 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.475629    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 03 09:48:18.475791 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.475629    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-w64h7\""
Jul 03 09:48:18.475905 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.475881    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 03 09:48:18.484000 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.483978    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-shhkl"]
Jul 03 09:48:18.560839 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.560811    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6d1f52c3-ee41-4420-84bb-0b168082e3e7-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-shhkl\" (UID: \"6d1f52c3-ee41-4420-84bb-0b168082e3e7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-shhkl"
Jul 03 09:48:18.561247 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.560847    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d1f52c3-ee41-4420-84bb-0b168082e3e7-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-shhkl\" (UID: \"6d1f52c3-ee41-4420-84bb-0b168082e3e7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-shhkl"
Jul 03 09:48:18.561247 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.560862    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/07788d0a-514f-45e3-aeb7-3f45e91d7aa6-root\") pod \"node-exporter-r724b\" (UID: \"07788d0a-514f-45e3-aeb7-3f45e91d7aa6\") " pod="openshift-monitoring/node-exporter-r724b"
Jul 03 09:48:18.561247 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.560884    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/07788d0a-514f-45e3-aeb7-3f45e91d7aa6-node-exporter-tls\") pod \"node-exporter-r724b\" (UID: \"07788d0a-514f-45e3-aeb7-3f45e91d7aa6\") " pod="openshift-monitoring/node-exporter-r724b"
Jul 03 09:48:18.561247 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.560902    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/07788d0a-514f-45e3-aeb7-3f45e91d7aa6-node-exporter-accelerators-collector-config\") pod \"node-exporter-r724b\" (UID: \"07788d0a-514f-45e3-aeb7-3f45e91d7aa6\") " pod="openshift-monitoring/node-exporter-r724b"
Jul 03 09:48:18.561247 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.560968    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/07788d0a-514f-45e3-aeb7-3f45e91d7aa6-node-exporter-wtmp\") pod \"node-exporter-r724b\" (UID: \"07788d0a-514f-45e3-aeb7-3f45e91d7aa6\") " pod="openshift-monitoring/node-exporter-r724b"
Jul 03 09:48:18.561247 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.561009    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d1f52c3-ee41-4420-84bb-0b168082e3e7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-shhkl\" (UID: \"6d1f52c3-ee41-4420-84bb-0b168082e3e7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-shhkl"
Jul 03 09:48:18.561247 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.561041    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/07788d0a-514f-45e3-aeb7-3f45e91d7aa6-sys\") pod \"node-exporter-r724b\" (UID: \"07788d0a-514f-45e3-aeb7-3f45e91d7aa6\") " pod="openshift-monitoring/node-exporter-r724b"
Jul 03 09:48:18.561247 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.561064    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkrlq\" (UniqueName: \"kubernetes.io/projected/6d1f52c3-ee41-4420-84bb-0b168082e3e7-kube-api-access-mkrlq\") pod \"kube-state-metrics-7c9dbb8b7d-shhkl\" (UID: \"6d1f52c3-ee41-4420-84bb-0b168082e3e7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-shhkl"
Jul 03 09:48:18.561247 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.561081    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07788d0a-514f-45e3-aeb7-3f45e91d7aa6-metrics-client-ca\") pod \"node-exporter-r724b\" (UID: \"07788d0a-514f-45e3-aeb7-3f45e91d7aa6\") " pod="openshift-monitoring/node-exporter-r724b"
Jul 03 09:48:18.561247 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.561134    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6d1f52c3-ee41-4420-84bb-0b168082e3e7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-shhkl\" (UID: \"6d1f52c3-ee41-4420-84bb-0b168082e3e7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-shhkl"
Jul 03 09:48:18.561247 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.561163    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/07788d0a-514f-45e3-aeb7-3f45e91d7aa6-node-exporter-textfile\") pod \"node-exporter-r724b\" (UID: \"07788d0a-514f-45e3-aeb7-3f45e91d7aa6\") " pod="openshift-monitoring/node-exporter-r724b"
Jul 03 09:48:18.561247 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.561205    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d1f52c3-ee41-4420-84bb-0b168082e3e7-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-shhkl\" (UID: \"6d1f52c3-ee41-4420-84bb-0b168082e3e7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-shhkl"
Jul 03 09:48:18.561667 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.561257    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/07788d0a-514f-45e3-aeb7-3f45e91d7aa6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r724b\" (UID: \"07788d0a-514f-45e3-aeb7-3f45e91d7aa6\") " pod="openshift-monitoring/node-exporter-r724b"
Jul 03 09:48:18.561667 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.561283    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp97s\" (UniqueName: \"kubernetes.io/projected/07788d0a-514f-45e3-aeb7-3f45e91d7aa6-kube-api-access-sp97s\") pod \"node-exporter-r724b\" (UID: \"07788d0a-514f-45e3-aeb7-3f45e91d7aa6\") " pod="openshift-monitoring/node-exporter-r724b"
Jul 03 09:48:18.661627 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.661603    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/07788d0a-514f-45e3-aeb7-3f45e91d7aa6-sys\") pod \"node-exporter-r724b\" (UID: \"07788d0a-514f-45e3-aeb7-3f45e91d7aa6\") " pod="openshift-monitoring/node-exporter-r724b"
Jul 03 09:48:18.661761 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.661640    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkrlq\" (UniqueName: \"kubernetes.io/projected/6d1f52c3-ee41-4420-84bb-0b168082e3e7-kube-api-access-mkrlq\") pod \"kube-state-metrics-7c9dbb8b7d-shhkl\" (UID: \"6d1f52c3-ee41-4420-84bb-0b168082e3e7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-shhkl"
Jul 03 09:48:18.661761 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.661662    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07788d0a-514f-45e3-aeb7-3f45e91d7aa6-metrics-client-ca\") pod \"node-exporter-r724b\" (UID: \"07788d0a-514f-45e3-aeb7-3f45e91d7aa6\") " pod="openshift-monitoring/node-exporter-r724b"
Jul 03 09:48:18.661761 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.661693    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6d1f52c3-ee41-4420-84bb-0b168082e3e7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-shhkl\" (UID: \"6d1f52c3-ee41-4420-84bb-0b168082e3e7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-shhkl"
Jul 03 09:48:18.661761 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.661709    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/07788d0a-514f-45e3-aeb7-3f45e91d7aa6-sys\") pod \"node-exporter-r724b\" (UID: \"07788d0a-514f-45e3-aeb7-3f45e91d7aa6\") " pod="openshift-monitoring/node-exporter-r724b"
Jul 03 09:48:18.661761 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.661718    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/07788d0a-514f-45e3-aeb7-3f45e91d7aa6-node-exporter-textfile\") pod \"node-exporter-r724b\" (UID: \"07788d0a-514f-45e3-aeb7-3f45e91d7aa6\") " pod="openshift-monitoring/node-exporter-r724b"
Jul 03 09:48:18.661996 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.661763    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d1f52c3-ee41-4420-84bb-0b168082e3e7-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-shhkl\" (UID: \"6d1f52c3-ee41-4420-84bb-0b168082e3e7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-shhkl"
Jul 03 09:48:18.661996 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.661814    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/07788d0a-514f-45e3-aeb7-3f45e91d7aa6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r724b\" (UID: \"07788d0a-514f-45e3-aeb7-3f45e91d7aa6\") " pod="openshift-monitoring/node-exporter-r724b"
Jul 03 09:48:18.661996 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.661833    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp97s\" (UniqueName: \"kubernetes.io/projected/07788d0a-514f-45e3-aeb7-3f45e91d7aa6-kube-api-access-sp97s\") pod \"node-exporter-r724b\" (UID: \"07788d0a-514f-45e3-aeb7-3f45e91d7aa6\") " pod="openshift-monitoring/node-exporter-r724b"
Jul 03 09:48:18.662145 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.662113    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/07788d0a-514f-45e3-aeb7-3f45e91d7aa6-node-exporter-textfile\") pod \"node-exporter-r724b\" (UID: \"07788d0a-514f-45e3-aeb7-3f45e91d7aa6\") " pod="openshift-monitoring/node-exporter-r724b"
Jul 03 09:48:18.662197 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.662128    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6d1f52c3-ee41-4420-84bb-0b168082e3e7-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-shhkl\" (UID: \"6d1f52c3-ee41-4420-84bb-0b168082e3e7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-shhkl"
Jul 03 09:48:18.662197 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.662180    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d1f52c3-ee41-4420-84bb-0b168082e3e7-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-shhkl\" (UID: \"6d1f52c3-ee41-4420-84bb-0b168082e3e7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-shhkl"
Jul 03 09:48:18.662300 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.662206    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/07788d0a-514f-45e3-aeb7-3f45e91d7aa6-root\") pod \"node-exporter-r724b\" (UID: \"07788d0a-514f-45e3-aeb7-3f45e91d7aa6\") " pod="openshift-monitoring/node-exporter-r724b"
Jul 03 09:48:18.662300 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.662250    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/07788d0a-514f-45e3-aeb7-3f45e91d7aa6-node-exporter-tls\") pod \"node-exporter-r724b\" (UID: \"07788d0a-514f-45e3-aeb7-3f45e91d7aa6\") " pod="openshift-monitoring/node-exporter-r724b"
Jul 03 09:48:18.662300 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.662281    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/07788d0a-514f-45e3-aeb7-3f45e91d7aa6-node-exporter-accelerators-collector-config\") pod \"node-exporter-r724b\" (UID: \"07788d0a-514f-45e3-aeb7-3f45e91d7aa6\") " pod="openshift-monitoring/node-exporter-r724b"
Jul 03 09:48:18.662441 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.662311    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/07788d0a-514f-45e3-aeb7-3f45e91d7aa6-root\") pod \"node-exporter-r724b\" (UID: \"07788d0a-514f-45e3-aeb7-3f45e91d7aa6\") " pod="openshift-monitoring/node-exporter-r724b"
Jul 03 09:48:18.662441 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.662321    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/07788d0a-514f-45e3-aeb7-3f45e91d7aa6-node-exporter-wtmp\") pod \"node-exporter-r724b\" (UID: \"07788d0a-514f-45e3-aeb7-3f45e91d7aa6\") " pod="openshift-monitoring/node-exporter-r724b"
Jul 03 09:48:18.662441 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.662368    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d1f52c3-ee41-4420-84bb-0b168082e3e7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-shhkl\" (UID: \"6d1f52c3-ee41-4420-84bb-0b168082e3e7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-shhkl"
Jul 03 09:48:18.662441 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.662425    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6d1f52c3-ee41-4420-84bb-0b168082e3e7-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-shhkl\" (UID: \"6d1f52c3-ee41-4420-84bb-0b168082e3e7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-shhkl"
Jul 03 09:48:18.662831 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.662438    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/07788d0a-514f-45e3-aeb7-3f45e91d7aa6-node-exporter-wtmp\") pod \"node-exporter-r724b\" (UID: \"07788d0a-514f-45e3-aeb7-3f45e91d7aa6\") " pod="openshift-monitoring/node-exporter-r724b"
Jul 03 09:48:18.662831 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.662471    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/07788d0a-514f-45e3-aeb7-3f45e91d7aa6-metrics-client-ca\") pod \"node-exporter-r724b\" (UID: \"07788d0a-514f-45e3-aeb7-3f45e91d7aa6\") " pod="openshift-monitoring/node-exporter-r724b"
Jul 03 09:48:18.662831 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.662492    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6d1f52c3-ee41-4420-84bb-0b168082e3e7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-shhkl\" (UID: \"6d1f52c3-ee41-4420-84bb-0b168082e3e7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-shhkl"
Jul 03 09:48:18.662831 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:48:18.662520    2559 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 03 09:48:18.662831 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.662586    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d1f52c3-ee41-4420-84bb-0b168082e3e7-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-shhkl\" (UID: \"6d1f52c3-ee41-4420-84bb-0b168082e3e7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-shhkl"
Jul 03 09:48:18.662831 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:48:18.662591    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07788d0a-514f-45e3-aeb7-3f45e91d7aa6-node-exporter-tls podName:07788d0a-514f-45e3-aeb7-3f45e91d7aa6 nodeName:}" failed. No retries permitted until 2026-07-03 09:48:19.162572931 +0000 UTC m=+300.033238542 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/07788d0a-514f-45e3-aeb7-3f45e91d7aa6-node-exporter-tls") pod "node-exporter-r724b" (UID: "07788d0a-514f-45e3-aeb7-3f45e91d7aa6") : secret "node-exporter-tls" not found
Jul 03 09:48:18.663138 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.662912    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/07788d0a-514f-45e3-aeb7-3f45e91d7aa6-node-exporter-accelerators-collector-config\") pod \"node-exporter-r724b\" (UID: \"07788d0a-514f-45e3-aeb7-3f45e91d7aa6\") " pod="openshift-monitoring/node-exporter-r724b"
Jul 03 09:48:18.664516 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.664487    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/07788d0a-514f-45e3-aeb7-3f45e91d7aa6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r724b\" (UID: \"07788d0a-514f-45e3-aeb7-3f45e91d7aa6\") " pod="openshift-monitoring/node-exporter-r724b"
Jul 03 09:48:18.664871 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.664853    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d1f52c3-ee41-4420-84bb-0b168082e3e7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-shhkl\" (UID: \"6d1f52c3-ee41-4420-84bb-0b168082e3e7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-shhkl"
Jul 03 09:48:18.664938 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.664917    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d1f52c3-ee41-4420-84bb-0b168082e3e7-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-shhkl\" (UID: \"6d1f52c3-ee41-4420-84bb-0b168082e3e7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-shhkl"
Jul 03 09:48:18.668806 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.668786    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkrlq\" (UniqueName: \"kubernetes.io/projected/6d1f52c3-ee41-4420-84bb-0b168082e3e7-kube-api-access-mkrlq\") pod \"kube-state-metrics-7c9dbb8b7d-shhkl\" (UID: \"6d1f52c3-ee41-4420-84bb-0b168082e3e7\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-shhkl"
Jul 03 09:48:18.673310 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.673289    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp97s\" (UniqueName: \"kubernetes.io/projected/07788d0a-514f-45e3-aeb7-3f45e91d7aa6-kube-api-access-sp97s\") pod \"node-exporter-r724b\" (UID: \"07788d0a-514f-45e3-aeb7-3f45e91d7aa6\") " pod="openshift-monitoring/node-exporter-r724b"
Jul 03 09:48:18.779773 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.779706    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-shhkl"
Jul 03 09:48:18.906899 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:18.906867    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-shhkl"]
Jul 03 09:48:18.909952 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:48:18.909924    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d1f52c3_ee41_4420_84bb_0b168082e3e7.slice/crio-bfef84f3b5fa707c51b0b57e1b8553dce036084885b2ea944f55f58954ab48d2 WatchSource:0}: Error finding container bfef84f3b5fa707c51b0b57e1b8553dce036084885b2ea944f55f58954ab48d2: Status 404 returned error can't find the container with id bfef84f3b5fa707c51b0b57e1b8553dce036084885b2ea944f55f58954ab48d2
Jul 03 09:48:19.165930 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:19.165899    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/07788d0a-514f-45e3-aeb7-3f45e91d7aa6-node-exporter-tls\") pod \"node-exporter-r724b\" (UID: \"07788d0a-514f-45e3-aeb7-3f45e91d7aa6\") " pod="openshift-monitoring/node-exporter-r724b"
Jul 03 09:48:19.168254 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:19.168232    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/07788d0a-514f-45e3-aeb7-3f45e91d7aa6-node-exporter-tls\") pod \"node-exporter-r724b\" (UID: \"07788d0a-514f-45e3-aeb7-3f45e91d7aa6\") " pod="openshift-monitoring/node-exporter-r724b"
Jul 03 09:48:19.385273 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:19.385205    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r724b"
Jul 03 09:48:19.395736 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:48:19.395609    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07788d0a_514f_45e3_aeb7_3f45e91d7aa6.slice/crio-f92769b966aa88563fdf77c46edf879df0177341fb98062c558f157c6538384f WatchSource:0}: Error finding container f92769b966aa88563fdf77c46edf879df0177341fb98062c558f157c6538384f: Status 404 returned error can't find the container with id f92769b966aa88563fdf77c46edf879df0177341fb98062c558f157c6538384f
Jul 03 09:48:19.500661 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:19.500632    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c4mdt_9d052bc8-d41a-494c-9523-5bfdcfb29ec2/console-operator/2.log"
Jul 03 09:48:19.502581 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:19.502483    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c4mdt_9d052bc8-d41a-494c-9523-5bfdcfb29ec2/console-operator/2.log"
Jul 03 09:48:19.525401 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:19.525376    2559 kubelet.go:1648] "Image garbage collection succeeded"
Jul 03 09:48:19.568895 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:19.568834    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r724b" event={"ID":"07788d0a-514f-45e3-aeb7-3f45e91d7aa6","Type":"ContainerStarted","Data":"f92769b966aa88563fdf77c46edf879df0177341fb98062c558f157c6538384f"}
Jul 03 09:48:19.570409 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:19.570377    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-shhkl" event={"ID":"6d1f52c3-ee41-4420-84bb-0b168082e3e7","Type":"ContainerStarted","Data":"bfef84f3b5fa707c51b0b57e1b8553dce036084885b2ea944f55f58954ab48d2"}
Jul 03 09:48:20.577285 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:20.577256    2559 generic.go:356] "Generic (PLEG): container finished" podID="07788d0a-514f-45e3-aeb7-3f45e91d7aa6" containerID="0e641574e727343deb4b7dc96f81432a8abb5c25cc22596fdc7c8243b43b6fcc" exitCode=0
Jul 03 09:48:20.577727 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:20.577340    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r724b" event={"ID":"07788d0a-514f-45e3-aeb7-3f45e91d7aa6","Type":"ContainerDied","Data":"0e641574e727343deb4b7dc96f81432a8abb5c25cc22596fdc7c8243b43b6fcc"}
Jul 03 09:48:20.579473 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:20.579448    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-shhkl" event={"ID":"6d1f52c3-ee41-4420-84bb-0b168082e3e7","Type":"ContainerStarted","Data":"18a57196f28ec0a0c1a845e0157979fa957fb93ff74f31c95c9d217ffa5bda07"}
Jul 03 09:48:20.579618 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:20.579510    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-shhkl" event={"ID":"6d1f52c3-ee41-4420-84bb-0b168082e3e7","Type":"ContainerStarted","Data":"95529e2471e8cac730166de3f489db6183a5c807de425596cf189235aa1d2199"}
Jul 03 09:48:21.584708 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:21.584670    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r724b" event={"ID":"07788d0a-514f-45e3-aeb7-3f45e91d7aa6","Type":"ContainerStarted","Data":"218049abfd5ee4e5674305086d88143ebb7653d282af118283f29fc6e5aa1a68"}
Jul 03 09:48:21.585179 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:21.584736    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r724b" event={"ID":"07788d0a-514f-45e3-aeb7-3f45e91d7aa6","Type":"ContainerStarted","Data":"3ec0a8e41ac8235a85c33ececdef8294ceba7188f009e88267032ebfe4805134"}
Jul 03 09:48:21.586802 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:21.586780    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-shhkl" event={"ID":"6d1f52c3-ee41-4420-84bb-0b168082e3e7","Type":"ContainerStarted","Data":"de0126c71d8ed62d4593db50d4910ffe3fded672b3e6577f9f9467223ce69a9d"}
Jul 03 09:48:21.605792 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:21.605752    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-r724b" podStartSLOduration=2.542130084 podStartE2EDuration="3.605738816s" totalImagesPullingTime="965.484432ms" totalInitContainerRuntime="98.1243ms" isStatefulPod=true podCreationTimestamp="2026-07-03 09:48:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:48:21.60427327 +0000 UTC m=+302.474938910" watchObservedRunningTime="2026-07-03 09:48:21.605738816 +0000 UTC m=+302.476404445"
Jul 03 09:48:21.624348 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:21.624282    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-shhkl" podStartSLOduration=2.411062963 podStartE2EDuration="3.624269404s" totalImagesPullingTime="1.213206441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:48:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:48:21.623703755 +0000 UTC m=+302.494369384" watchObservedRunningTime="2026-07-03 09:48:21.624269404 +0000 UTC m=+302.494935033"
Jul 03 09:48:23.668822 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:23.668789    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6f6d4b94d4-n6tjx"]
Jul 03 09:48:23.671565 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:23.671523    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6f6d4b94d4-n6tjx"
Jul 03 09:48:23.674104 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:23.674076    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 03 09:48:23.674221 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:23.674191    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 03 09:48:23.674285 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:23.674229    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 03 09:48:23.674396 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:23.674380    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 03 09:48:23.674865 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:23.674849    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-z9fzh\""
Jul 03 09:48:23.675007 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:23.674991    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 03 09:48:23.679659 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:23.679639    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 03 09:48:23.693937 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:23.693916    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6f6d4b94d4-n6tjx"]
Jul 03 09:48:23.803978 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:23.803953    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv6sz\" (UniqueName: \"kubernetes.io/projected/2c18068a-cf91-4ed8-b359-c9fc120c0377-kube-api-access-tv6sz\") pod \"telemeter-client-6f6d4b94d4-n6tjx\" (UID: \"2c18068a-cf91-4ed8-b359-c9fc120c0377\") " pod="openshift-monitoring/telemeter-client-6f6d4b94d4-n6tjx"
Jul 03 09:48:23.804132 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:23.803985    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2c18068a-cf91-4ed8-b359-c9fc120c0377-secret-telemeter-client\") pod \"telemeter-client-6f6d4b94d4-n6tjx\" (UID: \"2c18068a-cf91-4ed8-b359-c9fc120c0377\") " pod="openshift-monitoring/telemeter-client-6f6d4b94d4-n6tjx"
Jul 03 09:48:23.804132 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:23.804017    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c18068a-cf91-4ed8-b359-c9fc120c0377-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6f6d4b94d4-n6tjx\" (UID: \"2c18068a-cf91-4ed8-b359-c9fc120c0377\") " pod="openshift-monitoring/telemeter-client-6f6d4b94d4-n6tjx"
Jul 03 09:48:23.804132 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:23.804034    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c18068a-cf91-4ed8-b359-c9fc120c0377-metrics-client-ca\") pod \"telemeter-client-6f6d4b94d4-n6tjx\" (UID: \"2c18068a-cf91-4ed8-b359-c9fc120c0377\") " pod="openshift-monitoring/telemeter-client-6f6d4b94d4-n6tjx"
Jul 03 09:48:23.804132 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:23.804070    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2c18068a-cf91-4ed8-b359-c9fc120c0377-federate-client-tls\") pod \"telemeter-client-6f6d4b94d4-n6tjx\" (UID: \"2c18068a-cf91-4ed8-b359-c9fc120c0377\") " pod="openshift-monitoring/telemeter-client-6f6d4b94d4-n6tjx"
Jul 03 09:48:23.804132 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:23.804095    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c18068a-cf91-4ed8-b359-c9fc120c0377-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6f6d4b94d4-n6tjx\" (UID: \"2c18068a-cf91-4ed8-b359-c9fc120c0377\") " pod="openshift-monitoring/telemeter-client-6f6d4b94d4-n6tjx"
Jul 03 09:48:23.804132 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:23.804126    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2c18068a-cf91-4ed8-b359-c9fc120c0377-telemeter-client-tls\") pod \"telemeter-client-6f6d4b94d4-n6tjx\" (UID: \"2c18068a-cf91-4ed8-b359-c9fc120c0377\") " pod="openshift-monitoring/telemeter-client-6f6d4b94d4-n6tjx"
Jul 03 09:48:23.804362 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:23.804215    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c18068a-cf91-4ed8-b359-c9fc120c0377-serving-certs-ca-bundle\") pod \"telemeter-client-6f6d4b94d4-n6tjx\" (UID: \"2c18068a-cf91-4ed8-b359-c9fc120c0377\") " pod="openshift-monitoring/telemeter-client-6f6d4b94d4-n6tjx"
Jul 03 09:48:23.905280 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:23.905255    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c18068a-cf91-4ed8-b359-c9fc120c0377-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6f6d4b94d4-n6tjx\" (UID: \"2c18068a-cf91-4ed8-b359-c9fc120c0377\") " pod="openshift-monitoring/telemeter-client-6f6d4b94d4-n6tjx"
Jul 03 09:48:23.905408 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:23.905286    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c18068a-cf91-4ed8-b359-c9fc120c0377-metrics-client-ca\") pod \"telemeter-client-6f6d4b94d4-n6tjx\" (UID: \"2c18068a-cf91-4ed8-b359-c9fc120c0377\") " pod="openshift-monitoring/telemeter-client-6f6d4b94d4-n6tjx"
Jul 03 09:48:23.905408 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:23.905307    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2c18068a-cf91-4ed8-b359-c9fc120c0377-federate-client-tls\") pod \"telemeter-client-6f6d4b94d4-n6tjx\" (UID: \"2c18068a-cf91-4ed8-b359-c9fc120c0377\") " pod="openshift-monitoring/telemeter-client-6f6d4b94d4-n6tjx"
Jul 03 09:48:23.905408 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:23.905332    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c18068a-cf91-4ed8-b359-c9fc120c0377-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6f6d4b94d4-n6tjx\" (UID: \"2c18068a-cf91-4ed8-b359-c9fc120c0377\") " pod="openshift-monitoring/telemeter-client-6f6d4b94d4-n6tjx"
Jul 03 09:48:23.905408 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:23.905358    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2c18068a-cf91-4ed8-b359-c9fc120c0377-telemeter-client-tls\") pod \"telemeter-client-6f6d4b94d4-n6tjx\" (UID: \"2c18068a-cf91-4ed8-b359-c9fc120c0377\") " pod="openshift-monitoring/telemeter-client-6f6d4b94d4-n6tjx"
Jul 03 09:48:23.905408 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:23.905392    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c18068a-cf91-4ed8-b359-c9fc120c0377-serving-certs-ca-bundle\") pod \"telemeter-client-6f6d4b94d4-n6tjx\" (UID: \"2c18068a-cf91-4ed8-b359-c9fc120c0377\") " pod="openshift-monitoring/telemeter-client-6f6d4b94d4-n6tjx"
Jul 03 09:48:23.905694 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:23.905469    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv6sz\" (UniqueName: \"kubernetes.io/projected/2c18068a-cf91-4ed8-b359-c9fc120c0377-kube-api-access-tv6sz\") pod \"telemeter-client-6f6d4b94d4-n6tjx\" (UID: \"2c18068a-cf91-4ed8-b359-c9fc120c0377\") " pod="openshift-monitoring/telemeter-client-6f6d4b94d4-n6tjx"
Jul 03 09:48:23.905694 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:23.905496    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2c18068a-cf91-4ed8-b359-c9fc120c0377-secret-telemeter-client\") pod \"telemeter-client-6f6d4b94d4-n6tjx\" (UID: \"2c18068a-cf91-4ed8-b359-c9fc120c0377\") " pod="openshift-monitoring/telemeter-client-6f6d4b94d4-n6tjx"
Jul 03 09:48:23.906259 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:23.906179    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c18068a-cf91-4ed8-b359-c9fc120c0377-metrics-client-ca\") pod \"telemeter-client-6f6d4b94d4-n6tjx\" (UID: \"2c18068a-cf91-4ed8-b359-c9fc120c0377\") " pod="openshift-monitoring/telemeter-client-6f6d4b94d4-n6tjx"
Jul 03 09:48:23.906372 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:23.906304    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c18068a-cf91-4ed8-b359-c9fc120c0377-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6f6d4b94d4-n6tjx\" (UID: \"2c18068a-cf91-4ed8-b359-c9fc120c0377\") " pod="openshift-monitoring/telemeter-client-6f6d4b94d4-n6tjx"
Jul 03 09:48:23.906372 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:23.906308    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c18068a-cf91-4ed8-b359-c9fc120c0377-serving-certs-ca-bundle\") pod \"telemeter-client-6f6d4b94d4-n6tjx\" (UID: \"2c18068a-cf91-4ed8-b359-c9fc120c0377\") " pod="openshift-monitoring/telemeter-client-6f6d4b94d4-n6tjx"
Jul 03 09:48:23.908237 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:23.908208    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2c18068a-cf91-4ed8-b359-c9fc120c0377-secret-telemeter-client\") pod \"telemeter-client-6f6d4b94d4-n6tjx\" (UID: \"2c18068a-cf91-4ed8-b359-c9fc120c0377\") " pod="openshift-monitoring/telemeter-client-6f6d4b94d4-n6tjx"
Jul 03 09:48:23.908317 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:23.908245    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2c18068a-cf91-4ed8-b359-c9fc120c0377-telemeter-client-tls\") pod \"telemeter-client-6f6d4b94d4-n6tjx\" (UID: \"2c18068a-cf91-4ed8-b359-c9fc120c0377\") " pod="openshift-monitoring/telemeter-client-6f6d4b94d4-n6tjx"
Jul 03 09:48:23.908317 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:23.908253    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c18068a-cf91-4ed8-b359-c9fc120c0377-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6f6d4b94d4-n6tjx\" (UID: \"2c18068a-cf91-4ed8-b359-c9fc120c0377\") " pod="openshift-monitoring/telemeter-client-6f6d4b94d4-n6tjx"
Jul 03 09:48:23.908448 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:23.908429    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2c18068a-cf91-4ed8-b359-c9fc120c0377-federate-client-tls\") pod \"telemeter-client-6f6d4b94d4-n6tjx\" (UID: \"2c18068a-cf91-4ed8-b359-c9fc120c0377\") " pod="openshift-monitoring/telemeter-client-6f6d4b94d4-n6tjx"
Jul 03 09:48:23.913680 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:23.913658    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv6sz\" (UniqueName: \"kubernetes.io/projected/2c18068a-cf91-4ed8-b359-c9fc120c0377-kube-api-access-tv6sz\") pod \"telemeter-client-6f6d4b94d4-n6tjx\" (UID: \"2c18068a-cf91-4ed8-b359-c9fc120c0377\") " pod="openshift-monitoring/telemeter-client-6f6d4b94d4-n6tjx"
Jul 03 09:48:23.981378 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:23.981359    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6f6d4b94d4-n6tjx"
Jul 03 09:48:24.107922 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.107892    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6f6d4b94d4-n6tjx"]
Jul 03 09:48:24.110936 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:48:24.110912    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c18068a_cf91_4ed8_b359_c9fc120c0377.slice/crio-15ce700b53a1967fc3e3e8b0138727830872d550098c2c2ac0206989451df8a1 WatchSource:0}: Error finding container 15ce700b53a1967fc3e3e8b0138727830872d550098c2c2ac0206989451df8a1: Status 404 returned error can't find the container with id 15ce700b53a1967fc3e3e8b0138727830872d550098c2c2ac0206989451df8a1
Jul 03 09:48:24.112929 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.112913    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 03 09:48:24.598126 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.598091    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f6d4b94d4-n6tjx" event={"ID":"2c18068a-cf91-4ed8-b359-c9fc120c0377","Type":"ContainerStarted","Data":"15ce700b53a1967fc3e3e8b0138727830872d550098c2c2ac0206989451df8a1"}
Jul 03 09:48:24.661293 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.661265    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 03 09:48:24.664863 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.664843    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.667346 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.667324    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 03 09:48:24.667464 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.667343    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 03 09:48:24.668034 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.667867    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 03 09:48:24.668034 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.667883    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 03 09:48:24.668034 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.667916    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 03 09:48:24.668034 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.667921    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 03 09:48:24.668034 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.667929    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8adl9m3oks163\""
Jul 03 09:48:24.668034 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.667939    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 03 09:48:24.668034 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.667935    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 03 09:48:24.668392 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.668377    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 03 09:48:24.668485 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.668465    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 03 09:48:24.668485 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.668476    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 03 09:48:24.668696 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.668504    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 03 09:48:24.668696 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.668532    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 03 09:48:24.668696 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.668564    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 03 09:48:24.668696 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.668665    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xghw5\""
Jul 03 09:48:24.670743 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.670725    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 03 09:48:24.684813 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.684785    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 03 09:48:24.812676 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.812638    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7634ad42-5f1c-4f85-8bbc-93024244c4e3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.812866 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.812689    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7634ad42-5f1c-4f85-8bbc-93024244c4e3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.812866 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.812717    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7634ad42-5f1c-4f85-8bbc-93024244c4e3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.812866 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.812815    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.812866 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.812860    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7634ad42-5f1c-4f85-8bbc-93024244c4e3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.813076 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.812884    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.813076 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.812906    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnnk6\" (UniqueName: \"kubernetes.io/projected/7634ad42-5f1c-4f85-8bbc-93024244c4e3-kube-api-access-jnnk6\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.813076 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.812927    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7634ad42-5f1c-4f85-8bbc-93024244c4e3-config-out\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.813076 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.812957    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-config\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.813076 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.812979    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-web-config\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.813076 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.813020    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.813076 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.813048    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7634ad42-5f1c-4f85-8bbc-93024244c4e3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.813325 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.813104    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.813325 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.813131    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7634ad42-5f1c-4f85-8bbc-93024244c4e3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.813325 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.813229    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7634ad42-5f1c-4f85-8bbc-93024244c4e3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.813325 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.813264    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.813325 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.813290    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7634ad42-5f1c-4f85-8bbc-93024244c4e3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.813325 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.813313    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.813532 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.813360    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.813532 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.813380    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7634ad42-5f1c-4f85-8bbc-93024244c4e3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.914049 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.913971    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7634ad42-5f1c-4f85-8bbc-93024244c4e3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.914049 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.914006    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7634ad42-5f1c-4f85-8bbc-93024244c4e3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.914049 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.914048    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.914296 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.914080    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7634ad42-5f1c-4f85-8bbc-93024244c4e3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.914296 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.914103    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.914296 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.914126    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnnk6\" (UniqueName: \"kubernetes.io/projected/7634ad42-5f1c-4f85-8bbc-93024244c4e3-kube-api-access-jnnk6\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.914447 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.914322    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7634ad42-5f1c-4f85-8bbc-93024244c4e3-config-out\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.914447 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.914382    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-config\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.914447 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.914408    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-web-config\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.914625 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.914444    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.914625 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.914471    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7634ad42-5f1c-4f85-8bbc-93024244c4e3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.914625 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.914527    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.914625 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.914575    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7634ad42-5f1c-4f85-8bbc-93024244c4e3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.914625 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.914616    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7634ad42-5f1c-4f85-8bbc-93024244c4e3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.914866 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.914647    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.914866 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.914677    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7634ad42-5f1c-4f85-8bbc-93024244c4e3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.914866 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.914713    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.914866 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.914745    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.914866 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.914771    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7634ad42-5f1c-4f85-8bbc-93024244c4e3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.914866 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.914801    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7634ad42-5f1c-4f85-8bbc-93024244c4e3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.915163 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.914908    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7634ad42-5f1c-4f85-8bbc-93024244c4e3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.916703 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.915473    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7634ad42-5f1c-4f85-8bbc-93024244c4e3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.916703 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.915678    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7634ad42-5f1c-4f85-8bbc-93024244c4e3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.917522 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.917387    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7634ad42-5f1c-4f85-8bbc-93024244c4e3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.917656 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.917629    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7634ad42-5f1c-4f85-8bbc-93024244c4e3-config-out\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.920579 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.918181    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7634ad42-5f1c-4f85-8bbc-93024244c4e3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.920579 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.918610    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.920579 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.919120    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7634ad42-5f1c-4f85-8bbc-93024244c4e3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.920579 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.919912    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7634ad42-5f1c-4f85-8bbc-93024244c4e3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.920579 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.920307    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-config\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.920908 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.920585    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-web-config\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.920908 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.920644    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.920908 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.920664    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.921062 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.920900    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7634ad42-5f1c-4f85-8bbc-93024244c4e3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.921062 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.920953    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.921281 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.921261    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7634ad42-5f1c-4f85-8bbc-93024244c4e3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.921770 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.921742    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.922121 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.922099    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.922755 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.922704    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.924014 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.923995    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnnk6\" (UniqueName: \"kubernetes.io/projected/7634ad42-5f1c-4f85-8bbc-93024244c4e3-kube-api-access-jnnk6\") pod \"prometheus-k8s-0\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:24.975288 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:24.975265    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:25.125649 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:25.125619    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 03 09:48:25.127402 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:48:25.127371    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7634ad42_5f1c_4f85_8bbc_93024244c4e3.slice/crio-655e8dcb3cd205d6de6479a543c5f9ca922136d4d99dae00a15a68b132262799 WatchSource:0}: Error finding container 655e8dcb3cd205d6de6479a543c5f9ca922136d4d99dae00a15a68b132262799: Status 404 returned error can't find the container with id 655e8dcb3cd205d6de6479a543c5f9ca922136d4d99dae00a15a68b132262799
Jul 03 09:48:25.604989 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:25.604900    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7634ad42-5f1c-4f85-8bbc-93024244c4e3","Type":"ContainerStarted","Data":"655e8dcb3cd205d6de6479a543c5f9ca922136d4d99dae00a15a68b132262799"}
Jul 03 09:48:26.609528 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:26.609503    2559 generic.go:356] "Generic (PLEG): container finished" podID="7634ad42-5f1c-4f85-8bbc-93024244c4e3" containerID="25478e0bf60ee0529307ee7fcea036acb58430acedc41ee39c36f02d648a0d52" exitCode=0
Jul 03 09:48:26.609894 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:26.609586    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7634ad42-5f1c-4f85-8bbc-93024244c4e3","Type":"ContainerDied","Data":"25478e0bf60ee0529307ee7fcea036acb58430acedc41ee39c36f02d648a0d52"}
Jul 03 09:48:26.611984 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:26.611959    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f6d4b94d4-n6tjx" event={"ID":"2c18068a-cf91-4ed8-b359-c9fc120c0377","Type":"ContainerStarted","Data":"5878a40c943adc748dba7200f80aed6603b28489134d3f8135f6b493f0ddede0"}
Jul 03 09:48:26.612059 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:26.612018    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f6d4b94d4-n6tjx" event={"ID":"2c18068a-cf91-4ed8-b359-c9fc120c0377","Type":"ContainerStarted","Data":"4da941f67ad4a3d5979691931db09f76190b63917d8dbe5be8bfec3f824f38ed"}
Jul 03 09:48:26.685580 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:26.685536    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grmvl"
Jul 03 09:48:27.621890 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:27.621857    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f6d4b94d4-n6tjx" event={"ID":"2c18068a-cf91-4ed8-b359-c9fc120c0377","Type":"ContainerStarted","Data":"fd279a16c7dc3a535c33272acf511523844cb3d7ed1bb4a7a94a86dd2c87cbb9"}
Jul 03 09:48:30.541408 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:30.541382    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-58f58d4cf8-slxhx"
Jul 03 09:48:30.561985 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:30.561940    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6f6d4b94d4-n6tjx" podStartSLOduration=5.284733882 podStartE2EDuration="7.561922501s" totalImagesPullingTime="2.277188619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:48:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:48:27.644885463 +0000 UTC m=+308.515551092" watchObservedRunningTime="2026-07-03 09:48:30.561922501 +0000 UTC m=+311.432588132"
Jul 03 09:48:30.640584 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:30.638575    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7634ad42-5f1c-4f85-8bbc-93024244c4e3","Type":"ContainerStarted","Data":"b956c706fae187b75632af83323ed4cf235071aac8b93fe09ae3c46f219218da"}
Jul 03 09:48:30.640584 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:30.638658    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7634ad42-5f1c-4f85-8bbc-93024244c4e3","Type":"ContainerStarted","Data":"ff8d58bd9af98062e0a310bfa7bccba6974227e2a496b0d3187901674f67364a"}
Jul 03 09:48:32.650348 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:32.650266    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7634ad42-5f1c-4f85-8bbc-93024244c4e3","Type":"ContainerStarted","Data":"c9f23084a2cba3e582d6be01d8fa65743e577757fba8050541ca04ed39a7dcf3"}
Jul 03 09:48:32.650348 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:32.650332    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7634ad42-5f1c-4f85-8bbc-93024244c4e3","Type":"ContainerStarted","Data":"e16450ad5ca2565d7dbdd2ec4c5c3734f18bdf0f5684acff5a236b3732a7310d"}
Jul 03 09:48:32.650729 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:32.650357    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7634ad42-5f1c-4f85-8bbc-93024244c4e3","Type":"ContainerStarted","Data":"b8ec9c6e29a74165e727271a8216197374c2efcea16371052fe726a32f933f77"}
Jul 03 09:48:32.650729 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:32.650389    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7634ad42-5f1c-4f85-8bbc-93024244c4e3","Type":"ContainerStarted","Data":"825fe7e2954d592cab57a37b117fb10f2d945f5e8191625009393f14ee89da60"}
Jul 03 09:48:32.682470 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:32.682417    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.038902995 podStartE2EDuration="8.682395086s" totalImagesPullingTime="6.627746816s" totalInitContainerRuntime="15.745275ms" isStatefulPod=false podCreationTimestamp="2026-07-03 09:48:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:48:32.679923901 +0000 UTC m=+313.550589555" watchObservedRunningTime="2026-07-03 09:48:32.682395086 +0000 UTC m=+313.553060716"
Jul 03 09:48:32.685322 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:32.685306    2559 scope.go:117] "RemoveContainer" containerID="5b34eadeb5fc60665351b0581b39dafd2bfb8392d0ca86679e51e62c8d461bc6"
Jul 03 09:48:33.655965 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:33.655940    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c4mdt_9d052bc8-d41a-494c-9523-5bfdcfb29ec2/console-operator/2.log"
Jul 03 09:48:33.656310 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:33.656062    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-c4mdt" event={"ID":"9d052bc8-d41a-494c-9523-5bfdcfb29ec2","Type":"ContainerStarted","Data":"117c107e0f62775956a7cebd063822944211bb2829c27eb46dcaa0b23d8eb034"}
Jul 03 09:48:34.975751 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:34.975715    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:48:43.656651 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:43.656613    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-c4mdt"
Jul 03 09:48:43.660354 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:48:43.660332    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-c4mdt"
Jul 03 09:49:01.759564 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:01.759515    2559 generic.go:356] "Generic (PLEG): container finished" podID="c80c9446-f8d7-4e4e-bdda-e0467cab85ed" containerID="c7fcd2fdb264491aa87a8d991ff946f73c15a20a8bd1f3aa092c9cf6e533fb39" exitCode=0
Jul 03 09:49:01.759928 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:01.759577    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tpwdg" event={"ID":"c80c9446-f8d7-4e4e-bdda-e0467cab85ed","Type":"ContainerDied","Data":"c7fcd2fdb264491aa87a8d991ff946f73c15a20a8bd1f3aa092c9cf6e533fb39"}
Jul 03 09:49:01.759928 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:01.759862    2559 scope.go:117] "RemoveContainer" containerID="c7fcd2fdb264491aa87a8d991ff946f73c15a20a8bd1f3aa092c9cf6e533fb39"
Jul 03 09:49:02.764524 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:02.764483    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tpwdg" event={"ID":"c80c9446-f8d7-4e4e-bdda-e0467cab85ed","Type":"ContainerStarted","Data":"7deade3e95d13f1ff3cbdfaea26a6b56caf2def69fee75ca21cd49f1197f18b2"}
Jul 03 09:49:11.797197 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:11.797164    2559 generic.go:356] "Generic (PLEG): container finished" podID="3b40d22c-95af-41b3-a18e-d1cda05b4999" containerID="68fa8bcb2093392ef3ab96c10bc61fc59913c0c151e0f85d0d69ab17016cb76a" exitCode=0
Jul 03 09:49:11.797197 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:11.797199    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-7jjl2" event={"ID":"3b40d22c-95af-41b3-a18e-d1cda05b4999","Type":"ContainerDied","Data":"68fa8bcb2093392ef3ab96c10bc61fc59913c0c151e0f85d0d69ab17016cb76a"}
Jul 03 09:49:11.797672 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:11.797504    2559 scope.go:117] "RemoveContainer" containerID="68fa8bcb2093392ef3ab96c10bc61fc59913c0c151e0f85d0d69ab17016cb76a"
Jul 03 09:49:12.803707 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:12.803672    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-7jjl2" event={"ID":"3b40d22c-95af-41b3-a18e-d1cda05b4999","Type":"ContainerStarted","Data":"f82c54b95bddd027fd24c222d67064c3c9b2c492e88b77de1c4eebb48c60f97c"}
Jul 03 09:49:24.976065 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:24.976023    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:25.004752 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:25.004724    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:25.874747 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:25.874720    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:33.484440 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:33.484402    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65bd85a9-57d3-4ff1-bae1-9f3727371a28-metrics-certs\") pod \"network-metrics-daemon-grmvl\" (UID: \"65bd85a9-57d3-4ff1-bae1-9f3727371a28\") " pod="openshift-multus/network-metrics-daemon-grmvl"
Jul 03 09:49:33.486836 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:33.486813    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65bd85a9-57d3-4ff1-bae1-9f3727371a28-metrics-certs\") pod \"network-metrics-daemon-grmvl\" (UID: \"65bd85a9-57d3-4ff1-bae1-9f3727371a28\") " pod="openshift-multus/network-metrics-daemon-grmvl"
Jul 03 09:49:33.589018 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:33.588986    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-98cbg\""
Jul 03 09:49:33.597084 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:33.597058    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grmvl"
Jul 03 09:49:33.728539 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:33.728512    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-grmvl"]
Jul 03 09:49:33.730568 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:49:33.730515    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65bd85a9_57d3_4ff1_bae1_9f3727371a28.slice/crio-b4b5cc4cc438945c339bcec471cd51cbc5fdc1cfe3608ad9b5980344490b27cd WatchSource:0}: Error finding container b4b5cc4cc438945c339bcec471cd51cbc5fdc1cfe3608ad9b5980344490b27cd: Status 404 returned error can't find the container with id b4b5cc4cc438945c339bcec471cd51cbc5fdc1cfe3608ad9b5980344490b27cd
Jul 03 09:49:33.884479 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:33.884448    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-grmvl" event={"ID":"65bd85a9-57d3-4ff1-bae1-9f3727371a28","Type":"ContainerStarted","Data":"b4b5cc4cc438945c339bcec471cd51cbc5fdc1cfe3608ad9b5980344490b27cd"}
Jul 03 09:49:34.889780 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:34.889677    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-grmvl" event={"ID":"65bd85a9-57d3-4ff1-bae1-9f3727371a28","Type":"ContainerStarted","Data":"d20cc2d1c386cd66e8ce437f1a31f1a1eec4292065ec0eef52baaadbffcabef4"}
Jul 03 09:49:34.889780 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:34.889725    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-grmvl" event={"ID":"65bd85a9-57d3-4ff1-bae1-9f3727371a28","Type":"ContainerStarted","Data":"7a4d8d4c903f61855f4d83472dbc0966be27f72a261d058e0e5361f32a9fb9ce"}
Jul 03 09:49:34.907113 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:34.907069    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-grmvl" podStartSLOduration=374.013699842 podStartE2EDuration="6m14.907037311s" totalImagesPullingTime="893.337469ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:43:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:49:34.906173836 +0000 UTC m=+375.776839492" watchObservedRunningTime="2026-07-03 09:49:34.907037311 +0000 UTC m=+375.777702981"
Jul 03 09:49:43.045756 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:43.045723    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 03 09:49:43.046258 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:43.046010    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7634ad42-5f1c-4f85-8bbc-93024244c4e3" containerName="prometheus" containerID="cri-o://ff8d58bd9af98062e0a310bfa7bccba6974227e2a496b0d3187901674f67364a" gracePeriod=600
Jul 03 09:49:43.046258 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:43.046035    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7634ad42-5f1c-4f85-8bbc-93024244c4e3" containerName="kube-rbac-proxy" containerID="cri-o://e16450ad5ca2565d7dbdd2ec4c5c3734f18bdf0f5684acff5a236b3732a7310d" gracePeriod=600
Jul 03 09:49:43.046258 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:43.046048    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7634ad42-5f1c-4f85-8bbc-93024244c4e3" containerName="kube-rbac-proxy-thanos" containerID="cri-o://c9f23084a2cba3e582d6be01d8fa65743e577757fba8050541ca04ed39a7dcf3" gracePeriod=600
Jul 03 09:49:43.046258 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:43.046064    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7634ad42-5f1c-4f85-8bbc-93024244c4e3" containerName="kube-rbac-proxy-web" containerID="cri-o://b8ec9c6e29a74165e727271a8216197374c2efcea16371052fe726a32f933f77" gracePeriod=600
Jul 03 09:49:43.046258 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:43.046092    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7634ad42-5f1c-4f85-8bbc-93024244c4e3" containerName="config-reloader" containerID="cri-o://b956c706fae187b75632af83323ed4cf235071aac8b93fe09ae3c46f219218da" gracePeriod=600
Jul 03 09:49:43.046258 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:43.046205    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7634ad42-5f1c-4f85-8bbc-93024244c4e3" containerName="thanos-sidecar" containerID="cri-o://825fe7e2954d592cab57a37b117fb10f2d945f5e8191625009393f14ee89da60" gracePeriod=600
Jul 03 09:49:43.928239 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:43.928207    2559 generic.go:356] "Generic (PLEG): container finished" podID="7634ad42-5f1c-4f85-8bbc-93024244c4e3" containerID="c9f23084a2cba3e582d6be01d8fa65743e577757fba8050541ca04ed39a7dcf3" exitCode=0
Jul 03 09:49:43.928239 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:43.928234    2559 generic.go:356] "Generic (PLEG): container finished" podID="7634ad42-5f1c-4f85-8bbc-93024244c4e3" containerID="e16450ad5ca2565d7dbdd2ec4c5c3734f18bdf0f5684acff5a236b3732a7310d" exitCode=0
Jul 03 09:49:43.928239 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:43.928241    2559 generic.go:356] "Generic (PLEG): container finished" podID="7634ad42-5f1c-4f85-8bbc-93024244c4e3" containerID="825fe7e2954d592cab57a37b117fb10f2d945f5e8191625009393f14ee89da60" exitCode=0
Jul 03 09:49:43.928239 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:43.928246    2559 generic.go:356] "Generic (PLEG): container finished" podID="7634ad42-5f1c-4f85-8bbc-93024244c4e3" containerID="b956c706fae187b75632af83323ed4cf235071aac8b93fe09ae3c46f219218da" exitCode=0
Jul 03 09:49:43.928239 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:43.928251    2559 generic.go:356] "Generic (PLEG): container finished" podID="7634ad42-5f1c-4f85-8bbc-93024244c4e3" containerID="ff8d58bd9af98062e0a310bfa7bccba6974227e2a496b0d3187901674f67364a" exitCode=0
Jul 03 09:49:43.928620 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:43.928282    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7634ad42-5f1c-4f85-8bbc-93024244c4e3","Type":"ContainerDied","Data":"c9f23084a2cba3e582d6be01d8fa65743e577757fba8050541ca04ed39a7dcf3"}
Jul 03 09:49:43.928620 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:43.928359    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7634ad42-5f1c-4f85-8bbc-93024244c4e3","Type":"ContainerDied","Data":"e16450ad5ca2565d7dbdd2ec4c5c3734f18bdf0f5684acff5a236b3732a7310d"}
Jul 03 09:49:43.928620 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:43.928397    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7634ad42-5f1c-4f85-8bbc-93024244c4e3","Type":"ContainerDied","Data":"825fe7e2954d592cab57a37b117fb10f2d945f5e8191625009393f14ee89da60"}
Jul 03 09:49:43.928620 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:43.928435    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7634ad42-5f1c-4f85-8bbc-93024244c4e3","Type":"ContainerDied","Data":"b956c706fae187b75632af83323ed4cf235071aac8b93fe09ae3c46f219218da"}
Jul 03 09:49:43.928620 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:43.928476    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7634ad42-5f1c-4f85-8bbc-93024244c4e3","Type":"ContainerDied","Data":"ff8d58bd9af98062e0a310bfa7bccba6974227e2a496b0d3187901674f67364a"}
Jul 03 09:49:44.283324 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.283297    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:44.370999 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.370974    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-secret-prometheus-k8s-tls\") pod \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") "
Jul 03 09:49:44.371164 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.371012    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7634ad42-5f1c-4f85-8bbc-93024244c4e3-tls-assets\") pod \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") "
Jul 03 09:49:44.371164 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.371030    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-secret-metrics-client-certs\") pod \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") "
Jul 03 09:49:44.371164 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.371057    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7634ad42-5f1c-4f85-8bbc-93024244c4e3-prometheus-k8s-rulefiles-2\") pod \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") "
Jul 03 09:49:44.371332 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.371262    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7634ad42-5f1c-4f85-8bbc-93024244c4e3-config-out\") pod \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") "
Jul 03 09:49:44.371332 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.371303    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7634ad42-5f1c-4f85-8bbc-93024244c4e3-prometheus-trusted-ca-bundle\") pod \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") "
Jul 03 09:49:44.371446 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.371355    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7634ad42-5f1c-4f85-8bbc-93024244c4e3-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "7634ad42-5f1c-4f85-8bbc-93024244c4e3" (UID: "7634ad42-5f1c-4f85-8bbc-93024244c4e3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 09:49:44.371446 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.371359    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") "
Jul 03 09:49:44.371446 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.371435    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7634ad42-5f1c-4f85-8bbc-93024244c4e3-prometheus-k8s-db\") pod \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") "
Jul 03 09:49:44.371624 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.371465    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-thanos-prometheus-http-client-file\") pod \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") "
Jul 03 09:49:44.371624 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.371496    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-web-config\") pod \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") "
Jul 03 09:49:44.371624 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.371599    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") "
Jul 03 09:49:44.371930 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.371633    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-secret-grpc-tls\") pod \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") "
Jul 03 09:49:44.371930 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.371666    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7634ad42-5f1c-4f85-8bbc-93024244c4e3-configmap-kubelet-serving-ca-bundle\") pod \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") "
Jul 03 09:49:44.371930 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.371706    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-config\") pod \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") "
Jul 03 09:49:44.371930 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.371740    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7634ad42-5f1c-4f85-8bbc-93024244c4e3-configmap-serving-certs-ca-bundle\") pod \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") "
Jul 03 09:49:44.371930 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.371738    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7634ad42-5f1c-4f85-8bbc-93024244c4e3-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "7634ad42-5f1c-4f85-8bbc-93024244c4e3" (UID: "7634ad42-5f1c-4f85-8bbc-93024244c4e3"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 09:49:44.371930 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.371773    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7634ad42-5f1c-4f85-8bbc-93024244c4e3-prometheus-k8s-rulefiles-0\") pod \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") "
Jul 03 09:49:44.371930 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.371799    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7634ad42-5f1c-4f85-8bbc-93024244c4e3-prometheus-k8s-rulefiles-1\") pod \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") "
Jul 03 09:49:44.371930 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.371828    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnnk6\" (UniqueName: \"kubernetes.io/projected/7634ad42-5f1c-4f85-8bbc-93024244c4e3-kube-api-access-jnnk6\") pod \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") "
Jul 03 09:49:44.371930 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.371851    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7634ad42-5f1c-4f85-8bbc-93024244c4e3-configmap-metrics-client-ca\") pod \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") "
Jul 03 09:49:44.371930 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.371874    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-secret-kube-rbac-proxy\") pod \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\" (UID: \"7634ad42-5f1c-4f85-8bbc-93024244c4e3\") "
Jul 03 09:49:44.372405 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.372123    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7634ad42-5f1c-4f85-8bbc-93024244c4e3-prometheus-trusted-ca-bundle\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 09:49:44.372405 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.372139    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7634ad42-5f1c-4f85-8bbc-93024244c4e3-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 09:49:44.372607 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.372580    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7634ad42-5f1c-4f85-8bbc-93024244c4e3-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "7634ad42-5f1c-4f85-8bbc-93024244c4e3" (UID: "7634ad42-5f1c-4f85-8bbc-93024244c4e3"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 09:49:44.374096 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.373839    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7634ad42-5f1c-4f85-8bbc-93024244c4e3-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "7634ad42-5f1c-4f85-8bbc-93024244c4e3" (UID: "7634ad42-5f1c-4f85-8bbc-93024244c4e3"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 09:49:44.374096 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.373835    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "7634ad42-5f1c-4f85-8bbc-93024244c4e3" (UID: "7634ad42-5f1c-4f85-8bbc-93024244c4e3"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 09:49:44.374301 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.374159    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "7634ad42-5f1c-4f85-8bbc-93024244c4e3" (UID: "7634ad42-5f1c-4f85-8bbc-93024244c4e3"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 09:49:44.374894 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.374868    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "7634ad42-5f1c-4f85-8bbc-93024244c4e3" (UID: "7634ad42-5f1c-4f85-8bbc-93024244c4e3"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 09:49:44.375346 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.375082    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7634ad42-5f1c-4f85-8bbc-93024244c4e3-config-out" (OuterVolumeSpecName: "config-out") pod "7634ad42-5f1c-4f85-8bbc-93024244c4e3" (UID: "7634ad42-5f1c-4f85-8bbc-93024244c4e3"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 09:49:44.375346 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.375182    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7634ad42-5f1c-4f85-8bbc-93024244c4e3-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "7634ad42-5f1c-4f85-8bbc-93024244c4e3" (UID: "7634ad42-5f1c-4f85-8bbc-93024244c4e3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 09:49:44.375346 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.375215    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "7634ad42-5f1c-4f85-8bbc-93024244c4e3" (UID: "7634ad42-5f1c-4f85-8bbc-93024244c4e3"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 09:49:44.375635 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.375587    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7634ad42-5f1c-4f85-8bbc-93024244c4e3-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "7634ad42-5f1c-4f85-8bbc-93024244c4e3" (UID: "7634ad42-5f1c-4f85-8bbc-93024244c4e3"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 09:49:44.375915 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.375889    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7634ad42-5f1c-4f85-8bbc-93024244c4e3-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "7634ad42-5f1c-4f85-8bbc-93024244c4e3" (UID: "7634ad42-5f1c-4f85-8bbc-93024244c4e3"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 09:49:44.375988 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.375943    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7634ad42-5f1c-4f85-8bbc-93024244c4e3-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "7634ad42-5f1c-4f85-8bbc-93024244c4e3" (UID: "7634ad42-5f1c-4f85-8bbc-93024244c4e3"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 09:49:44.376044 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.376018    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "7634ad42-5f1c-4f85-8bbc-93024244c4e3" (UID: "7634ad42-5f1c-4f85-8bbc-93024244c4e3"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 09:49:44.376094 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.376054    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "7634ad42-5f1c-4f85-8bbc-93024244c4e3" (UID: "7634ad42-5f1c-4f85-8bbc-93024244c4e3"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 09:49:44.376151 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.376118    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7634ad42-5f1c-4f85-8bbc-93024244c4e3-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "7634ad42-5f1c-4f85-8bbc-93024244c4e3" (UID: "7634ad42-5f1c-4f85-8bbc-93024244c4e3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 09:49:44.376568 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.376521    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "7634ad42-5f1c-4f85-8bbc-93024244c4e3" (UID: "7634ad42-5f1c-4f85-8bbc-93024244c4e3"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 09:49:44.377446 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.377428    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-config" (OuterVolumeSpecName: "config") pod "7634ad42-5f1c-4f85-8bbc-93024244c4e3" (UID: "7634ad42-5f1c-4f85-8bbc-93024244c4e3"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 09:49:44.378050 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.378022    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7634ad42-5f1c-4f85-8bbc-93024244c4e3-kube-api-access-jnnk6" (OuterVolumeSpecName: "kube-api-access-jnnk6") pod "7634ad42-5f1c-4f85-8bbc-93024244c4e3" (UID: "7634ad42-5f1c-4f85-8bbc-93024244c4e3"). InnerVolumeSpecName "kube-api-access-jnnk6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 09:49:44.386164 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.386142    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-web-config" (OuterVolumeSpecName: "web-config") pod "7634ad42-5f1c-4f85-8bbc-93024244c4e3" (UID: "7634ad42-5f1c-4f85-8bbc-93024244c4e3"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 09:49:44.472643 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.472589    2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 09:49:44.472643 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.472608    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7634ad42-5f1c-4f85-8bbc-93024244c4e3-prometheus-k8s-db\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 09:49:44.472643 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.472618    2559 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-thanos-prometheus-http-client-file\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 09:49:44.472643 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.472626    2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-web-config\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 09:49:44.472643 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.472634    2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 09:49:44.472643 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.472643    2559 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-secret-grpc-tls\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 09:49:44.472867 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.472651    2559 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7634ad42-5f1c-4f85-8bbc-93024244c4e3-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 09:49:44.472867 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.472659    2559 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-config\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 09:49:44.472867 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.472667    2559 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7634ad42-5f1c-4f85-8bbc-93024244c4e3-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 09:49:44.472867 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.472675    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7634ad42-5f1c-4f85-8bbc-93024244c4e3-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 09:49:44.472867 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.472683    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7634ad42-5f1c-4f85-8bbc-93024244c4e3-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 09:49:44.472867 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.472691    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnnk6\" (UniqueName: \"kubernetes.io/projected/7634ad42-5f1c-4f85-8bbc-93024244c4e3-kube-api-access-jnnk6\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 09:49:44.472867 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.472700    2559 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7634ad42-5f1c-4f85-8bbc-93024244c4e3-configmap-metrics-client-ca\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 09:49:44.472867 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.472708    2559 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-secret-kube-rbac-proxy\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 09:49:44.472867 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.472716    2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-secret-prometheus-k8s-tls\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 09:49:44.472867 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.472724    2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7634ad42-5f1c-4f85-8bbc-93024244c4e3-tls-assets\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 09:49:44.472867 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.472733    2559 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7634ad42-5f1c-4f85-8bbc-93024244c4e3-secret-metrics-client-certs\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 09:49:44.472867 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.472740    2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7634ad42-5f1c-4f85-8bbc-93024244c4e3-config-out\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 09:49:44.935857 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.935828    2559 generic.go:356] "Generic (PLEG): container finished" podID="7634ad42-5f1c-4f85-8bbc-93024244c4e3" containerID="b8ec9c6e29a74165e727271a8216197374c2efcea16371052fe726a32f933f77" exitCode=0
Jul 03 09:49:44.936005 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.935908    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:44.936005 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.935908    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7634ad42-5f1c-4f85-8bbc-93024244c4e3","Type":"ContainerDied","Data":"b8ec9c6e29a74165e727271a8216197374c2efcea16371052fe726a32f933f77"}
Jul 03 09:49:44.936005 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.935973    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7634ad42-5f1c-4f85-8bbc-93024244c4e3","Type":"ContainerDied","Data":"655e8dcb3cd205d6de6479a543c5f9ca922136d4d99dae00a15a68b132262799"}
Jul 03 09:49:44.936101 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.936007    2559 scope.go:117] "RemoveContainer" containerID="c9f23084a2cba3e582d6be01d8fa65743e577757fba8050541ca04ed39a7dcf3"
Jul 03 09:49:44.944513 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.944498    2559 scope.go:117] "RemoveContainer" containerID="e16450ad5ca2565d7dbdd2ec4c5c3734f18bdf0f5684acff5a236b3732a7310d"
Jul 03 09:49:44.951284 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.951264    2559 scope.go:117] "RemoveContainer" containerID="b8ec9c6e29a74165e727271a8216197374c2efcea16371052fe726a32f933f77"
Jul 03 09:49:44.957924 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.957892    2559 scope.go:117] "RemoveContainer" containerID="825fe7e2954d592cab57a37b117fb10f2d945f5e8191625009393f14ee89da60"
Jul 03 09:49:44.960012 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.959995    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 03 09:49:44.964425 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.964406    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 03 09:49:44.965031 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.965019    2559 scope.go:117] "RemoveContainer" containerID="b956c706fae187b75632af83323ed4cf235071aac8b93fe09ae3c46f219218da"
Jul 03 09:49:44.971449 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.971434    2559 scope.go:117] "RemoveContainer" containerID="ff8d58bd9af98062e0a310bfa7bccba6974227e2a496b0d3187901674f67364a"
Jul 03 09:49:44.978377 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.978364    2559 scope.go:117] "RemoveContainer" containerID="25478e0bf60ee0529307ee7fcea036acb58430acedc41ee39c36f02d648a0d52"
Jul 03 09:49:44.984680 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.984667    2559 scope.go:117] "RemoveContainer" containerID="c9f23084a2cba3e582d6be01d8fa65743e577757fba8050541ca04ed39a7dcf3"
Jul 03 09:49:44.984953 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:49:44.984935    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9f23084a2cba3e582d6be01d8fa65743e577757fba8050541ca04ed39a7dcf3\": container with ID starting with c9f23084a2cba3e582d6be01d8fa65743e577757fba8050541ca04ed39a7dcf3 not found: ID does not exist" containerID="c9f23084a2cba3e582d6be01d8fa65743e577757fba8050541ca04ed39a7dcf3"
Jul 03 09:49:44.984999 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.984961    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9f23084a2cba3e582d6be01d8fa65743e577757fba8050541ca04ed39a7dcf3"} err="failed to get container status \"c9f23084a2cba3e582d6be01d8fa65743e577757fba8050541ca04ed39a7dcf3\": rpc error: code = NotFound desc = could not find container \"c9f23084a2cba3e582d6be01d8fa65743e577757fba8050541ca04ed39a7dcf3\": container with ID starting with c9f23084a2cba3e582d6be01d8fa65743e577757fba8050541ca04ed39a7dcf3 not found: ID does not exist"
Jul 03 09:49:44.984999 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.984990    2559 scope.go:117] "RemoveContainer" containerID="e16450ad5ca2565d7dbdd2ec4c5c3734f18bdf0f5684acff5a236b3732a7310d"
Jul 03 09:49:44.985214 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:49:44.985198    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e16450ad5ca2565d7dbdd2ec4c5c3734f18bdf0f5684acff5a236b3732a7310d\": container with ID starting with e16450ad5ca2565d7dbdd2ec4c5c3734f18bdf0f5684acff5a236b3732a7310d not found: ID does not exist" containerID="e16450ad5ca2565d7dbdd2ec4c5c3734f18bdf0f5684acff5a236b3732a7310d"
Jul 03 09:49:44.985263 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.985216    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e16450ad5ca2565d7dbdd2ec4c5c3734f18bdf0f5684acff5a236b3732a7310d"} err="failed to get container status \"e16450ad5ca2565d7dbdd2ec4c5c3734f18bdf0f5684acff5a236b3732a7310d\": rpc error: code = NotFound desc = could not find container \"e16450ad5ca2565d7dbdd2ec4c5c3734f18bdf0f5684acff5a236b3732a7310d\": container with ID starting with e16450ad5ca2565d7dbdd2ec4c5c3734f18bdf0f5684acff5a236b3732a7310d not found: ID does not exist"
Jul 03 09:49:44.985263 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.985229    2559 scope.go:117] "RemoveContainer" containerID="b8ec9c6e29a74165e727271a8216197374c2efcea16371052fe726a32f933f77"
Jul 03 09:49:44.985448 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:49:44.985415    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8ec9c6e29a74165e727271a8216197374c2efcea16371052fe726a32f933f77\": container with ID starting with b8ec9c6e29a74165e727271a8216197374c2efcea16371052fe726a32f933f77 not found: ID does not exist" containerID="b8ec9c6e29a74165e727271a8216197374c2efcea16371052fe726a32f933f77"
Jul 03 09:49:44.985490 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.985452    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8ec9c6e29a74165e727271a8216197374c2efcea16371052fe726a32f933f77"} err="failed to get container status \"b8ec9c6e29a74165e727271a8216197374c2efcea16371052fe726a32f933f77\": rpc error: code = NotFound desc = could not find container \"b8ec9c6e29a74165e727271a8216197374c2efcea16371052fe726a32f933f77\": container with ID starting with b8ec9c6e29a74165e727271a8216197374c2efcea16371052fe726a32f933f77 not found: ID does not exist"
Jul 03 09:49:44.985490 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.985465    2559 scope.go:117] "RemoveContainer" containerID="825fe7e2954d592cab57a37b117fb10f2d945f5e8191625009393f14ee89da60"
Jul 03 09:49:44.985710 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:49:44.985695    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"825fe7e2954d592cab57a37b117fb10f2d945f5e8191625009393f14ee89da60\": container with ID starting with 825fe7e2954d592cab57a37b117fb10f2d945f5e8191625009393f14ee89da60 not found: ID does not exist" containerID="825fe7e2954d592cab57a37b117fb10f2d945f5e8191625009393f14ee89da60"
Jul 03 09:49:44.985771 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.985714    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"825fe7e2954d592cab57a37b117fb10f2d945f5e8191625009393f14ee89da60"} err="failed to get container status \"825fe7e2954d592cab57a37b117fb10f2d945f5e8191625009393f14ee89da60\": rpc error: code = NotFound desc = could not find container \"825fe7e2954d592cab57a37b117fb10f2d945f5e8191625009393f14ee89da60\": container with ID starting with 825fe7e2954d592cab57a37b117fb10f2d945f5e8191625009393f14ee89da60 not found: ID does not exist"
Jul 03 09:49:44.985771 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.985726    2559 scope.go:117] "RemoveContainer" containerID="b956c706fae187b75632af83323ed4cf235071aac8b93fe09ae3c46f219218da"
Jul 03 09:49:44.985987 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:49:44.985970    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b956c706fae187b75632af83323ed4cf235071aac8b93fe09ae3c46f219218da\": container with ID starting with b956c706fae187b75632af83323ed4cf235071aac8b93fe09ae3c46f219218da not found: ID does not exist" containerID="b956c706fae187b75632af83323ed4cf235071aac8b93fe09ae3c46f219218da"
Jul 03 09:49:44.986028 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.985992    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b956c706fae187b75632af83323ed4cf235071aac8b93fe09ae3c46f219218da"} err="failed to get container status \"b956c706fae187b75632af83323ed4cf235071aac8b93fe09ae3c46f219218da\": rpc error: code = NotFound desc = could not find container \"b956c706fae187b75632af83323ed4cf235071aac8b93fe09ae3c46f219218da\": container with ID starting with b956c706fae187b75632af83323ed4cf235071aac8b93fe09ae3c46f219218da not found: ID does not exist"
Jul 03 09:49:44.986028 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.986009    2559 scope.go:117] "RemoveContainer" containerID="ff8d58bd9af98062e0a310bfa7bccba6974227e2a496b0d3187901674f67364a"
Jul 03 09:49:44.986212 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:49:44.986197    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff8d58bd9af98062e0a310bfa7bccba6974227e2a496b0d3187901674f67364a\": container with ID starting with ff8d58bd9af98062e0a310bfa7bccba6974227e2a496b0d3187901674f67364a not found: ID does not exist" containerID="ff8d58bd9af98062e0a310bfa7bccba6974227e2a496b0d3187901674f67364a"
Jul 03 09:49:44.986263 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.986215    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff8d58bd9af98062e0a310bfa7bccba6974227e2a496b0d3187901674f67364a"} err="failed to get container status \"ff8d58bd9af98062e0a310bfa7bccba6974227e2a496b0d3187901674f67364a\": rpc error: code = NotFound desc = could not find container \"ff8d58bd9af98062e0a310bfa7bccba6974227e2a496b0d3187901674f67364a\": container with ID starting with ff8d58bd9af98062e0a310bfa7bccba6974227e2a496b0d3187901674f67364a not found: ID does not exist"
Jul 03 09:49:44.986263 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.986227    2559 scope.go:117] "RemoveContainer" containerID="25478e0bf60ee0529307ee7fcea036acb58430acedc41ee39c36f02d648a0d52"
Jul 03 09:49:44.986437 ip-10-0-131-117 kubenswrapper[2559]: E0703 09:49:44.986421    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25478e0bf60ee0529307ee7fcea036acb58430acedc41ee39c36f02d648a0d52\": container with ID starting with 25478e0bf60ee0529307ee7fcea036acb58430acedc41ee39c36f02d648a0d52 not found: ID does not exist" containerID="25478e0bf60ee0529307ee7fcea036acb58430acedc41ee39c36f02d648a0d52"
Jul 03 09:49:44.986471 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:44.986451    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25478e0bf60ee0529307ee7fcea036acb58430acedc41ee39c36f02d648a0d52"} err="failed to get container status \"25478e0bf60ee0529307ee7fcea036acb58430acedc41ee39c36f02d648a0d52\": rpc error: code = NotFound desc = could not find container \"25478e0bf60ee0529307ee7fcea036acb58430acedc41ee39c36f02d648a0d52\": container with ID starting with 25478e0bf60ee0529307ee7fcea036acb58430acedc41ee39c36f02d648a0d52 not found: ID does not exist"
Jul 03 09:49:45.003684 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.003659    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 03 09:49:45.003933 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.003922    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7634ad42-5f1c-4f85-8bbc-93024244c4e3" containerName="prometheus"
Jul 03 09:49:45.003981 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.003935    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7634ad42-5f1c-4f85-8bbc-93024244c4e3" containerName="prometheus"
Jul 03 09:49:45.003981 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.003945    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7634ad42-5f1c-4f85-8bbc-93024244c4e3" containerName="kube-rbac-proxy"
Jul 03 09:49:45.003981 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.003951    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7634ad42-5f1c-4f85-8bbc-93024244c4e3" containerName="kube-rbac-proxy"
Jul 03 09:49:45.003981 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.003959    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7634ad42-5f1c-4f85-8bbc-93024244c4e3" containerName="init-config-reloader"
Jul 03 09:49:45.003981 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.003965    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7634ad42-5f1c-4f85-8bbc-93024244c4e3" containerName="init-config-reloader"
Jul 03 09:49:45.003981 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.003971    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7634ad42-5f1c-4f85-8bbc-93024244c4e3" containerName="config-reloader"
Jul 03 09:49:45.003981 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.003978    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7634ad42-5f1c-4f85-8bbc-93024244c4e3" containerName="config-reloader"
Jul 03 09:49:45.004174 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.003984    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7634ad42-5f1c-4f85-8bbc-93024244c4e3" containerName="thanos-sidecar"
Jul 03 09:49:45.004174 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.003990    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7634ad42-5f1c-4f85-8bbc-93024244c4e3" containerName="thanos-sidecar"
Jul 03 09:49:45.004174 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.003996    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7634ad42-5f1c-4f85-8bbc-93024244c4e3" containerName="kube-rbac-proxy-web"
Jul 03 09:49:45.004174 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.004001    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7634ad42-5f1c-4f85-8bbc-93024244c4e3" containerName="kube-rbac-proxy-web"
Jul 03 09:49:45.004174 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.004008    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7634ad42-5f1c-4f85-8bbc-93024244c4e3" containerName="kube-rbac-proxy-thanos"
Jul 03 09:49:45.004174 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.004013    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7634ad42-5f1c-4f85-8bbc-93024244c4e3" containerName="kube-rbac-proxy-thanos"
Jul 03 09:49:45.004174 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.004082    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7634ad42-5f1c-4f85-8bbc-93024244c4e3" containerName="kube-rbac-proxy-web"
Jul 03 09:49:45.004174 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.004090    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7634ad42-5f1c-4f85-8bbc-93024244c4e3" containerName="kube-rbac-proxy"
Jul 03 09:49:45.004174 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.004097    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7634ad42-5f1c-4f85-8bbc-93024244c4e3" containerName="config-reloader"
Jul 03 09:49:45.004174 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.004102    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7634ad42-5f1c-4f85-8bbc-93024244c4e3" containerName="thanos-sidecar"
Jul 03 09:49:45.004174 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.004110    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7634ad42-5f1c-4f85-8bbc-93024244c4e3" containerName="prometheus"
Jul 03 09:49:45.004174 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.004115    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7634ad42-5f1c-4f85-8bbc-93024244c4e3" containerName="kube-rbac-proxy-thanos"
Jul 03 09:49:45.009275 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.009259    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.012713 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.012697    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 03 09:49:45.012992 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.012969    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 03 09:49:45.013075 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.013004    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 03 09:49:45.013075 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.013049    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 03 09:49:45.013390 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.013374    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 03 09:49:45.013390 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.013385    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 03 09:49:45.013847 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.013833    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 03 09:49:45.014423 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.014408    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 03 09:49:45.014843 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.014827    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8adl9m3oks163\""
Jul 03 09:49:45.015229 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.015208    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 03 09:49:45.017103 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.017083    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 03 09:49:45.017183 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.017153    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 03 09:49:45.017259 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.017241    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 03 09:49:45.017523 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.017507    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xghw5\""
Jul 03 09:49:45.020049 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.020034    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 03 09:49:45.027300 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.027282    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 03 09:49:45.032262 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.032245    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 03 09:49:45.076487 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.076461    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3307e753-ff67-4a84-ba87-a846b4c271a7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.076606 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.076497    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3307e753-ff67-4a84-ba87-a846b4c271a7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.076606 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.076523    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3307e753-ff67-4a84-ba87-a846b4c271a7-config-out\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.076606 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.076591    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3307e753-ff67-4a84-ba87-a846b4c271a7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.076720 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.076623    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3307e753-ff67-4a84-ba87-a846b4c271a7-config\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.076720 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.076648    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3307e753-ff67-4a84-ba87-a846b4c271a7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.076720 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.076670    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3307e753-ff67-4a84-ba87-a846b4c271a7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.076720 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.076692    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3307e753-ff67-4a84-ba87-a846b4c271a7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.076720 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.076717    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3307e753-ff67-4a84-ba87-a846b4c271a7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.076949 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.076787    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3307e753-ff67-4a84-ba87-a846b4c271a7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.076949 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.076824    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3307e753-ff67-4a84-ba87-a846b4c271a7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.076949 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.076855    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3307e753-ff67-4a84-ba87-a846b4c271a7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.076949 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.076880    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3307e753-ff67-4a84-ba87-a846b4c271a7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.076949 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.076905    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3307e753-ff67-4a84-ba87-a846b4c271a7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.076949 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.076944    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3307e753-ff67-4a84-ba87-a846b4c271a7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.077150 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.076975    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3307e753-ff67-4a84-ba87-a846b4c271a7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.077150 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.076998    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3307e753-ff67-4a84-ba87-a846b4c271a7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.077150 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.077036    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3307e753-ff67-4a84-ba87-a846b4c271a7-web-config\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.077150 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.077088    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3307e753-ff67-4a84-ba87-a846b4c271a7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.077150 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.077109    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znbf8\" (UniqueName: \"kubernetes.io/projected/3307e753-ff67-4a84-ba87-a846b4c271a7-kube-api-access-znbf8\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.126882 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.126855    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 03 09:49:45.178027 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.178001    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3307e753-ff67-4a84-ba87-a846b4c271a7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.178027 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.178031    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3307e753-ff67-4a84-ba87-a846b4c271a7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.178205 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.178049    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3307e753-ff67-4a84-ba87-a846b4c271a7-config-out\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.178205 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.178163    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3307e753-ff67-4a84-ba87-a846b4c271a7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.178307 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.178203    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3307e753-ff67-4a84-ba87-a846b4c271a7-config\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.178307 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.178232    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3307e753-ff67-4a84-ba87-a846b4c271a7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.178407 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.178351    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3307e753-ff67-4a84-ba87-a846b4c271a7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.178407 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.178394    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3307e753-ff67-4a84-ba87-a846b4c271a7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.178509 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.178422    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3307e753-ff67-4a84-ba87-a846b4c271a7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.178509 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.178456    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3307e753-ff67-4a84-ba87-a846b4c271a7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.178509 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.178492    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3307e753-ff67-4a84-ba87-a846b4c271a7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.178702 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.178523    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3307e753-ff67-4a84-ba87-a846b4c271a7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.178702 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.178572    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3307e753-ff67-4a84-ba87-a846b4c271a7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.178702 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.178598    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3307e753-ff67-4a84-ba87-a846b4c271a7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.178702 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.178647    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3307e753-ff67-4a84-ba87-a846b4c271a7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.178702 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.178684    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3307e753-ff67-4a84-ba87-a846b4c271a7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.178928 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.178708    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3307e753-ff67-4a84-ba87-a846b4c271a7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.178928 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.178740    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3307e753-ff67-4a84-ba87-a846b4c271a7-web-config\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.178928 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.178782    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3307e753-ff67-4a84-ba87-a846b4c271a7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.178928 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.178809    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znbf8\" (UniqueName: \"kubernetes.io/projected/3307e753-ff67-4a84-ba87-a846b4c271a7-kube-api-access-znbf8\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.179097 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.178886    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3307e753-ff67-4a84-ba87-a846b4c271a7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.179457 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.179387    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3307e753-ff67-4a84-ba87-a846b4c271a7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.179774 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.179745    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3307e753-ff67-4a84-ba87-a846b4c271a7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.180769 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.180748    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3307e753-ff67-4a84-ba87-a846b4c271a7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.181884 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.181509    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3307e753-ff67-4a84-ba87-a846b4c271a7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.182021 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.181657    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3307e753-ff67-4a84-ba87-a846b4c271a7-config\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.182021 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.181872    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3307e753-ff67-4a84-ba87-a846b4c271a7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.182150 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.181873    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3307e753-ff67-4a84-ba87-a846b4c271a7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.182387 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.182357    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3307e753-ff67-4a84-ba87-a846b4c271a7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.182678 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.182659    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3307e753-ff67-4a84-ba87-a846b4c271a7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.183391 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.183233    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3307e753-ff67-4a84-ba87-a846b4c271a7-web-config\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.183514 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.183492    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3307e753-ff67-4a84-ba87-a846b4c271a7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.184088 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.183738    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3307e753-ff67-4a84-ba87-a846b4c271a7-config-out\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.184088 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.183884    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3307e753-ff67-4a84-ba87-a846b4c271a7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.184088 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.184048    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3307e753-ff67-4a84-ba87-a846b4c271a7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.184680 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.184663    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3307e753-ff67-4a84-ba87-a846b4c271a7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.184783 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.184696    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3307e753-ff67-4a84-ba87-a846b4c271a7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.184863 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.184841    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3307e753-ff67-4a84-ba87-a846b4c271a7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.185007 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.184992    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3307e753-ff67-4a84-ba87-a846b4c271a7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.187597 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.187533    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znbf8\" (UniqueName: \"kubernetes.io/projected/3307e753-ff67-4a84-ba87-a846b4c271a7-kube-api-access-znbf8\") pod \"prometheus-k8s-0\" (UID: \"3307e753-ff67-4a84-ba87-a846b4c271a7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.318324 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.318295    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:49:45.461160 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.461137    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 03 09:49:45.463045 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:49:45.463018    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3307e753_ff67_4a84_ba87_a846b4c271a7.slice/crio-788fb71684f666870e9718e5e86c0d263805a45f97af5dd85f3718260049c352 WatchSource:0}: Error finding container 788fb71684f666870e9718e5e86c0d263805a45f97af5dd85f3718260049c352: Status 404 returned error can't find the container with id 788fb71684f666870e9718e5e86c0d263805a45f97af5dd85f3718260049c352
Jul 03 09:49:45.690724 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.690692    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7634ad42-5f1c-4f85-8bbc-93024244c4e3" path="/var/lib/kubelet/pods/7634ad42-5f1c-4f85-8bbc-93024244c4e3/volumes"
Jul 03 09:49:45.941258 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.941224    2559 generic.go:356] "Generic (PLEG): container finished" podID="3307e753-ff67-4a84-ba87-a846b4c271a7" containerID="c8be381064d76d0ee03508c87371046a0d539a56ba4d42706cbb8a42d0eac6da" exitCode=0
Jul 03 09:49:45.941420 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.941317    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3307e753-ff67-4a84-ba87-a846b4c271a7","Type":"ContainerDied","Data":"c8be381064d76d0ee03508c87371046a0d539a56ba4d42706cbb8a42d0eac6da"}
Jul 03 09:49:45.941420 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:45.941385    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3307e753-ff67-4a84-ba87-a846b4c271a7","Type":"ContainerStarted","Data":"788fb71684f666870e9718e5e86c0d263805a45f97af5dd85f3718260049c352"}
Jul 03 09:49:46.949844 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:46.949806    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3307e753-ff67-4a84-ba87-a846b4c271a7","Type":"ContainerStarted","Data":"8279d18a69487377b515e4f2e089f7730aad6544c609a2ec8cea27671876d678"}
Jul 03 09:49:46.950208 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:46.949875    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3307e753-ff67-4a84-ba87-a846b4c271a7","Type":"ContainerStarted","Data":"bd42eb7d3be73f754a6d619e9c21fb83bd80c72f4f4ebde4afb6fb2e67e84389"}
Jul 03 09:49:46.950208 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:46.949905    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3307e753-ff67-4a84-ba87-a846b4c271a7","Type":"ContainerStarted","Data":"4cef08e23e5d720116804e45adb233eb541b3e9a519ff88847f91f6fad0f72e9"}
Jul 03 09:49:46.950208 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:46.949934    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3307e753-ff67-4a84-ba87-a846b4c271a7","Type":"ContainerStarted","Data":"4d73d4860a54432a0ee818780f17eb83f674c85cbe78c162bd30a394f7fef86e"}
Jul 03 09:49:46.950208 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:46.949958    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3307e753-ff67-4a84-ba87-a846b4c271a7","Type":"ContainerStarted","Data":"b62c4aab5b8131aad4bf744c5a76b387a64cfaa7ef754d3549c10e2cb85795dc"}
Jul 03 09:49:46.950208 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:46.949980    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3307e753-ff67-4a84-ba87-a846b4c271a7","Type":"ContainerStarted","Data":"2c5cf5dbe5409b29405d701147c541209e0fbcb95b3573ed3a92f07264df05ae"}
Jul 03 09:49:46.988997 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:46.988891    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.9724175969999997 podStartE2EDuration="2.9888725s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.454903ms" isStatefulPod=false podCreationTimestamp="2026-07-03 09:49:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:49:46.985251515 +0000 UTC m=+387.855917157" watchObservedRunningTime="2026-07-03 09:49:46.9888725 +0000 UTC m=+387.859538133"
Jul 03 09:49:50.319248 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:49:50.319214    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:50:45.318796 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:50:45.318710    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:50:45.334579 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:50:45.334533    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:50:46.186452 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:50:46.186427    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 03 09:52:06.640982 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:06.640950    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl"]
Jul 03 09:52:06.644319 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:06.644297    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl"
Jul 03 09:52:06.649567 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:06.649526    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 03 09:52:06.651314 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:06.651293    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 03 09:52:06.651679 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:06.651657    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zswg2\""
Jul 03 09:52:06.651784 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:06.651715    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 03 09:52:06.652048 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:06.652030    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 03 09:52:06.679877 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:06.679855    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl"]
Jul 03 09:52:06.830257 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:06.830223    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8be607f2-2be4-4ab0-ae11-da355ce1c27f-tmp\") pod \"opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl\" (UID: \"8be607f2-2be4-4ab0-ae11-da355ce1c27f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl"
Jul 03 09:52:06.830257 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:06.830261    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8be607f2-2be4-4ab0-ae11-da355ce1c27f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl\" (UID: \"8be607f2-2be4-4ab0-ae11-da355ce1c27f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl"
Jul 03 09:52:06.830485 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:06.830289    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zxgc\" (UniqueName: \"kubernetes.io/projected/8be607f2-2be4-4ab0-ae11-da355ce1c27f-kube-api-access-5zxgc\") pod \"opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl\" (UID: \"8be607f2-2be4-4ab0-ae11-da355ce1c27f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl"
Jul 03 09:52:06.830485 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:06.830359    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8be607f2-2be4-4ab0-ae11-da355ce1c27f-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl\" (UID: \"8be607f2-2be4-4ab0-ae11-da355ce1c27f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl"
Jul 03 09:52:06.830485 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:06.830415    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8be607f2-2be4-4ab0-ae11-da355ce1c27f-manifests\") pod \"opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl\" (UID: \"8be607f2-2be4-4ab0-ae11-da355ce1c27f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl"
Jul 03 09:52:06.931688 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:06.931654    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8be607f2-2be4-4ab0-ae11-da355ce1c27f-manifests\") pod \"opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl\" (UID: \"8be607f2-2be4-4ab0-ae11-da355ce1c27f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl"
Jul 03 09:52:06.931863 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:06.931756    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8be607f2-2be4-4ab0-ae11-da355ce1c27f-tmp\") pod \"opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl\" (UID: \"8be607f2-2be4-4ab0-ae11-da355ce1c27f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl"
Jul 03 09:52:06.931863 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:06.931781    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8be607f2-2be4-4ab0-ae11-da355ce1c27f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl\" (UID: \"8be607f2-2be4-4ab0-ae11-da355ce1c27f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl"
Jul 03 09:52:06.931863 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:06.931803    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zxgc\" (UniqueName: \"kubernetes.io/projected/8be607f2-2be4-4ab0-ae11-da355ce1c27f-kube-api-access-5zxgc\") pod \"opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl\" (UID: \"8be607f2-2be4-4ab0-ae11-da355ce1c27f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl"
Jul 03 09:52:06.931863 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:06.931832    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8be607f2-2be4-4ab0-ae11-da355ce1c27f-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl\" (UID: \"8be607f2-2be4-4ab0-ae11-da355ce1c27f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl"
Jul 03 09:52:06.932082 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:06.932059    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8be607f2-2be4-4ab0-ae11-da355ce1c27f-manifests\") pod \"opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl\" (UID: \"8be607f2-2be4-4ab0-ae11-da355ce1c27f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl"
Jul 03 09:52:06.934229 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:06.934196    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8be607f2-2be4-4ab0-ae11-da355ce1c27f-tmp\") pod \"opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl\" (UID: \"8be607f2-2be4-4ab0-ae11-da355ce1c27f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl"
Jul 03 09:52:06.934343 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:06.934257    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8be607f2-2be4-4ab0-ae11-da355ce1c27f-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl\" (UID: \"8be607f2-2be4-4ab0-ae11-da355ce1c27f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl"
Jul 03 09:52:06.934343 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:06.934296    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8be607f2-2be4-4ab0-ae11-da355ce1c27f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl\" (UID: \"8be607f2-2be4-4ab0-ae11-da355ce1c27f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl"
Jul 03 09:52:06.944264 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:06.944238    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zxgc\" (UniqueName: \"kubernetes.io/projected/8be607f2-2be4-4ab0-ae11-da355ce1c27f-kube-api-access-5zxgc\") pod \"opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl\" (UID: \"8be607f2-2be4-4ab0-ae11-da355ce1c27f\") " pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl"
Jul 03 09:52:06.955026 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:06.955003    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl"
Jul 03 09:52:07.094603 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:07.094579    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl"]
Jul 03 09:52:07.096481 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:52:07.096456    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8be607f2_2be4_4ab0_ae11_da355ce1c27f.slice/crio-dd0104c27d951d8f5b17fe8625d51b7216b8f21fc678b1b674a4fd0fe79304fb WatchSource:0}: Error finding container dd0104c27d951d8f5b17fe8625d51b7216b8f21fc678b1b674a4fd0fe79304fb: Status 404 returned error can't find the container with id dd0104c27d951d8f5b17fe8625d51b7216b8f21fc678b1b674a4fd0fe79304fb
Jul 03 09:52:07.468754 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:07.468721    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl" event={"ID":"8be607f2-2be4-4ab0-ae11-da355ce1c27f","Type":"ContainerStarted","Data":"dd0104c27d951d8f5b17fe8625d51b7216b8f21fc678b1b674a4fd0fe79304fb"}
Jul 03 09:52:10.486023 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:10.485983    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl" event={"ID":"8be607f2-2be4-4ab0-ae11-da355ce1c27f","Type":"ContainerStarted","Data":"e877fa7b1bac9a20b94fad54bb08f54d6e8478feed6dfc964e6ae5dbd2b847dc"}
Jul 03 09:52:11.491917 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:11.491882    2559 generic.go:356] "Generic (PLEG): container finished" podID="8be607f2-2be4-4ab0-ae11-da355ce1c27f" containerID="e877fa7b1bac9a20b94fad54bb08f54d6e8478feed6dfc964e6ae5dbd2b847dc" exitCode=0
Jul 03 09:52:11.492278 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:11.491961    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl" event={"ID":"8be607f2-2be4-4ab0-ae11-da355ce1c27f","Type":"ContainerDied","Data":"e877fa7b1bac9a20b94fad54bb08f54d6e8478feed6dfc964e6ae5dbd2b847dc"}
Jul 03 09:52:12.498511 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:12.498477    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl" event={"ID":"8be607f2-2be4-4ab0-ae11-da355ce1c27f","Type":"ContainerStarted","Data":"30ebad9d4a93b80877ce2455bd41c118c309d7787c8b0ab0d19e31abd2a8a31e"}
Jul 03 09:52:12.498996 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:12.498599    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl"
Jul 03 09:52:12.524375 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:12.524320    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl" podStartSLOduration=2.199122485 podStartE2EDuration="6.524306057s" totalImagesPullingTime="3.256299121s" totalInitContainerRuntime="1.068884451s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:52:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:52:12.52163797 +0000 UTC m=+533.392303612" watchObservedRunningTime="2026-07-03 09:52:12.524306057 +0000 UTC m=+533.394971686"
Jul 03 09:52:23.504766 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:23.504738    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl"
Jul 03 09:52:25.046917 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:25.046884    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-75576cf7dd-7t9tp"]
Jul 03 09:52:25.056727 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:25.056704    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-75576cf7dd-7t9tp"
Jul 03 09:52:25.061828 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:25.061805    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 03 09:52:25.062347 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:25.062326    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-wgc44\""
Jul 03 09:52:25.062617 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:25.062596    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 03 09:52:25.062617 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:25.062603    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 03 09:52:25.062773 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:25.062617    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 03 09:52:25.062882 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:25.062869    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 03 09:52:25.075733 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:25.075714    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3f0d6ea2-8150-4e3b-bad7-71f4de48c005-metrics-cert\") pod \"lws-controller-manager-75576cf7dd-7t9tp\" (UID: \"3f0d6ea2-8150-4e3b-bad7-71f4de48c005\") " pod="openshift-lws-operator/lws-controller-manager-75576cf7dd-7t9tp"
Jul 03 09:52:25.075905 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:25.075886    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcz6s\" (UniqueName: \"kubernetes.io/projected/3f0d6ea2-8150-4e3b-bad7-71f4de48c005-kube-api-access-vcz6s\") pod \"lws-controller-manager-75576cf7dd-7t9tp\" (UID: \"3f0d6ea2-8150-4e3b-bad7-71f4de48c005\") " pod="openshift-lws-operator/lws-controller-manager-75576cf7dd-7t9tp"
Jul 03 09:52:25.075980 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:25.075923    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3f0d6ea2-8150-4e3b-bad7-71f4de48c005-manager-config\") pod \"lws-controller-manager-75576cf7dd-7t9tp\" (UID: \"3f0d6ea2-8150-4e3b-bad7-71f4de48c005\") " pod="openshift-lws-operator/lws-controller-manager-75576cf7dd-7t9tp"
Jul 03 09:52:25.075980 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:25.075955    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f0d6ea2-8150-4e3b-bad7-71f4de48c005-cert\") pod \"lws-controller-manager-75576cf7dd-7t9tp\" (UID: \"3f0d6ea2-8150-4e3b-bad7-71f4de48c005\") " pod="openshift-lws-operator/lws-controller-manager-75576cf7dd-7t9tp"
Jul 03 09:52:25.076051 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:25.075975    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-75576cf7dd-7t9tp"]
Jul 03 09:52:25.176948 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:25.176917    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcz6s\" (UniqueName: \"kubernetes.io/projected/3f0d6ea2-8150-4e3b-bad7-71f4de48c005-kube-api-access-vcz6s\") pod \"lws-controller-manager-75576cf7dd-7t9tp\" (UID: \"3f0d6ea2-8150-4e3b-bad7-71f4de48c005\") " pod="openshift-lws-operator/lws-controller-manager-75576cf7dd-7t9tp"
Jul 03 09:52:25.177103 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:25.176954    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3f0d6ea2-8150-4e3b-bad7-71f4de48c005-manager-config\") pod \"lws-controller-manager-75576cf7dd-7t9tp\" (UID: \"3f0d6ea2-8150-4e3b-bad7-71f4de48c005\") " pod="openshift-lws-operator/lws-controller-manager-75576cf7dd-7t9tp"
Jul 03 09:52:25.177103 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:25.176981    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f0d6ea2-8150-4e3b-bad7-71f4de48c005-cert\") pod \"lws-controller-manager-75576cf7dd-7t9tp\" (UID: \"3f0d6ea2-8150-4e3b-bad7-71f4de48c005\") " pod="openshift-lws-operator/lws-controller-manager-75576cf7dd-7t9tp"
Jul 03 09:52:25.177103 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:25.177015    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3f0d6ea2-8150-4e3b-bad7-71f4de48c005-metrics-cert\") pod \"lws-controller-manager-75576cf7dd-7t9tp\" (UID: \"3f0d6ea2-8150-4e3b-bad7-71f4de48c005\") " pod="openshift-lws-operator/lws-controller-manager-75576cf7dd-7t9tp"
Jul 03 09:52:25.177540 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:25.177518    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3f0d6ea2-8150-4e3b-bad7-71f4de48c005-manager-config\") pod \"lws-controller-manager-75576cf7dd-7t9tp\" (UID: \"3f0d6ea2-8150-4e3b-bad7-71f4de48c005\") " pod="openshift-lws-operator/lws-controller-manager-75576cf7dd-7t9tp"
Jul 03 09:52:25.179592 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:25.179564    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3f0d6ea2-8150-4e3b-bad7-71f4de48c005-metrics-cert\") pod \"lws-controller-manager-75576cf7dd-7t9tp\" (UID: \"3f0d6ea2-8150-4e3b-bad7-71f4de48c005\") " pod="openshift-lws-operator/lws-controller-manager-75576cf7dd-7t9tp"
Jul 03 09:52:25.179592 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:25.179572    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f0d6ea2-8150-4e3b-bad7-71f4de48c005-cert\") pod \"lws-controller-manager-75576cf7dd-7t9tp\" (UID: \"3f0d6ea2-8150-4e3b-bad7-71f4de48c005\") " pod="openshift-lws-operator/lws-controller-manager-75576cf7dd-7t9tp"
Jul 03 09:52:25.198174 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:25.198151    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcz6s\" (UniqueName: \"kubernetes.io/projected/3f0d6ea2-8150-4e3b-bad7-71f4de48c005-kube-api-access-vcz6s\") pod \"lws-controller-manager-75576cf7dd-7t9tp\" (UID: \"3f0d6ea2-8150-4e3b-bad7-71f4de48c005\") " pod="openshift-lws-operator/lws-controller-manager-75576cf7dd-7t9tp"
Jul 03 09:52:25.366235 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:25.366165    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-75576cf7dd-7t9tp"
Jul 03 09:52:25.552773 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:25.552748    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-75576cf7dd-7t9tp"]
Jul 03 09:52:25.554581 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:52:25.554532    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f0d6ea2_8150_4e3b_bad7_71f4de48c005.slice/crio-d15ec54a1177df9424efad99af009ab0c848e67a29fb4b28254448aa87214640 WatchSource:0}: Error finding container d15ec54a1177df9424efad99af009ab0c848e67a29fb4b28254448aa87214640: Status 404 returned error can't find the container with id d15ec54a1177df9424efad99af009ab0c848e67a29fb4b28254448aa87214640
Jul 03 09:52:26.072997 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:26.072966    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5f5df5b9bf-qlxc9"]
Jul 03 09:52:26.075986 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:26.075966    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f5df5b9bf-qlxc9"
Jul 03 09:52:26.082676 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:26.082457    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 03 09:52:26.083669 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:26.083470    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 03 09:52:26.083669 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:26.083537    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 03 09:52:26.083669 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:26.083610    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-gjsm8\""
Jul 03 09:52:26.083669 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:26.083537    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 03 09:52:26.096605 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:26.096584    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f5df5b9bf-qlxc9"]
Jul 03 09:52:26.185087 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:26.185060    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4679e45-918e-4741-a4c0-730f1a8bfd28-tmp\") pod \"kube-auth-proxy-5f5df5b9bf-qlxc9\" (UID: \"b4679e45-918e-4741-a4c0-730f1a8bfd28\") " pod="openshift-ingress/kube-auth-proxy-5f5df5b9bf-qlxc9"
Jul 03 09:52:26.185255 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:26.185130    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4679e45-918e-4741-a4c0-730f1a8bfd28-tls-certs\") pod \"kube-auth-proxy-5f5df5b9bf-qlxc9\" (UID: \"b4679e45-918e-4741-a4c0-730f1a8bfd28\") " pod="openshift-ingress/kube-auth-proxy-5f5df5b9bf-qlxc9"
Jul 03 09:52:26.185255 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:26.185167    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m78x\" (UniqueName: \"kubernetes.io/projected/b4679e45-918e-4741-a4c0-730f1a8bfd28-kube-api-access-5m78x\") pod \"kube-auth-proxy-5f5df5b9bf-qlxc9\" (UID: \"b4679e45-918e-4741-a4c0-730f1a8bfd28\") " pod="openshift-ingress/kube-auth-proxy-5f5df5b9bf-qlxc9"
Jul 03 09:52:26.285791 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:26.285764    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4679e45-918e-4741-a4c0-730f1a8bfd28-tls-certs\") pod \"kube-auth-proxy-5f5df5b9bf-qlxc9\" (UID: \"b4679e45-918e-4741-a4c0-730f1a8bfd28\") " pod="openshift-ingress/kube-auth-proxy-5f5df5b9bf-qlxc9"
Jul 03 09:52:26.285928 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:26.285802    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m78x\" (UniqueName: \"kubernetes.io/projected/b4679e45-918e-4741-a4c0-730f1a8bfd28-kube-api-access-5m78x\") pod \"kube-auth-proxy-5f5df5b9bf-qlxc9\" (UID: \"b4679e45-918e-4741-a4c0-730f1a8bfd28\") " pod="openshift-ingress/kube-auth-proxy-5f5df5b9bf-qlxc9"
Jul 03 09:52:26.285928 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:26.285833    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4679e45-918e-4741-a4c0-730f1a8bfd28-tmp\") pod \"kube-auth-proxy-5f5df5b9bf-qlxc9\" (UID: \"b4679e45-918e-4741-a4c0-730f1a8bfd28\") " pod="openshift-ingress/kube-auth-proxy-5f5df5b9bf-qlxc9"
Jul 03 09:52:26.288116 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:26.288096    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4679e45-918e-4741-a4c0-730f1a8bfd28-tmp\") pod \"kube-auth-proxy-5f5df5b9bf-qlxc9\" (UID: \"b4679e45-918e-4741-a4c0-730f1a8bfd28\") " pod="openshift-ingress/kube-auth-proxy-5f5df5b9bf-qlxc9"
Jul 03 09:52:26.288242 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:26.288219    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4679e45-918e-4741-a4c0-730f1a8bfd28-tls-certs\") pod \"kube-auth-proxy-5f5df5b9bf-qlxc9\" (UID: \"b4679e45-918e-4741-a4c0-730f1a8bfd28\") " pod="openshift-ingress/kube-auth-proxy-5f5df5b9bf-qlxc9"
Jul 03 09:52:26.297581 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:26.297538    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m78x\" (UniqueName: \"kubernetes.io/projected/b4679e45-918e-4741-a4c0-730f1a8bfd28-kube-api-access-5m78x\") pod \"kube-auth-proxy-5f5df5b9bf-qlxc9\" (UID: \"b4679e45-918e-4741-a4c0-730f1a8bfd28\") " pod="openshift-ingress/kube-auth-proxy-5f5df5b9bf-qlxc9"
Jul 03 09:52:26.386909 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:26.386830    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f5df5b9bf-qlxc9"
Jul 03 09:52:26.562536 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:26.562460    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-75576cf7dd-7t9tp" event={"ID":"3f0d6ea2-8150-4e3b-bad7-71f4de48c005","Type":"ContainerStarted","Data":"d15ec54a1177df9424efad99af009ab0c848e67a29fb4b28254448aa87214640"}
Jul 03 09:52:26.568605 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:26.568345    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f5df5b9bf-qlxc9"]
Jul 03 09:52:26.571285 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:52:26.571249    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4679e45_918e_4741_a4c0_730f1a8bfd28.slice/crio-fd9169e3c407b1ec01e2608ea3323c5994fb3b157a11cf4b3742382c476e4bb9 WatchSource:0}: Error finding container fd9169e3c407b1ec01e2608ea3323c5994fb3b157a11cf4b3742382c476e4bb9: Status 404 returned error can't find the container with id fd9169e3c407b1ec01e2608ea3323c5994fb3b157a11cf4b3742382c476e4bb9
Jul 03 09:52:27.574144 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:27.574101    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f5df5b9bf-qlxc9" event={"ID":"b4679e45-918e-4741-a4c0-730f1a8bfd28","Type":"ContainerStarted","Data":"fd9169e3c407b1ec01e2608ea3323c5994fb3b157a11cf4b3742382c476e4bb9"}
Jul 03 09:52:28.581792 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:28.581460    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-75576cf7dd-7t9tp" event={"ID":"3f0d6ea2-8150-4e3b-bad7-71f4de48c005","Type":"ContainerStarted","Data":"6a1fe276b3f9c0be6da0ec2df075001e8b60319b2daf6e4fd535d2d97363b407"}
Jul 03 09:52:28.581792 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:28.581599    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-75576cf7dd-7t9tp"
Jul 03 09:52:29.587823 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:29.587752    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f5df5b9bf-qlxc9" event={"ID":"b4679e45-918e-4741-a4c0-730f1a8bfd28","Type":"ContainerStarted","Data":"d347c436d603264b518b911d396e9f7f93e7b5b3710f27a19d95641313af9ed5"}
Jul 03 09:52:29.609073 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:29.609023    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-75576cf7dd-7t9tp" podStartSLOduration=1.892602473 podStartE2EDuration="4.609003948s" totalImagesPullingTime="2.716401475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:52:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:52:28.623045171 +0000 UTC m=+549.493710799" watchObservedRunningTime="2026-07-03 09:52:29.609003948 +0000 UTC m=+550.479669574"
Jul 03 09:52:29.609242 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:29.609114    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5f5df5b9bf-qlxc9" podStartSLOduration=1.140111159 podStartE2EDuration="3.609108473s" totalImagesPullingTime="2.468997314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:52:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:52:29.606976722 +0000 UTC m=+550.477642363" watchObservedRunningTime="2026-07-03 09:52:29.609108473 +0000 UTC m=+550.479774107"
Jul 03 09:52:39.590760 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:52:39.590730    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-75576cf7dd-7t9tp"
Jul 03 09:53:19.541162 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:53:19.541131    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c4mdt_9d052bc8-d41a-494c-9523-5bfdcfb29ec2/console-operator/2.log"
Jul 03 09:53:19.543127 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:53:19.543107    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c4mdt_9d052bc8-d41a-494c-9523-5bfdcfb29ec2/console-operator/2.log"
Jul 03 09:55:04.925895 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:04.925861    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6"]
Jul 03 09:55:04.929249 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:04.929226    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6"
Jul 03 09:55:04.932032 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:04.932014    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 03 09:55:04.932134 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:04.932015    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-dbr9c\""
Jul 03 09:55:04.942402 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:04.942383    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6"]
Jul 03 09:55:05.023451 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:05.023415    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/691d502a-0ea2-4ca0-bb5c-c05c4a56db73-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4wpm6\" (UID: \"691d502a-0ea2-4ca0-bb5c-c05c4a56db73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6"
Jul 03 09:55:05.023451 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:05.023456    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/691d502a-0ea2-4ca0-bb5c-c05c4a56db73-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4wpm6\" (UID: \"691d502a-0ea2-4ca0-bb5c-c05c4a56db73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6"
Jul 03 09:55:05.023657 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:05.023482    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/691d502a-0ea2-4ca0-bb5c-c05c4a56db73-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4wpm6\" (UID: \"691d502a-0ea2-4ca0-bb5c-c05c4a56db73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6"
Jul 03 09:55:05.023657 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:05.023592    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/691d502a-0ea2-4ca0-bb5c-c05c4a56db73-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4wpm6\" (UID: \"691d502a-0ea2-4ca0-bb5c-c05c4a56db73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6"
Jul 03 09:55:05.023657 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:05.023613    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/691d502a-0ea2-4ca0-bb5c-c05c4a56db73-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4wpm6\" (UID: \"691d502a-0ea2-4ca0-bb5c-c05c4a56db73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6"
Jul 03 09:55:05.023657 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:05.023646    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/691d502a-0ea2-4ca0-bb5c-c05c4a56db73-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4wpm6\" (UID: \"691d502a-0ea2-4ca0-bb5c-c05c4a56db73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6"
Jul 03 09:55:05.023782 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:05.023725    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lb6p7\" (UniqueName: \"kubernetes.io/projected/691d502a-0ea2-4ca0-bb5c-c05c4a56db73-kube-api-access-lb6p7\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4wpm6\" (UID: \"691d502a-0ea2-4ca0-bb5c-c05c4a56db73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6"
Jul 03 09:55:05.023782 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:05.023777    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/691d502a-0ea2-4ca0-bb5c-c05c4a56db73-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4wpm6\" (UID: \"691d502a-0ea2-4ca0-bb5c-c05c4a56db73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6"
Jul 03 09:55:05.023886 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:05.023800    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/691d502a-0ea2-4ca0-bb5c-c05c4a56db73-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4wpm6\" (UID: \"691d502a-0ea2-4ca0-bb5c-c05c4a56db73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6"
Jul 03 09:55:05.124942 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:05.124907    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/691d502a-0ea2-4ca0-bb5c-c05c4a56db73-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4wpm6\" (UID: \"691d502a-0ea2-4ca0-bb5c-c05c4a56db73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6"
Jul 03 09:55:05.124942 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:05.124940    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/691d502a-0ea2-4ca0-bb5c-c05c4a56db73-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4wpm6\" (UID: \"691d502a-0ea2-4ca0-bb5c-c05c4a56db73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6"
Jul 03 09:55:05.125139 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:05.124964    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/691d502a-0ea2-4ca0-bb5c-c05c4a56db73-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4wpm6\" (UID: \"691d502a-0ea2-4ca0-bb5c-c05c4a56db73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6"
Jul 03 09:55:05.125139 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:05.125085    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lb6p7\" (UniqueName: \"kubernetes.io/projected/691d502a-0ea2-4ca0-bb5c-c05c4a56db73-kube-api-access-lb6p7\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4wpm6\" (UID: \"691d502a-0ea2-4ca0-bb5c-c05c4a56db73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6"
Jul 03 09:55:05.125219 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:05.125191    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/691d502a-0ea2-4ca0-bb5c-c05c4a56db73-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4wpm6\" (UID: \"691d502a-0ea2-4ca0-bb5c-c05c4a56db73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6"
Jul 03 09:55:05.125266 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:05.125218    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/691d502a-0ea2-4ca0-bb5c-c05c4a56db73-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4wpm6\" (UID: \"691d502a-0ea2-4ca0-bb5c-c05c4a56db73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6"
Jul 03 09:55:05.125309 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:05.125272    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/691d502a-0ea2-4ca0-bb5c-c05c4a56db73-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4wpm6\" (UID: \"691d502a-0ea2-4ca0-bb5c-c05c4a56db73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6"
Jul 03 09:55:05.125309 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:05.125298    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/691d502a-0ea2-4ca0-bb5c-c05c4a56db73-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4wpm6\" (UID: \"691d502a-0ea2-4ca0-bb5c-c05c4a56db73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6"
Jul 03 09:55:05.125409 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:05.125322    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/691d502a-0ea2-4ca0-bb5c-c05c4a56db73-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4wpm6\" (UID: \"691d502a-0ea2-4ca0-bb5c-c05c4a56db73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6"
Jul 03 09:55:05.125409 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:05.125333    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/691d502a-0ea2-4ca0-bb5c-c05c4a56db73-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4wpm6\" (UID: \"691d502a-0ea2-4ca0-bb5c-c05c4a56db73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6"
Jul 03 09:55:05.125528 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:05.125511    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/691d502a-0ea2-4ca0-bb5c-c05c4a56db73-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4wpm6\" (UID: \"691d502a-0ea2-4ca0-bb5c-c05c4a56db73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6"
Jul 03 09:55:05.125689 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:05.125667    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/691d502a-0ea2-4ca0-bb5c-c05c4a56db73-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4wpm6\" (UID: \"691d502a-0ea2-4ca0-bb5c-c05c4a56db73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6"
Jul 03 09:55:05.125742 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:05.125688    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/691d502a-0ea2-4ca0-bb5c-c05c4a56db73-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4wpm6\" (UID: \"691d502a-0ea2-4ca0-bb5c-c05c4a56db73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6"
Jul 03 09:55:05.125742 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:05.125688    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/691d502a-0ea2-4ca0-bb5c-c05c4a56db73-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4wpm6\" (UID: \"691d502a-0ea2-4ca0-bb5c-c05c4a56db73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6"
Jul 03 09:55:05.127684 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:05.127656    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/691d502a-0ea2-4ca0-bb5c-c05c4a56db73-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4wpm6\" (UID: \"691d502a-0ea2-4ca0-bb5c-c05c4a56db73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6"
Jul 03 09:55:05.127908 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:05.127889    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/691d502a-0ea2-4ca0-bb5c-c05c4a56db73-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4wpm6\" (UID: \"691d502a-0ea2-4ca0-bb5c-c05c4a56db73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6"
Jul 03 09:55:05.136902 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:05.136878    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/691d502a-0ea2-4ca0-bb5c-c05c4a56db73-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4wpm6\" (UID: \"691d502a-0ea2-4ca0-bb5c-c05c4a56db73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6"
Jul 03 09:55:05.137486 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:05.137465    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lb6p7\" (UniqueName: \"kubernetes.io/projected/691d502a-0ea2-4ca0-bb5c-c05c4a56db73-kube-api-access-lb6p7\") pod \"maas-default-gateway-openshift-default-5896d4dd49-4wpm6\" (UID: \"691d502a-0ea2-4ca0-bb5c-c05c4a56db73\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6"
Jul 03 09:55:05.239478 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:05.239409    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6"
Jul 03 09:55:05.380697 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:05.380673    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6"]
Jul 03 09:55:05.382384 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:55:05.382352    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod691d502a_0ea2_4ca0_bb5c_c05c4a56db73.slice/crio-3513593e551fd5b4c1ab6983d283ae1bc0b5b56836f130fddc7d5c504108b9a3 WatchSource:0}: Error finding container 3513593e551fd5b4c1ab6983d283ae1bc0b5b56836f130fddc7d5c504108b9a3: Status 404 returned error can't find the container with id 3513593e551fd5b4c1ab6983d283ae1bc0b5b56836f130fddc7d5c504108b9a3
Jul 03 09:55:05.384392 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:05.384372    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 03 09:55:06.238763 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:06.238728    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6" event={"ID":"691d502a-0ea2-4ca0-bb5c-c05c4a56db73","Type":"ContainerStarted","Data":"3513593e551fd5b4c1ab6983d283ae1bc0b5b56836f130fddc7d5c504108b9a3"}
Jul 03 09:55:08.412043 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:08.412006    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 03 09:55:08.412296 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:08.412079    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 03 09:55:08.412296 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:08.412107    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 03 09:55:09.256747 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:09.256700    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6" event={"ID":"691d502a-0ea2-4ca0-bb5c-c05c4a56db73","Type":"ContainerStarted","Data":"5d696a92e1d704b0017ed78fc6c6973708252610bcd5005dee29d9f2557e9c9b"}
Jul 03 09:55:09.279053 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:09.279008    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6" podStartSLOduration=2.251721742 podStartE2EDuration="5.278992186s" totalImagesPullingTime="3.027270444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:55:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:55:09.277446339 +0000 UTC m=+710.148111968" watchObservedRunningTime="2026-07-03 09:55:09.278992186 +0000 UTC m=+710.149657861"
Jul 03 09:55:10.239898 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:10.239862    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6"
Jul 03 09:55:10.244498 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:10.244475    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6"
Jul 03 09:55:10.261235 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:10.261209    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6"
Jul 03 09:55:10.262037 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:10.262021    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6"
Jul 03 09:55:10.343063 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:10.343037    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2bgz7"]
Jul 03 09:55:10.346132 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:10.346111    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2bgz7"
Jul 03 09:55:10.349119 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:10.349099    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 03 09:55:10.349467 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:10.349448    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 03 09:55:10.349540 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:10.349506    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-phr6p\""
Jul 03 09:55:10.350845 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:10.350830    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 03 09:55:10.359132 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:10.359115    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2bgz7"]
Jul 03 09:55:10.444697 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:10.444652    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2bgz7"]
Jul 03 09:55:10.469211 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:10.469180    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-986kj\" (UniqueName: \"kubernetes.io/projected/8806efa9-93bb-4796-af5a-f8c752c1d13f-kube-api-access-986kj\") pod \"limitador-limitador-64c94fd64f-2bgz7\" (UID: \"8806efa9-93bb-4796-af5a-f8c752c1d13f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2bgz7"
Jul 03 09:55:10.469412 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:10.469234    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8806efa9-93bb-4796-af5a-f8c752c1d13f-config-file\") pod \"limitador-limitador-64c94fd64f-2bgz7\" (UID: \"8806efa9-93bb-4796-af5a-f8c752c1d13f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2bgz7"
Jul 03 09:55:10.570033 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:10.569955    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-986kj\" (UniqueName: \"kubernetes.io/projected/8806efa9-93bb-4796-af5a-f8c752c1d13f-kube-api-access-986kj\") pod \"limitador-limitador-64c94fd64f-2bgz7\" (UID: \"8806efa9-93bb-4796-af5a-f8c752c1d13f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2bgz7"
Jul 03 09:55:10.570033 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:10.570007    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8806efa9-93bb-4796-af5a-f8c752c1d13f-config-file\") pod \"limitador-limitador-64c94fd64f-2bgz7\" (UID: \"8806efa9-93bb-4796-af5a-f8c752c1d13f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2bgz7"
Jul 03 09:55:10.570565 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:10.570528    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8806efa9-93bb-4796-af5a-f8c752c1d13f-config-file\") pod \"limitador-limitador-64c94fd64f-2bgz7\" (UID: \"8806efa9-93bb-4796-af5a-f8c752c1d13f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2bgz7"
Jul 03 09:55:10.590871 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:10.590844    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-986kj\" (UniqueName: \"kubernetes.io/projected/8806efa9-93bb-4796-af5a-f8c752c1d13f-kube-api-access-986kj\") pod \"limitador-limitador-64c94fd64f-2bgz7\" (UID: \"8806efa9-93bb-4796-af5a-f8c752c1d13f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2bgz7"
Jul 03 09:55:10.656413 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:10.656383    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2bgz7"
Jul 03 09:55:10.792274 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:10.792250    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2bgz7"]
Jul 03 09:55:10.794949 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:55:10.794925    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8806efa9_93bb_4796_af5a_f8c752c1d13f.slice/crio-af895cb285e7c8a596544b9c5db5dc0c6e9f964c65a351c7c5d7ddf1bba44487 WatchSource:0}: Error finding container af895cb285e7c8a596544b9c5db5dc0c6e9f964c65a351c7c5d7ddf1bba44487: Status 404 returned error can't find the container with id af895cb285e7c8a596544b9c5db5dc0c6e9f964c65a351c7c5d7ddf1bba44487
Jul 03 09:55:11.266369 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:11.266336    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2bgz7" event={"ID":"8806efa9-93bb-4796-af5a-f8c752c1d13f","Type":"ContainerStarted","Data":"af895cb285e7c8a596544b9c5db5dc0c6e9f964c65a351c7c5d7ddf1bba44487"}
Jul 03 09:55:14.280273 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:14.280242    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2bgz7" event={"ID":"8806efa9-93bb-4796-af5a-f8c752c1d13f","Type":"ContainerStarted","Data":"5d0a6d1f3b3e01fce4276b438b45ea44b4f884f9d8b66055e4e0c76f9492ef59"}
Jul 03 09:55:14.280654 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:14.280382    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-2bgz7"
Jul 03 09:55:14.298373 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:14.298331    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-2bgz7" podStartSLOduration=1.5764786100000001 podStartE2EDuration="4.298312106s" totalImagesPullingTime="2.721833496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:55:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:55:14.297188441 +0000 UTC m=+715.167854070" watchObservedRunningTime="2026-07-03 09:55:14.298312106 +0000 UTC m=+715.168977735"
Jul 03 09:55:25.285944 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:25.285909    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-2bgz7"
Jul 03 09:55:27.834693 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:27.834657    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2bgz7"]
Jul 03 09:55:27.835131 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:27.834880    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-2bgz7" podUID="8806efa9-93bb-4796-af5a-f8c752c1d13f" containerName="limitador" containerID="cri-o://5d0a6d1f3b3e01fce4276b438b45ea44b4f884f9d8b66055e4e0c76f9492ef59" gracePeriod=30
Jul 03 09:55:28.343314 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:28.343282    2559 generic.go:356] "Generic (PLEG): container finished" podID="8806efa9-93bb-4796-af5a-f8c752c1d13f" containerID="5d0a6d1f3b3e01fce4276b438b45ea44b4f884f9d8b66055e4e0c76f9492ef59" exitCode=0
Jul 03 09:55:28.343472 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:28.343338    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2bgz7" event={"ID":"8806efa9-93bb-4796-af5a-f8c752c1d13f","Type":"ContainerDied","Data":"5d0a6d1f3b3e01fce4276b438b45ea44b4f884f9d8b66055e4e0c76f9492ef59"}
Jul 03 09:55:28.774788 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:28.774764    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2bgz7"
Jul 03 09:55:28.939197 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:28.939171    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-986kj\" (UniqueName: \"kubernetes.io/projected/8806efa9-93bb-4796-af5a-f8c752c1d13f-kube-api-access-986kj\") pod \"8806efa9-93bb-4796-af5a-f8c752c1d13f\" (UID: \"8806efa9-93bb-4796-af5a-f8c752c1d13f\") "
Jul 03 09:55:28.939580 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:28.939217    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8806efa9-93bb-4796-af5a-f8c752c1d13f-config-file\") pod \"8806efa9-93bb-4796-af5a-f8c752c1d13f\" (UID: \"8806efa9-93bb-4796-af5a-f8c752c1d13f\") "
Jul 03 09:55:28.939626 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:28.939603    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8806efa9-93bb-4796-af5a-f8c752c1d13f-config-file" (OuterVolumeSpecName: "config-file") pod "8806efa9-93bb-4796-af5a-f8c752c1d13f" (UID: "8806efa9-93bb-4796-af5a-f8c752c1d13f"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 09:55:28.941424 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:28.941405    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8806efa9-93bb-4796-af5a-f8c752c1d13f-kube-api-access-986kj" (OuterVolumeSpecName: "kube-api-access-986kj") pod "8806efa9-93bb-4796-af5a-f8c752c1d13f" (UID: "8806efa9-93bb-4796-af5a-f8c752c1d13f"). InnerVolumeSpecName "kube-api-access-986kj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 09:55:29.039994 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:29.039964    2559 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8806efa9-93bb-4796-af5a-f8c752c1d13f-config-file\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 09:55:29.039994 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:29.039991    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-986kj\" (UniqueName: \"kubernetes.io/projected/8806efa9-93bb-4796-af5a-f8c752c1d13f-kube-api-access-986kj\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 09:55:29.348713 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:29.348635    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2bgz7"
Jul 03 09:55:29.348713 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:29.348662    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2bgz7" event={"ID":"8806efa9-93bb-4796-af5a-f8c752c1d13f","Type":"ContainerDied","Data":"af895cb285e7c8a596544b9c5db5dc0c6e9f964c65a351c7c5d7ddf1bba44487"}
Jul 03 09:55:29.348713 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:29.348713    2559 scope.go:117] "RemoveContainer" containerID="5d0a6d1f3b3e01fce4276b438b45ea44b4f884f9d8b66055e4e0c76f9492ef59"
Jul 03 09:55:29.370532 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:29.370510    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2bgz7"]
Jul 03 09:55:29.375114 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:29.375092    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2bgz7"]
Jul 03 09:55:29.690021 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:29.689983    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8806efa9-93bb-4796-af5a-f8c752c1d13f" path="/var/lib/kubelet/pods/8806efa9-93bb-4796-af5a-f8c752c1d13f/volumes"
Jul 03 09:55:31.947918 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:31.947889    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-dgn4m"]
Jul 03 09:55:31.948277 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:31.948216    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8806efa9-93bb-4796-af5a-f8c752c1d13f" containerName="limitador"
Jul 03 09:55:31.948277 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:31.948226    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8806efa9-93bb-4796-af5a-f8c752c1d13f" containerName="limitador"
Jul 03 09:55:31.948349 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:31.948288    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8806efa9-93bb-4796-af5a-f8c752c1d13f" containerName="limitador"
Jul 03 09:55:31.952595 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:31.952577    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-dgn4m"
Jul 03 09:55:31.955693 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:31.955667    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 03 09:55:31.955807 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:31.955759    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-z6p92\""
Jul 03 09:55:31.959624 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:31.959602    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-dgn4m"]
Jul 03 09:55:31.963958 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:31.963938    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/eeb806d8-fe96-44e1-b0e6-3de1f844fde0-data\") pod \"postgres-69fb4594cf-dgn4m\" (UID: \"eeb806d8-fe96-44e1-b0e6-3de1f844fde0\") " pod="opendatahub/postgres-69fb4594cf-dgn4m"
Jul 03 09:55:31.964055 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:31.963975    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmzrt\" (UniqueName: \"kubernetes.io/projected/eeb806d8-fe96-44e1-b0e6-3de1f844fde0-kube-api-access-bmzrt\") pod \"postgres-69fb4594cf-dgn4m\" (UID: \"eeb806d8-fe96-44e1-b0e6-3de1f844fde0\") " pod="opendatahub/postgres-69fb4594cf-dgn4m"
Jul 03 09:55:32.064465 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:32.064437    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/eeb806d8-fe96-44e1-b0e6-3de1f844fde0-data\") pod \"postgres-69fb4594cf-dgn4m\" (UID: \"eeb806d8-fe96-44e1-b0e6-3de1f844fde0\") " pod="opendatahub/postgres-69fb4594cf-dgn4m"
Jul 03 09:55:32.064687 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:32.064487    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmzrt\" (UniqueName: \"kubernetes.io/projected/eeb806d8-fe96-44e1-b0e6-3de1f844fde0-kube-api-access-bmzrt\") pod \"postgres-69fb4594cf-dgn4m\" (UID: \"eeb806d8-fe96-44e1-b0e6-3de1f844fde0\") " pod="opendatahub/postgres-69fb4594cf-dgn4m"
Jul 03 09:55:32.064816 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:32.064798    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/eeb806d8-fe96-44e1-b0e6-3de1f844fde0-data\") pod \"postgres-69fb4594cf-dgn4m\" (UID: \"eeb806d8-fe96-44e1-b0e6-3de1f844fde0\") " pod="opendatahub/postgres-69fb4594cf-dgn4m"
Jul 03 09:55:32.073903 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:32.073880    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmzrt\" (UniqueName: \"kubernetes.io/projected/eeb806d8-fe96-44e1-b0e6-3de1f844fde0-kube-api-access-bmzrt\") pod \"postgres-69fb4594cf-dgn4m\" (UID: \"eeb806d8-fe96-44e1-b0e6-3de1f844fde0\") " pod="opendatahub/postgres-69fb4594cf-dgn4m"
Jul 03 09:55:32.264064 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:32.263977    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-dgn4m"
Jul 03 09:55:32.396176 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:32.396150    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-dgn4m"]
Jul 03 09:55:32.398111 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:55:32.398081    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeb806d8_fe96_44e1_b0e6_3de1f844fde0.slice/crio-f012c75886138f411599ebea5b579aa18c74810981d62b2a8cf68ad2dbe92569 WatchSource:0}: Error finding container f012c75886138f411599ebea5b579aa18c74810981d62b2a8cf68ad2dbe92569: Status 404 returned error can't find the container with id f012c75886138f411599ebea5b579aa18c74810981d62b2a8cf68ad2dbe92569
Jul 03 09:55:33.368905 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:33.368863    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-dgn4m" event={"ID":"eeb806d8-fe96-44e1-b0e6-3de1f844fde0","Type":"ContainerStarted","Data":"f012c75886138f411599ebea5b579aa18c74810981d62b2a8cf68ad2dbe92569"}
Jul 03 09:55:37.393434 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:37.393347    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-dgn4m" event={"ID":"eeb806d8-fe96-44e1-b0e6-3de1f844fde0","Type":"ContainerStarted","Data":"503afac89b844fd901db270e7ca2343b920c86d6047dd8b2160b73abd9bc1e1d"}
Jul 03 09:55:37.393823 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:37.393455    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-dgn4m"
Jul 03 09:55:37.421337 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:37.421290    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-dgn4m" podStartSLOduration=1.891276143 podStartE2EDuration="6.421276096s" totalImagesPullingTime="4.529999953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:55:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:55:37.420616674 +0000 UTC m=+738.291282302" watchObservedRunningTime="2026-07-03 09:55:37.421276096 +0000 UTC m=+738.291941725"
Jul 03 09:55:43.429321 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:55:43.429293    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-dgn4m"
Jul 03 09:56:25.477296 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:25.477265    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-58447bbcb5-j4txd"]
Jul 03 09:56:25.480295 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:25.480275    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-58447bbcb5-j4txd"
Jul 03 09:56:25.483687 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:25.483668    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-bh87n\""
Jul 03 09:56:25.484428 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:25.484413    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 03 09:56:25.504363 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:25.504328    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-58447bbcb5-j4txd"]
Jul 03 09:56:25.524839 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:25.524814    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/699b1035-90af-4a32-bfce-152e62d81eb3-openshift-service-ca\") pod \"maas-api-58447bbcb5-j4txd\" (UID: \"699b1035-90af-4a32-bfce-152e62d81eb3\") " pod="opendatahub/maas-api-58447bbcb5-j4txd"
Jul 03 09:56:25.524958 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:25.524881    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/699b1035-90af-4a32-bfce-152e62d81eb3-maas-api-tls\") pod \"maas-api-58447bbcb5-j4txd\" (UID: \"699b1035-90af-4a32-bfce-152e62d81eb3\") " pod="opendatahub/maas-api-58447bbcb5-j4txd"
Jul 03 09:56:25.524958 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:25.524921    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th2t7\" (UniqueName: \"kubernetes.io/projected/699b1035-90af-4a32-bfce-152e62d81eb3-kube-api-access-th2t7\") pod \"maas-api-58447bbcb5-j4txd\" (UID: \"699b1035-90af-4a32-bfce-152e62d81eb3\") " pod="opendatahub/maas-api-58447bbcb5-j4txd"
Jul 03 09:56:25.625914 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:25.625871    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/699b1035-90af-4a32-bfce-152e62d81eb3-openshift-service-ca\") pod \"maas-api-58447bbcb5-j4txd\" (UID: \"699b1035-90af-4a32-bfce-152e62d81eb3\") " pod="opendatahub/maas-api-58447bbcb5-j4txd"
Jul 03 09:56:25.626098 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:25.625982    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/699b1035-90af-4a32-bfce-152e62d81eb3-maas-api-tls\") pod \"maas-api-58447bbcb5-j4txd\" (UID: \"699b1035-90af-4a32-bfce-152e62d81eb3\") " pod="opendatahub/maas-api-58447bbcb5-j4txd"
Jul 03 09:56:25.626098 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:25.626028    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th2t7\" (UniqueName: \"kubernetes.io/projected/699b1035-90af-4a32-bfce-152e62d81eb3-kube-api-access-th2t7\") pod \"maas-api-58447bbcb5-j4txd\" (UID: \"699b1035-90af-4a32-bfce-152e62d81eb3\") " pod="opendatahub/maas-api-58447bbcb5-j4txd"
Jul 03 09:56:25.626470 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:25.626448    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/699b1035-90af-4a32-bfce-152e62d81eb3-openshift-service-ca\") pod \"maas-api-58447bbcb5-j4txd\" (UID: \"699b1035-90af-4a32-bfce-152e62d81eb3\") " pod="opendatahub/maas-api-58447bbcb5-j4txd"
Jul 03 09:56:25.628446 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:25.628426    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/699b1035-90af-4a32-bfce-152e62d81eb3-maas-api-tls\") pod \"maas-api-58447bbcb5-j4txd\" (UID: \"699b1035-90af-4a32-bfce-152e62d81eb3\") " pod="opendatahub/maas-api-58447bbcb5-j4txd"
Jul 03 09:56:25.634654 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:25.634623    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-th2t7\" (UniqueName: \"kubernetes.io/projected/699b1035-90af-4a32-bfce-152e62d81eb3-kube-api-access-th2t7\") pod \"maas-api-58447bbcb5-j4txd\" (UID: \"699b1035-90af-4a32-bfce-152e62d81eb3\") " pod="opendatahub/maas-api-58447bbcb5-j4txd"
Jul 03 09:56:25.790594 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:25.790509    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-58447bbcb5-j4txd"
Jul 03 09:56:25.924352 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:25.924329    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-58447bbcb5-j4txd"]
Jul 03 09:56:25.926888 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:56:25.926862    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod699b1035_90af_4a32_bfce_152e62d81eb3.slice/crio-d5c4868add8963822f0ff68d839d9808375402cca28621cc3bcfc768903d0151 WatchSource:0}: Error finding container d5c4868add8963822f0ff68d839d9808375402cca28621cc3bcfc768903d0151: Status 404 returned error can't find the container with id d5c4868add8963822f0ff68d839d9808375402cca28621cc3bcfc768903d0151
Jul 03 09:56:26.048021 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:26.047951    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-nm4pd"]
Jul 03 09:56:26.051040 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:26.051025    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-nm4pd"
Jul 03 09:56:26.053823 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:26.053802    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 03 09:56:26.054596 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:26.054581    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-zd4bk\""
Jul 03 09:56:26.063963 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:26.063945    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-nm4pd"]
Jul 03 09:56:26.130378 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:26.130349    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-httqw\" (UniqueName: \"kubernetes.io/projected/c3fd3dbb-3234-46dd-a0e5-4d7871a1befe-kube-api-access-httqw\") pod \"payload-pre-processing-7964457696-nm4pd\" (UID: \"c3fd3dbb-3234-46dd-a0e5-4d7871a1befe\") " pod="openshift-ingress/payload-pre-processing-7964457696-nm4pd"
Jul 03 09:56:26.130520 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:26.130394    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3fd3dbb-3234-46dd-a0e5-4d7871a1befe-plugins-config-volume\") pod \"payload-pre-processing-7964457696-nm4pd\" (UID: \"c3fd3dbb-3234-46dd-a0e5-4d7871a1befe\") " pod="openshift-ingress/payload-pre-processing-7964457696-nm4pd"
Jul 03 09:56:26.230991 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:26.230959    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-httqw\" (UniqueName: \"kubernetes.io/projected/c3fd3dbb-3234-46dd-a0e5-4d7871a1befe-kube-api-access-httqw\") pod \"payload-pre-processing-7964457696-nm4pd\" (UID: \"c3fd3dbb-3234-46dd-a0e5-4d7871a1befe\") " pod="openshift-ingress/payload-pre-processing-7964457696-nm4pd"
Jul 03 09:56:26.231151 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:26.231009    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3fd3dbb-3234-46dd-a0e5-4d7871a1befe-plugins-config-volume\") pod \"payload-pre-processing-7964457696-nm4pd\" (UID: \"c3fd3dbb-3234-46dd-a0e5-4d7871a1befe\") " pod="openshift-ingress/payload-pre-processing-7964457696-nm4pd"
Jul 03 09:56:26.231742 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:26.231725    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3fd3dbb-3234-46dd-a0e5-4d7871a1befe-plugins-config-volume\") pod \"payload-pre-processing-7964457696-nm4pd\" (UID: \"c3fd3dbb-3234-46dd-a0e5-4d7871a1befe\") " pod="openshift-ingress/payload-pre-processing-7964457696-nm4pd"
Jul 03 09:56:26.245576 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:26.245528    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-httqw\" (UniqueName: \"kubernetes.io/projected/c3fd3dbb-3234-46dd-a0e5-4d7871a1befe-kube-api-access-httqw\") pod \"payload-pre-processing-7964457696-nm4pd\" (UID: \"c3fd3dbb-3234-46dd-a0e5-4d7871a1befe\") " pod="openshift-ingress/payload-pre-processing-7964457696-nm4pd"
Jul 03 09:56:26.361809 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:26.361733    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-nm4pd"
Jul 03 09:56:26.496841 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:26.496813    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-nm4pd"]
Jul 03 09:56:26.500475 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:56:26.500432    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3fd3dbb_3234_46dd_a0e5_4d7871a1befe.slice/crio-6233571daeac422ce9a4fc0b5fde2c07f7c82e1162510367dd8d0e2ee4e0144f WatchSource:0}: Error finding container 6233571daeac422ce9a4fc0b5fde2c07f7c82e1162510367dd8d0e2ee4e0144f: Status 404 returned error can't find the container with id 6233571daeac422ce9a4fc0b5fde2c07f7c82e1162510367dd8d0e2ee4e0144f
Jul 03 09:56:26.605012 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:26.604816    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-nm4pd" event={"ID":"c3fd3dbb-3234-46dd-a0e5-4d7871a1befe","Type":"ContainerStarted","Data":"6233571daeac422ce9a4fc0b5fde2c07f7c82e1162510367dd8d0e2ee4e0144f"}
Jul 03 09:56:26.606842 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:26.606812    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-58447bbcb5-j4txd" event={"ID":"699b1035-90af-4a32-bfce-152e62d81eb3","Type":"ContainerStarted","Data":"d5c4868add8963822f0ff68d839d9808375402cca28621cc3bcfc768903d0151"}
Jul 03 09:56:29.624092 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:29.623991    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-nm4pd" event={"ID":"c3fd3dbb-3234-46dd-a0e5-4d7871a1befe","Type":"ContainerStarted","Data":"2d230430ff9da61fbbb0cee038c1af026a9d11c9fd240a7fd5674ee0e663fa5f"}
Jul 03 09:56:29.624092 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:29.624084    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-nm4pd"
Jul 03 09:56:29.625435 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:29.625412    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-58447bbcb5-j4txd" event={"ID":"699b1035-90af-4a32-bfce-152e62d81eb3","Type":"ContainerStarted","Data":"cd25369b7226a388cd40b94348915d94281e8543c6bc8d38426314f747512ac6"}
Jul 03 09:56:29.625571 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:29.625555    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-58447bbcb5-j4txd"
Jul 03 09:56:29.641451 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:29.641406    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-nm4pd" podStartSLOduration=0.962173455 podStartE2EDuration="3.641391721s" totalImagesPullingTime="2.679218266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:56:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:56:29.639795179 +0000 UTC m=+790.510460812" watchObservedRunningTime="2026-07-03 09:56:29.641391721 +0000 UTC m=+790.512057328"
Jul 03 09:56:29.660434 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:29.660373    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-58447bbcb5-j4txd" podStartSLOduration=1.405278539 podStartE2EDuration="4.660355671s" totalImagesPullingTime="3.255077132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:56:29.659353383 +0000 UTC m=+790.530019023" watchObservedRunningTime="2026-07-03 09:56:29.660355671 +0000 UTC m=+790.531021301"
Jul 03 09:56:33.643473 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:33.643442    2559 generic.go:356] "Generic (PLEG): container finished" podID="691d502a-0ea2-4ca0-bb5c-c05c4a56db73" containerID="5d696a92e1d704b0017ed78fc6c6973708252610bcd5005dee29d9f2557e9c9b" exitCode=0
Jul 03 09:56:33.643874 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:33.643518    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6" event={"ID":"691d502a-0ea2-4ca0-bb5c-c05c4a56db73","Type":"ContainerDied","Data":"5d696a92e1d704b0017ed78fc6c6973708252610bcd5005dee29d9f2557e9c9b"}
Jul 03 09:56:33.643914 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:33.643890    2559 scope.go:117] "RemoveContainer" containerID="5d696a92e1d704b0017ed78fc6c6973708252610bcd5005dee29d9f2557e9c9b"
Jul 03 09:56:33.644811 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:33.644782    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 03 09:56:33.644872 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:33.644846    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 03 09:56:33.644910 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:33.644893    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 03 09:56:34.653040 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:34.651497    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6" event={"ID":"691d502a-0ea2-4ca0-bb5c-c05c4a56db73","Type":"ContainerStarted","Data":"5df48a59c0b17379d42b82860ae9f8285824ee05e5678610466463aafb51c4de"}
Jul 03 09:56:35.240633 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:35.240595    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6"
Jul 03 09:56:35.240866 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:35.240842    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-4wpm6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body=
Jul 03 09:56:35.240925 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:35.240905    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6" podUID="691d502a-0ea2-4ca0-bb5c-c05c4a56db73" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused"
Jul 03 09:56:35.634811 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:35.634727    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-58447bbcb5-j4txd"
Jul 03 09:56:36.240682 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:36.240650    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-4wpm6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body=
Jul 03 09:56:36.241088 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:36.240716    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6" podUID="691d502a-0ea2-4ca0-bb5c-c05c4a56db73" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused"
Jul 03 09:56:37.240170 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:37.240140    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-4wpm6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body=
Jul 03 09:56:37.240348 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:37.240190    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6" podUID="691d502a-0ea2-4ca0-bb5c-c05c4a56db73" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused"
Jul 03 09:56:38.240569 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:38.240522    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-4wpm6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body=
Jul 03 09:56:38.241011 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:38.240588    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6" podUID="691d502a-0ea2-4ca0-bb5c-c05c4a56db73" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused"
Jul 03 09:56:39.244207 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:39.244178    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6"
Jul 03 09:56:39.244584 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:39.244574    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6"
Jul 03 09:56:39.245329 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:39.245307    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-4wpm6"
Jul 03 09:56:40.631770 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:40.631734    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-7964457696-nm4pd" podUID="c3fd3dbb-3234-46dd-a0e5-4d7871a1befe" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.28:9004: connect: connection refused"
Jul 03 09:56:49.722760 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:49.722730    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf"]
Jul 03 09:56:49.726233 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:49.726212    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf"
Jul 03 09:56:49.728770 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:49.728750    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-m2wrc\""
Jul 03 09:56:49.728908 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:49.728788    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 03 09:56:49.733701 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:49.733664    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 03 09:56:49.733824 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:49.733754    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 03 09:56:49.739739 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:49.739720    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf"]
Jul 03 09:56:49.765036 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:49.765012    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80238e80-c7f9-486e-8d92-2aea565a4360-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf\" (UID: \"80238e80-c7f9-486e-8d92-2aea565a4360\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf"
Jul 03 09:56:49.765203 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:49.765046    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80238e80-c7f9-486e-8d92-2aea565a4360-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf\" (UID: \"80238e80-c7f9-486e-8d92-2aea565a4360\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf"
Jul 03 09:56:49.765203 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:49.765080    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80238e80-c7f9-486e-8d92-2aea565a4360-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf\" (UID: \"80238e80-c7f9-486e-8d92-2aea565a4360\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf"
Jul 03 09:56:49.765203 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:49.765099    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tslt6\" (UniqueName: \"kubernetes.io/projected/80238e80-c7f9-486e-8d92-2aea565a4360-kube-api-access-tslt6\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf\" (UID: \"80238e80-c7f9-486e-8d92-2aea565a4360\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf"
Jul 03 09:56:49.765364 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:49.765209    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80238e80-c7f9-486e-8d92-2aea565a4360-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf\" (UID: \"80238e80-c7f9-486e-8d92-2aea565a4360\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf"
Jul 03 09:56:49.765364 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:49.765267    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80238e80-c7f9-486e-8d92-2aea565a4360-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf\" (UID: \"80238e80-c7f9-486e-8d92-2aea565a4360\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf"
Jul 03 09:56:49.866221 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:49.866194    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80238e80-c7f9-486e-8d92-2aea565a4360-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf\" (UID: \"80238e80-c7f9-486e-8d92-2aea565a4360\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf"
Jul 03 09:56:49.866477 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:49.866233    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80238e80-c7f9-486e-8d92-2aea565a4360-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf\" (UID: \"80238e80-c7f9-486e-8d92-2aea565a4360\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf"
Jul 03 09:56:49.866477 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:49.866262    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80238e80-c7f9-486e-8d92-2aea565a4360-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf\" (UID: \"80238e80-c7f9-486e-8d92-2aea565a4360\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf"
Jul 03 09:56:49.866477 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:49.866286    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tslt6\" (UniqueName: \"kubernetes.io/projected/80238e80-c7f9-486e-8d92-2aea565a4360-kube-api-access-tslt6\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf\" (UID: \"80238e80-c7f9-486e-8d92-2aea565a4360\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf"
Jul 03 09:56:49.866477 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:49.866348    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80238e80-c7f9-486e-8d92-2aea565a4360-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf\" (UID: \"80238e80-c7f9-486e-8d92-2aea565a4360\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf"
Jul 03 09:56:49.866732 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:49.866566    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80238e80-c7f9-486e-8d92-2aea565a4360-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf\" (UID: \"80238e80-c7f9-486e-8d92-2aea565a4360\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf"
Jul 03 09:56:49.866732 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:49.866715    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80238e80-c7f9-486e-8d92-2aea565a4360-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf\" (UID: \"80238e80-c7f9-486e-8d92-2aea565a4360\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf"
Jul 03 09:56:49.866807 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:49.866758    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80238e80-c7f9-486e-8d92-2aea565a4360-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf\" (UID: \"80238e80-c7f9-486e-8d92-2aea565a4360\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf"
Jul 03 09:56:49.866964 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:49.866947    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80238e80-c7f9-486e-8d92-2aea565a4360-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf\" (UID: \"80238e80-c7f9-486e-8d92-2aea565a4360\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf"
Jul 03 09:56:49.868782 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:49.868744    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80238e80-c7f9-486e-8d92-2aea565a4360-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf\" (UID: \"80238e80-c7f9-486e-8d92-2aea565a4360\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf"
Jul 03 09:56:49.868934 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:49.868917    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80238e80-c7f9-486e-8d92-2aea565a4360-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf\" (UID: \"80238e80-c7f9-486e-8d92-2aea565a4360\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf"
Jul 03 09:56:49.874896 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:49.874873    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tslt6\" (UniqueName: \"kubernetes.io/projected/80238e80-c7f9-486e-8d92-2aea565a4360-kube-api-access-tslt6\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf\" (UID: \"80238e80-c7f9-486e-8d92-2aea565a4360\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf"
Jul 03 09:56:50.042784 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:50.042698    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf"
Jul 03 09:56:50.179815 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:50.179788    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf"]
Jul 03 09:56:50.181668 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:56:50.181641    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80238e80_c7f9_486e_8d92_2aea565a4360.slice/crio-a66fee4960fdb03dc486d56a3d094437588294481e7de8fe1252ceb002220c24 WatchSource:0}: Error finding container a66fee4960fdb03dc486d56a3d094437588294481e7de8fe1252ceb002220c24: Status 404 returned error can't find the container with id a66fee4960fdb03dc486d56a3d094437588294481e7de8fe1252ceb002220c24
Jul 03 09:56:50.630907 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:50.630879    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-nm4pd"
Jul 03 09:56:50.734528 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:50.734489    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf" event={"ID":"80238e80-c7f9-486e-8d92-2aea565a4360","Type":"ContainerStarted","Data":"a66fee4960fdb03dc486d56a3d094437588294481e7de8fe1252ceb002220c24"}
Jul 03 09:56:51.740181 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:51.740140    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf" event={"ID":"80238e80-c7f9-486e-8d92-2aea565a4360","Type":"ContainerStarted","Data":"33489d5870771b07bb091f7a3158c61c4a4936c3925fa4c3f374d9effa335f29"}
Jul 03 09:56:51.762057 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:56:51.762003    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf" podStartSLOduration=1.594290593 podStartE2EDuration="2.761990751s" totalImagesPullingTime="1.167700158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:56:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:56:51.760721278 +0000 UTC m=+812.631386958" watchObservedRunningTime="2026-07-03 09:56:51.761990751 +0000 UTC m=+812.632656379"
Jul 03 09:57:00.043190 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:57:00.043155    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf"
Jul 03 09:57:00.043632 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:57:00.043468    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf"
Jul 03 09:57:00.055536 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:57:00.055513    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf"
Jul 03 09:57:00.791514 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:57:00.791486    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf"
Jul 03 09:57:31.828896 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:57:31.828857    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f"]
Jul 03 09:57:31.832223 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:57:31.832205    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f"
Jul 03 09:57:31.835279 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:57:31.835251    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 03 09:57:31.848461 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:57:31.848441    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f"]
Jul 03 09:57:31.922870 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:57:31.922842    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d74fcd96-4b0b-44c5-8189-7c482df358e7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f\" (UID: \"d74fcd96-4b0b-44c5-8189-7c482df358e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f"
Jul 03 09:57:31.923019 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:57:31.922877    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d74fcd96-4b0b-44c5-8189-7c482df358e7-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f\" (UID: \"d74fcd96-4b0b-44c5-8189-7c482df358e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f"
Jul 03 09:57:31.923019 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:57:31.922897    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d74fcd96-4b0b-44c5-8189-7c482df358e7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f\" (UID: \"d74fcd96-4b0b-44c5-8189-7c482df358e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f"
Jul 03 09:57:31.923019 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:57:31.923001    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d74fcd96-4b0b-44c5-8189-7c482df358e7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f\" (UID: \"d74fcd96-4b0b-44c5-8189-7c482df358e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f"
Jul 03 09:57:31.923123 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:57:31.923035    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d74fcd96-4b0b-44c5-8189-7c482df358e7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f\" (UID: \"d74fcd96-4b0b-44c5-8189-7c482df358e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f"
Jul 03 09:57:31.923123 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:57:31.923057    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbp7z\" (UniqueName: \"kubernetes.io/projected/d74fcd96-4b0b-44c5-8189-7c482df358e7-kube-api-access-tbp7z\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f\" (UID: \"d74fcd96-4b0b-44c5-8189-7c482df358e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f"
Jul 03 09:57:32.024291 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:57:32.024256    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d74fcd96-4b0b-44c5-8189-7c482df358e7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f\" (UID: \"d74fcd96-4b0b-44c5-8189-7c482df358e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f"
Jul 03 09:57:32.024456 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:57:32.024299    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d74fcd96-4b0b-44c5-8189-7c482df358e7-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f\" (UID: \"d74fcd96-4b0b-44c5-8189-7c482df358e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f"
Jul 03 09:57:32.024456 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:57:32.024319    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d74fcd96-4b0b-44c5-8189-7c482df358e7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f\" (UID: \"d74fcd96-4b0b-44c5-8189-7c482df358e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f"
Jul 03 09:57:32.024456 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:57:32.024396    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d74fcd96-4b0b-44c5-8189-7c482df358e7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f\" (UID: \"d74fcd96-4b0b-44c5-8189-7c482df358e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f"
Jul 03 09:57:32.024456 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:57:32.024430    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d74fcd96-4b0b-44c5-8189-7c482df358e7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f\" (UID: \"d74fcd96-4b0b-44c5-8189-7c482df358e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f"
Jul 03 09:57:32.024456 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:57:32.024455    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbp7z\" (UniqueName: \"kubernetes.io/projected/d74fcd96-4b0b-44c5-8189-7c482df358e7-kube-api-access-tbp7z\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f\" (UID: \"d74fcd96-4b0b-44c5-8189-7c482df358e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f"
Jul 03 09:57:32.024865 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:57:32.024825    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d74fcd96-4b0b-44c5-8189-7c482df358e7-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f\" (UID: \"d74fcd96-4b0b-44c5-8189-7c482df358e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f"
Jul 03 09:57:32.024985 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:57:32.024916    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d74fcd96-4b0b-44c5-8189-7c482df358e7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f\" (UID: \"d74fcd96-4b0b-44c5-8189-7c482df358e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f"
Jul 03 09:57:32.024985 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:57:32.024920    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d74fcd96-4b0b-44c5-8189-7c482df358e7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f\" (UID: \"d74fcd96-4b0b-44c5-8189-7c482df358e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f"
Jul 03 09:57:32.027192 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:57:32.027170    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d74fcd96-4b0b-44c5-8189-7c482df358e7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f\" (UID: \"d74fcd96-4b0b-44c5-8189-7c482df358e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f"
Jul 03 09:57:32.027481 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:57:32.027462    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d74fcd96-4b0b-44c5-8189-7c482df358e7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f\" (UID: \"d74fcd96-4b0b-44c5-8189-7c482df358e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f"
Jul 03 09:57:32.033322 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:57:32.033295    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbp7z\" (UniqueName: \"kubernetes.io/projected/d74fcd96-4b0b-44c5-8189-7c482df358e7-kube-api-access-tbp7z\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f\" (UID: \"d74fcd96-4b0b-44c5-8189-7c482df358e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f"
Jul 03 09:57:32.142372 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:57:32.142291    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f"
Jul 03 09:57:32.275317 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:57:32.275296    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f"]
Jul 03 09:57:32.277732 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:57:32.277708    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd74fcd96_4b0b_44c5_8189_7c482df358e7.slice/crio-d161b108dcb054a5ae02ce9e4bb8e74ef27465c8c64a6b68ed50e8a4ca23b636 WatchSource:0}: Error finding container d161b108dcb054a5ae02ce9e4bb8e74ef27465c8c64a6b68ed50e8a4ca23b636: Status 404 returned error can't find the container with id d161b108dcb054a5ae02ce9e4bb8e74ef27465c8c64a6b68ed50e8a4ca23b636
Jul 03 09:57:32.917760 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:57:32.917654    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f" event={"ID":"d74fcd96-4b0b-44c5-8189-7c482df358e7","Type":"ContainerStarted","Data":"dfa3601acea759d338b37644bc95f54740bfb0411c0e7b8b7aaa7165fe0b8097"}
Jul 03 09:57:32.917760 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:57:32.917711    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f" event={"ID":"d74fcd96-4b0b-44c5-8189-7c482df358e7","Type":"ContainerStarted","Data":"d161b108dcb054a5ae02ce9e4bb8e74ef27465c8c64a6b68ed50e8a4ca23b636"}
Jul 03 09:57:32.939078 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:57:32.939028    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f" podStartSLOduration=1.7616981109999998 podStartE2EDuration="1.939012673s" totalImagesPullingTime="177.314562ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:57:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:57:32.937110856 +0000 UTC m=+853.807776485" watchObservedRunningTime="2026-07-03 09:57:32.939012673 +0000 UTC m=+853.809678301"
Jul 03 09:57:42.142787 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:57:42.142749    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f"
Jul 03 09:57:42.143238 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:57:42.142819    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f"
Jul 03 09:57:42.155162 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:57:42.155136    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f"
Jul 03 09:57:42.972427 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:57:42.972400    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f"
Jul 03 09:58:00.102669 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:58:00.102632    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg"]
Jul 03 09:58:00.105181 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:58:00.105160    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg"
Jul 03 09:58:00.108039 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:58:00.108018    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 03 09:58:00.117221 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:58:00.117192    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg"]
Jul 03 09:58:00.272909 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:58:00.272843    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8z4n\" (UniqueName: \"kubernetes.io/projected/4d54910f-d4cc-4a39-9f21-6f4ea2f96bd3-kube-api-access-r8z4n\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg\" (UID: \"4d54910f-d4cc-4a39-9f21-6f4ea2f96bd3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg"
Jul 03 09:58:00.273091 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:58:00.272917    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d54910f-d4cc-4a39-9f21-6f4ea2f96bd3-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg\" (UID: \"4d54910f-d4cc-4a39-9f21-6f4ea2f96bd3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg"
Jul 03 09:58:00.273091 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:58:00.272978    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d54910f-d4cc-4a39-9f21-6f4ea2f96bd3-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg\" (UID: \"4d54910f-d4cc-4a39-9f21-6f4ea2f96bd3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg"
Jul 03 09:58:00.273091 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:58:00.273044    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d54910f-d4cc-4a39-9f21-6f4ea2f96bd3-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg\" (UID: \"4d54910f-d4cc-4a39-9f21-6f4ea2f96bd3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg"
Jul 03 09:58:00.273091 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:58:00.273085    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d54910f-d4cc-4a39-9f21-6f4ea2f96bd3-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg\" (UID: \"4d54910f-d4cc-4a39-9f21-6f4ea2f96bd3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg"
Jul 03 09:58:00.273248 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:58:00.273130    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d54910f-d4cc-4a39-9f21-6f4ea2f96bd3-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg\" (UID: \"4d54910f-d4cc-4a39-9f21-6f4ea2f96bd3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg"
Jul 03 09:58:00.374534 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:58:00.374455    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d54910f-d4cc-4a39-9f21-6f4ea2f96bd3-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg\" (UID: \"4d54910f-d4cc-4a39-9f21-6f4ea2f96bd3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg"
Jul 03 09:58:00.374534 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:58:00.374526    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8z4n\" (UniqueName: \"kubernetes.io/projected/4d54910f-d4cc-4a39-9f21-6f4ea2f96bd3-kube-api-access-r8z4n\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg\" (UID: \"4d54910f-d4cc-4a39-9f21-6f4ea2f96bd3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg"
Jul 03 09:58:00.374771 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:58:00.374570    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d54910f-d4cc-4a39-9f21-6f4ea2f96bd3-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg\" (UID: \"4d54910f-d4cc-4a39-9f21-6f4ea2f96bd3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg"
Jul 03 09:58:00.374771 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:58:00.374593    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d54910f-d4cc-4a39-9f21-6f4ea2f96bd3-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg\" (UID: \"4d54910f-d4cc-4a39-9f21-6f4ea2f96bd3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg"
Jul 03 09:58:00.374771 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:58:00.374637    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d54910f-d4cc-4a39-9f21-6f4ea2f96bd3-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg\" (UID: \"4d54910f-d4cc-4a39-9f21-6f4ea2f96bd3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg"
Jul 03 09:58:00.374916 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:58:00.374769    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d54910f-d4cc-4a39-9f21-6f4ea2f96bd3-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg\" (UID: \"4d54910f-d4cc-4a39-9f21-6f4ea2f96bd3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg"
Jul 03 09:58:00.374916 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:58:00.374885    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d54910f-d4cc-4a39-9f21-6f4ea2f96bd3-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg\" (UID: \"4d54910f-d4cc-4a39-9f21-6f4ea2f96bd3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg"
Jul 03 09:58:00.374982 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:58:00.374969    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d54910f-d4cc-4a39-9f21-6f4ea2f96bd3-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg\" (UID: \"4d54910f-d4cc-4a39-9f21-6f4ea2f96bd3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg"
Jul 03 09:58:00.375015 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:58:00.374998    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d54910f-d4cc-4a39-9f21-6f4ea2f96bd3-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg\" (UID: \"4d54910f-d4cc-4a39-9f21-6f4ea2f96bd3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg"
Jul 03 09:58:00.376836 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:58:00.376815    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d54910f-d4cc-4a39-9f21-6f4ea2f96bd3-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg\" (UID: \"4d54910f-d4cc-4a39-9f21-6f4ea2f96bd3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg"
Jul 03 09:58:00.377115 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:58:00.377097    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d54910f-d4cc-4a39-9f21-6f4ea2f96bd3-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg\" (UID: \"4d54910f-d4cc-4a39-9f21-6f4ea2f96bd3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg"
Jul 03 09:58:00.383728 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:58:00.383698    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8z4n\" (UniqueName: \"kubernetes.io/projected/4d54910f-d4cc-4a39-9f21-6f4ea2f96bd3-kube-api-access-r8z4n\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg\" (UID: \"4d54910f-d4cc-4a39-9f21-6f4ea2f96bd3\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg"
Jul 03 09:58:00.414885 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:58:00.414858    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg"
Jul 03 09:58:00.551189 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:58:00.551167    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg"]
Jul 03 09:58:00.553341 ip-10-0-131-117 kubenswrapper[2559]: W0703 09:58:00.553312    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d54910f_d4cc_4a39_9f21_6f4ea2f96bd3.slice/crio-f9e7e72f551d1a9228ce47774419431bce0fb92d2fd3873093fbc39f07c9fa9d WatchSource:0}: Error finding container f9e7e72f551d1a9228ce47774419431bce0fb92d2fd3873093fbc39f07c9fa9d: Status 404 returned error can't find the container with id f9e7e72f551d1a9228ce47774419431bce0fb92d2fd3873093fbc39f07c9fa9d
Jul 03 09:58:01.050164 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:58:01.050068    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg" event={"ID":"4d54910f-d4cc-4a39-9f21-6f4ea2f96bd3","Type":"ContainerStarted","Data":"1caff05c2640811bf842292953d1a0859f1f51231e303b5dbb2c5186a085b1ac"}
Jul 03 09:58:01.050164 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:58:01.050122    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg" event={"ID":"4d54910f-d4cc-4a39-9f21-6f4ea2f96bd3","Type":"ContainerStarted","Data":"f9e7e72f551d1a9228ce47774419431bce0fb92d2fd3873093fbc39f07c9fa9d"}
Jul 03 09:58:01.076604 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:58:01.076540    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg" podStartSLOduration=0.89132234 podStartE2EDuration="1.076524965s" totalImagesPullingTime="185.202625ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 09:58:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 09:58:01.075872231 +0000 UTC m=+881.946537863" watchObservedRunningTime="2026-07-03 09:58:01.076524965 +0000 UTC m=+881.947190594"
Jul 03 09:58:10.415271 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:58:10.415237    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg"
Jul 03 09:58:10.415731 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:58:10.415289    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg"
Jul 03 09:58:10.428224 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:58:10.428193    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg"
Jul 03 09:58:11.105794 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:58:11.105716    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg"
Jul 03 09:58:19.575935 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:58:19.575906    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c4mdt_9d052bc8-d41a-494c-9523-5bfdcfb29ec2/console-operator/2.log"
Jul 03 09:58:19.578271 ip-10-0-131-117 kubenswrapper[2559]: I0703 09:58:19.578244    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c4mdt_9d052bc8-d41a-494c-9523-5bfdcfb29ec2/console-operator/2.log"
Jul 03 10:03:19.604660 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:03:19.604571    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c4mdt_9d052bc8-d41a-494c-9523-5bfdcfb29ec2/console-operator/2.log"
Jul 03 10:03:19.615262 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:03:19.615241    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c4mdt_9d052bc8-d41a-494c-9523-5bfdcfb29ec2/console-operator/2.log"
Jul 03 10:08:19.645780 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:08:19.645652    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c4mdt_9d052bc8-d41a-494c-9523-5bfdcfb29ec2/console-operator/2.log"
Jul 03 10:08:19.650609 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:08:19.650585    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c4mdt_9d052bc8-d41a-494c-9523-5bfdcfb29ec2/console-operator/2.log"
Jul 03 10:12:10.932107 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:10.932071    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-375f3f4c-5cd78f74b7-gbs8n"]
Jul 03 10:12:10.936024 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:10.936001    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-375f3f4c-5cd78f74b7-gbs8n"
Jul 03 10:12:10.938669 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:10.938644    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-375f3f4c-serving-cert\""
Jul 03 10:12:10.952456 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:10.952433    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-375f3f4c-5cd78f74b7-gbs8n"]
Jul 03 10:12:10.972286 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:10.972257    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ee3b826-36a5-4e24-a953-9741a3fe8bed-openshift-service-ca\") pod \"maas-api-e2e-ait-375f3f4c-5cd78f74b7-gbs8n\" (UID: \"4ee3b826-36a5-4e24-a953-9741a3fe8bed\") " pod="opendatahub/maas-api-e2e-ait-375f3f4c-5cd78f74b7-gbs8n"
Jul 03 10:12:10.972436 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:10.972301    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh8mb\" (UniqueName: \"kubernetes.io/projected/4ee3b826-36a5-4e24-a953-9741a3fe8bed-kube-api-access-lh8mb\") pod \"maas-api-e2e-ait-375f3f4c-5cd78f74b7-gbs8n\" (UID: \"4ee3b826-36a5-4e24-a953-9741a3fe8bed\") " pod="opendatahub/maas-api-e2e-ait-375f3f4c-5cd78f74b7-gbs8n"
Jul 03 10:12:10.972436 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:10.972325    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ee3b826-36a5-4e24-a953-9741a3fe8bed-maas-api-tls\") pod \"maas-api-e2e-ait-375f3f4c-5cd78f74b7-gbs8n\" (UID: \"4ee3b826-36a5-4e24-a953-9741a3fe8bed\") " pod="opendatahub/maas-api-e2e-ait-375f3f4c-5cd78f74b7-gbs8n"
Jul 03 10:12:11.073655 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:11.073618    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ee3b826-36a5-4e24-a953-9741a3fe8bed-openshift-service-ca\") pod \"maas-api-e2e-ait-375f3f4c-5cd78f74b7-gbs8n\" (UID: \"4ee3b826-36a5-4e24-a953-9741a3fe8bed\") " pod="opendatahub/maas-api-e2e-ait-375f3f4c-5cd78f74b7-gbs8n"
Jul 03 10:12:11.073823 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:11.073672    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lh8mb\" (UniqueName: \"kubernetes.io/projected/4ee3b826-36a5-4e24-a953-9741a3fe8bed-kube-api-access-lh8mb\") pod \"maas-api-e2e-ait-375f3f4c-5cd78f74b7-gbs8n\" (UID: \"4ee3b826-36a5-4e24-a953-9741a3fe8bed\") " pod="opendatahub/maas-api-e2e-ait-375f3f4c-5cd78f74b7-gbs8n"
Jul 03 10:12:11.073823 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:11.073703    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ee3b826-36a5-4e24-a953-9741a3fe8bed-maas-api-tls\") pod \"maas-api-e2e-ait-375f3f4c-5cd78f74b7-gbs8n\" (UID: \"4ee3b826-36a5-4e24-a953-9741a3fe8bed\") " pod="opendatahub/maas-api-e2e-ait-375f3f4c-5cd78f74b7-gbs8n"
Jul 03 10:12:11.073897 ip-10-0-131-117 kubenswrapper[2559]: E0703 10:12:11.073846    2559 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-375f3f4c-serving-cert: secret "maas-api-e2e-ait-375f3f4c-serving-cert" not found
Jul 03 10:12:11.073930 ip-10-0-131-117 kubenswrapper[2559]: E0703 10:12:11.073922    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ee3b826-36a5-4e24-a953-9741a3fe8bed-maas-api-tls podName:4ee3b826-36a5-4e24-a953-9741a3fe8bed nodeName:}" failed. No retries permitted until 2026-07-03 10:12:11.573901146 +0000 UTC m=+1732.444566752 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4ee3b826-36a5-4e24-a953-9741a3fe8bed-maas-api-tls") pod "maas-api-e2e-ait-375f3f4c-5cd78f74b7-gbs8n" (UID: "4ee3b826-36a5-4e24-a953-9741a3fe8bed") : secret "maas-api-e2e-ait-375f3f4c-serving-cert" not found
Jul 03 10:12:11.074307 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:11.074288    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ee3b826-36a5-4e24-a953-9741a3fe8bed-openshift-service-ca\") pod \"maas-api-e2e-ait-375f3f4c-5cd78f74b7-gbs8n\" (UID: \"4ee3b826-36a5-4e24-a953-9741a3fe8bed\") " pod="opendatahub/maas-api-e2e-ait-375f3f4c-5cd78f74b7-gbs8n"
Jul 03 10:12:11.088046 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:11.088013    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh8mb\" (UniqueName: \"kubernetes.io/projected/4ee3b826-36a5-4e24-a953-9741a3fe8bed-kube-api-access-lh8mb\") pod \"maas-api-e2e-ait-375f3f4c-5cd78f74b7-gbs8n\" (UID: \"4ee3b826-36a5-4e24-a953-9741a3fe8bed\") " pod="opendatahub/maas-api-e2e-ait-375f3f4c-5cd78f74b7-gbs8n"
Jul 03 10:12:11.578102 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:11.578064    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ee3b826-36a5-4e24-a953-9741a3fe8bed-maas-api-tls\") pod \"maas-api-e2e-ait-375f3f4c-5cd78f74b7-gbs8n\" (UID: \"4ee3b826-36a5-4e24-a953-9741a3fe8bed\") " pod="opendatahub/maas-api-e2e-ait-375f3f4c-5cd78f74b7-gbs8n"
Jul 03 10:12:11.578297 ip-10-0-131-117 kubenswrapper[2559]: E0703 10:12:11.578210    2559 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-375f3f4c-serving-cert: secret "maas-api-e2e-ait-375f3f4c-serving-cert" not found
Jul 03 10:12:11.578297 ip-10-0-131-117 kubenswrapper[2559]: E0703 10:12:11.578284    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ee3b826-36a5-4e24-a953-9741a3fe8bed-maas-api-tls podName:4ee3b826-36a5-4e24-a953-9741a3fe8bed nodeName:}" failed. No retries permitted until 2026-07-03 10:12:12.578269338 +0000 UTC m=+1733.448934945 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4ee3b826-36a5-4e24-a953-9741a3fe8bed-maas-api-tls") pod "maas-api-e2e-ait-375f3f4c-5cd78f74b7-gbs8n" (UID: "4ee3b826-36a5-4e24-a953-9741a3fe8bed") : secret "maas-api-e2e-ait-375f3f4c-serving-cert" not found
Jul 03 10:12:12.586895 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:12.586853    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ee3b826-36a5-4e24-a953-9741a3fe8bed-maas-api-tls\") pod \"maas-api-e2e-ait-375f3f4c-5cd78f74b7-gbs8n\" (UID: \"4ee3b826-36a5-4e24-a953-9741a3fe8bed\") " pod="opendatahub/maas-api-e2e-ait-375f3f4c-5cd78f74b7-gbs8n"
Jul 03 10:12:12.589373 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:12.589349    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ee3b826-36a5-4e24-a953-9741a3fe8bed-maas-api-tls\") pod \"maas-api-e2e-ait-375f3f4c-5cd78f74b7-gbs8n\" (UID: \"4ee3b826-36a5-4e24-a953-9741a3fe8bed\") " pod="opendatahub/maas-api-e2e-ait-375f3f4c-5cd78f74b7-gbs8n"
Jul 03 10:12:12.746619 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:12.746581    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-375f3f4c-5cd78f74b7-gbs8n"
Jul 03 10:12:12.896994 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:12.896968    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-375f3f4c-5cd78f74b7-gbs8n"]
Jul 03 10:12:12.899122 ip-10-0-131-117 kubenswrapper[2559]: W0703 10:12:12.899094    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ee3b826_36a5_4e24_a953_9741a3fe8bed.slice/crio-d27490c77fd04e1486141810ee47c510b0f826720d805c3afa671e43dc3cffb8 WatchSource:0}: Error finding container d27490c77fd04e1486141810ee47c510b0f826720d805c3afa671e43dc3cffb8: Status 404 returned error can't find the container with id d27490c77fd04e1486141810ee47c510b0f826720d805c3afa671e43dc3cffb8
Jul 03 10:12:12.900430 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:12.900407    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 03 10:12:12.944877 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:12.944839    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-375f3f4c-5cd78f74b7-gbs8n" event={"ID":"4ee3b826-36a5-4e24-a953-9741a3fe8bed","Type":"ContainerStarted","Data":"d27490c77fd04e1486141810ee47c510b0f826720d805c3afa671e43dc3cffb8"}
Jul 03 10:12:13.950727 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:13.950692    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-375f3f4c-5cd78f74b7-gbs8n" event={"ID":"4ee3b826-36a5-4e24-a953-9741a3fe8bed","Type":"ContainerStarted","Data":"6a6b1b2b6fef602c645bbc1d327d52b659db34dd85e712ec976bd85d07147a0b"}
Jul 03 10:12:13.951174 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:13.950755    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-375f3f4c-5cd78f74b7-gbs8n"
Jul 03 10:12:13.984003 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:13.983954    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-375f3f4c-5cd78f74b7-gbs8n" podStartSLOduration=3.556513644 podStartE2EDuration="3.983932655s" totalImagesPullingTime="427.419011ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 10:12:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 10:12:13.983267645 +0000 UTC m=+1734.853933273" watchObservedRunningTime="2026-07-03 10:12:13.983932655 +0000 UTC m=+1734.854598284"
Jul 03 10:12:16.303671 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:16.303638    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-375f3f4c-5cd78f74b7-gbs8n"]
Jul 03 10:12:16.304163 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:16.303869    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-375f3f4c-5cd78f74b7-gbs8n" podUID="4ee3b826-36a5-4e24-a953-9741a3fe8bed" containerName="maas-api" containerID="cri-o://6a6b1b2b6fef602c645bbc1d327d52b659db34dd85e712ec976bd85d07147a0b" gracePeriod=30
Jul 03 10:12:16.557883 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:16.557821    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-375f3f4c-5cd78f74b7-gbs8n"
Jul 03 10:12:16.623612 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:16.623577    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lh8mb\" (UniqueName: \"kubernetes.io/projected/4ee3b826-36a5-4e24-a953-9741a3fe8bed-kube-api-access-lh8mb\") pod \"4ee3b826-36a5-4e24-a953-9741a3fe8bed\" (UID: \"4ee3b826-36a5-4e24-a953-9741a3fe8bed\") "
Jul 03 10:12:16.623780 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:16.623637    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ee3b826-36a5-4e24-a953-9741a3fe8bed-maas-api-tls\") pod \"4ee3b826-36a5-4e24-a953-9741a3fe8bed\" (UID: \"4ee3b826-36a5-4e24-a953-9741a3fe8bed\") "
Jul 03 10:12:16.623780 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:16.623725    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ee3b826-36a5-4e24-a953-9741a3fe8bed-openshift-service-ca\") pod \"4ee3b826-36a5-4e24-a953-9741a3fe8bed\" (UID: \"4ee3b826-36a5-4e24-a953-9741a3fe8bed\") "
Jul 03 10:12:16.624077 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:16.624053    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ee3b826-36a5-4e24-a953-9741a3fe8bed-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4ee3b826-36a5-4e24-a953-9741a3fe8bed" (UID: "4ee3b826-36a5-4e24-a953-9741a3fe8bed"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 10:12:16.625894 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:16.625871    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ee3b826-36a5-4e24-a953-9741a3fe8bed-kube-api-access-lh8mb" (OuterVolumeSpecName: "kube-api-access-lh8mb") pod "4ee3b826-36a5-4e24-a953-9741a3fe8bed" (UID: "4ee3b826-36a5-4e24-a953-9741a3fe8bed"). InnerVolumeSpecName "kube-api-access-lh8mb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 10:12:16.626013 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:16.625906    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ee3b826-36a5-4e24-a953-9741a3fe8bed-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4ee3b826-36a5-4e24-a953-9741a3fe8bed" (UID: "4ee3b826-36a5-4e24-a953-9741a3fe8bed"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 10:12:16.724317 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:16.724280    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ee3b826-36a5-4e24-a953-9741a3fe8bed-openshift-service-ca\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:12:16.724317 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:16.724311    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lh8mb\" (UniqueName: \"kubernetes.io/projected/4ee3b826-36a5-4e24-a953-9741a3fe8bed-kube-api-access-lh8mb\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:12:16.724317 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:16.724323    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ee3b826-36a5-4e24-a953-9741a3fe8bed-maas-api-tls\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:12:16.965738 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:16.965706    2559 generic.go:356] "Generic (PLEG): container finished" podID="4ee3b826-36a5-4e24-a953-9741a3fe8bed" containerID="6a6b1b2b6fef602c645bbc1d327d52b659db34dd85e712ec976bd85d07147a0b" exitCode=0
Jul 03 10:12:16.965918 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:16.965749    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-375f3f4c-5cd78f74b7-gbs8n" event={"ID":"4ee3b826-36a5-4e24-a953-9741a3fe8bed","Type":"ContainerDied","Data":"6a6b1b2b6fef602c645bbc1d327d52b659db34dd85e712ec976bd85d07147a0b"}
Jul 03 10:12:16.965918 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:16.965754    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-375f3f4c-5cd78f74b7-gbs8n"
Jul 03 10:12:16.965918 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:16.965792    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-375f3f4c-5cd78f74b7-gbs8n" event={"ID":"4ee3b826-36a5-4e24-a953-9741a3fe8bed","Type":"ContainerDied","Data":"d27490c77fd04e1486141810ee47c510b0f826720d805c3afa671e43dc3cffb8"}
Jul 03 10:12:16.965918 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:16.965815    2559 scope.go:117] "RemoveContainer" containerID="6a6b1b2b6fef602c645bbc1d327d52b659db34dd85e712ec976bd85d07147a0b"
Jul 03 10:12:16.976053 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:16.976032    2559 scope.go:117] "RemoveContainer" containerID="6a6b1b2b6fef602c645bbc1d327d52b659db34dd85e712ec976bd85d07147a0b"
Jul 03 10:12:16.976360 ip-10-0-131-117 kubenswrapper[2559]: E0703 10:12:16.976337    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a6b1b2b6fef602c645bbc1d327d52b659db34dd85e712ec976bd85d07147a0b\": container with ID starting with 6a6b1b2b6fef602c645bbc1d327d52b659db34dd85e712ec976bd85d07147a0b not found: ID does not exist" containerID="6a6b1b2b6fef602c645bbc1d327d52b659db34dd85e712ec976bd85d07147a0b"
Jul 03 10:12:16.976459 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:16.976373    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a6b1b2b6fef602c645bbc1d327d52b659db34dd85e712ec976bd85d07147a0b"} err="failed to get container status \"6a6b1b2b6fef602c645bbc1d327d52b659db34dd85e712ec976bd85d07147a0b\": rpc error: code = NotFound desc = could not find container \"6a6b1b2b6fef602c645bbc1d327d52b659db34dd85e712ec976bd85d07147a0b\": container with ID starting with 6a6b1b2b6fef602c645bbc1d327d52b659db34dd85e712ec976bd85d07147a0b not found: ID does not exist"
Jul 03 10:12:16.990580 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:16.990536    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-375f3f4c-5cd78f74b7-gbs8n"]
Jul 03 10:12:16.996799 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:16.996773    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-375f3f4c-5cd78f74b7-gbs8n"]
Jul 03 10:12:17.691814 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:17.691782    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ee3b826-36a5-4e24-a953-9741a3fe8bed" path="/var/lib/kubelet/pods/4ee3b826-36a5-4e24-a953-9741a3fe8bed/volumes"
Jul 03 10:12:23.881258 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:23.881216    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-dc22bc5f-9ff5774c-x6bl7"]
Jul 03 10:12:23.881832 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:23.881811    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ee3b826-36a5-4e24-a953-9741a3fe8bed" containerName="maas-api"
Jul 03 10:12:23.881911 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:23.881835    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ee3b826-36a5-4e24-a953-9741a3fe8bed" containerName="maas-api"
Jul 03 10:12:23.881967 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:23.881943    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ee3b826-36a5-4e24-a953-9741a3fe8bed" containerName="maas-api"
Jul 03 10:12:23.884457 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:23.884435    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-dc22bc5f-9ff5774c-x6bl7"
Jul 03 10:12:23.891029 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:23.891008    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-dc22bc5f-serving-cert\""
Jul 03 10:12:23.899943 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:23.899919    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-dc22bc5f-9ff5774c-x6bl7"]
Jul 03 10:12:23.989731 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:23.989703    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b43446e9-b9db-4fb6-8df4-abfdecfa9017-maas-api-tls\") pod \"maas-api-e2e-ait-dc22bc5f-9ff5774c-x6bl7\" (UID: \"b43446e9-b9db-4fb6-8df4-abfdecfa9017\") " pod="opendatahub/maas-api-e2e-ait-dc22bc5f-9ff5774c-x6bl7"
Jul 03 10:12:23.989930 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:23.989862    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zn2jd\" (UniqueName: \"kubernetes.io/projected/b43446e9-b9db-4fb6-8df4-abfdecfa9017-kube-api-access-zn2jd\") pod \"maas-api-e2e-ait-dc22bc5f-9ff5774c-x6bl7\" (UID: \"b43446e9-b9db-4fb6-8df4-abfdecfa9017\") " pod="opendatahub/maas-api-e2e-ait-dc22bc5f-9ff5774c-x6bl7"
Jul 03 10:12:23.989930 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:23.989900    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b43446e9-b9db-4fb6-8df4-abfdecfa9017-openshift-service-ca\") pod \"maas-api-e2e-ait-dc22bc5f-9ff5774c-x6bl7\" (UID: \"b43446e9-b9db-4fb6-8df4-abfdecfa9017\") " pod="opendatahub/maas-api-e2e-ait-dc22bc5f-9ff5774c-x6bl7"
Jul 03 10:12:24.091190 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:24.091153    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zn2jd\" (UniqueName: \"kubernetes.io/projected/b43446e9-b9db-4fb6-8df4-abfdecfa9017-kube-api-access-zn2jd\") pod \"maas-api-e2e-ait-dc22bc5f-9ff5774c-x6bl7\" (UID: \"b43446e9-b9db-4fb6-8df4-abfdecfa9017\") " pod="opendatahub/maas-api-e2e-ait-dc22bc5f-9ff5774c-x6bl7"
Jul 03 10:12:24.091190 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:24.091200    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b43446e9-b9db-4fb6-8df4-abfdecfa9017-openshift-service-ca\") pod \"maas-api-e2e-ait-dc22bc5f-9ff5774c-x6bl7\" (UID: \"b43446e9-b9db-4fb6-8df4-abfdecfa9017\") " pod="opendatahub/maas-api-e2e-ait-dc22bc5f-9ff5774c-x6bl7"
Jul 03 10:12:24.091459 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:24.091234    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b43446e9-b9db-4fb6-8df4-abfdecfa9017-maas-api-tls\") pod \"maas-api-e2e-ait-dc22bc5f-9ff5774c-x6bl7\" (UID: \"b43446e9-b9db-4fb6-8df4-abfdecfa9017\") " pod="opendatahub/maas-api-e2e-ait-dc22bc5f-9ff5774c-x6bl7"
Jul 03 10:12:24.091459 ip-10-0-131-117 kubenswrapper[2559]: E0703 10:12:24.091387    2559 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-dc22bc5f-serving-cert: secret "maas-api-e2e-ait-dc22bc5f-serving-cert" not found
Jul 03 10:12:24.091459 ip-10-0-131-117 kubenswrapper[2559]: E0703 10:12:24.091452    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b43446e9-b9db-4fb6-8df4-abfdecfa9017-maas-api-tls podName:b43446e9-b9db-4fb6-8df4-abfdecfa9017 nodeName:}" failed. No retries permitted until 2026-07-03 10:12:24.591430777 +0000 UTC m=+1745.462096384 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b43446e9-b9db-4fb6-8df4-abfdecfa9017-maas-api-tls") pod "maas-api-e2e-ait-dc22bc5f-9ff5774c-x6bl7" (UID: "b43446e9-b9db-4fb6-8df4-abfdecfa9017") : secret "maas-api-e2e-ait-dc22bc5f-serving-cert" not found
Jul 03 10:12:24.091842 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:24.091823    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b43446e9-b9db-4fb6-8df4-abfdecfa9017-openshift-service-ca\") pod \"maas-api-e2e-ait-dc22bc5f-9ff5774c-x6bl7\" (UID: \"b43446e9-b9db-4fb6-8df4-abfdecfa9017\") " pod="opendatahub/maas-api-e2e-ait-dc22bc5f-9ff5774c-x6bl7"
Jul 03 10:12:24.117176 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:24.117138    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zn2jd\" (UniqueName: \"kubernetes.io/projected/b43446e9-b9db-4fb6-8df4-abfdecfa9017-kube-api-access-zn2jd\") pod \"maas-api-e2e-ait-dc22bc5f-9ff5774c-x6bl7\" (UID: \"b43446e9-b9db-4fb6-8df4-abfdecfa9017\") " pod="opendatahub/maas-api-e2e-ait-dc22bc5f-9ff5774c-x6bl7"
Jul 03 10:12:24.595614 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:24.595580    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b43446e9-b9db-4fb6-8df4-abfdecfa9017-maas-api-tls\") pod \"maas-api-e2e-ait-dc22bc5f-9ff5774c-x6bl7\" (UID: \"b43446e9-b9db-4fb6-8df4-abfdecfa9017\") " pod="opendatahub/maas-api-e2e-ait-dc22bc5f-9ff5774c-x6bl7"
Jul 03 10:12:24.598090 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:24.598065    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b43446e9-b9db-4fb6-8df4-abfdecfa9017-maas-api-tls\") pod \"maas-api-e2e-ait-dc22bc5f-9ff5774c-x6bl7\" (UID: \"b43446e9-b9db-4fb6-8df4-abfdecfa9017\") " pod="opendatahub/maas-api-e2e-ait-dc22bc5f-9ff5774c-x6bl7"
Jul 03 10:12:24.796163 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:24.796128    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-dc22bc5f-9ff5774c-x6bl7"
Jul 03 10:12:24.938317 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:24.938288    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-dc22bc5f-9ff5774c-x6bl7"]
Jul 03 10:12:24.939244 ip-10-0-131-117 kubenswrapper[2559]: W0703 10:12:24.939215    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb43446e9_b9db_4fb6_8df4_abfdecfa9017.slice/crio-33bef8f45e84ed078ac1dda3b95251022a08fda205b0471f347699f5cdc2d5a2 WatchSource:0}: Error finding container 33bef8f45e84ed078ac1dda3b95251022a08fda205b0471f347699f5cdc2d5a2: Status 404 returned error can't find the container with id 33bef8f45e84ed078ac1dda3b95251022a08fda205b0471f347699f5cdc2d5a2
Jul 03 10:12:25.004802 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:25.004765    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-dc22bc5f-9ff5774c-x6bl7" event={"ID":"b43446e9-b9db-4fb6-8df4-abfdecfa9017","Type":"ContainerStarted","Data":"33bef8f45e84ed078ac1dda3b95251022a08fda205b0471f347699f5cdc2d5a2"}
Jul 03 10:12:26.010233 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:26.010199    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-dc22bc5f-9ff5774c-x6bl7" event={"ID":"b43446e9-b9db-4fb6-8df4-abfdecfa9017","Type":"ContainerStarted","Data":"2a4f0684949efef94859f5678bbdc70c9900ec93d65a94023c7b2519b15a7ba8"}
Jul 03 10:12:26.010646 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:26.010323    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-dc22bc5f-9ff5774c-x6bl7"
Jul 03 10:12:29.241255 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:29.241193    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-dc22bc5f-9ff5774c-x6bl7" podStartSLOduration=5.853774421 podStartE2EDuration="6.241169807s" totalImagesPullingTime="387.395386ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 10:12:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 10:12:26.036251368 +0000 UTC m=+1746.906916996" watchObservedRunningTime="2026-07-03 10:12:29.241169807 +0000 UTC m=+1750.111835439"
Jul 03 10:12:29.242594 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:29.242572    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-dc22bc5f-9ff5774c-x6bl7"]
Jul 03 10:12:29.242855 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:29.242827    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-dc22bc5f-9ff5774c-x6bl7" podUID="b43446e9-b9db-4fb6-8df4-abfdecfa9017" containerName="maas-api" containerID="cri-o://2a4f0684949efef94859f5678bbdc70c9900ec93d65a94023c7b2519b15a7ba8" gracePeriod=30
Jul 03 10:12:29.490952 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:29.490920    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-dc22bc5f-9ff5774c-x6bl7"
Jul 03 10:12:29.545729 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:29.545643    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b43446e9-b9db-4fb6-8df4-abfdecfa9017-openshift-service-ca\") pod \"b43446e9-b9db-4fb6-8df4-abfdecfa9017\" (UID: \"b43446e9-b9db-4fb6-8df4-abfdecfa9017\") "
Jul 03 10:12:29.545729 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:29.545715    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b43446e9-b9db-4fb6-8df4-abfdecfa9017-maas-api-tls\") pod \"b43446e9-b9db-4fb6-8df4-abfdecfa9017\" (UID: \"b43446e9-b9db-4fb6-8df4-abfdecfa9017\") "
Jul 03 10:12:29.545953 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:29.545742    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zn2jd\" (UniqueName: \"kubernetes.io/projected/b43446e9-b9db-4fb6-8df4-abfdecfa9017-kube-api-access-zn2jd\") pod \"b43446e9-b9db-4fb6-8df4-abfdecfa9017\" (UID: \"b43446e9-b9db-4fb6-8df4-abfdecfa9017\") "
Jul 03 10:12:29.546008 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:29.545971    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b43446e9-b9db-4fb6-8df4-abfdecfa9017-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b43446e9-b9db-4fb6-8df4-abfdecfa9017" (UID: "b43446e9-b9db-4fb6-8df4-abfdecfa9017"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 10:12:29.547934 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:29.547908    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b43446e9-b9db-4fb6-8df4-abfdecfa9017-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b43446e9-b9db-4fb6-8df4-abfdecfa9017" (UID: "b43446e9-b9db-4fb6-8df4-abfdecfa9017"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 10:12:29.548038 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:29.547935    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b43446e9-b9db-4fb6-8df4-abfdecfa9017-kube-api-access-zn2jd" (OuterVolumeSpecName: "kube-api-access-zn2jd") pod "b43446e9-b9db-4fb6-8df4-abfdecfa9017" (UID: "b43446e9-b9db-4fb6-8df4-abfdecfa9017"). InnerVolumeSpecName "kube-api-access-zn2jd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 10:12:29.646420 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:29.646382    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b43446e9-b9db-4fb6-8df4-abfdecfa9017-openshift-service-ca\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:12:29.646420 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:29.646413    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b43446e9-b9db-4fb6-8df4-abfdecfa9017-maas-api-tls\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:12:29.646420 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:29.646426    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zn2jd\" (UniqueName: \"kubernetes.io/projected/b43446e9-b9db-4fb6-8df4-abfdecfa9017-kube-api-access-zn2jd\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:12:30.036167 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:30.036134    2559 generic.go:356] "Generic (PLEG): container finished" podID="b43446e9-b9db-4fb6-8df4-abfdecfa9017" containerID="2a4f0684949efef94859f5678bbdc70c9900ec93d65a94023c7b2519b15a7ba8" exitCode=0
Jul 03 10:12:30.036337 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:30.036177    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-dc22bc5f-9ff5774c-x6bl7"
Jul 03 10:12:30.036337 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:30.036189    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-dc22bc5f-9ff5774c-x6bl7" event={"ID":"b43446e9-b9db-4fb6-8df4-abfdecfa9017","Type":"ContainerDied","Data":"2a4f0684949efef94859f5678bbdc70c9900ec93d65a94023c7b2519b15a7ba8"}
Jul 03 10:12:30.036337 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:30.036231    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-dc22bc5f-9ff5774c-x6bl7" event={"ID":"b43446e9-b9db-4fb6-8df4-abfdecfa9017","Type":"ContainerDied","Data":"33bef8f45e84ed078ac1dda3b95251022a08fda205b0471f347699f5cdc2d5a2"}
Jul 03 10:12:30.036337 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:30.036252    2559 scope.go:117] "RemoveContainer" containerID="2a4f0684949efef94859f5678bbdc70c9900ec93d65a94023c7b2519b15a7ba8"
Jul 03 10:12:30.045182 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:30.045162    2559 scope.go:117] "RemoveContainer" containerID="2a4f0684949efef94859f5678bbdc70c9900ec93d65a94023c7b2519b15a7ba8"
Jul 03 10:12:30.045470 ip-10-0-131-117 kubenswrapper[2559]: E0703 10:12:30.045450    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a4f0684949efef94859f5678bbdc70c9900ec93d65a94023c7b2519b15a7ba8\": container with ID starting with 2a4f0684949efef94859f5678bbdc70c9900ec93d65a94023c7b2519b15a7ba8 not found: ID does not exist" containerID="2a4f0684949efef94859f5678bbdc70c9900ec93d65a94023c7b2519b15a7ba8"
Jul 03 10:12:30.045529 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:30.045480    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a4f0684949efef94859f5678bbdc70c9900ec93d65a94023c7b2519b15a7ba8"} err="failed to get container status \"2a4f0684949efef94859f5678bbdc70c9900ec93d65a94023c7b2519b15a7ba8\": rpc error: code = NotFound desc = could not find container \"2a4f0684949efef94859f5678bbdc70c9900ec93d65a94023c7b2519b15a7ba8\": container with ID starting with 2a4f0684949efef94859f5678bbdc70c9900ec93d65a94023c7b2519b15a7ba8 not found: ID does not exist"
Jul 03 10:12:30.055139 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:30.055118    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-dc22bc5f-9ff5774c-x6bl7"]
Jul 03 10:12:30.059303 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:30.059280    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-dc22bc5f-9ff5774c-x6bl7"]
Jul 03 10:12:31.691130 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:31.691099    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b43446e9-b9db-4fb6-8df4-abfdecfa9017" path="/var/lib/kubelet/pods/b43446e9-b9db-4fb6-8df4-abfdecfa9017/volumes"
Jul 03 10:12:41.737472 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:41.737438    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2"]
Jul 03 10:12:41.738035 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:41.738016    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b43446e9-b9db-4fb6-8df4-abfdecfa9017" containerName="maas-api"
Jul 03 10:12:41.738082 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:41.738040    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b43446e9-b9db-4fb6-8df4-abfdecfa9017" containerName="maas-api"
Jul 03 10:12:41.738183 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:41.738169    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b43446e9-b9db-4fb6-8df4-abfdecfa9017" containerName="maas-api"
Jul 03 10:12:41.742939 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:41.742920    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2"
Jul 03 10:12:41.745711 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:41.745691    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-1b6948bd-openshift-default-dockercfg-6sthb\""
Jul 03 10:12:41.752852 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:41.752829    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2"]
Jul 03 10:12:41.858871 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:41.858835    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bdef26f-0275-4652-8dd3-f7fca6c21acf-istiod-ca-cert\") pod \"e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2\" (UID: \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\") " pod="openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2"
Jul 03 10:12:41.858871 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:41.858874    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bdef26f-0275-4652-8dd3-f7fca6c21acf-istio-token\") pod \"e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2\" (UID: \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\") " pod="openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2"
Jul 03 10:12:41.859078 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:41.858912    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bdef26f-0275-4652-8dd3-f7fca6c21acf-workload-certs\") pod \"e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2\" (UID: \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\") " pod="openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2"
Jul 03 10:12:41.859078 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:41.858941    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bdef26f-0275-4652-8dd3-f7fca6c21acf-credential-socket\") pod \"e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2\" (UID: \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\") " pod="openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2"
Jul 03 10:12:41.859078 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:41.858968    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k98q\" (UniqueName: \"kubernetes.io/projected/9bdef26f-0275-4652-8dd3-f7fca6c21acf-kube-api-access-4k98q\") pod \"e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2\" (UID: \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\") " pod="openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2"
Jul 03 10:12:41.859078 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:41.859025    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bdef26f-0275-4652-8dd3-f7fca6c21acf-istio-data\") pod \"e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2\" (UID: \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\") " pod="openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2"
Jul 03 10:12:41.859206 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:41.859086    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bdef26f-0275-4652-8dd3-f7fca6c21acf-istio-envoy\") pod \"e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2\" (UID: \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\") " pod="openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2"
Jul 03 10:12:41.859206 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:41.859103    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bdef26f-0275-4652-8dd3-f7fca6c21acf-workload-socket\") pod \"e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2\" (UID: \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\") " pod="openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2"
Jul 03 10:12:41.859267 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:41.859201    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bdef26f-0275-4652-8dd3-f7fca6c21acf-istio-podinfo\") pod \"e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2\" (UID: \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\") " pod="openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2"
Jul 03 10:12:41.960640 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:41.960599    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bdef26f-0275-4652-8dd3-f7fca6c21acf-credential-socket\") pod \"e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2\" (UID: \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\") " pod="openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2"
Jul 03 10:12:41.960833 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:41.960651    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k98q\" (UniqueName: \"kubernetes.io/projected/9bdef26f-0275-4652-8dd3-f7fca6c21acf-kube-api-access-4k98q\") pod \"e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2\" (UID: \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\") " pod="openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2"
Jul 03 10:12:41.960833 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:41.960679    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bdef26f-0275-4652-8dd3-f7fca6c21acf-istio-data\") pod \"e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2\" (UID: \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\") " pod="openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2"
Jul 03 10:12:41.960833 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:41.960714    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bdef26f-0275-4652-8dd3-f7fca6c21acf-istio-envoy\") pod \"e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2\" (UID: \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\") " pod="openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2"
Jul 03 10:12:41.960833 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:41.960737    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bdef26f-0275-4652-8dd3-f7fca6c21acf-workload-socket\") pod \"e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2\" (UID: \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\") " pod="openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2"
Jul 03 10:12:41.960833 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:41.960771    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bdef26f-0275-4652-8dd3-f7fca6c21acf-istio-podinfo\") pod \"e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2\" (UID: \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\") " pod="openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2"
Jul 03 10:12:41.961095 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:41.960842    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bdef26f-0275-4652-8dd3-f7fca6c21acf-istiod-ca-cert\") pod \"e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2\" (UID: \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\") " pod="openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2"
Jul 03 10:12:41.961095 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:41.960881    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bdef26f-0275-4652-8dd3-f7fca6c21acf-istio-token\") pod \"e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2\" (UID: \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\") " pod="openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2"
Jul 03 10:12:41.961095 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:41.960947    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bdef26f-0275-4652-8dd3-f7fca6c21acf-workload-certs\") pod \"e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2\" (UID: \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\") " pod="openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2"
Jul 03 10:12:41.961095 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:41.961055    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bdef26f-0275-4652-8dd3-f7fca6c21acf-credential-socket\") pod \"e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2\" (UID: \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\") " pod="openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2"
Jul 03 10:12:41.961282 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:41.961119    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bdef26f-0275-4652-8dd3-f7fca6c21acf-istio-data\") pod \"e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2\" (UID: \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\") " pod="openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2"
Jul 03 10:12:41.961443 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:41.961419    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bdef26f-0275-4652-8dd3-f7fca6c21acf-workload-socket\") pod \"e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2\" (UID: \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\") " pod="openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2"
Jul 03 10:12:41.961622 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:41.961601    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bdef26f-0275-4652-8dd3-f7fca6c21acf-workload-certs\") pod \"e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2\" (UID: \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\") " pod="openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2"
Jul 03 10:12:41.961869 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:41.961852    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bdef26f-0275-4652-8dd3-f7fca6c21acf-istiod-ca-cert\") pod \"e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2\" (UID: \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\") " pod="openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2"
Jul 03 10:12:41.963018 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:41.963001    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bdef26f-0275-4652-8dd3-f7fca6c21acf-istio-envoy\") pod \"e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2\" (UID: \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\") " pod="openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2"
Jul 03 10:12:41.963308 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:41.963288    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bdef26f-0275-4652-8dd3-f7fca6c21acf-istio-podinfo\") pod \"e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2\" (UID: \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\") " pod="openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2"
Jul 03 10:12:41.974959 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:41.974933    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k98q\" (UniqueName: \"kubernetes.io/projected/9bdef26f-0275-4652-8dd3-f7fca6c21acf-kube-api-access-4k98q\") pod \"e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2\" (UID: \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\") " pod="openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2"
Jul 03 10:12:41.980819 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:41.980799    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bdef26f-0275-4652-8dd3-f7fca6c21acf-istio-token\") pod \"e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2\" (UID: \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\") " pod="openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2"
Jul 03 10:12:42.054306 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:42.054205    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2"
Jul 03 10:12:42.197638 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:42.197610    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2"]
Jul 03 10:12:42.200211 ip-10-0-131-117 kubenswrapper[2559]: W0703 10:12:42.200184    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bdef26f_0275_4652_8dd3_f7fca6c21acf.slice/crio-05a4898bb5ddfc2a73ddc42a2564a8e04f8b53664f3f6a042fe020468510a335 WatchSource:0}: Error finding container 05a4898bb5ddfc2a73ddc42a2564a8e04f8b53664f3f6a042fe020468510a335: Status 404 returned error can't find the container with id 05a4898bb5ddfc2a73ddc42a2564a8e04f8b53664f3f6a042fe020468510a335
Jul 03 10:12:42.202324 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:42.202293    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 03 10:12:42.202404 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:42.202366    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 03 10:12:42.202404 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:42.202393    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 03 10:12:43.107517 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:43.107479    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2" event={"ID":"9bdef26f-0275-4652-8dd3-f7fca6c21acf","Type":"ContainerStarted","Data":"c037170eb20cd9308f2b2200b8ce27a08c353c1d43433d3772586e14fc707033"}
Jul 03 10:12:43.107976 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:43.107559    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2" event={"ID":"9bdef26f-0275-4652-8dd3-f7fca6c21acf","Type":"ContainerStarted","Data":"05a4898bb5ddfc2a73ddc42a2564a8e04f8b53664f3f6a042fe020468510a335"}
Jul 03 10:12:43.138167 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:43.138115    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2" podStartSLOduration=2.138099166 podStartE2EDuration="2.138099166s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 10:12:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 10:12:43.135719936 +0000 UTC m=+1764.006385565" watchObservedRunningTime="2026-07-03 10:12:43.138099166 +0000 UTC m=+1764.008764795"
Jul 03 10:12:44.054986 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:44.054952    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2"
Jul 03 10:12:44.060136 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:44.060111    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2"
Jul 03 10:12:44.112865 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:44.112838    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2"
Jul 03 10:12:44.113879 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:44.113861    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2"
Jul 03 10:12:47.587163 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:47.587120    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2"]
Jul 03 10:12:47.587691 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:47.587382    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2" podUID="9bdef26f-0275-4652-8dd3-f7fca6c21acf" containerName="istio-proxy" containerID="cri-o://c037170eb20cd9308f2b2200b8ce27a08c353c1d43433d3772586e14fc707033" gracePeriod=30
Jul 03 10:12:53.334960 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:53.334930    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2"
Jul 03 10:12:53.472669 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:53.472585    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bdef26f-0275-4652-8dd3-f7fca6c21acf-istio-envoy\") pod \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\" (UID: \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\") "
Jul 03 10:12:53.472669 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:53.472661    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bdef26f-0275-4652-8dd3-f7fca6c21acf-workload-certs\") pod \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\" (UID: \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\") "
Jul 03 10:12:53.472870 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:53.472726    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bdef26f-0275-4652-8dd3-f7fca6c21acf-istio-podinfo\") pod \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\" (UID: \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\") "
Jul 03 10:12:53.472870 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:53.472782    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bdef26f-0275-4652-8dd3-f7fca6c21acf-credential-socket\") pod \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\" (UID: \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\") "
Jul 03 10:12:53.472870 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:53.472820    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bdef26f-0275-4652-8dd3-f7fca6c21acf-istio-token\") pod \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\" (UID: \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\") "
Jul 03 10:12:53.472870 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:53.472853    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bdef26f-0275-4652-8dd3-f7fca6c21acf-istio-data\") pod \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\" (UID: \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\") "
Jul 03 10:12:53.473071 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:53.472919    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4k98q\" (UniqueName: \"kubernetes.io/projected/9bdef26f-0275-4652-8dd3-f7fca6c21acf-kube-api-access-4k98q\") pod \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\" (UID: \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\") "
Jul 03 10:12:53.473071 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:53.472963    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bdef26f-0275-4652-8dd3-f7fca6c21acf-workload-socket\") pod \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\" (UID: \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\") "
Jul 03 10:12:53.473071 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:53.472974    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bdef26f-0275-4652-8dd3-f7fca6c21acf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9bdef26f-0275-4652-8dd3-f7fca6c21acf" (UID: "9bdef26f-0275-4652-8dd3-f7fca6c21acf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:12:53.473071 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:53.472990    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bdef26f-0275-4652-8dd3-f7fca6c21acf-istiod-ca-cert\") pod \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\" (UID: \"9bdef26f-0275-4652-8dd3-f7fca6c21acf\") "
Jul 03 10:12:53.473408 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:53.473336    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bdef26f-0275-4652-8dd3-f7fca6c21acf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9bdef26f-0275-4652-8dd3-f7fca6c21acf" (UID: "9bdef26f-0275-4652-8dd3-f7fca6c21acf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:12:53.473408 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:53.473365    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bdef26f-0275-4652-8dd3-f7fca6c21acf-workload-certs\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:12:53.473636 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:53.473612    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bdef26f-0275-4652-8dd3-f7fca6c21acf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9bdef26f-0275-4652-8dd3-f7fca6c21acf" (UID: "9bdef26f-0275-4652-8dd3-f7fca6c21acf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:12:53.473714 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:53.473690    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bdef26f-0275-4652-8dd3-f7fca6c21acf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9bdef26f-0275-4652-8dd3-f7fca6c21acf" (UID: "9bdef26f-0275-4652-8dd3-f7fca6c21acf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 10:12:53.473843 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:53.473822    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bdef26f-0275-4652-8dd3-f7fca6c21acf-istio-data" (OuterVolumeSpecName: "istio-data") pod "9bdef26f-0275-4652-8dd3-f7fca6c21acf" (UID: "9bdef26f-0275-4652-8dd3-f7fca6c21acf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:12:53.475219 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:53.475197    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bdef26f-0275-4652-8dd3-f7fca6c21acf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9bdef26f-0275-4652-8dd3-f7fca6c21acf" (UID: "9bdef26f-0275-4652-8dd3-f7fca6c21acf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:12:53.475400 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:53.475379    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bdef26f-0275-4652-8dd3-f7fca6c21acf-istio-token" (OuterVolumeSpecName: "istio-token") pod "9bdef26f-0275-4652-8dd3-f7fca6c21acf" (UID: "9bdef26f-0275-4652-8dd3-f7fca6c21acf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 10:12:53.475662 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:53.475637    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bdef26f-0275-4652-8dd3-f7fca6c21acf-kube-api-access-4k98q" (OuterVolumeSpecName: "kube-api-access-4k98q") pod "9bdef26f-0275-4652-8dd3-f7fca6c21acf" (UID: "9bdef26f-0275-4652-8dd3-f7fca6c21acf"). InnerVolumeSpecName "kube-api-access-4k98q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 10:12:53.475662 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:53.475646    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9bdef26f-0275-4652-8dd3-f7fca6c21acf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9bdef26f-0275-4652-8dd3-f7fca6c21acf" (UID: "9bdef26f-0275-4652-8dd3-f7fca6c21acf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 03 10:12:53.574739 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:53.574704    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bdef26f-0275-4652-8dd3-f7fca6c21acf-credential-socket\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:12:53.574739 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:53.574733    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bdef26f-0275-4652-8dd3-f7fca6c21acf-istio-token\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:12:53.574739 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:53.574743    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bdef26f-0275-4652-8dd3-f7fca6c21acf-istio-data\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:12:53.574964 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:53.574752    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4k98q\" (UniqueName: \"kubernetes.io/projected/9bdef26f-0275-4652-8dd3-f7fca6c21acf-kube-api-access-4k98q\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:12:53.574964 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:53.574760    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bdef26f-0275-4652-8dd3-f7fca6c21acf-workload-socket\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:12:53.574964 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:53.574771    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bdef26f-0275-4652-8dd3-f7fca6c21acf-istiod-ca-cert\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:12:53.574964 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:53.574778    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bdef26f-0275-4652-8dd3-f7fca6c21acf-istio-envoy\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:12:53.574964 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:53.574785    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bdef26f-0275-4652-8dd3-f7fca6c21acf-istio-podinfo\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:12:54.164447 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:54.164414    2559 generic.go:356] "Generic (PLEG): container finished" podID="9bdef26f-0275-4652-8dd3-f7fca6c21acf" containerID="c037170eb20cd9308f2b2200b8ce27a08c353c1d43433d3772586e14fc707033" exitCode=0
Jul 03 10:12:54.164641 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:54.164470    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2"
Jul 03 10:12:54.164641 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:54.164497    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2" event={"ID":"9bdef26f-0275-4652-8dd3-f7fca6c21acf","Type":"ContainerDied","Data":"c037170eb20cd9308f2b2200b8ce27a08c353c1d43433d3772586e14fc707033"}
Jul 03 10:12:54.164641 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:54.164562    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2" event={"ID":"9bdef26f-0275-4652-8dd3-f7fca6c21acf","Type":"ContainerDied","Data":"05a4898bb5ddfc2a73ddc42a2564a8e04f8b53664f3f6a042fe020468510a335"}
Jul 03 10:12:54.164641 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:54.164587    2559 scope.go:117] "RemoveContainer" containerID="c037170eb20cd9308f2b2200b8ce27a08c353c1d43433d3772586e14fc707033"
Jul 03 10:12:54.173380 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:54.173363    2559 scope.go:117] "RemoveContainer" containerID="c037170eb20cd9308f2b2200b8ce27a08c353c1d43433d3772586e14fc707033"
Jul 03 10:12:54.173698 ip-10-0-131-117 kubenswrapper[2559]: E0703 10:12:54.173674    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c037170eb20cd9308f2b2200b8ce27a08c353c1d43433d3772586e14fc707033\": container with ID starting with c037170eb20cd9308f2b2200b8ce27a08c353c1d43433d3772586e14fc707033 not found: ID does not exist" containerID="c037170eb20cd9308f2b2200b8ce27a08c353c1d43433d3772586e14fc707033"
Jul 03 10:12:54.173754 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:54.173705    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c037170eb20cd9308f2b2200b8ce27a08c353c1d43433d3772586e14fc707033"} err="failed to get container status \"c037170eb20cd9308f2b2200b8ce27a08c353c1d43433d3772586e14fc707033\": rpc error: code = NotFound desc = could not find container \"c037170eb20cd9308f2b2200b8ce27a08c353c1d43433d3772586e14fc707033\": container with ID starting with c037170eb20cd9308f2b2200b8ce27a08c353c1d43433d3772586e14fc707033 not found: ID does not exist"
Jul 03 10:12:54.186536 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:54.186500    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2"]
Jul 03 10:12:54.192904 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:54.192880    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-1b6948bd-openshift-default-b9b59db79-lq8k2"]
Jul 03 10:12:55.691526 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:12:55.691495    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bdef26f-0275-4652-8dd3-f7fca6c21acf" path="/var/lib/kubelet/pods/9bdef26f-0275-4652-8dd3-f7fca6c21acf/volumes"
Jul 03 10:13:19.679880 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:13:19.679856    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c4mdt_9d052bc8-d41a-494c-9523-5bfdcfb29ec2/console-operator/2.log"
Jul 03 10:13:19.687340 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:13:19.687318    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c4mdt_9d052bc8-d41a-494c-9523-5bfdcfb29ec2/console-operator/2.log"
Jul 03 10:14:34.113080 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:34.113049    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-ae3a9533-5c4fdb5479-ldvw8"]
Jul 03 10:14:34.113509 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:34.113412    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bdef26f-0275-4652-8dd3-f7fca6c21acf" containerName="istio-proxy"
Jul 03 10:14:34.113509 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:34.113423    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bdef26f-0275-4652-8dd3-f7fca6c21acf" containerName="istio-proxy"
Jul 03 10:14:34.113509 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:34.113479    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bdef26f-0275-4652-8dd3-f7fca6c21acf" containerName="istio-proxy"
Jul 03 10:14:34.116438 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:34.116419    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-ae3a9533-5c4fdb5479-ldvw8"
Jul 03 10:14:34.120774 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:34.120758    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-ae3a9533-serving-cert\""
Jul 03 10:14:34.136378 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:34.136355    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-ae3a9533-5c4fdb5479-ldvw8"]
Jul 03 10:14:34.211447 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:34.206573    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cef985e7-f7a7-4ecc-9a08-833d139f712f-maas-api-tls\") pod \"maas-api-e2e-mt-ae3a9533-5c4fdb5479-ldvw8\" (UID: \"cef985e7-f7a7-4ecc-9a08-833d139f712f\") " pod="opendatahub/maas-api-e2e-mt-ae3a9533-5c4fdb5479-ldvw8"
Jul 03 10:14:34.211447 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:34.206687    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cef985e7-f7a7-4ecc-9a08-833d139f712f-openshift-service-ca\") pod \"maas-api-e2e-mt-ae3a9533-5c4fdb5479-ldvw8\" (UID: \"cef985e7-f7a7-4ecc-9a08-833d139f712f\") " pod="opendatahub/maas-api-e2e-mt-ae3a9533-5c4fdb5479-ldvw8"
Jul 03 10:14:34.211447 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:34.206734    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n9v6\" (UniqueName: \"kubernetes.io/projected/cef985e7-f7a7-4ecc-9a08-833d139f712f-kube-api-access-5n9v6\") pod \"maas-api-e2e-mt-ae3a9533-5c4fdb5479-ldvw8\" (UID: \"cef985e7-f7a7-4ecc-9a08-833d139f712f\") " pod="opendatahub/maas-api-e2e-mt-ae3a9533-5c4fdb5479-ldvw8"
Jul 03 10:14:34.307565 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:34.307499    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cef985e7-f7a7-4ecc-9a08-833d139f712f-openshift-service-ca\") pod \"maas-api-e2e-mt-ae3a9533-5c4fdb5479-ldvw8\" (UID: \"cef985e7-f7a7-4ecc-9a08-833d139f712f\") " pod="opendatahub/maas-api-e2e-mt-ae3a9533-5c4fdb5479-ldvw8"
Jul 03 10:14:34.307565 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:34.307574    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n9v6\" (UniqueName: \"kubernetes.io/projected/cef985e7-f7a7-4ecc-9a08-833d139f712f-kube-api-access-5n9v6\") pod \"maas-api-e2e-mt-ae3a9533-5c4fdb5479-ldvw8\" (UID: \"cef985e7-f7a7-4ecc-9a08-833d139f712f\") " pod="opendatahub/maas-api-e2e-mt-ae3a9533-5c4fdb5479-ldvw8"
Jul 03 10:14:34.307826 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:34.307646    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cef985e7-f7a7-4ecc-9a08-833d139f712f-maas-api-tls\") pod \"maas-api-e2e-mt-ae3a9533-5c4fdb5479-ldvw8\" (UID: \"cef985e7-f7a7-4ecc-9a08-833d139f712f\") " pod="opendatahub/maas-api-e2e-mt-ae3a9533-5c4fdb5479-ldvw8"
Jul 03 10:14:34.308227 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:34.308200    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cef985e7-f7a7-4ecc-9a08-833d139f712f-openshift-service-ca\") pod \"maas-api-e2e-mt-ae3a9533-5c4fdb5479-ldvw8\" (UID: \"cef985e7-f7a7-4ecc-9a08-833d139f712f\") " pod="opendatahub/maas-api-e2e-mt-ae3a9533-5c4fdb5479-ldvw8"
Jul 03 10:14:34.310160 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:34.310134    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cef985e7-f7a7-4ecc-9a08-833d139f712f-maas-api-tls\") pod \"maas-api-e2e-mt-ae3a9533-5c4fdb5479-ldvw8\" (UID: \"cef985e7-f7a7-4ecc-9a08-833d139f712f\") " pod="opendatahub/maas-api-e2e-mt-ae3a9533-5c4fdb5479-ldvw8"
Jul 03 10:14:34.359404 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:34.359364    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n9v6\" (UniqueName: \"kubernetes.io/projected/cef985e7-f7a7-4ecc-9a08-833d139f712f-kube-api-access-5n9v6\") pod \"maas-api-e2e-mt-ae3a9533-5c4fdb5479-ldvw8\" (UID: \"cef985e7-f7a7-4ecc-9a08-833d139f712f\") " pod="opendatahub/maas-api-e2e-mt-ae3a9533-5c4fdb5479-ldvw8"
Jul 03 10:14:34.426479 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:34.426448    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-ae3a9533-5c4fdb5479-ldvw8"
Jul 03 10:14:34.600192 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:34.600154    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-ae3a9533-5c4fdb5479-ldvw8"]
Jul 03 10:14:34.604050 ip-10-0-131-117 kubenswrapper[2559]: W0703 10:14:34.604022    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcef985e7_f7a7_4ecc_9a08_833d139f712f.slice/crio-5222dded4b9a836bd2fb8847cc8265e4fdfec6726346435ff611d2be9c5ebf65 WatchSource:0}: Error finding container 5222dded4b9a836bd2fb8847cc8265e4fdfec6726346435ff611d2be9c5ebf65: Status 404 returned error can't find the container with id 5222dded4b9a836bd2fb8847cc8265e4fdfec6726346435ff611d2be9c5ebf65
Jul 03 10:14:34.617011 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:34.616975    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-ae3a9533-5c4fdb5479-ldvw8" event={"ID":"cef985e7-f7a7-4ecc-9a08-833d139f712f","Type":"ContainerStarted","Data":"5222dded4b9a836bd2fb8847cc8265e4fdfec6726346435ff611d2be9c5ebf65"}
Jul 03 10:14:35.622906 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:35.622872    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-ae3a9533-5c4fdb5479-ldvw8" event={"ID":"cef985e7-f7a7-4ecc-9a08-833d139f712f","Type":"ContainerStarted","Data":"65cb1c6d39a48158d0fb512e4f0b3cea236617e326697eba478a332c47697592"}
Jul 03 10:14:35.623297 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:35.622947    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-ae3a9533-5c4fdb5479-ldvw8"
Jul 03 10:14:35.643797 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:35.643748    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-ae3a9533-5c4fdb5479-ldvw8" podStartSLOduration=1.229313322 podStartE2EDuration="1.643729024s" totalImagesPullingTime="414.415702ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 10:14:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 10:14:35.641971313 +0000 UTC m=+1876.512636973" watchObservedRunningTime="2026-07-03 10:14:35.643729024 +0000 UTC m=+1876.514394661"
Jul 03 10:14:41.633828 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:41.633739    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-ae3a9533-5c4fdb5479-ldvw8"
Jul 03 10:14:46.244701 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:46.244666    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-ae3a9533-5c4fdb5479-ldvw8"]
Jul 03 10:14:46.245106 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:46.244850    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-ae3a9533-5c4fdb5479-ldvw8" podUID="cef985e7-f7a7-4ecc-9a08-833d139f712f" containerName="maas-api" containerID="cri-o://65cb1c6d39a48158d0fb512e4f0b3cea236617e326697eba478a332c47697592" gracePeriod=30
Jul 03 10:14:46.485748 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:46.485718    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-ae3a9533-5c4fdb5479-ldvw8"
Jul 03 10:14:46.621812 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:46.621725    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5n9v6\" (UniqueName: \"kubernetes.io/projected/cef985e7-f7a7-4ecc-9a08-833d139f712f-kube-api-access-5n9v6\") pod \"cef985e7-f7a7-4ecc-9a08-833d139f712f\" (UID: \"cef985e7-f7a7-4ecc-9a08-833d139f712f\") "
Jul 03 10:14:46.621812 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:46.621777    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cef985e7-f7a7-4ecc-9a08-833d139f712f-maas-api-tls\") pod \"cef985e7-f7a7-4ecc-9a08-833d139f712f\" (UID: \"cef985e7-f7a7-4ecc-9a08-833d139f712f\") "
Jul 03 10:14:46.622005 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:46.621835    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cef985e7-f7a7-4ecc-9a08-833d139f712f-openshift-service-ca\") pod \"cef985e7-f7a7-4ecc-9a08-833d139f712f\" (UID: \"cef985e7-f7a7-4ecc-9a08-833d139f712f\") "
Jul 03 10:14:46.622247 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:46.622218    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cef985e7-f7a7-4ecc-9a08-833d139f712f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cef985e7-f7a7-4ecc-9a08-833d139f712f" (UID: "cef985e7-f7a7-4ecc-9a08-833d139f712f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 10:14:46.623978 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:46.623949    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cef985e7-f7a7-4ecc-9a08-833d139f712f-kube-api-access-5n9v6" (OuterVolumeSpecName: "kube-api-access-5n9v6") pod "cef985e7-f7a7-4ecc-9a08-833d139f712f" (UID: "cef985e7-f7a7-4ecc-9a08-833d139f712f"). InnerVolumeSpecName "kube-api-access-5n9v6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 10:14:46.624072 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:46.624057    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cef985e7-f7a7-4ecc-9a08-833d139f712f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cef985e7-f7a7-4ecc-9a08-833d139f712f" (UID: "cef985e7-f7a7-4ecc-9a08-833d139f712f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 10:14:46.676395 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:46.676358    2559 generic.go:356] "Generic (PLEG): container finished" podID="cef985e7-f7a7-4ecc-9a08-833d139f712f" containerID="65cb1c6d39a48158d0fb512e4f0b3cea236617e326697eba478a332c47697592" exitCode=0
Jul 03 10:14:46.676568 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:46.676401    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-ae3a9533-5c4fdb5479-ldvw8"
Jul 03 10:14:46.676568 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:46.676439    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-ae3a9533-5c4fdb5479-ldvw8" event={"ID":"cef985e7-f7a7-4ecc-9a08-833d139f712f","Type":"ContainerDied","Data":"65cb1c6d39a48158d0fb512e4f0b3cea236617e326697eba478a332c47697592"}
Jul 03 10:14:46.676568 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:46.676490    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-ae3a9533-5c4fdb5479-ldvw8" event={"ID":"cef985e7-f7a7-4ecc-9a08-833d139f712f","Type":"ContainerDied","Data":"5222dded4b9a836bd2fb8847cc8265e4fdfec6726346435ff611d2be9c5ebf65"}
Jul 03 10:14:46.676568 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:46.676519    2559 scope.go:117] "RemoveContainer" containerID="65cb1c6d39a48158d0fb512e4f0b3cea236617e326697eba478a332c47697592"
Jul 03 10:14:46.686103 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:46.686086    2559 scope.go:117] "RemoveContainer" containerID="65cb1c6d39a48158d0fb512e4f0b3cea236617e326697eba478a332c47697592"
Jul 03 10:14:46.686386 ip-10-0-131-117 kubenswrapper[2559]: E0703 10:14:46.686368    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65cb1c6d39a48158d0fb512e4f0b3cea236617e326697eba478a332c47697592\": container with ID starting with 65cb1c6d39a48158d0fb512e4f0b3cea236617e326697eba478a332c47697592 not found: ID does not exist" containerID="65cb1c6d39a48158d0fb512e4f0b3cea236617e326697eba478a332c47697592"
Jul 03 10:14:46.686432 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:46.686395    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65cb1c6d39a48158d0fb512e4f0b3cea236617e326697eba478a332c47697592"} err="failed to get container status \"65cb1c6d39a48158d0fb512e4f0b3cea236617e326697eba478a332c47697592\": rpc error: code = NotFound desc = could not find container \"65cb1c6d39a48158d0fb512e4f0b3cea236617e326697eba478a332c47697592\": container with ID starting with 65cb1c6d39a48158d0fb512e4f0b3cea236617e326697eba478a332c47697592 not found: ID does not exist"
Jul 03 10:14:46.702398 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:46.702378    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-ae3a9533-5c4fdb5479-ldvw8"]
Jul 03 10:14:46.711808 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:46.711785    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-ae3a9533-5c4fdb5479-ldvw8"]
Jul 03 10:14:46.723489 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:46.723469    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cef985e7-f7a7-4ecc-9a08-833d139f712f-maas-api-tls\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:14:46.723582 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:46.723493    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cef985e7-f7a7-4ecc-9a08-833d139f712f-openshift-service-ca\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:14:46.723582 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:46.723505    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5n9v6\" (UniqueName: \"kubernetes.io/projected/cef985e7-f7a7-4ecc-9a08-833d139f712f-kube-api-access-5n9v6\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:14:47.690734 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:14:47.690694    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cef985e7-f7a7-4ecc-9a08-833d139f712f" path="/var/lib/kubelet/pods/cef985e7-f7a7-4ecc-9a08-833d139f712f/volumes"
Jul 03 10:15:14.973935 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:14.973899    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-d191a33c-f665b6444-4njmf"]
Jul 03 10:15:14.974475 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:14.974460    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cef985e7-f7a7-4ecc-9a08-833d139f712f" containerName="maas-api"
Jul 03 10:15:14.974518 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:14.974479    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cef985e7-f7a7-4ecc-9a08-833d139f712f" containerName="maas-api"
Jul 03 10:15:14.974601 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:14.974588    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="cef985e7-f7a7-4ecc-9a08-833d139f712f" containerName="maas-api"
Jul 03 10:15:14.978015 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:14.977994    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-d191a33c-f665b6444-4njmf"
Jul 03 10:15:14.980682 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:14.980661    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-d191a33c-serving-cert\""
Jul 03 10:15:14.991511 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:14.991485    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-d191a33c-f665b6444-4njmf"]
Jul 03 10:15:15.099944 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:15.099912    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f2b0f9b-f499-40b7-8243-ccee0eda8b5a-maas-api-tls\") pod \"maas-api-e2e-mt-d191a33c-f665b6444-4njmf\" (UID: \"9f2b0f9b-f499-40b7-8243-ccee0eda8b5a\") " pod="opendatahub/maas-api-e2e-mt-d191a33c-f665b6444-4njmf"
Jul 03 10:15:15.100133 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:15.099971    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jk5s\" (UniqueName: \"kubernetes.io/projected/9f2b0f9b-f499-40b7-8243-ccee0eda8b5a-kube-api-access-5jk5s\") pod \"maas-api-e2e-mt-d191a33c-f665b6444-4njmf\" (UID: \"9f2b0f9b-f499-40b7-8243-ccee0eda8b5a\") " pod="opendatahub/maas-api-e2e-mt-d191a33c-f665b6444-4njmf"
Jul 03 10:15:15.100133 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:15.100086    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f2b0f9b-f499-40b7-8243-ccee0eda8b5a-openshift-service-ca\") pod \"maas-api-e2e-mt-d191a33c-f665b6444-4njmf\" (UID: \"9f2b0f9b-f499-40b7-8243-ccee0eda8b5a\") " pod="opendatahub/maas-api-e2e-mt-d191a33c-f665b6444-4njmf"
Jul 03 10:15:15.200768 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:15.200729    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f2b0f9b-f499-40b7-8243-ccee0eda8b5a-maas-api-tls\") pod \"maas-api-e2e-mt-d191a33c-f665b6444-4njmf\" (UID: \"9f2b0f9b-f499-40b7-8243-ccee0eda8b5a\") " pod="opendatahub/maas-api-e2e-mt-d191a33c-f665b6444-4njmf"
Jul 03 10:15:15.200955 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:15.200797    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jk5s\" (UniqueName: \"kubernetes.io/projected/9f2b0f9b-f499-40b7-8243-ccee0eda8b5a-kube-api-access-5jk5s\") pod \"maas-api-e2e-mt-d191a33c-f665b6444-4njmf\" (UID: \"9f2b0f9b-f499-40b7-8243-ccee0eda8b5a\") " pod="opendatahub/maas-api-e2e-mt-d191a33c-f665b6444-4njmf"
Jul 03 10:15:15.200955 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:15.200873    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f2b0f9b-f499-40b7-8243-ccee0eda8b5a-openshift-service-ca\") pod \"maas-api-e2e-mt-d191a33c-f665b6444-4njmf\" (UID: \"9f2b0f9b-f499-40b7-8243-ccee0eda8b5a\") " pod="opendatahub/maas-api-e2e-mt-d191a33c-f665b6444-4njmf"
Jul 03 10:15:15.201606 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:15.201538    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f2b0f9b-f499-40b7-8243-ccee0eda8b5a-openshift-service-ca\") pod \"maas-api-e2e-mt-d191a33c-f665b6444-4njmf\" (UID: \"9f2b0f9b-f499-40b7-8243-ccee0eda8b5a\") " pod="opendatahub/maas-api-e2e-mt-d191a33c-f665b6444-4njmf"
Jul 03 10:15:15.203322 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:15.203297    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f2b0f9b-f499-40b7-8243-ccee0eda8b5a-maas-api-tls\") pod \"maas-api-e2e-mt-d191a33c-f665b6444-4njmf\" (UID: \"9f2b0f9b-f499-40b7-8243-ccee0eda8b5a\") " pod="opendatahub/maas-api-e2e-mt-d191a33c-f665b6444-4njmf"
Jul 03 10:15:15.209475 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:15.209442    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jk5s\" (UniqueName: \"kubernetes.io/projected/9f2b0f9b-f499-40b7-8243-ccee0eda8b5a-kube-api-access-5jk5s\") pod \"maas-api-e2e-mt-d191a33c-f665b6444-4njmf\" (UID: \"9f2b0f9b-f499-40b7-8243-ccee0eda8b5a\") " pod="opendatahub/maas-api-e2e-mt-d191a33c-f665b6444-4njmf"
Jul 03 10:15:15.291516 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:15.291426    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-d191a33c-f665b6444-4njmf"
Jul 03 10:15:15.428619 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:15.428596    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-d191a33c-f665b6444-4njmf"]
Jul 03 10:15:15.431009 ip-10-0-131-117 kubenswrapper[2559]: W0703 10:15:15.430981    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f2b0f9b_f499_40b7_8243_ccee0eda8b5a.slice/crio-1a38bfe4858472a553947ed358b5dd254e6ebb6f11e4e83cbead5d4586b80c80 WatchSource:0}: Error finding container 1a38bfe4858472a553947ed358b5dd254e6ebb6f11e4e83cbead5d4586b80c80: Status 404 returned error can't find the container with id 1a38bfe4858472a553947ed358b5dd254e6ebb6f11e4e83cbead5d4586b80c80
Jul 03 10:15:15.816908 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:15.816878    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-d191a33c-f665b6444-4njmf" event={"ID":"9f2b0f9b-f499-40b7-8243-ccee0eda8b5a","Type":"ContainerStarted","Data":"1a38bfe4858472a553947ed358b5dd254e6ebb6f11e4e83cbead5d4586b80c80"}
Jul 03 10:15:16.822777 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:16.822743    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-d191a33c-f665b6444-4njmf" event={"ID":"9f2b0f9b-f499-40b7-8243-ccee0eda8b5a","Type":"ContainerStarted","Data":"0542e0079fcdfa15fe58bb8b3c97a50623df653b527d6058431212673b543662"}
Jul 03 10:15:16.823147 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:16.822887    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-d191a33c-f665b6444-4njmf"
Jul 03 10:15:16.840667 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:16.840610    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-d191a33c-f665b6444-4njmf" podStartSLOduration=2.525367005 podStartE2EDuration="2.84059128s" totalImagesPullingTime="315.224275ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 10:15:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 10:15:16.840238817 +0000 UTC m=+1917.710904667" watchObservedRunningTime="2026-07-03 10:15:16.84059128 +0000 UTC m=+1917.711256910"
Jul 03 10:15:22.834891 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:22.834854    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-d191a33c-f665b6444-4njmf"
Jul 03 10:15:45.419516 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:45.419476    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-d191a33c/e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv"]
Jul 03 10:15:45.427676 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:45.427644    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-d191a33c/e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv"
Jul 03 10:15:45.430468 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:45.430446    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-d191a33c\"/\"openshift-service-ca.crt\""
Jul 03 10:15:45.430618 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:45.430450    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-d191a33c\"/\"e2e-lifecycle-model-d191a33c-kserve-self-signed-certs\""
Jul 03 10:15:45.431292 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:45.431278    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-d191a33c\"/\"kube-root-ca.crt\""
Jul 03 10:15:45.431378 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:45.431349    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-d191a33c\"/\"default-dockercfg-dzh2m\""
Jul 03 10:15:45.436299 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:45.436280    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-d191a33c/e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv"]
Jul 03 10:15:45.493371 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:45.493329    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/508ba842-9d7f-4115-bac4-fc8b4a8c3d08-home\") pod \"e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv\" (UID: \"508ba842-9d7f-4115-bac4-fc8b4a8c3d08\") " pod="ai-tenant-e2e-mt-d191a33c/e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv"
Jul 03 10:15:45.493371 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:45.493371    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/508ba842-9d7f-4115-bac4-fc8b4a8c3d08-tmp-dir\") pod \"e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv\" (UID: \"508ba842-9d7f-4115-bac4-fc8b4a8c3d08\") " pod="ai-tenant-e2e-mt-d191a33c/e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv"
Jul 03 10:15:45.493598 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:45.493464    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/508ba842-9d7f-4115-bac4-fc8b4a8c3d08-model-cache\") pod \"e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv\" (UID: \"508ba842-9d7f-4115-bac4-fc8b4a8c3d08\") " pod="ai-tenant-e2e-mt-d191a33c/e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv"
Jul 03 10:15:45.493598 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:45.493526    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8kll\" (UniqueName: \"kubernetes.io/projected/508ba842-9d7f-4115-bac4-fc8b4a8c3d08-kube-api-access-q8kll\") pod \"e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv\" (UID: \"508ba842-9d7f-4115-bac4-fc8b4a8c3d08\") " pod="ai-tenant-e2e-mt-d191a33c/e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv"
Jul 03 10:15:45.493688 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:45.493615    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/508ba842-9d7f-4115-bac4-fc8b4a8c3d08-dshm\") pod \"e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv\" (UID: \"508ba842-9d7f-4115-bac4-fc8b4a8c3d08\") " pod="ai-tenant-e2e-mt-d191a33c/e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv"
Jul 03 10:15:45.493688 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:45.493641    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/508ba842-9d7f-4115-bac4-fc8b4a8c3d08-tls-certs\") pod \"e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv\" (UID: \"508ba842-9d7f-4115-bac4-fc8b4a8c3d08\") " pod="ai-tenant-e2e-mt-d191a33c/e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv"
Jul 03 10:15:45.594353 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:45.594312    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/508ba842-9d7f-4115-bac4-fc8b4a8c3d08-model-cache\") pod \"e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv\" (UID: \"508ba842-9d7f-4115-bac4-fc8b4a8c3d08\") " pod="ai-tenant-e2e-mt-d191a33c/e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv"
Jul 03 10:15:45.594574 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:45.594375    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8kll\" (UniqueName: \"kubernetes.io/projected/508ba842-9d7f-4115-bac4-fc8b4a8c3d08-kube-api-access-q8kll\") pod \"e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv\" (UID: \"508ba842-9d7f-4115-bac4-fc8b4a8c3d08\") " pod="ai-tenant-e2e-mt-d191a33c/e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv"
Jul 03 10:15:45.594574 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:45.594427    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/508ba842-9d7f-4115-bac4-fc8b4a8c3d08-dshm\") pod \"e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv\" (UID: \"508ba842-9d7f-4115-bac4-fc8b4a8c3d08\") " pod="ai-tenant-e2e-mt-d191a33c/e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv"
Jul 03 10:15:45.594574 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:45.594455    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/508ba842-9d7f-4115-bac4-fc8b4a8c3d08-tls-certs\") pod \"e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv\" (UID: \"508ba842-9d7f-4115-bac4-fc8b4a8c3d08\") " pod="ai-tenant-e2e-mt-d191a33c/e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv"
Jul 03 10:15:45.594574 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:45.594493    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/508ba842-9d7f-4115-bac4-fc8b4a8c3d08-home\") pod \"e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv\" (UID: \"508ba842-9d7f-4115-bac4-fc8b4a8c3d08\") " pod="ai-tenant-e2e-mt-d191a33c/e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv"
Jul 03 10:15:45.594574 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:45.594518    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/508ba842-9d7f-4115-bac4-fc8b4a8c3d08-tmp-dir\") pod \"e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv\" (UID: \"508ba842-9d7f-4115-bac4-fc8b4a8c3d08\") " pod="ai-tenant-e2e-mt-d191a33c/e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv"
Jul 03 10:15:45.594871 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:45.594848    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/508ba842-9d7f-4115-bac4-fc8b4a8c3d08-model-cache\") pod \"e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv\" (UID: \"508ba842-9d7f-4115-bac4-fc8b4a8c3d08\") " pod="ai-tenant-e2e-mt-d191a33c/e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv"
Jul 03 10:15:45.594940 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:45.594922    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/508ba842-9d7f-4115-bac4-fc8b4a8c3d08-home\") pod \"e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv\" (UID: \"508ba842-9d7f-4115-bac4-fc8b4a8c3d08\") " pod="ai-tenant-e2e-mt-d191a33c/e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv"
Jul 03 10:15:45.594978 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:45.594937    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/508ba842-9d7f-4115-bac4-fc8b4a8c3d08-tmp-dir\") pod \"e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv\" (UID: \"508ba842-9d7f-4115-bac4-fc8b4a8c3d08\") " pod="ai-tenant-e2e-mt-d191a33c/e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv"
Jul 03 10:15:45.596790 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:45.596757    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/508ba842-9d7f-4115-bac4-fc8b4a8c3d08-dshm\") pod \"e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv\" (UID: \"508ba842-9d7f-4115-bac4-fc8b4a8c3d08\") " pod="ai-tenant-e2e-mt-d191a33c/e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv"
Jul 03 10:15:45.597090 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:45.597072    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/508ba842-9d7f-4115-bac4-fc8b4a8c3d08-tls-certs\") pod \"e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv\" (UID: \"508ba842-9d7f-4115-bac4-fc8b4a8c3d08\") " pod="ai-tenant-e2e-mt-d191a33c/e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv"
Jul 03 10:15:45.605824 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:45.605789    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8kll\" (UniqueName: \"kubernetes.io/projected/508ba842-9d7f-4115-bac4-fc8b4a8c3d08-kube-api-access-q8kll\") pod \"e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv\" (UID: \"508ba842-9d7f-4115-bac4-fc8b4a8c3d08\") " pod="ai-tenant-e2e-mt-d191a33c/e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv"
Jul 03 10:15:45.738566 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:45.738517    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-d191a33c/e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv"
Jul 03 10:15:45.874753 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:45.874726    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-d191a33c/e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv"]
Jul 03 10:15:45.877136 ip-10-0-131-117 kubenswrapper[2559]: W0703 10:15:45.877107    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod508ba842_9d7f_4115_bac4_fc8b4a8c3d08.slice/crio-13f0d410bb86c55a247d856fbc2d73a419b99ab8e6700d8bce9b00da84de2a03 WatchSource:0}: Error finding container 13f0d410bb86c55a247d856fbc2d73a419b99ab8e6700d8bce9b00da84de2a03: Status 404 returned error can't find the container with id 13f0d410bb86c55a247d856fbc2d73a419b99ab8e6700d8bce9b00da84de2a03
Jul 03 10:15:45.959170 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:45.959138    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-d191a33c/e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv" event={"ID":"508ba842-9d7f-4115-bac4-fc8b4a8c3d08","Type":"ContainerStarted","Data":"479faa17b5fd41b7bb8cc14c659a6ebc493c6198da1e651024fe6d4719127707"}
Jul 03 10:15:45.959368 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:45.959179    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-d191a33c/e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv" event={"ID":"508ba842-9d7f-4115-bac4-fc8b4a8c3d08","Type":"ContainerStarted","Data":"13f0d410bb86c55a247d856fbc2d73a419b99ab8e6700d8bce9b00da84de2a03"}
Jul 03 10:15:45.979785 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:45.979729    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-d191a33c/e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv" podStartSLOduration=0.979712369 podStartE2EDuration="979.712369ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 10:15:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 10:15:45.978877848 +0000 UTC m=+1946.849543507" watchObservedRunningTime="2026-07-03 10:15:45.979712369 +0000 UTC m=+1946.850377998"
Jul 03 10:15:55.739027 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:55.738991    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-d191a33c/e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv"
Jul 03 10:15:55.739570 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:55.739106    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-d191a33c/e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv"
Jul 03 10:15:55.751438 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:55.751416    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-d191a33c/e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv"
Jul 03 10:15:56.019260 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:15:56.019178    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-d191a33c/e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv"
Jul 03 10:16:07.529052 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:07.529022    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-d191a33c-f665b6444-4njmf"]
Jul 03 10:16:07.529429 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:07.529237    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-d191a33c-f665b6444-4njmf" podUID="9f2b0f9b-f499-40b7-8243-ccee0eda8b5a" containerName="maas-api" containerID="cri-o://0542e0079fcdfa15fe58bb8b3c97a50623df653b527d6058431212673b543662" gracePeriod=30
Jul 03 10:16:07.776723 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:07.776697    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-d191a33c-f665b6444-4njmf"
Jul 03 10:16:07.896541 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:07.896458    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f2b0f9b-f499-40b7-8243-ccee0eda8b5a-maas-api-tls\") pod \"9f2b0f9b-f499-40b7-8243-ccee0eda8b5a\" (UID: \"9f2b0f9b-f499-40b7-8243-ccee0eda8b5a\") "
Jul 03 10:16:07.896541 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:07.896502    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jk5s\" (UniqueName: \"kubernetes.io/projected/9f2b0f9b-f499-40b7-8243-ccee0eda8b5a-kube-api-access-5jk5s\") pod \"9f2b0f9b-f499-40b7-8243-ccee0eda8b5a\" (UID: \"9f2b0f9b-f499-40b7-8243-ccee0eda8b5a\") "
Jul 03 10:16:07.896541 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:07.896536    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f2b0f9b-f499-40b7-8243-ccee0eda8b5a-openshift-service-ca\") pod \"9f2b0f9b-f499-40b7-8243-ccee0eda8b5a\" (UID: \"9f2b0f9b-f499-40b7-8243-ccee0eda8b5a\") "
Jul 03 10:16:07.897001 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:07.896977    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f2b0f9b-f499-40b7-8243-ccee0eda8b5a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9f2b0f9b-f499-40b7-8243-ccee0eda8b5a" (UID: "9f2b0f9b-f499-40b7-8243-ccee0eda8b5a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 10:16:07.898850 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:07.898822    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f2b0f9b-f499-40b7-8243-ccee0eda8b5a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9f2b0f9b-f499-40b7-8243-ccee0eda8b5a" (UID: "9f2b0f9b-f499-40b7-8243-ccee0eda8b5a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 10:16:07.898850 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:07.898833    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f2b0f9b-f499-40b7-8243-ccee0eda8b5a-kube-api-access-5jk5s" (OuterVolumeSpecName: "kube-api-access-5jk5s") pod "9f2b0f9b-f499-40b7-8243-ccee0eda8b5a" (UID: "9f2b0f9b-f499-40b7-8243-ccee0eda8b5a"). InnerVolumeSpecName "kube-api-access-5jk5s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 10:16:07.997737 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:07.997713    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f2b0f9b-f499-40b7-8243-ccee0eda8b5a-maas-api-tls\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:16:07.997737 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:07.997737    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jk5s\" (UniqueName: \"kubernetes.io/projected/9f2b0f9b-f499-40b7-8243-ccee0eda8b5a-kube-api-access-5jk5s\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:16:07.997877 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:07.997747    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f2b0f9b-f499-40b7-8243-ccee0eda8b5a-openshift-service-ca\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:16:08.067814 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:08.067783    2559 generic.go:356] "Generic (PLEG): container finished" podID="9f2b0f9b-f499-40b7-8243-ccee0eda8b5a" containerID="0542e0079fcdfa15fe58bb8b3c97a50623df653b527d6058431212673b543662" exitCode=0
Jul 03 10:16:08.067944 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:08.067839    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-d191a33c-f665b6444-4njmf"
Jul 03 10:16:08.067944 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:08.067854    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-d191a33c-f665b6444-4njmf" event={"ID":"9f2b0f9b-f499-40b7-8243-ccee0eda8b5a","Type":"ContainerDied","Data":"0542e0079fcdfa15fe58bb8b3c97a50623df653b527d6058431212673b543662"}
Jul 03 10:16:08.067944 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:08.067896    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-d191a33c-f665b6444-4njmf" event={"ID":"9f2b0f9b-f499-40b7-8243-ccee0eda8b5a","Type":"ContainerDied","Data":"1a38bfe4858472a553947ed358b5dd254e6ebb6f11e4e83cbead5d4586b80c80"}
Jul 03 10:16:08.068871 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:08.067917    2559 scope.go:117] "RemoveContainer" containerID="0542e0079fcdfa15fe58bb8b3c97a50623df653b527d6058431212673b543662"
Jul 03 10:16:08.078675 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:08.078658    2559 scope.go:117] "RemoveContainer" containerID="0542e0079fcdfa15fe58bb8b3c97a50623df653b527d6058431212673b543662"
Jul 03 10:16:08.078919 ip-10-0-131-117 kubenswrapper[2559]: E0703 10:16:08.078901    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0542e0079fcdfa15fe58bb8b3c97a50623df653b527d6058431212673b543662\": container with ID starting with 0542e0079fcdfa15fe58bb8b3c97a50623df653b527d6058431212673b543662 not found: ID does not exist" containerID="0542e0079fcdfa15fe58bb8b3c97a50623df653b527d6058431212673b543662"
Jul 03 10:16:08.078986 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:08.078931    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0542e0079fcdfa15fe58bb8b3c97a50623df653b527d6058431212673b543662"} err="failed to get container status \"0542e0079fcdfa15fe58bb8b3c97a50623df653b527d6058431212673b543662\": rpc error: code = NotFound desc = could not find container \"0542e0079fcdfa15fe58bb8b3c97a50623df653b527d6058431212673b543662\": container with ID starting with 0542e0079fcdfa15fe58bb8b3c97a50623df653b527d6058431212673b543662 not found: ID does not exist"
Jul 03 10:16:08.093047 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:08.093022    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-d191a33c-f665b6444-4njmf"]
Jul 03 10:16:08.102863 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:08.102844    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-d191a33c-f665b6444-4njmf"]
Jul 03 10:16:09.691286 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:09.691250    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f2b0f9b-f499-40b7-8243-ccee0eda8b5a" path="/var/lib/kubelet/pods/9f2b0f9b-f499-40b7-8243-ccee0eda8b5a/volumes"
Jul 03 10:16:18.261160 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:18.261080    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-d191a33c/e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv"]
Jul 03 10:16:33.281812 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:33.281756    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-d191a33c/e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv" podUID="508ba842-9d7f-4115-bac4-fc8b4a8c3d08" containerName="main" containerID="cri-o://479faa17b5fd41b7bb8cc14c659a6ebc493c6198da1e651024fe6d4719127707" gracePeriod=45
Jul 03 10:16:33.538537 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:33.538480    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-d191a33c/e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv"
Jul 03 10:16:33.640903 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:33.640871    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/508ba842-9d7f-4115-bac4-fc8b4a8c3d08-tmp-dir\") pod \"508ba842-9d7f-4115-bac4-fc8b4a8c3d08\" (UID: \"508ba842-9d7f-4115-bac4-fc8b4a8c3d08\") "
Jul 03 10:16:33.641055 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:33.640957    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8kll\" (UniqueName: \"kubernetes.io/projected/508ba842-9d7f-4115-bac4-fc8b4a8c3d08-kube-api-access-q8kll\") pod \"508ba842-9d7f-4115-bac4-fc8b4a8c3d08\" (UID: \"508ba842-9d7f-4115-bac4-fc8b4a8c3d08\") "
Jul 03 10:16:33.641055 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:33.640991    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/508ba842-9d7f-4115-bac4-fc8b4a8c3d08-dshm\") pod \"508ba842-9d7f-4115-bac4-fc8b4a8c3d08\" (UID: \"508ba842-9d7f-4115-bac4-fc8b4a8c3d08\") "
Jul 03 10:16:33.641055 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:33.641030    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/508ba842-9d7f-4115-bac4-fc8b4a8c3d08-tls-certs\") pod \"508ba842-9d7f-4115-bac4-fc8b4a8c3d08\" (UID: \"508ba842-9d7f-4115-bac4-fc8b4a8c3d08\") "
Jul 03 10:16:33.641175 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:33.641069    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/508ba842-9d7f-4115-bac4-fc8b4a8c3d08-model-cache\") pod \"508ba842-9d7f-4115-bac4-fc8b4a8c3d08\" (UID: \"508ba842-9d7f-4115-bac4-fc8b4a8c3d08\") "
Jul 03 10:16:33.641175 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:33.641144    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/508ba842-9d7f-4115-bac4-fc8b4a8c3d08-home\") pod \"508ba842-9d7f-4115-bac4-fc8b4a8c3d08\" (UID: \"508ba842-9d7f-4115-bac4-fc8b4a8c3d08\") "
Jul 03 10:16:33.641175 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:33.641166    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/508ba842-9d7f-4115-bac4-fc8b4a8c3d08-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "508ba842-9d7f-4115-bac4-fc8b4a8c3d08" (UID: "508ba842-9d7f-4115-bac4-fc8b4a8c3d08"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:16:33.641397 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:33.641377    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/508ba842-9d7f-4115-bac4-fc8b4a8c3d08-model-cache" (OuterVolumeSpecName: "model-cache") pod "508ba842-9d7f-4115-bac4-fc8b4a8c3d08" (UID: "508ba842-9d7f-4115-bac4-fc8b4a8c3d08"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:16:33.641486 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:33.641468    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/508ba842-9d7f-4115-bac4-fc8b4a8c3d08-model-cache\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:16:33.641714 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:33.641478    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/508ba842-9d7f-4115-bac4-fc8b4a8c3d08-home" (OuterVolumeSpecName: "home") pod "508ba842-9d7f-4115-bac4-fc8b4a8c3d08" (UID: "508ba842-9d7f-4115-bac4-fc8b4a8c3d08"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:16:33.641714 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:33.641488    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/508ba842-9d7f-4115-bac4-fc8b4a8c3d08-tmp-dir\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:16:33.643270 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:33.643239    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/508ba842-9d7f-4115-bac4-fc8b4a8c3d08-kube-api-access-q8kll" (OuterVolumeSpecName: "kube-api-access-q8kll") pod "508ba842-9d7f-4115-bac4-fc8b4a8c3d08" (UID: "508ba842-9d7f-4115-bac4-fc8b4a8c3d08"). InnerVolumeSpecName "kube-api-access-q8kll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 10:16:33.643270 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:33.643249    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/508ba842-9d7f-4115-bac4-fc8b4a8c3d08-dshm" (OuterVolumeSpecName: "dshm") pod "508ba842-9d7f-4115-bac4-fc8b4a8c3d08" (UID: "508ba842-9d7f-4115-bac4-fc8b4a8c3d08"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:16:33.643423 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:33.643284    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/508ba842-9d7f-4115-bac4-fc8b4a8c3d08-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "508ba842-9d7f-4115-bac4-fc8b4a8c3d08" (UID: "508ba842-9d7f-4115-bac4-fc8b4a8c3d08"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 10:16:33.742391 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:33.742366    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/508ba842-9d7f-4115-bac4-fc8b4a8c3d08-home\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:16:33.742538 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:33.742395    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8kll\" (UniqueName: \"kubernetes.io/projected/508ba842-9d7f-4115-bac4-fc8b4a8c3d08-kube-api-access-q8kll\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:16:33.742538 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:33.742416    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/508ba842-9d7f-4115-bac4-fc8b4a8c3d08-dshm\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:16:33.742538 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:33.742430    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/508ba842-9d7f-4115-bac4-fc8b4a8c3d08-tls-certs\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:16:34.192665 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:34.192628    2559 generic.go:356] "Generic (PLEG): container finished" podID="508ba842-9d7f-4115-bac4-fc8b4a8c3d08" containerID="479faa17b5fd41b7bb8cc14c659a6ebc493c6198da1e651024fe6d4719127707" exitCode=0
Jul 03 10:16:34.192859 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:34.192674    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-d191a33c/e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv"
Jul 03 10:16:34.192859 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:34.192687    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-d191a33c/e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv" event={"ID":"508ba842-9d7f-4115-bac4-fc8b4a8c3d08","Type":"ContainerDied","Data":"479faa17b5fd41b7bb8cc14c659a6ebc493c6198da1e651024fe6d4719127707"}
Jul 03 10:16:34.192859 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:34.192726    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-d191a33c/e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv" event={"ID":"508ba842-9d7f-4115-bac4-fc8b4a8c3d08","Type":"ContainerDied","Data":"13f0d410bb86c55a247d856fbc2d73a419b99ab8e6700d8bce9b00da84de2a03"}
Jul 03 10:16:34.192859 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:34.192747    2559 scope.go:117] "RemoveContainer" containerID="479faa17b5fd41b7bb8cc14c659a6ebc493c6198da1e651024fe6d4719127707"
Jul 03 10:16:34.201208 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:34.201178    2559 scope.go:117] "RemoveContainer" containerID="479faa17b5fd41b7bb8cc14c659a6ebc493c6198da1e651024fe6d4719127707"
Jul 03 10:16:34.201479 ip-10-0-131-117 kubenswrapper[2559]: E0703 10:16:34.201458    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"479faa17b5fd41b7bb8cc14c659a6ebc493c6198da1e651024fe6d4719127707\": container with ID starting with 479faa17b5fd41b7bb8cc14c659a6ebc493c6198da1e651024fe6d4719127707 not found: ID does not exist" containerID="479faa17b5fd41b7bb8cc14c659a6ebc493c6198da1e651024fe6d4719127707"
Jul 03 10:16:34.201557 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:34.201489    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"479faa17b5fd41b7bb8cc14c659a6ebc493c6198da1e651024fe6d4719127707"} err="failed to get container status \"479faa17b5fd41b7bb8cc14c659a6ebc493c6198da1e651024fe6d4719127707\": rpc error: code = NotFound desc = could not find container \"479faa17b5fd41b7bb8cc14c659a6ebc493c6198da1e651024fe6d4719127707\": container with ID starting with 479faa17b5fd41b7bb8cc14c659a6ebc493c6198da1e651024fe6d4719127707 not found: ID does not exist"
Jul 03 10:16:34.213132 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:34.213110    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-d191a33c/e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv"]
Jul 03 10:16:34.221115 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:34.221091    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-d191a33c/e2e-lifecycle-model-d191a33c-kserve-d78767bd7-5stxv"]
Jul 03 10:16:35.690630 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:16:35.690592    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="508ba842-9d7f-4115-bac4-fc8b4a8c3d08" path="/var/lib/kubelet/pods/508ba842-9d7f-4115-bac4-fc8b4a8c3d08/volumes"
Jul 03 10:18:02.998851 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:02.998817    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"]
Jul 03 10:18:03.001419 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:02.999200    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f2b0f9b-f499-40b7-8243-ccee0eda8b5a" containerName="maas-api"
Jul 03 10:18:03.001419 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:02.999214    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f2b0f9b-f499-40b7-8243-ccee0eda8b5a" containerName="maas-api"
Jul 03 10:18:03.001419 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:02.999225    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="508ba842-9d7f-4115-bac4-fc8b4a8c3d08" containerName="main"
Jul 03 10:18:03.001419 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:02.999231    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="508ba842-9d7f-4115-bac4-fc8b4a8c3d08" containerName="main"
Jul 03 10:18:03.001419 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:02.999294    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="508ba842-9d7f-4115-bac4-fc8b4a8c3d08" containerName="main"
Jul 03 10:18:03.001419 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:02.999302    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f2b0f9b-f499-40b7-8243-ccee0eda8b5a" containerName="maas-api"
Jul 03 10:18:03.002327 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:03.002312    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"
Jul 03 10:18:03.006944 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:03.006924    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-90e0ea-openshift-default-dockercfg-7wtm2\""
Jul 03 10:18:03.021968 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:03.021947    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"]
Jul 03 10:18:03.040105 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:03.040080    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c5169a0-9f03-4294-81ad-43d5323d6069-istio-token\") pod \"e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w\" (UID: \"1c5169a0-9f03-4294-81ad-43d5323d6069\") " pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"
Jul 03 10:18:03.040238 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:03.040127    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c5169a0-9f03-4294-81ad-43d5323d6069-credential-socket\") pod \"e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w\" (UID: \"1c5169a0-9f03-4294-81ad-43d5323d6069\") " pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"
Jul 03 10:18:03.040238 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:03.040193    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c5169a0-9f03-4294-81ad-43d5323d6069-workload-socket\") pod \"e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w\" (UID: \"1c5169a0-9f03-4294-81ad-43d5323d6069\") " pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"
Jul 03 10:18:03.040345 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:03.040235    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c5169a0-9f03-4294-81ad-43d5323d6069-istio-podinfo\") pod \"e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w\" (UID: \"1c5169a0-9f03-4294-81ad-43d5323d6069\") " pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"
Jul 03 10:18:03.040345 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:03.040270    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c5169a0-9f03-4294-81ad-43d5323d6069-istiod-ca-cert\") pod \"e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w\" (UID: \"1c5169a0-9f03-4294-81ad-43d5323d6069\") " pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"
Jul 03 10:18:03.040345 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:03.040323    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp2pm\" (UniqueName: \"kubernetes.io/projected/1c5169a0-9f03-4294-81ad-43d5323d6069-kube-api-access-wp2pm\") pod \"e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w\" (UID: \"1c5169a0-9f03-4294-81ad-43d5323d6069\") " pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"
Jul 03 10:18:03.040345 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:03.040343    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c5169a0-9f03-4294-81ad-43d5323d6069-istio-envoy\") pod \"e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w\" (UID: \"1c5169a0-9f03-4294-81ad-43d5323d6069\") " pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"
Jul 03 10:18:03.040524 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:03.040363    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c5169a0-9f03-4294-81ad-43d5323d6069-istio-data\") pod \"e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w\" (UID: \"1c5169a0-9f03-4294-81ad-43d5323d6069\") " pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"
Jul 03 10:18:03.040524 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:03.040402    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c5169a0-9f03-4294-81ad-43d5323d6069-workload-certs\") pod \"e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w\" (UID: \"1c5169a0-9f03-4294-81ad-43d5323d6069\") " pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"
Jul 03 10:18:03.141818 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:03.141790    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c5169a0-9f03-4294-81ad-43d5323d6069-credential-socket\") pod \"e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w\" (UID: \"1c5169a0-9f03-4294-81ad-43d5323d6069\") " pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"
Jul 03 10:18:03.142018 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:03.141838    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c5169a0-9f03-4294-81ad-43d5323d6069-workload-socket\") pod \"e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w\" (UID: \"1c5169a0-9f03-4294-81ad-43d5323d6069\") " pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"
Jul 03 10:18:03.142018 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:03.141860    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c5169a0-9f03-4294-81ad-43d5323d6069-istio-podinfo\") pod \"e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w\" (UID: \"1c5169a0-9f03-4294-81ad-43d5323d6069\") " pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"
Jul 03 10:18:03.142018 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:03.141941    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c5169a0-9f03-4294-81ad-43d5323d6069-istiod-ca-cert\") pod \"e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w\" (UID: \"1c5169a0-9f03-4294-81ad-43d5323d6069\") " pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"
Jul 03 10:18:03.142018 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:03.141988    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp2pm\" (UniqueName: \"kubernetes.io/projected/1c5169a0-9f03-4294-81ad-43d5323d6069-kube-api-access-wp2pm\") pod \"e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w\" (UID: \"1c5169a0-9f03-4294-81ad-43d5323d6069\") " pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"
Jul 03 10:18:03.142244 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:03.142022    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c5169a0-9f03-4294-81ad-43d5323d6069-istio-envoy\") pod \"e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w\" (UID: \"1c5169a0-9f03-4294-81ad-43d5323d6069\") " pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"
Jul 03 10:18:03.142244 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:03.142057    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c5169a0-9f03-4294-81ad-43d5323d6069-istio-data\") pod \"e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w\" (UID: \"1c5169a0-9f03-4294-81ad-43d5323d6069\") " pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"
Jul 03 10:18:03.142244 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:03.142098    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c5169a0-9f03-4294-81ad-43d5323d6069-workload-certs\") pod \"e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w\" (UID: \"1c5169a0-9f03-4294-81ad-43d5323d6069\") " pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"
Jul 03 10:18:03.142244 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:03.142145    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c5169a0-9f03-4294-81ad-43d5323d6069-istio-token\") pod \"e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w\" (UID: \"1c5169a0-9f03-4294-81ad-43d5323d6069\") " pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"
Jul 03 10:18:03.142441 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:03.142240    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c5169a0-9f03-4294-81ad-43d5323d6069-workload-socket\") pod \"e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w\" (UID: \"1c5169a0-9f03-4294-81ad-43d5323d6069\") " pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"
Jul 03 10:18:03.142501 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:03.142433    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c5169a0-9f03-4294-81ad-43d5323d6069-istio-data\") pod \"e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w\" (UID: \"1c5169a0-9f03-4294-81ad-43d5323d6069\") " pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"
Jul 03 10:18:03.142560 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:03.142524    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c5169a0-9f03-4294-81ad-43d5323d6069-workload-certs\") pod \"e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w\" (UID: \"1c5169a0-9f03-4294-81ad-43d5323d6069\") " pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"
Jul 03 10:18:03.142660 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:03.142636    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c5169a0-9f03-4294-81ad-43d5323d6069-credential-socket\") pod \"e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w\" (UID: \"1c5169a0-9f03-4294-81ad-43d5323d6069\") " pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"
Jul 03 10:18:03.142782 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:03.142695    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c5169a0-9f03-4294-81ad-43d5323d6069-istiod-ca-cert\") pod \"e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w\" (UID: \"1c5169a0-9f03-4294-81ad-43d5323d6069\") " pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"
Jul 03 10:18:03.144255 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:03.144232    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c5169a0-9f03-4294-81ad-43d5323d6069-istio-envoy\") pod \"e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w\" (UID: \"1c5169a0-9f03-4294-81ad-43d5323d6069\") " pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"
Jul 03 10:18:03.144384 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:03.144365    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c5169a0-9f03-4294-81ad-43d5323d6069-istio-podinfo\") pod \"e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w\" (UID: \"1c5169a0-9f03-4294-81ad-43d5323d6069\") " pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"
Jul 03 10:18:03.153276 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:03.153248    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp2pm\" (UniqueName: \"kubernetes.io/projected/1c5169a0-9f03-4294-81ad-43d5323d6069-kube-api-access-wp2pm\") pod \"e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w\" (UID: \"1c5169a0-9f03-4294-81ad-43d5323d6069\") " pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"
Jul 03 10:18:03.157832 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:03.157812    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c5169a0-9f03-4294-81ad-43d5323d6069-istio-token\") pod \"e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w\" (UID: \"1c5169a0-9f03-4294-81ad-43d5323d6069\") " pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"
Jul 03 10:18:03.313289 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:03.313200    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"
Jul 03 10:18:03.453303 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:03.453276    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"]
Jul 03 10:18:03.454681 ip-10-0-131-117 kubenswrapper[2559]: W0703 10:18:03.454659    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c5169a0_9f03_4294_81ad_43d5323d6069.slice/crio-092e1fbbc2ef2139b6d07e8b9d0925bf99fefd462fc8d597d5da15185ce32c89 WatchSource:0}: Error finding container 092e1fbbc2ef2139b6d07e8b9d0925bf99fefd462fc8d597d5da15185ce32c89: Status 404 returned error can't find the container with id 092e1fbbc2ef2139b6d07e8b9d0925bf99fefd462fc8d597d5da15185ce32c89
Jul 03 10:18:03.456896 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:03.456862    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 03 10:18:03.456973 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:03.456924    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 03 10:18:03.456973 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:03.456951    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 03 10:18:03.608102 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:03.607991    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w" event={"ID":"1c5169a0-9f03-4294-81ad-43d5323d6069","Type":"ContainerStarted","Data":"feba11206d5bf93558741b2c430fcdbb41015b78aefd55b67f97bad1e9094fb3"}
Jul 03 10:18:03.608245 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:03.608119    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w" event={"ID":"1c5169a0-9f03-4294-81ad-43d5323d6069","Type":"ContainerStarted","Data":"092e1fbbc2ef2139b6d07e8b9d0925bf99fefd462fc8d597d5da15185ce32c89"}
Jul 03 10:18:03.638268 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:03.638207    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w" podStartSLOduration=1.6381841590000001 podStartE2EDuration="1.638184159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 10:18:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 10:18:03.630031093 +0000 UTC m=+2084.500696734" watchObservedRunningTime="2026-07-03 10:18:03.638184159 +0000 UTC m=+2084.508849787"
Jul 03 10:18:04.313698 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:04.313659    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"
Jul 03 10:18:04.318338 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:04.318311    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"
Jul 03 10:18:04.613139 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:04.613056    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"
Jul 03 10:18:04.613926 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:04.613905    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"
Jul 03 10:18:14.088180 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:14.088145    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-0ccbef-fc4bd7d5f-8trl4"]
Jul 03 10:18:14.091939 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:14.091917    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-0ccbef-fc4bd7d5f-8trl4"
Jul 03 10:18:14.096483 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:14.096464    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-0ccbef-serving-cert\""
Jul 03 10:18:14.102730 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:14.102694    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-0ccbef-fc4bd7d5f-8trl4"]
Jul 03 10:18:14.255440 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:14.255395    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xdhg\" (UniqueName: \"kubernetes.io/projected/2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9-kube-api-access-8xdhg\") pod \"maas-api-e2e-inf-b-0ccbef-fc4bd7d5f-8trl4\" (UID: \"2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9\") " pod="opendatahub/maas-api-e2e-inf-b-0ccbef-fc4bd7d5f-8trl4"
Jul 03 10:18:14.255660 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:14.255617    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9-maas-api-tls\") pod \"maas-api-e2e-inf-b-0ccbef-fc4bd7d5f-8trl4\" (UID: \"2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9\") " pod="opendatahub/maas-api-e2e-inf-b-0ccbef-fc4bd7d5f-8trl4"
Jul 03 10:18:14.255660 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:14.255643    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9-openshift-service-ca\") pod \"maas-api-e2e-inf-b-0ccbef-fc4bd7d5f-8trl4\" (UID: \"2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9\") " pod="opendatahub/maas-api-e2e-inf-b-0ccbef-fc4bd7d5f-8trl4"
Jul 03 10:18:14.356729 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:14.356630    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9-maas-api-tls\") pod \"maas-api-e2e-inf-b-0ccbef-fc4bd7d5f-8trl4\" (UID: \"2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9\") " pod="opendatahub/maas-api-e2e-inf-b-0ccbef-fc4bd7d5f-8trl4"
Jul 03 10:18:14.356729 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:14.356682    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9-openshift-service-ca\") pod \"maas-api-e2e-inf-b-0ccbef-fc4bd7d5f-8trl4\" (UID: \"2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9\") " pod="opendatahub/maas-api-e2e-inf-b-0ccbef-fc4bd7d5f-8trl4"
Jul 03 10:18:14.356729 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:14.356715    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xdhg\" (UniqueName: \"kubernetes.io/projected/2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9-kube-api-access-8xdhg\") pod \"maas-api-e2e-inf-b-0ccbef-fc4bd7d5f-8trl4\" (UID: \"2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9\") " pod="opendatahub/maas-api-e2e-inf-b-0ccbef-fc4bd7d5f-8trl4"
Jul 03 10:18:14.358343 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:14.358308    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9-openshift-service-ca\") pod \"maas-api-e2e-inf-b-0ccbef-fc4bd7d5f-8trl4\" (UID: \"2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9\") " pod="opendatahub/maas-api-e2e-inf-b-0ccbef-fc4bd7d5f-8trl4"
Jul 03 10:18:14.361182 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:14.361148    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9-maas-api-tls\") pod \"maas-api-e2e-inf-b-0ccbef-fc4bd7d5f-8trl4\" (UID: \"2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9\") " pod="opendatahub/maas-api-e2e-inf-b-0ccbef-fc4bd7d5f-8trl4"
Jul 03 10:18:14.367655 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:14.367629    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xdhg\" (UniqueName: \"kubernetes.io/projected/2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9-kube-api-access-8xdhg\") pod \"maas-api-e2e-inf-b-0ccbef-fc4bd7d5f-8trl4\" (UID: \"2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9\") " pod="opendatahub/maas-api-e2e-inf-b-0ccbef-fc4bd7d5f-8trl4"
Jul 03 10:18:14.404514 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:14.404487    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-0ccbef-fc4bd7d5f-8trl4"
Jul 03 10:18:14.577842 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:14.577815    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-0ccbef-fc4bd7d5f-8trl4"]
Jul 03 10:18:14.580851 ip-10-0-131-117 kubenswrapper[2559]: W0703 10:18:14.580822    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ada67ae_0cbc_44ae_90bd_72f8c0e96bc9.slice/crio-f83367b3204695ff8831cced45c3cb1c6d57f3d4eb8ab010e029625bae84685f WatchSource:0}: Error finding container f83367b3204695ff8831cced45c3cb1c6d57f3d4eb8ab010e029625bae84685f: Status 404 returned error can't find the container with id f83367b3204695ff8831cced45c3cb1c6d57f3d4eb8ab010e029625bae84685f
Jul 03 10:18:14.582643 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:14.582624    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 03 10:18:14.675742 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:14.675706    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-0ccbef-fc4bd7d5f-8trl4" event={"ID":"2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9","Type":"ContainerStarted","Data":"f83367b3204695ff8831cced45c3cb1c6d57f3d4eb8ab010e029625bae84685f"}
Jul 03 10:18:15.681618 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:15.681581    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-0ccbef-fc4bd7d5f-8trl4" event={"ID":"2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9","Type":"ContainerStarted","Data":"75619f19d0f3a55c66c62d8c727295e7ca9512846e28a4d1c4044bee9202033b"}
Jul 03 10:18:15.682006 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:15.681662    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-0ccbef-fc4bd7d5f-8trl4"
Jul 03 10:18:15.703124 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:15.703070    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-0ccbef-fc4bd7d5f-8trl4" podStartSLOduration=1.269240392 podStartE2EDuration="1.703053962s" totalImagesPullingTime="433.81357ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 10:18:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 10:18:15.701730176 +0000 UTC m=+2096.572395818" watchObservedRunningTime="2026-07-03 10:18:15.703053962 +0000 UTC m=+2096.573719636"
Jul 03 10:18:19.711717 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:19.711691    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c4mdt_9d052bc8-d41a-494c-9523-5bfdcfb29ec2/console-operator/2.log"
Jul 03 10:18:19.724267 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:19.724239    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c4mdt_9d052bc8-d41a-494c-9523-5bfdcfb29ec2/console-operator/2.log"
Jul 03 10:18:20.460629 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:20.460349    2559 patch_prober.go:28] interesting pod/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": read tcp 10.134.0.2:56116->10.134.0.38:15021: read: connection reset by peer" start-of-body=
Jul 03 10:18:20.460629 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:20.460404    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w" podUID="1c5169a0-9f03-4294-81ad-43d5323d6069" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": read tcp 10.134.0.2:56116->10.134.0.38:15021: read: connection reset by peer"
Jul 03 10:18:20.707839 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:20.707813    2559 generic.go:356] "Generic (PLEG): container finished" podID="1c5169a0-9f03-4294-81ad-43d5323d6069" containerID="feba11206d5bf93558741b2c430fcdbb41015b78aefd55b67f97bad1e9094fb3" exitCode=0
Jul 03 10:18:20.708020 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:20.707891    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w" event={"ID":"1c5169a0-9f03-4294-81ad-43d5323d6069","Type":"ContainerDied","Data":"feba11206d5bf93558741b2c430fcdbb41015b78aefd55b67f97bad1e9094fb3"}
Jul 03 10:18:20.708272 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:20.708258    2559 scope.go:117] "RemoveContainer" containerID="feba11206d5bf93558741b2c430fcdbb41015b78aefd55b67f97bad1e9094fb3"
Jul 03 10:18:20.709280 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:20.709227    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 03 10:18:20.709344 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:20.709293    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 03 10:18:20.709344 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:20.709324    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 03 10:18:21.692302 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:21.692278    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-0ccbef-fc4bd7d5f-8trl4"
Jul 03 10:18:21.714770 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:21.714735    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w" event={"ID":"1c5169a0-9f03-4294-81ad-43d5323d6069","Type":"ContainerStarted","Data":"19598bfa81aa2eeccf6c6bb670093bb35d549e3a820811343f54d2c719122cc1"}
Jul 03 10:18:22.314327 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:22.314297    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"
Jul 03 10:18:22.314583 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:22.314539    2559 patch_prober.go:28] interesting pod/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 03 10:18:22.314714 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:22.314604    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w" podUID="1c5169a0-9f03-4294-81ad-43d5323d6069" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 03 10:18:23.314336 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:23.314295    2559 patch_prober.go:28] interesting pod/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 03 10:18:23.314840 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:23.314354    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w" podUID="1c5169a0-9f03-4294-81ad-43d5323d6069" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 03 10:18:24.314493 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:24.314458    2559 patch_prober.go:28] interesting pod/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 03 10:18:24.314945 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:24.314511    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w" podUID="1c5169a0-9f03-4294-81ad-43d5323d6069" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 03 10:18:25.313700 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:25.313666    2559 patch_prober.go:28] interesting pod/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 03 10:18:25.313879 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:25.313731    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w" podUID="1c5169a0-9f03-4294-81ad-43d5323d6069" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 03 10:18:26.317173 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:26.317144    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"
Jul 03 10:18:26.317560 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:26.317502    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"
Jul 03 10:18:26.318228 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:18:26.318212    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"
Jul 03 10:19:12.910807 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:12.910718    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-0ccbef/test-model-0ccbef-kserve-59b56dc647-6jnm4"]
Jul 03 10:19:12.915024 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:12.915003    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-0ccbef/test-model-0ccbef-kserve-59b56dc647-6jnm4"
Jul 03 10:19:12.919052 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:12.919023    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-0ccbef\"/\"test-model-0ccbef-kserve-self-signed-certs\""
Jul 03 10:19:12.919052 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:12.919050    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-0ccbef\"/\"kube-root-ca.crt\""
Jul 03 10:19:12.919245 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:12.919051    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-0ccbef\"/\"default-dockercfg-zcrh4\""
Jul 03 10:19:12.919245 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:12.919033    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-0ccbef\"/\"openshift-service-ca.crt\""
Jul 03 10:19:12.926590 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:12.926565    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-0ccbef/test-model-0ccbef-kserve-59b56dc647-6jnm4"]
Jul 03 10:19:13.018333 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:13.018304    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1518d5bf-a5fc-45da-82b6-84f543457224-home\") pod \"test-model-0ccbef-kserve-59b56dc647-6jnm4\" (UID: \"1518d5bf-a5fc-45da-82b6-84f543457224\") " pod="ai-tenant-e2e-inf-b-0ccbef/test-model-0ccbef-kserve-59b56dc647-6jnm4"
Jul 03 10:19:13.018333 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:13.018345    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1518d5bf-a5fc-45da-82b6-84f543457224-tmp-dir\") pod \"test-model-0ccbef-kserve-59b56dc647-6jnm4\" (UID: \"1518d5bf-a5fc-45da-82b6-84f543457224\") " pod="ai-tenant-e2e-inf-b-0ccbef/test-model-0ccbef-kserve-59b56dc647-6jnm4"
Jul 03 10:19:13.018581 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:13.018366    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1518d5bf-a5fc-45da-82b6-84f543457224-model-cache\") pod \"test-model-0ccbef-kserve-59b56dc647-6jnm4\" (UID: \"1518d5bf-a5fc-45da-82b6-84f543457224\") " pod="ai-tenant-e2e-inf-b-0ccbef/test-model-0ccbef-kserve-59b56dc647-6jnm4"
Jul 03 10:19:13.018581 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:13.018447    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1518d5bf-a5fc-45da-82b6-84f543457224-tls-certs\") pod \"test-model-0ccbef-kserve-59b56dc647-6jnm4\" (UID: \"1518d5bf-a5fc-45da-82b6-84f543457224\") " pod="ai-tenant-e2e-inf-b-0ccbef/test-model-0ccbef-kserve-59b56dc647-6jnm4"
Jul 03 10:19:13.018581 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:13.018487    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5f6n\" (UniqueName: \"kubernetes.io/projected/1518d5bf-a5fc-45da-82b6-84f543457224-kube-api-access-t5f6n\") pod \"test-model-0ccbef-kserve-59b56dc647-6jnm4\" (UID: \"1518d5bf-a5fc-45da-82b6-84f543457224\") " pod="ai-tenant-e2e-inf-b-0ccbef/test-model-0ccbef-kserve-59b56dc647-6jnm4"
Jul 03 10:19:13.018686 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:13.018602    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1518d5bf-a5fc-45da-82b6-84f543457224-dshm\") pod \"test-model-0ccbef-kserve-59b56dc647-6jnm4\" (UID: \"1518d5bf-a5fc-45da-82b6-84f543457224\") " pod="ai-tenant-e2e-inf-b-0ccbef/test-model-0ccbef-kserve-59b56dc647-6jnm4"
Jul 03 10:19:13.119427 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:13.119387    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1518d5bf-a5fc-45da-82b6-84f543457224-dshm\") pod \"test-model-0ccbef-kserve-59b56dc647-6jnm4\" (UID: \"1518d5bf-a5fc-45da-82b6-84f543457224\") " pod="ai-tenant-e2e-inf-b-0ccbef/test-model-0ccbef-kserve-59b56dc647-6jnm4"
Jul 03 10:19:13.119653 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:13.119488    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1518d5bf-a5fc-45da-82b6-84f543457224-home\") pod \"test-model-0ccbef-kserve-59b56dc647-6jnm4\" (UID: \"1518d5bf-a5fc-45da-82b6-84f543457224\") " pod="ai-tenant-e2e-inf-b-0ccbef/test-model-0ccbef-kserve-59b56dc647-6jnm4"
Jul 03 10:19:13.119653 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:13.119525    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1518d5bf-a5fc-45da-82b6-84f543457224-tmp-dir\") pod \"test-model-0ccbef-kserve-59b56dc647-6jnm4\" (UID: \"1518d5bf-a5fc-45da-82b6-84f543457224\") " pod="ai-tenant-e2e-inf-b-0ccbef/test-model-0ccbef-kserve-59b56dc647-6jnm4"
Jul 03 10:19:13.119653 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:13.119573    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1518d5bf-a5fc-45da-82b6-84f543457224-model-cache\") pod \"test-model-0ccbef-kserve-59b56dc647-6jnm4\" (UID: \"1518d5bf-a5fc-45da-82b6-84f543457224\") " pod="ai-tenant-e2e-inf-b-0ccbef/test-model-0ccbef-kserve-59b56dc647-6jnm4"
Jul 03 10:19:13.119653 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:13.119620    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1518d5bf-a5fc-45da-82b6-84f543457224-tls-certs\") pod \"test-model-0ccbef-kserve-59b56dc647-6jnm4\" (UID: \"1518d5bf-a5fc-45da-82b6-84f543457224\") " pod="ai-tenant-e2e-inf-b-0ccbef/test-model-0ccbef-kserve-59b56dc647-6jnm4"
Jul 03 10:19:13.119653 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:13.119647    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5f6n\" (UniqueName: \"kubernetes.io/projected/1518d5bf-a5fc-45da-82b6-84f543457224-kube-api-access-t5f6n\") pod \"test-model-0ccbef-kserve-59b56dc647-6jnm4\" (UID: \"1518d5bf-a5fc-45da-82b6-84f543457224\") " pod="ai-tenant-e2e-inf-b-0ccbef/test-model-0ccbef-kserve-59b56dc647-6jnm4"
Jul 03 10:19:13.120015 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:13.119980    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1518d5bf-a5fc-45da-82b6-84f543457224-home\") pod \"test-model-0ccbef-kserve-59b56dc647-6jnm4\" (UID: \"1518d5bf-a5fc-45da-82b6-84f543457224\") " pod="ai-tenant-e2e-inf-b-0ccbef/test-model-0ccbef-kserve-59b56dc647-6jnm4"
Jul 03 10:19:13.120281 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:13.120245    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1518d5bf-a5fc-45da-82b6-84f543457224-model-cache\") pod \"test-model-0ccbef-kserve-59b56dc647-6jnm4\" (UID: \"1518d5bf-a5fc-45da-82b6-84f543457224\") " pod="ai-tenant-e2e-inf-b-0ccbef/test-model-0ccbef-kserve-59b56dc647-6jnm4"
Jul 03 10:19:13.120379 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:13.120349    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1518d5bf-a5fc-45da-82b6-84f543457224-tmp-dir\") pod \"test-model-0ccbef-kserve-59b56dc647-6jnm4\" (UID: \"1518d5bf-a5fc-45da-82b6-84f543457224\") " pod="ai-tenant-e2e-inf-b-0ccbef/test-model-0ccbef-kserve-59b56dc647-6jnm4"
Jul 03 10:19:13.122763 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:13.122743    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1518d5bf-a5fc-45da-82b6-84f543457224-dshm\") pod \"test-model-0ccbef-kserve-59b56dc647-6jnm4\" (UID: \"1518d5bf-a5fc-45da-82b6-84f543457224\") " pod="ai-tenant-e2e-inf-b-0ccbef/test-model-0ccbef-kserve-59b56dc647-6jnm4"
Jul 03 10:19:13.122847 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:13.122806    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1518d5bf-a5fc-45da-82b6-84f543457224-tls-certs\") pod \"test-model-0ccbef-kserve-59b56dc647-6jnm4\" (UID: \"1518d5bf-a5fc-45da-82b6-84f543457224\") " pod="ai-tenant-e2e-inf-b-0ccbef/test-model-0ccbef-kserve-59b56dc647-6jnm4"
Jul 03 10:19:13.129801 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:13.129775    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5f6n\" (UniqueName: \"kubernetes.io/projected/1518d5bf-a5fc-45da-82b6-84f543457224-kube-api-access-t5f6n\") pod \"test-model-0ccbef-kserve-59b56dc647-6jnm4\" (UID: \"1518d5bf-a5fc-45da-82b6-84f543457224\") " pod="ai-tenant-e2e-inf-b-0ccbef/test-model-0ccbef-kserve-59b56dc647-6jnm4"
Jul 03 10:19:13.228701 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:13.228658    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-0ccbef/test-model-0ccbef-kserve-59b56dc647-6jnm4"
Jul 03 10:19:13.367038 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:13.367011    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-0ccbef/test-model-0ccbef-kserve-59b56dc647-6jnm4"]
Jul 03 10:19:13.370013 ip-10-0-131-117 kubenswrapper[2559]: W0703 10:19:13.369986    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1518d5bf_a5fc_45da_82b6_84f543457224.slice/crio-a02af706f84187ae275ee2fa0b206108b2c0c81d35d24c4307ba3c0bc88ed1e3 WatchSource:0}: Error finding container a02af706f84187ae275ee2fa0b206108b2c0c81d35d24c4307ba3c0bc88ed1e3: Status 404 returned error can't find the container with id a02af706f84187ae275ee2fa0b206108b2c0c81d35d24c4307ba3c0bc88ed1e3
Jul 03 10:19:13.966346 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:13.966312    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-0ccbef/test-model-0ccbef-kserve-59b56dc647-6jnm4" event={"ID":"1518d5bf-a5fc-45da-82b6-84f543457224","Type":"ContainerStarted","Data":"a0ee0dbaaaf237972fdb5d2b5bc2c73bb194dfee3d910b19a23ff2175097feb1"}
Jul 03 10:19:13.966746 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:13.966356    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-0ccbef/test-model-0ccbef-kserve-59b56dc647-6jnm4" event={"ID":"1518d5bf-a5fc-45da-82b6-84f543457224","Type":"ContainerStarted","Data":"a02af706f84187ae275ee2fa0b206108b2c0c81d35d24c4307ba3c0bc88ed1e3"}
Jul 03 10:19:13.984754 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:13.984704    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-0ccbef/test-model-0ccbef-kserve-59b56dc647-6jnm4" podStartSLOduration=1.984688179 podStartE2EDuration="1.984688179s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 10:19:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 10:19:13.983805266 +0000 UTC m=+2154.854470906" watchObservedRunningTime="2026-07-03 10:19:13.984688179 +0000 UTC m=+2154.855353807"
Jul 03 10:19:23.229130 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:23.229088    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-0ccbef/test-model-0ccbef-kserve-59b56dc647-6jnm4"
Jul 03 10:19:23.229771 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:23.229168    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-0ccbef/test-model-0ccbef-kserve-59b56dc647-6jnm4"
Jul 03 10:19:23.241448 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:23.241426    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-0ccbef/test-model-0ccbef-kserve-59b56dc647-6jnm4"
Jul 03 10:19:24.024205 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:24.024178    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-0ccbef/test-model-0ccbef-kserve-59b56dc647-6jnm4"
Jul 03 10:19:33.350197 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:33.350164    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-0ccbef/test-model-0ccbef-kserve-59b56dc647-6jnm4"]
Jul 03 10:19:48.370627 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:48.370589    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-0ccbef/test-model-0ccbef-kserve-59b56dc647-6jnm4" podUID="1518d5bf-a5fc-45da-82b6-84f543457224" containerName="main" containerID="cri-o://a0ee0dbaaaf237972fdb5d2b5bc2c73bb194dfee3d910b19a23ff2175097feb1" gracePeriod=45
Jul 03 10:19:48.625925 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:48.625861    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-0ccbef/test-model-0ccbef-kserve-59b56dc647-6jnm4"
Jul 03 10:19:48.669404 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:48.669377    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1518d5bf-a5fc-45da-82b6-84f543457224-tls-certs\") pod \"1518d5bf-a5fc-45da-82b6-84f543457224\" (UID: \"1518d5bf-a5fc-45da-82b6-84f543457224\") "
Jul 03 10:19:48.669580 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:48.669477    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1518d5bf-a5fc-45da-82b6-84f543457224-dshm\") pod \"1518d5bf-a5fc-45da-82b6-84f543457224\" (UID: \"1518d5bf-a5fc-45da-82b6-84f543457224\") "
Jul 03 10:19:48.669580 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:48.669512    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1518d5bf-a5fc-45da-82b6-84f543457224-home\") pod \"1518d5bf-a5fc-45da-82b6-84f543457224\" (UID: \"1518d5bf-a5fc-45da-82b6-84f543457224\") "
Jul 03 10:19:48.669701 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:48.669586    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5f6n\" (UniqueName: \"kubernetes.io/projected/1518d5bf-a5fc-45da-82b6-84f543457224-kube-api-access-t5f6n\") pod \"1518d5bf-a5fc-45da-82b6-84f543457224\" (UID: \"1518d5bf-a5fc-45da-82b6-84f543457224\") "
Jul 03 10:19:48.669701 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:48.669631    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1518d5bf-a5fc-45da-82b6-84f543457224-model-cache\") pod \"1518d5bf-a5fc-45da-82b6-84f543457224\" (UID: \"1518d5bf-a5fc-45da-82b6-84f543457224\") "
Jul 03 10:19:48.669701 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:48.669678    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1518d5bf-a5fc-45da-82b6-84f543457224-tmp-dir\") pod \"1518d5bf-a5fc-45da-82b6-84f543457224\" (UID: \"1518d5bf-a5fc-45da-82b6-84f543457224\") "
Jul 03 10:19:48.670276 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:48.670209    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1518d5bf-a5fc-45da-82b6-84f543457224-home" (OuterVolumeSpecName: "home") pod "1518d5bf-a5fc-45da-82b6-84f543457224" (UID: "1518d5bf-a5fc-45da-82b6-84f543457224"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:19:48.670386 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:48.670365    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1518d5bf-a5fc-45da-82b6-84f543457224-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1518d5bf-a5fc-45da-82b6-84f543457224" (UID: "1518d5bf-a5fc-45da-82b6-84f543457224"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:19:48.670386 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:48.670370    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1518d5bf-a5fc-45da-82b6-84f543457224-model-cache" (OuterVolumeSpecName: "model-cache") pod "1518d5bf-a5fc-45da-82b6-84f543457224" (UID: "1518d5bf-a5fc-45da-82b6-84f543457224"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:19:48.672024 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:48.671998    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1518d5bf-a5fc-45da-82b6-84f543457224-dshm" (OuterVolumeSpecName: "dshm") pod "1518d5bf-a5fc-45da-82b6-84f543457224" (UID: "1518d5bf-a5fc-45da-82b6-84f543457224"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:19:48.672427 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:48.672408    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1518d5bf-a5fc-45da-82b6-84f543457224-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1518d5bf-a5fc-45da-82b6-84f543457224" (UID: "1518d5bf-a5fc-45da-82b6-84f543457224"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 10:19:48.672427 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:48.672417    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1518d5bf-a5fc-45da-82b6-84f543457224-kube-api-access-t5f6n" (OuterVolumeSpecName: "kube-api-access-t5f6n") pod "1518d5bf-a5fc-45da-82b6-84f543457224" (UID: "1518d5bf-a5fc-45da-82b6-84f543457224"). InnerVolumeSpecName "kube-api-access-t5f6n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 10:19:48.771447 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:48.771406    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5f6n\" (UniqueName: \"kubernetes.io/projected/1518d5bf-a5fc-45da-82b6-84f543457224-kube-api-access-t5f6n\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:19:48.771447 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:48.771444    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1518d5bf-a5fc-45da-82b6-84f543457224-model-cache\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:19:48.771447 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:48.771454    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1518d5bf-a5fc-45da-82b6-84f543457224-tmp-dir\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:19:48.771447 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:48.771461    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1518d5bf-a5fc-45da-82b6-84f543457224-tls-certs\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:19:48.771724 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:48.771469    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1518d5bf-a5fc-45da-82b6-84f543457224-dshm\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:19:48.771724 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:48.771475    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1518d5bf-a5fc-45da-82b6-84f543457224-home\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:19:49.135857 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:49.135824    2559 generic.go:356] "Generic (PLEG): container finished" podID="1518d5bf-a5fc-45da-82b6-84f543457224" containerID="a0ee0dbaaaf237972fdb5d2b5bc2c73bb194dfee3d910b19a23ff2175097feb1" exitCode=0
Jul 03 10:19:49.136031 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:49.135874    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-0ccbef/test-model-0ccbef-kserve-59b56dc647-6jnm4"
Jul 03 10:19:49.136031 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:49.135881    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-0ccbef/test-model-0ccbef-kserve-59b56dc647-6jnm4" event={"ID":"1518d5bf-a5fc-45da-82b6-84f543457224","Type":"ContainerDied","Data":"a0ee0dbaaaf237972fdb5d2b5bc2c73bb194dfee3d910b19a23ff2175097feb1"}
Jul 03 10:19:49.136031 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:49.135913    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-0ccbef/test-model-0ccbef-kserve-59b56dc647-6jnm4" event={"ID":"1518d5bf-a5fc-45da-82b6-84f543457224","Type":"ContainerDied","Data":"a02af706f84187ae275ee2fa0b206108b2c0c81d35d24c4307ba3c0bc88ed1e3"}
Jul 03 10:19:49.136031 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:49.135929    2559 scope.go:117] "RemoveContainer" containerID="a0ee0dbaaaf237972fdb5d2b5bc2c73bb194dfee3d910b19a23ff2175097feb1"
Jul 03 10:19:49.145116 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:49.145096    2559 scope.go:117] "RemoveContainer" containerID="a0ee0dbaaaf237972fdb5d2b5bc2c73bb194dfee3d910b19a23ff2175097feb1"
Jul 03 10:19:49.145359 ip-10-0-131-117 kubenswrapper[2559]: E0703 10:19:49.145342    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0ee0dbaaaf237972fdb5d2b5bc2c73bb194dfee3d910b19a23ff2175097feb1\": container with ID starting with a0ee0dbaaaf237972fdb5d2b5bc2c73bb194dfee3d910b19a23ff2175097feb1 not found: ID does not exist" containerID="a0ee0dbaaaf237972fdb5d2b5bc2c73bb194dfee3d910b19a23ff2175097feb1"
Jul 03 10:19:49.145399 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:49.145369    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0ee0dbaaaf237972fdb5d2b5bc2c73bb194dfee3d910b19a23ff2175097feb1"} err="failed to get container status \"a0ee0dbaaaf237972fdb5d2b5bc2c73bb194dfee3d910b19a23ff2175097feb1\": rpc error: code = NotFound desc = could not find container \"a0ee0dbaaaf237972fdb5d2b5bc2c73bb194dfee3d910b19a23ff2175097feb1\": container with ID starting with a0ee0dbaaaf237972fdb5d2b5bc2c73bb194dfee3d910b19a23ff2175097feb1 not found: ID does not exist"
Jul 03 10:19:49.160638 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:49.160612    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-0ccbef/test-model-0ccbef-kserve-59b56dc647-6jnm4"]
Jul 03 10:19:49.163944 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:49.163924    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-0ccbef/test-model-0ccbef-kserve-59b56dc647-6jnm4"]
Jul 03 10:19:49.693659 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:19:49.693626    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1518d5bf-a5fc-45da-82b6-84f543457224" path="/var/lib/kubelet/pods/1518d5bf-a5fc-45da-82b6-84f543457224/volumes"
Jul 03 10:20:16.361762 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:16.361728    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"]
Jul 03 10:20:16.362242 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:16.361929    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w" podUID="1c5169a0-9f03-4294-81ad-43d5323d6069" containerName="istio-proxy" containerID="cri-o://19598bfa81aa2eeccf6c6bb670093bb35d549e3a820811343f54d2c719122cc1" gracePeriod=30
Jul 03 10:20:17.560640 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:17.560609    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-0ccbef-fc4bd7d5f-8trl4"]
Jul 03 10:20:17.561092 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:17.560826    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-0ccbef-fc4bd7d5f-8trl4" podUID="2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9" containerName="maas-api" containerID="cri-o://75619f19d0f3a55c66c62d8c727295e7ca9512846e28a4d1c4044bee9202033b" gracePeriod=30
Jul 03 10:20:17.815460 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:17.815400    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-0ccbef-fc4bd7d5f-8trl4"
Jul 03 10:20:17.840884 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:17.840840    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xdhg\" (UniqueName: \"kubernetes.io/projected/2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9-kube-api-access-8xdhg\") pod \"2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9\" (UID: \"2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9\") "
Jul 03 10:20:17.841062 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:17.840904    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9-maas-api-tls\") pod \"2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9\" (UID: \"2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9\") "
Jul 03 10:20:17.841062 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:17.840984    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9-openshift-service-ca\") pod \"2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9\" (UID: \"2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9\") "
Jul 03 10:20:17.841721 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:17.841663    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9" (UID: "2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 10:20:17.843943 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:17.843886    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9-kube-api-access-8xdhg" (OuterVolumeSpecName: "kube-api-access-8xdhg") pod "2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9" (UID: "2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9"). InnerVolumeSpecName "kube-api-access-8xdhg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 10:20:17.843943 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:17.843905    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9" (UID: "2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 10:20:17.941763 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:17.941727    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9-openshift-service-ca\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:20:17.941763 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:17.941755    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xdhg\" (UniqueName: \"kubernetes.io/projected/2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9-kube-api-access-8xdhg\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:20:17.941763 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:17.941764    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9-maas-api-tls\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:20:18.273502 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:18.273472    2559 generic.go:356] "Generic (PLEG): container finished" podID="2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9" containerID="75619f19d0f3a55c66c62d8c727295e7ca9512846e28a4d1c4044bee9202033b" exitCode=0
Jul 03 10:20:18.273689 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:18.273519    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-0ccbef-fc4bd7d5f-8trl4"
Jul 03 10:20:18.273689 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:18.273581    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-0ccbef-fc4bd7d5f-8trl4" event={"ID":"2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9","Type":"ContainerDied","Data":"75619f19d0f3a55c66c62d8c727295e7ca9512846e28a4d1c4044bee9202033b"}
Jul 03 10:20:18.273689 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:18.273638    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-0ccbef-fc4bd7d5f-8trl4" event={"ID":"2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9","Type":"ContainerDied","Data":"f83367b3204695ff8831cced45c3cb1c6d57f3d4eb8ab010e029625bae84685f"}
Jul 03 10:20:18.273689 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:18.273666    2559 scope.go:117] "RemoveContainer" containerID="75619f19d0f3a55c66c62d8c727295e7ca9512846e28a4d1c4044bee9202033b"
Jul 03 10:20:18.282656 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:18.282637    2559 scope.go:117] "RemoveContainer" containerID="75619f19d0f3a55c66c62d8c727295e7ca9512846e28a4d1c4044bee9202033b"
Jul 03 10:20:18.282904 ip-10-0-131-117 kubenswrapper[2559]: E0703 10:20:18.282886    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75619f19d0f3a55c66c62d8c727295e7ca9512846e28a4d1c4044bee9202033b\": container with ID starting with 75619f19d0f3a55c66c62d8c727295e7ca9512846e28a4d1c4044bee9202033b not found: ID does not exist" containerID="75619f19d0f3a55c66c62d8c727295e7ca9512846e28a4d1c4044bee9202033b"
Jul 03 10:20:18.282956 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:18.282912    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75619f19d0f3a55c66c62d8c727295e7ca9512846e28a4d1c4044bee9202033b"} err="failed to get container status \"75619f19d0f3a55c66c62d8c727295e7ca9512846e28a4d1c4044bee9202033b\": rpc error: code = NotFound desc = could not find container \"75619f19d0f3a55c66c62d8c727295e7ca9512846e28a4d1c4044bee9202033b\": container with ID starting with 75619f19d0f3a55c66c62d8c727295e7ca9512846e28a4d1c4044bee9202033b not found: ID does not exist"
Jul 03 10:20:18.298539 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:18.298514    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-0ccbef-fc4bd7d5f-8trl4"]
Jul 03 10:20:18.300903 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:18.300884    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-0ccbef-fc4bd7d5f-8trl4"]
Jul 03 10:20:19.691450 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:19.691412    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9" path="/var/lib/kubelet/pods/2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9/volumes"
Jul 03 10:20:21.614718 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:21.614694    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"
Jul 03 10:20:21.672791 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:21.672765    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c5169a0-9f03-4294-81ad-43d5323d6069-credential-socket\") pod \"1c5169a0-9f03-4294-81ad-43d5323d6069\" (UID: \"1c5169a0-9f03-4294-81ad-43d5323d6069\") "
Jul 03 10:20:21.672947 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:21.672823    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c5169a0-9f03-4294-81ad-43d5323d6069-istio-data\") pod \"1c5169a0-9f03-4294-81ad-43d5323d6069\" (UID: \"1c5169a0-9f03-4294-81ad-43d5323d6069\") "
Jul 03 10:20:21.672947 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:21.672848    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c5169a0-9f03-4294-81ad-43d5323d6069-istiod-ca-cert\") pod \"1c5169a0-9f03-4294-81ad-43d5323d6069\" (UID: \"1c5169a0-9f03-4294-81ad-43d5323d6069\") "
Jul 03 10:20:21.672947 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:21.672882    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c5169a0-9f03-4294-81ad-43d5323d6069-istio-token\") pod \"1c5169a0-9f03-4294-81ad-43d5323d6069\" (UID: \"1c5169a0-9f03-4294-81ad-43d5323d6069\") "
Jul 03 10:20:21.672947 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:21.672897    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c5169a0-9f03-4294-81ad-43d5323d6069-workload-socket\") pod \"1c5169a0-9f03-4294-81ad-43d5323d6069\" (UID: \"1c5169a0-9f03-4294-81ad-43d5323d6069\") "
Jul 03 10:20:21.673146 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:21.672957    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c5169a0-9f03-4294-81ad-43d5323d6069-workload-certs\") pod \"1c5169a0-9f03-4294-81ad-43d5323d6069\" (UID: \"1c5169a0-9f03-4294-81ad-43d5323d6069\") "
Jul 03 10:20:21.673146 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:21.672989    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wp2pm\" (UniqueName: \"kubernetes.io/projected/1c5169a0-9f03-4294-81ad-43d5323d6069-kube-api-access-wp2pm\") pod \"1c5169a0-9f03-4294-81ad-43d5323d6069\" (UID: \"1c5169a0-9f03-4294-81ad-43d5323d6069\") "
Jul 03 10:20:21.673146 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:21.673010    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c5169a0-9f03-4294-81ad-43d5323d6069-istio-podinfo\") pod \"1c5169a0-9f03-4294-81ad-43d5323d6069\" (UID: \"1c5169a0-9f03-4294-81ad-43d5323d6069\") "
Jul 03 10:20:21.673146 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:21.673036    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c5169a0-9f03-4294-81ad-43d5323d6069-istio-envoy\") pod \"1c5169a0-9f03-4294-81ad-43d5323d6069\" (UID: \"1c5169a0-9f03-4294-81ad-43d5323d6069\") "
Jul 03 10:20:21.673755 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:21.673292    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c5169a0-9f03-4294-81ad-43d5323d6069-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1c5169a0-9f03-4294-81ad-43d5323d6069" (UID: "1c5169a0-9f03-4294-81ad-43d5323d6069"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:20:21.673755 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:21.673306    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c5169a0-9f03-4294-81ad-43d5323d6069-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1c5169a0-9f03-4294-81ad-43d5323d6069" (UID: "1c5169a0-9f03-4294-81ad-43d5323d6069"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:20:21.673755 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:21.673319    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c5169a0-9f03-4294-81ad-43d5323d6069-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1c5169a0-9f03-4294-81ad-43d5323d6069" (UID: "1c5169a0-9f03-4294-81ad-43d5323d6069"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 10:20:21.673755 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:21.673359    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c5169a0-9f03-4294-81ad-43d5323d6069-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1c5169a0-9f03-4294-81ad-43d5323d6069" (UID: "1c5169a0-9f03-4294-81ad-43d5323d6069"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:20:21.673755 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:21.673726    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c5169a0-9f03-4294-81ad-43d5323d6069-istio-data" (OuterVolumeSpecName: "istio-data") pod "1c5169a0-9f03-4294-81ad-43d5323d6069" (UID: "1c5169a0-9f03-4294-81ad-43d5323d6069"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:20:21.675314 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:21.675283    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1c5169a0-9f03-4294-81ad-43d5323d6069-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1c5169a0-9f03-4294-81ad-43d5323d6069" (UID: "1c5169a0-9f03-4294-81ad-43d5323d6069"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 03 10:20:21.675314 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:21.675304    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c5169a0-9f03-4294-81ad-43d5323d6069-istio-token" (OuterVolumeSpecName: "istio-token") pod "1c5169a0-9f03-4294-81ad-43d5323d6069" (UID: "1c5169a0-9f03-4294-81ad-43d5323d6069"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 10:20:21.675314 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:21.675289    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c5169a0-9f03-4294-81ad-43d5323d6069-kube-api-access-wp2pm" (OuterVolumeSpecName: "kube-api-access-wp2pm") pod "1c5169a0-9f03-4294-81ad-43d5323d6069" (UID: "1c5169a0-9f03-4294-81ad-43d5323d6069"). InnerVolumeSpecName "kube-api-access-wp2pm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 10:20:21.675502 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:21.675400    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c5169a0-9f03-4294-81ad-43d5323d6069-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1c5169a0-9f03-4294-81ad-43d5323d6069" (UID: "1c5169a0-9f03-4294-81ad-43d5323d6069"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:20:21.774142 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:21.774107    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c5169a0-9f03-4294-81ad-43d5323d6069-istio-data\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:20:21.774142 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:21.774137    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c5169a0-9f03-4294-81ad-43d5323d6069-istiod-ca-cert\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:20:21.774142 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:21.774145    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c5169a0-9f03-4294-81ad-43d5323d6069-istio-token\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:20:21.774360 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:21.774153    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c5169a0-9f03-4294-81ad-43d5323d6069-workload-socket\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:20:21.774360 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:21.774162    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c5169a0-9f03-4294-81ad-43d5323d6069-workload-certs\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:20:21.774360 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:21.774171    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wp2pm\" (UniqueName: \"kubernetes.io/projected/1c5169a0-9f03-4294-81ad-43d5323d6069-kube-api-access-wp2pm\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:20:21.774360 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:21.774179    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c5169a0-9f03-4294-81ad-43d5323d6069-istio-podinfo\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:20:21.774360 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:21.774187    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c5169a0-9f03-4294-81ad-43d5323d6069-istio-envoy\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:20:21.774360 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:21.774196    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c5169a0-9f03-4294-81ad-43d5323d6069-credential-socket\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:20:22.297385 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:22.297347    2559 generic.go:356] "Generic (PLEG): container finished" podID="1c5169a0-9f03-4294-81ad-43d5323d6069" containerID="19598bfa81aa2eeccf6c6bb670093bb35d549e3a820811343f54d2c719122cc1" exitCode=0
Jul 03 10:20:22.297685 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:22.297398    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"
Jul 03 10:20:22.297685 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:22.297435    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w" event={"ID":"1c5169a0-9f03-4294-81ad-43d5323d6069","Type":"ContainerDied","Data":"19598bfa81aa2eeccf6c6bb670093bb35d549e3a820811343f54d2c719122cc1"}
Jul 03 10:20:22.297685 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:22.297489    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w" event={"ID":"1c5169a0-9f03-4294-81ad-43d5323d6069","Type":"ContainerDied","Data":"092e1fbbc2ef2139b6d07e8b9d0925bf99fefd462fc8d597d5da15185ce32c89"}
Jul 03 10:20:22.297685 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:22.297510    2559 scope.go:117] "RemoveContainer" containerID="19598bfa81aa2eeccf6c6bb670093bb35d549e3a820811343f54d2c719122cc1"
Jul 03 10:20:22.306314 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:22.306244    2559 scope.go:117] "RemoveContainer" containerID="feba11206d5bf93558741b2c430fcdbb41015b78aefd55b67f97bad1e9094fb3"
Jul 03 10:20:22.314325 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:22.314305    2559 scope.go:117] "RemoveContainer" containerID="19598bfa81aa2eeccf6c6bb670093bb35d549e3a820811343f54d2c719122cc1"
Jul 03 10:20:22.314587 ip-10-0-131-117 kubenswrapper[2559]: E0703 10:20:22.314565    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19598bfa81aa2eeccf6c6bb670093bb35d549e3a820811343f54d2c719122cc1\": container with ID starting with 19598bfa81aa2eeccf6c6bb670093bb35d549e3a820811343f54d2c719122cc1 not found: ID does not exist" containerID="19598bfa81aa2eeccf6c6bb670093bb35d549e3a820811343f54d2c719122cc1"
Jul 03 10:20:22.314669 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:22.314596    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19598bfa81aa2eeccf6c6bb670093bb35d549e3a820811343f54d2c719122cc1"} err="failed to get container status \"19598bfa81aa2eeccf6c6bb670093bb35d549e3a820811343f54d2c719122cc1\": rpc error: code = NotFound desc = could not find container \"19598bfa81aa2eeccf6c6bb670093bb35d549e3a820811343f54d2c719122cc1\": container with ID starting with 19598bfa81aa2eeccf6c6bb670093bb35d549e3a820811343f54d2c719122cc1 not found: ID does not exist"
Jul 03 10:20:22.314669 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:22.314614    2559 scope.go:117] "RemoveContainer" containerID="feba11206d5bf93558741b2c430fcdbb41015b78aefd55b67f97bad1e9094fb3"
Jul 03 10:20:22.314883 ip-10-0-131-117 kubenswrapper[2559]: E0703 10:20:22.314852    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"feba11206d5bf93558741b2c430fcdbb41015b78aefd55b67f97bad1e9094fb3\": container with ID starting with feba11206d5bf93558741b2c430fcdbb41015b78aefd55b67f97bad1e9094fb3 not found: ID does not exist" containerID="feba11206d5bf93558741b2c430fcdbb41015b78aefd55b67f97bad1e9094fb3"
Jul 03 10:20:22.314923 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:22.314886    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"feba11206d5bf93558741b2c430fcdbb41015b78aefd55b67f97bad1e9094fb3"} err="failed to get container status \"feba11206d5bf93558741b2c430fcdbb41015b78aefd55b67f97bad1e9094fb3\": rpc error: code = NotFound desc = could not find container \"feba11206d5bf93558741b2c430fcdbb41015b78aefd55b67f97bad1e9094fb3\": container with ID starting with feba11206d5bf93558741b2c430fcdbb41015b78aefd55b67f97bad1e9094fb3 not found: ID does not exist"
Jul 03 10:20:22.318405 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:22.318383    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"]
Jul 03 10:20:22.325119 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:22.325097    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-90e0ea-openshift-default-7bc55b8f7c-kwv6w"]
Jul 03 10:20:23.691980 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:23.691951    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c5169a0-9f03-4294-81ad-43d5323d6069" path="/var/lib/kubelet/pods/1c5169a0-9f03-4294-81ad-43d5323d6069/volumes"
Jul 03 10:20:25.000118 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.000080    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"]
Jul 03 10:20:25.000635 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.000617    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c5169a0-9f03-4294-81ad-43d5323d6069" containerName="istio-proxy"
Jul 03 10:20:25.000722 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.000637    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c5169a0-9f03-4294-81ad-43d5323d6069" containerName="istio-proxy"
Jul 03 10:20:25.000722 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.000651    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1518d5bf-a5fc-45da-82b6-84f543457224" containerName="main"
Jul 03 10:20:25.000722 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.000659    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1518d5bf-a5fc-45da-82b6-84f543457224" containerName="main"
Jul 03 10:20:25.000722 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.000693    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9" containerName="maas-api"
Jul 03 10:20:25.000722 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.000702    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9" containerName="maas-api"
Jul 03 10:20:25.000967 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.000800    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c5169a0-9f03-4294-81ad-43d5323d6069" containerName="istio-proxy"
Jul 03 10:20:25.000967 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.000815    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c5169a0-9f03-4294-81ad-43d5323d6069" containerName="istio-proxy"
Jul 03 10:20:25.000967 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.000827    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1518d5bf-a5fc-45da-82b6-84f543457224" containerName="main"
Jul 03 10:20:25.000967 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.000839    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ada67ae-0cbc-44ae-90bd-72f8c0e96bc9" containerName="maas-api"
Jul 03 10:20:25.003860 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.003836    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"
Jul 03 10:20:25.007429 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.007409    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-f98768-openshift-default-dockercfg-r88ft\""
Jul 03 10:20:25.022907 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.022877    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"]
Jul 03 10:20:25.105955 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.105923    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05f310a8-ff8d-44b6-a080-fb94fb3a0127-credential-socket\") pod \"e2e-api-a-f98768-openshift-default-c947cb58c-75j4n\" (UID: \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\") " pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"
Jul 03 10:20:25.106144 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.105969    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05f310a8-ff8d-44b6-a080-fb94fb3a0127-istio-envoy\") pod \"e2e-api-a-f98768-openshift-default-c947cb58c-75j4n\" (UID: \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\") " pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"
Jul 03 10:20:25.106144 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.105995    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05f310a8-ff8d-44b6-a080-fb94fb3a0127-workload-socket\") pod \"e2e-api-a-f98768-openshift-default-c947cb58c-75j4n\" (UID: \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\") " pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"
Jul 03 10:20:25.106144 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.106084    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05f310a8-ff8d-44b6-a080-fb94fb3a0127-istiod-ca-cert\") pod \"e2e-api-a-f98768-openshift-default-c947cb58c-75j4n\" (UID: \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\") " pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"
Jul 03 10:20:25.106144 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.106134    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05f310a8-ff8d-44b6-a080-fb94fb3a0127-istio-podinfo\") pod \"e2e-api-a-f98768-openshift-default-c947cb58c-75j4n\" (UID: \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\") " pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"
Jul 03 10:20:25.106426 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.106163    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05f310a8-ff8d-44b6-a080-fb94fb3a0127-istio-data\") pod \"e2e-api-a-f98768-openshift-default-c947cb58c-75j4n\" (UID: \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\") " pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"
Jul 03 10:20:25.106426 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.106223    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05f310a8-ff8d-44b6-a080-fb94fb3a0127-istio-token\") pod \"e2e-api-a-f98768-openshift-default-c947cb58c-75j4n\" (UID: \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\") " pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"
Jul 03 10:20:25.106426 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.106277    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgr4v\" (UniqueName: \"kubernetes.io/projected/05f310a8-ff8d-44b6-a080-fb94fb3a0127-kube-api-access-sgr4v\") pod \"e2e-api-a-f98768-openshift-default-c947cb58c-75j4n\" (UID: \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\") " pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"
Jul 03 10:20:25.106426 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.106314    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05f310a8-ff8d-44b6-a080-fb94fb3a0127-workload-certs\") pod \"e2e-api-a-f98768-openshift-default-c947cb58c-75j4n\" (UID: \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\") " pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"
Jul 03 10:20:25.207686 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.207648    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05f310a8-ff8d-44b6-a080-fb94fb3a0127-istiod-ca-cert\") pod \"e2e-api-a-f98768-openshift-default-c947cb58c-75j4n\" (UID: \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\") " pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"
Jul 03 10:20:25.207686 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.207688    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05f310a8-ff8d-44b6-a080-fb94fb3a0127-istio-podinfo\") pod \"e2e-api-a-f98768-openshift-default-c947cb58c-75j4n\" (UID: \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\") " pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"
Jul 03 10:20:25.207910 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.207712    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05f310a8-ff8d-44b6-a080-fb94fb3a0127-istio-data\") pod \"e2e-api-a-f98768-openshift-default-c947cb58c-75j4n\" (UID: \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\") " pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"
Jul 03 10:20:25.207910 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.207751    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05f310a8-ff8d-44b6-a080-fb94fb3a0127-istio-token\") pod \"e2e-api-a-f98768-openshift-default-c947cb58c-75j4n\" (UID: \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\") " pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"
Jul 03 10:20:25.207910 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.207791    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgr4v\" (UniqueName: \"kubernetes.io/projected/05f310a8-ff8d-44b6-a080-fb94fb3a0127-kube-api-access-sgr4v\") pod \"e2e-api-a-f98768-openshift-default-c947cb58c-75j4n\" (UID: \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\") " pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"
Jul 03 10:20:25.207910 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.207830    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05f310a8-ff8d-44b6-a080-fb94fb3a0127-workload-certs\") pod \"e2e-api-a-f98768-openshift-default-c947cb58c-75j4n\" (UID: \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\") " pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"
Jul 03 10:20:25.207910 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.207886    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05f310a8-ff8d-44b6-a080-fb94fb3a0127-credential-socket\") pod \"e2e-api-a-f98768-openshift-default-c947cb58c-75j4n\" (UID: \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\") " pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"
Jul 03 10:20:25.208149 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.207924    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05f310a8-ff8d-44b6-a080-fb94fb3a0127-istio-envoy\") pod \"e2e-api-a-f98768-openshift-default-c947cb58c-75j4n\" (UID: \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\") " pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"
Jul 03 10:20:25.208149 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.207955    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05f310a8-ff8d-44b6-a080-fb94fb3a0127-workload-socket\") pod \"e2e-api-a-f98768-openshift-default-c947cb58c-75j4n\" (UID: \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\") " pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"
Jul 03 10:20:25.208249 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.208230    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05f310a8-ff8d-44b6-a080-fb94fb3a0127-istio-data\") pod \"e2e-api-a-f98768-openshift-default-c947cb58c-75j4n\" (UID: \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\") " pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"
Jul 03 10:20:25.208312 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.208280    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05f310a8-ff8d-44b6-a080-fb94fb3a0127-workload-socket\") pod \"e2e-api-a-f98768-openshift-default-c947cb58c-75j4n\" (UID: \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\") " pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"
Jul 03 10:20:25.208443 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.208413    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05f310a8-ff8d-44b6-a080-fb94fb3a0127-credential-socket\") pod \"e2e-api-a-f98768-openshift-default-c947cb58c-75j4n\" (UID: \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\") " pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"
Jul 03 10:20:25.208443 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.208436    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05f310a8-ff8d-44b6-a080-fb94fb3a0127-istiod-ca-cert\") pod \"e2e-api-a-f98768-openshift-default-c947cb58c-75j4n\" (UID: \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\") " pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"
Jul 03 10:20:25.208712 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.208525    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05f310a8-ff8d-44b6-a080-fb94fb3a0127-workload-certs\") pod \"e2e-api-a-f98768-openshift-default-c947cb58c-75j4n\" (UID: \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\") " pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"
Jul 03 10:20:25.210239 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.210221    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05f310a8-ff8d-44b6-a080-fb94fb3a0127-istio-envoy\") pod \"e2e-api-a-f98768-openshift-default-c947cb58c-75j4n\" (UID: \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\") " pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"
Jul 03 10:20:25.210350 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.210256    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05f310a8-ff8d-44b6-a080-fb94fb3a0127-istio-podinfo\") pod \"e2e-api-a-f98768-openshift-default-c947cb58c-75j4n\" (UID: \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\") " pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"
Jul 03 10:20:25.216841 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.216822    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05f310a8-ff8d-44b6-a080-fb94fb3a0127-istio-token\") pod \"e2e-api-a-f98768-openshift-default-c947cb58c-75j4n\" (UID: \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\") " pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"
Jul 03 10:20:25.219606 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.219588    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgr4v\" (UniqueName: \"kubernetes.io/projected/05f310a8-ff8d-44b6-a080-fb94fb3a0127-kube-api-access-sgr4v\") pod \"e2e-api-a-f98768-openshift-default-c947cb58c-75j4n\" (UID: \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\") " pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"
Jul 03 10:20:25.314045 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.313955    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"
Jul 03 10:20:25.477423 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.477393    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"]
Jul 03 10:20:25.481150 ip-10-0-131-117 kubenswrapper[2559]: W0703 10:20:25.481123    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05f310a8_ff8d_44b6_a080_fb94fb3a0127.slice/crio-837f6e567145ff35a6c953731a2bd66eac764caba94523759b15032c8995bc16 WatchSource:0}: Error finding container 837f6e567145ff35a6c953731a2bd66eac764caba94523759b15032c8995bc16: Status 404 returned error can't find the container with id 837f6e567145ff35a6c953731a2bd66eac764caba94523759b15032c8995bc16
Jul 03 10:20:25.483141 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.483109    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 03 10:20:25.483214 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.483176    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 03 10:20:25.483214 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:25.483204    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 03 10:20:26.319370 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:26.319332    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n" event={"ID":"05f310a8-ff8d-44b6-a080-fb94fb3a0127","Type":"ContainerStarted","Data":"ab564d2c69dba110b57d1e154f35b14c748913555a4287f803d2dd50d3d17f3b"}
Jul 03 10:20:26.319866 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:26.319393    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n" event={"ID":"05f310a8-ff8d-44b6-a080-fb94fb3a0127","Type":"ContainerStarted","Data":"837f6e567145ff35a6c953731a2bd66eac764caba94523759b15032c8995bc16"}
Jul 03 10:20:26.342821 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:26.342777    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n" podStartSLOduration=2.342761546 podStartE2EDuration="2.342761546s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 10:20:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 10:20:26.34085824 +0000 UTC m=+2227.211523884" watchObservedRunningTime="2026-07-03 10:20:26.342761546 +0000 UTC m=+2227.213427175"
Jul 03 10:20:27.314514 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:27.314476    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"
Jul 03 10:20:27.319460 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:27.319436    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"
Jul 03 10:20:27.323651 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:27.323630    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"
Jul 03 10:20:27.324413 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:27.324393    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"
Jul 03 10:20:41.400431 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:41.400396    2559 generic.go:356] "Generic (PLEG): container finished" podID="05f310a8-ff8d-44b6-a080-fb94fb3a0127" containerID="ab564d2c69dba110b57d1e154f35b14c748913555a4287f803d2dd50d3d17f3b" exitCode=0
Jul 03 10:20:41.400878 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:41.400469    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n" event={"ID":"05f310a8-ff8d-44b6-a080-fb94fb3a0127","Type":"ContainerDied","Data":"ab564d2c69dba110b57d1e154f35b14c748913555a4287f803d2dd50d3d17f3b"}
Jul 03 10:20:41.400924 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:41.400890    2559 scope.go:117] "RemoveContainer" containerID="ab564d2c69dba110b57d1e154f35b14c748913555a4287f803d2dd50d3d17f3b"
Jul 03 10:20:41.401997 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:41.401931    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 03 10:20:41.402107 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:41.402006    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 03 10:20:41.402107 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:41.402040    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 03 10:20:42.324185 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:42.324150    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"
Jul 03 10:20:42.406761 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:42.406731    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n" event={"ID":"05f310a8-ff8d-44b6-a080-fb94fb3a0127","Type":"ContainerStarted","Data":"10543a3af3471fb4c0d5283ad3202c30a04595f2854c25345a056ae179933154"}
Jul 03 10:20:43.314712 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:43.314670    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"
Jul 03 10:20:43.315789 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:43.315768    2559 patch_prober.go:28] interesting pod/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 03 10:20:43.315854 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:43.315828    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n" podUID="05f310a8-ff8d-44b6-a080-fb94fb3a0127" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 03 10:20:44.314910 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:44.314873    2559 patch_prober.go:28] interesting pod/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 03 10:20:44.315319 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:44.314927    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n" podUID="05f310a8-ff8d-44b6-a080-fb94fb3a0127" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 03 10:20:45.314937 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:45.314901    2559 patch_prober.go:28] interesting pod/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 03 10:20:45.315442 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:45.314967    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n" podUID="05f310a8-ff8d-44b6-a080-fb94fb3a0127" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 03 10:20:46.314723 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:46.314687    2559 patch_prober.go:28] interesting pod/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 03 10:20:46.314902 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:46.314743    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n" podUID="05f310a8-ff8d-44b6-a080-fb94fb3a0127" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 03 10:20:47.319116 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:47.319085    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"
Jul 03 10:20:47.319626 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:47.319388    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"
Jul 03 10:20:47.320128 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:47.320088    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"
Jul 03 10:20:55.684696 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:55.684654    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"]
Jul 03 10:20:55.685284 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:20:55.684904    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n" podUID="05f310a8-ff8d-44b6-a080-fb94fb3a0127" containerName="istio-proxy" containerID="cri-o://10543a3af3471fb4c0d5283ad3202c30a04595f2854c25345a056ae179933154" gracePeriod=30
Jul 03 10:21:00.939821 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:00.939786    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"
Jul 03 10:21:01.052675 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:01.052577    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05f310a8-ff8d-44b6-a080-fb94fb3a0127-istiod-ca-cert\") pod \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\" (UID: \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\") "
Jul 03 10:21:01.052675 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:01.052634    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05f310a8-ff8d-44b6-a080-fb94fb3a0127-istio-podinfo\") pod \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\" (UID: \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\") "
Jul 03 10:21:01.052675 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:01.052658    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05f310a8-ff8d-44b6-a080-fb94fb3a0127-istio-envoy\") pod \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\" (UID: \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\") "
Jul 03 10:21:01.052971 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:01.052697    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05f310a8-ff8d-44b6-a080-fb94fb3a0127-credential-socket\") pod \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\" (UID: \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\") "
Jul 03 10:21:01.052971 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:01.052754    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05f310a8-ff8d-44b6-a080-fb94fb3a0127-workload-certs\") pod \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\" (UID: \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\") "
Jul 03 10:21:01.052971 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:01.052788    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05f310a8-ff8d-44b6-a080-fb94fb3a0127-istio-data\") pod \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\" (UID: \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\") "
Jul 03 10:21:01.052971 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:01.052821    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05f310a8-ff8d-44b6-a080-fb94fb3a0127-istio-token\") pod \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\" (UID: \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\") "
Jul 03 10:21:01.052971 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:01.052875    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgr4v\" (UniqueName: \"kubernetes.io/projected/05f310a8-ff8d-44b6-a080-fb94fb3a0127-kube-api-access-sgr4v\") pod \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\" (UID: \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\") "
Jul 03 10:21:01.052971 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:01.052899    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05f310a8-ff8d-44b6-a080-fb94fb3a0127-workload-socket\") pod \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\" (UID: \"05f310a8-ff8d-44b6-a080-fb94fb3a0127\") "
Jul 03 10:21:01.053282 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:01.053080    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05f310a8-ff8d-44b6-a080-fb94fb3a0127-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "05f310a8-ff8d-44b6-a080-fb94fb3a0127" (UID: "05f310a8-ff8d-44b6-a080-fb94fb3a0127"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:21:01.053282 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:01.053092    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05f310a8-ff8d-44b6-a080-fb94fb3a0127-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "05f310a8-ff8d-44b6-a080-fb94fb3a0127" (UID: "05f310a8-ff8d-44b6-a080-fb94fb3a0127"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:21:01.053282 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:01.053079    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05f310a8-ff8d-44b6-a080-fb94fb3a0127-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "05f310a8-ff8d-44b6-a080-fb94fb3a0127" (UID: "05f310a8-ff8d-44b6-a080-fb94fb3a0127"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 10:21:01.053282 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:01.053278    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05f310a8-ff8d-44b6-a080-fb94fb3a0127-workload-certs\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:21:01.053756 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:01.053285    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05f310a8-ff8d-44b6-a080-fb94fb3a0127-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "05f310a8-ff8d-44b6-a080-fb94fb3a0127" (UID: "05f310a8-ff8d-44b6-a080-fb94fb3a0127"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:21:01.053756 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:01.053299    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05f310a8-ff8d-44b6-a080-fb94fb3a0127-istiod-ca-cert\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:21:01.053756 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:01.053314    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05f310a8-ff8d-44b6-a080-fb94fb3a0127-credential-socket\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:21:01.053979 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:01.053947    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05f310a8-ff8d-44b6-a080-fb94fb3a0127-istio-data" (OuterVolumeSpecName: "istio-data") pod "05f310a8-ff8d-44b6-a080-fb94fb3a0127" (UID: "05f310a8-ff8d-44b6-a080-fb94fb3a0127"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:21:01.054974 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:01.054948    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05f310a8-ff8d-44b6-a080-fb94fb3a0127-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "05f310a8-ff8d-44b6-a080-fb94fb3a0127" (UID: "05f310a8-ff8d-44b6-a080-fb94fb3a0127"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:21:01.055126 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:01.055111    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05f310a8-ff8d-44b6-a080-fb94fb3a0127-kube-api-access-sgr4v" (OuterVolumeSpecName: "kube-api-access-sgr4v") pod "05f310a8-ff8d-44b6-a080-fb94fb3a0127" (UID: "05f310a8-ff8d-44b6-a080-fb94fb3a0127"). InnerVolumeSpecName "kube-api-access-sgr4v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 10:21:01.055195 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:01.055179    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/05f310a8-ff8d-44b6-a080-fb94fb3a0127-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "05f310a8-ff8d-44b6-a080-fb94fb3a0127" (UID: "05f310a8-ff8d-44b6-a080-fb94fb3a0127"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 03 10:21:01.055233 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:01.055215    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05f310a8-ff8d-44b6-a080-fb94fb3a0127-istio-token" (OuterVolumeSpecName: "istio-token") pod "05f310a8-ff8d-44b6-a080-fb94fb3a0127" (UID: "05f310a8-ff8d-44b6-a080-fb94fb3a0127"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 10:21:01.154846 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:01.154801    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05f310a8-ff8d-44b6-a080-fb94fb3a0127-istio-data\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:21:01.154846 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:01.154843    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05f310a8-ff8d-44b6-a080-fb94fb3a0127-istio-token\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:21:01.154846 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:01.154853    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgr4v\" (UniqueName: \"kubernetes.io/projected/05f310a8-ff8d-44b6-a080-fb94fb3a0127-kube-api-access-sgr4v\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:21:01.154846 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:01.154862    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05f310a8-ff8d-44b6-a080-fb94fb3a0127-workload-socket\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:21:01.154846 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:01.154872    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05f310a8-ff8d-44b6-a080-fb94fb3a0127-istio-podinfo\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:21:01.155182 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:01.154880    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05f310a8-ff8d-44b6-a080-fb94fb3a0127-istio-envoy\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:21:01.501659 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:01.501625    2559 generic.go:356] "Generic (PLEG): container finished" podID="05f310a8-ff8d-44b6-a080-fb94fb3a0127" containerID="10543a3af3471fb4c0d5283ad3202c30a04595f2854c25345a056ae179933154" exitCode=0
Jul 03 10:21:01.501829 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:01.501670    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"
Jul 03 10:21:01.501829 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:01.501710    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n" event={"ID":"05f310a8-ff8d-44b6-a080-fb94fb3a0127","Type":"ContainerDied","Data":"10543a3af3471fb4c0d5283ad3202c30a04595f2854c25345a056ae179933154"}
Jul 03 10:21:01.501829 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:01.501765    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n" event={"ID":"05f310a8-ff8d-44b6-a080-fb94fb3a0127","Type":"ContainerDied","Data":"837f6e567145ff35a6c953731a2bd66eac764caba94523759b15032c8995bc16"}
Jul 03 10:21:01.501829 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:01.501787    2559 scope.go:117] "RemoveContainer" containerID="10543a3af3471fb4c0d5283ad3202c30a04595f2854c25345a056ae179933154"
Jul 03 10:21:01.511346 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:01.511323    2559 scope.go:117] "RemoveContainer" containerID="ab564d2c69dba110b57d1e154f35b14c748913555a4287f803d2dd50d3d17f3b"
Jul 03 10:21:01.519462 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:01.519447    2559 scope.go:117] "RemoveContainer" containerID="10543a3af3471fb4c0d5283ad3202c30a04595f2854c25345a056ae179933154"
Jul 03 10:21:01.519708 ip-10-0-131-117 kubenswrapper[2559]: E0703 10:21:01.519690    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10543a3af3471fb4c0d5283ad3202c30a04595f2854c25345a056ae179933154\": container with ID starting with 10543a3af3471fb4c0d5283ad3202c30a04595f2854c25345a056ae179933154 not found: ID does not exist" containerID="10543a3af3471fb4c0d5283ad3202c30a04595f2854c25345a056ae179933154"
Jul 03 10:21:01.519779 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:01.519715    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10543a3af3471fb4c0d5283ad3202c30a04595f2854c25345a056ae179933154"} err="failed to get container status \"10543a3af3471fb4c0d5283ad3202c30a04595f2854c25345a056ae179933154\": rpc error: code = NotFound desc = could not find container \"10543a3af3471fb4c0d5283ad3202c30a04595f2854c25345a056ae179933154\": container with ID starting with 10543a3af3471fb4c0d5283ad3202c30a04595f2854c25345a056ae179933154 not found: ID does not exist"
Jul 03 10:21:01.519779 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:01.519731    2559 scope.go:117] "RemoveContainer" containerID="ab564d2c69dba110b57d1e154f35b14c748913555a4287f803d2dd50d3d17f3b"
Jul 03 10:21:01.519957 ip-10-0-131-117 kubenswrapper[2559]: E0703 10:21:01.519944    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab564d2c69dba110b57d1e154f35b14c748913555a4287f803d2dd50d3d17f3b\": container with ID starting with ab564d2c69dba110b57d1e154f35b14c748913555a4287f803d2dd50d3d17f3b not found: ID does not exist" containerID="ab564d2c69dba110b57d1e154f35b14c748913555a4287f803d2dd50d3d17f3b"
Jul 03 10:21:01.519997 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:01.519960    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab564d2c69dba110b57d1e154f35b14c748913555a4287f803d2dd50d3d17f3b"} err="failed to get container status \"ab564d2c69dba110b57d1e154f35b14c748913555a4287f803d2dd50d3d17f3b\": rpc error: code = NotFound desc = could not find container \"ab564d2c69dba110b57d1e154f35b14c748913555a4287f803d2dd50d3d17f3b\": container with ID starting with ab564d2c69dba110b57d1e154f35b14c748913555a4287f803d2dd50d3d17f3b not found: ID does not exist"
Jul 03 10:21:01.532194 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:01.532169    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"]
Jul 03 10:21:01.541671 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:01.541651    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-f98768-openshift-default-c947cb58c-75j4n"]
Jul 03 10:21:01.691502 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:01.691469    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05f310a8-ff8d-44b6-a080-fb94fb3a0127" path="/var/lib/kubelet/pods/05f310a8-ff8d-44b6-a080-fb94fb3a0127/volumes"
Jul 03 10:21:05.573287 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:05.573251    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"]
Jul 03 10:21:05.573698 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:05.573685    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c5169a0-9f03-4294-81ad-43d5323d6069" containerName="istio-proxy"
Jul 03 10:21:05.573698 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:05.573698    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c5169a0-9f03-4294-81ad-43d5323d6069" containerName="istio-proxy"
Jul 03 10:21:05.573774 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:05.573711    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05f310a8-ff8d-44b6-a080-fb94fb3a0127" containerName="istio-proxy"
Jul 03 10:21:05.573774 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:05.573717    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="05f310a8-ff8d-44b6-a080-fb94fb3a0127" containerName="istio-proxy"
Jul 03 10:21:05.573774 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:05.573730    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05f310a8-ff8d-44b6-a080-fb94fb3a0127" containerName="istio-proxy"
Jul 03 10:21:05.573774 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:05.573736    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="05f310a8-ff8d-44b6-a080-fb94fb3a0127" containerName="istio-proxy"
Jul 03 10:21:05.573891 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:05.573798    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="05f310a8-ff8d-44b6-a080-fb94fb3a0127" containerName="istio-proxy"
Jul 03 10:21:05.573891 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:05.573807    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="05f310a8-ff8d-44b6-a080-fb94fb3a0127" containerName="istio-proxy"
Jul 03 10:21:05.576704 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:05.576689    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"
Jul 03 10:21:05.579608 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:05.579590    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-1fc47c-openshift-default-dockercfg-h97q8\""
Jul 03 10:21:05.593582 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:05.593559    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5e28afb-fec0-4b3b-8537-a599cdb606e7-istio-data\") pod \"e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv\" (UID: \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\") " pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"
Jul 03 10:21:05.593663 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:05.593599    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5e28afb-fec0-4b3b-8537-a599cdb606e7-credential-socket\") pod \"e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv\" (UID: \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\") " pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"
Jul 03 10:21:05.593663 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:05.593624    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5e28afb-fec0-4b3b-8537-a599cdb606e7-istio-envoy\") pod \"e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv\" (UID: \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\") " pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"
Jul 03 10:21:05.593663 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:05.593659    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5e28afb-fec0-4b3b-8537-a599cdb606e7-istio-token\") pod \"e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv\" (UID: \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\") " pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"
Jul 03 10:21:05.593792 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:05.593711    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2kqw\" (UniqueName: \"kubernetes.io/projected/d5e28afb-fec0-4b3b-8537-a599cdb606e7-kube-api-access-r2kqw\") pod \"e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv\" (UID: \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\") " pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"
Jul 03 10:21:05.593792 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:05.593752    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5e28afb-fec0-4b3b-8537-a599cdb606e7-workload-certs\") pod \"e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv\" (UID: \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\") " pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"
Jul 03 10:21:05.593792 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:05.593775    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5e28afb-fec0-4b3b-8537-a599cdb606e7-istio-podinfo\") pod \"e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv\" (UID: \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\") " pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"
Jul 03 10:21:05.593897 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:05.593792    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5e28afb-fec0-4b3b-8537-a599cdb606e7-istiod-ca-cert\") pod \"e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv\" (UID: \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\") " pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"
Jul 03 10:21:05.593897 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:05.593864    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5e28afb-fec0-4b3b-8537-a599cdb606e7-workload-socket\") pod \"e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv\" (UID: \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\") " pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"
Jul 03 10:21:05.614690 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:05.614660    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"]
Jul 03 10:21:05.694879 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:05.694850    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5e28afb-fec0-4b3b-8537-a599cdb606e7-workload-certs\") pod \"e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv\" (UID: \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\") " pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"
Jul 03 10:21:05.695073 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:05.694895    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5e28afb-fec0-4b3b-8537-a599cdb606e7-istio-podinfo\") pod \"e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv\" (UID: \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\") " pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"
Jul 03 10:21:05.695073 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:05.694932    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5e28afb-fec0-4b3b-8537-a599cdb606e7-istiod-ca-cert\") pod \"e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv\" (UID: \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\") " pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"
Jul 03 10:21:05.695073 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:05.695031    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5e28afb-fec0-4b3b-8537-a599cdb606e7-workload-socket\") pod \"e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv\" (UID: \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\") " pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"
Jul 03 10:21:05.695249 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:05.695080    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5e28afb-fec0-4b3b-8537-a599cdb606e7-istio-data\") pod \"e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv\" (UID: \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\") " pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"
Jul 03 10:21:05.695249 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:05.695118    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5e28afb-fec0-4b3b-8537-a599cdb606e7-credential-socket\") pod \"e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv\" (UID: \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\") " pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"
Jul 03 10:21:05.695249 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:05.695150    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5e28afb-fec0-4b3b-8537-a599cdb606e7-istio-envoy\") pod \"e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv\" (UID: \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\") " pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"
Jul 03 10:21:05.695249 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:05.695195    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5e28afb-fec0-4b3b-8537-a599cdb606e7-istio-token\") pod \"e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv\" (UID: \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\") " pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"
Jul 03 10:21:05.695478 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:05.695287    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5e28afb-fec0-4b3b-8537-a599cdb606e7-workload-certs\") pod \"e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv\" (UID: \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\") " pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"
Jul 03 10:21:05.695478 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:05.695296    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2kqw\" (UniqueName: \"kubernetes.io/projected/d5e28afb-fec0-4b3b-8537-a599cdb606e7-kube-api-access-r2kqw\") pod \"e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv\" (UID: \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\") " pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"
Jul 03 10:21:05.695478 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:05.695460    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5e28afb-fec0-4b3b-8537-a599cdb606e7-workload-socket\") pod \"e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv\" (UID: \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\") " pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"
Jul 03 10:21:05.695650 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:05.695502    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5e28afb-fec0-4b3b-8537-a599cdb606e7-istio-data\") pod \"e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv\" (UID: \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\") " pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"
Jul 03 10:21:05.695783 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:05.695753    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5e28afb-fec0-4b3b-8537-a599cdb606e7-istiod-ca-cert\") pod \"e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv\" (UID: \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\") " pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"
Jul 03 10:21:05.695783 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:05.695776    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5e28afb-fec0-4b3b-8537-a599cdb606e7-credential-socket\") pod \"e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv\" (UID: \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\") " pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"
Jul 03 10:21:05.697498 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:05.697474    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5e28afb-fec0-4b3b-8537-a599cdb606e7-istio-podinfo\") pod \"e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv\" (UID: \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\") " pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"
Jul 03 10:21:05.697680 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:05.697663    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5e28afb-fec0-4b3b-8537-a599cdb606e7-istio-envoy\") pod \"e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv\" (UID: \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\") " pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"
Jul 03 10:21:05.713805 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:05.713776    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5e28afb-fec0-4b3b-8537-a599cdb606e7-istio-token\") pod \"e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv\" (UID: \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\") " pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"
Jul 03 10:21:05.715709 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:05.715688    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2kqw\" (UniqueName: \"kubernetes.io/projected/d5e28afb-fec0-4b3b-8537-a599cdb606e7-kube-api-access-r2kqw\") pod \"e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv\" (UID: \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\") " pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"
Jul 03 10:21:05.887157 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:05.887074    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"
Jul 03 10:21:06.039169 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:06.039129    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"]
Jul 03 10:21:06.043057 ip-10-0-131-117 kubenswrapper[2559]: W0703 10:21:06.043032    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5e28afb_fec0_4b3b_8537_a599cdb606e7.slice/crio-407dac5d2bca2f8ea1116dfbfa46585603b09c11cc95116659cfd2f82cedf01d WatchSource:0}: Error finding container 407dac5d2bca2f8ea1116dfbfa46585603b09c11cc95116659cfd2f82cedf01d: Status 404 returned error can't find the container with id 407dac5d2bca2f8ea1116dfbfa46585603b09c11cc95116659cfd2f82cedf01d
Jul 03 10:21:06.045119 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:06.045084    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 03 10:21:06.045221 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:06.045163    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 03 10:21:06.045221 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:06.045210    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 03 10:21:06.528856 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:06.528825    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv" event={"ID":"d5e28afb-fec0-4b3b-8537-a599cdb606e7","Type":"ContainerStarted","Data":"d9259f457eded500c331db0e975c7844f182cd8b7abef561b6377b527b9e0484"}
Jul 03 10:21:06.529077 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:06.528882    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv" event={"ID":"d5e28afb-fec0-4b3b-8537-a599cdb606e7","Type":"ContainerStarted","Data":"407dac5d2bca2f8ea1116dfbfa46585603b09c11cc95116659cfd2f82cedf01d"}
Jul 03 10:21:06.551042 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:06.550991    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv" podStartSLOduration=1.550975501 podStartE2EDuration="1.550975501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 10:21:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 10:21:06.549923451 +0000 UTC m=+2267.420589105" watchObservedRunningTime="2026-07-03 10:21:06.550975501 +0000 UTC m=+2267.421641130"
Jul 03 10:21:06.887852 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:06.887769    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"
Jul 03 10:21:07.892151 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:07.892125    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"
Jul 03 10:21:08.538406 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:08.538366    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"
Jul 03 10:21:08.539199 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:08.539178    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"
Jul 03 10:21:16.935640 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:16.935603    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-12921d-5c5456f9d5-98m5x"]
Jul 03 10:21:16.938110 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:16.938093    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-12921d-5c5456f9d5-98m5x"
Jul 03 10:21:16.944644 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:16.944620    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-12921d-serving-cert\""
Jul 03 10:21:16.983016 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:16.982984    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-12921d-5c5456f9d5-98m5x"]
Jul 03 10:21:17.008172 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:17.008144    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a8a438d-5bdb-4299-bf97-d72206279c38-openshift-service-ca\") pod \"maas-api-e2e-shared-b-12921d-5c5456f9d5-98m5x\" (UID: \"9a8a438d-5bdb-4299-bf97-d72206279c38\") " pod="opendatahub/maas-api-e2e-shared-b-12921d-5c5456f9d5-98m5x"
Jul 03 10:21:17.008172 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:17.008174    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5jcj\" (UniqueName: \"kubernetes.io/projected/9a8a438d-5bdb-4299-bf97-d72206279c38-kube-api-access-m5jcj\") pod \"maas-api-e2e-shared-b-12921d-5c5456f9d5-98m5x\" (UID: \"9a8a438d-5bdb-4299-bf97-d72206279c38\") " pod="opendatahub/maas-api-e2e-shared-b-12921d-5c5456f9d5-98m5x"
Jul 03 10:21:17.008363 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:17.008197    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a8a438d-5bdb-4299-bf97-d72206279c38-maas-api-tls\") pod \"maas-api-e2e-shared-b-12921d-5c5456f9d5-98m5x\" (UID: \"9a8a438d-5bdb-4299-bf97-d72206279c38\") " pod="opendatahub/maas-api-e2e-shared-b-12921d-5c5456f9d5-98m5x"
Jul 03 10:21:17.109449 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:17.109415    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a8a438d-5bdb-4299-bf97-d72206279c38-maas-api-tls\") pod \"maas-api-e2e-shared-b-12921d-5c5456f9d5-98m5x\" (UID: \"9a8a438d-5bdb-4299-bf97-d72206279c38\") " pod="opendatahub/maas-api-e2e-shared-b-12921d-5c5456f9d5-98m5x"
Jul 03 10:21:17.109656 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:17.109529    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a8a438d-5bdb-4299-bf97-d72206279c38-openshift-service-ca\") pod \"maas-api-e2e-shared-b-12921d-5c5456f9d5-98m5x\" (UID: \"9a8a438d-5bdb-4299-bf97-d72206279c38\") " pod="opendatahub/maas-api-e2e-shared-b-12921d-5c5456f9d5-98m5x"
Jul 03 10:21:17.109656 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:17.109572    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5jcj\" (UniqueName: \"kubernetes.io/projected/9a8a438d-5bdb-4299-bf97-d72206279c38-kube-api-access-m5jcj\") pod \"maas-api-e2e-shared-b-12921d-5c5456f9d5-98m5x\" (UID: \"9a8a438d-5bdb-4299-bf97-d72206279c38\") " pod="opendatahub/maas-api-e2e-shared-b-12921d-5c5456f9d5-98m5x"
Jul 03 10:21:17.109656 ip-10-0-131-117 kubenswrapper[2559]: E0703 10:21:17.109584    2559 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-b-12921d-serving-cert: secret "maas-api-e2e-shared-b-12921d-serving-cert" not found
Jul 03 10:21:17.109833 ip-10-0-131-117 kubenswrapper[2559]: E0703 10:21:17.109663    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a8a438d-5bdb-4299-bf97-d72206279c38-maas-api-tls podName:9a8a438d-5bdb-4299-bf97-d72206279c38 nodeName:}" failed. No retries permitted until 2026-07-03 10:21:17.609644858 +0000 UTC m=+2278.480310469 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9a8a438d-5bdb-4299-bf97-d72206279c38-maas-api-tls") pod "maas-api-e2e-shared-b-12921d-5c5456f9d5-98m5x" (UID: "9a8a438d-5bdb-4299-bf97-d72206279c38") : secret "maas-api-e2e-shared-b-12921d-serving-cert" not found
Jul 03 10:21:17.110211 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:17.110185    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a8a438d-5bdb-4299-bf97-d72206279c38-openshift-service-ca\") pod \"maas-api-e2e-shared-b-12921d-5c5456f9d5-98m5x\" (UID: \"9a8a438d-5bdb-4299-bf97-d72206279c38\") " pod="opendatahub/maas-api-e2e-shared-b-12921d-5c5456f9d5-98m5x"
Jul 03 10:21:17.123409 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:17.123386    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5jcj\" (UniqueName: \"kubernetes.io/projected/9a8a438d-5bdb-4299-bf97-d72206279c38-kube-api-access-m5jcj\") pod \"maas-api-e2e-shared-b-12921d-5c5456f9d5-98m5x\" (UID: \"9a8a438d-5bdb-4299-bf97-d72206279c38\") " pod="opendatahub/maas-api-e2e-shared-b-12921d-5c5456f9d5-98m5x"
Jul 03 10:21:17.616728 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:17.616688    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a8a438d-5bdb-4299-bf97-d72206279c38-maas-api-tls\") pod \"maas-api-e2e-shared-b-12921d-5c5456f9d5-98m5x\" (UID: \"9a8a438d-5bdb-4299-bf97-d72206279c38\") " pod="opendatahub/maas-api-e2e-shared-b-12921d-5c5456f9d5-98m5x"
Jul 03 10:21:17.619257 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:17.619229    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a8a438d-5bdb-4299-bf97-d72206279c38-maas-api-tls\") pod \"maas-api-e2e-shared-b-12921d-5c5456f9d5-98m5x\" (UID: \"9a8a438d-5bdb-4299-bf97-d72206279c38\") " pod="opendatahub/maas-api-e2e-shared-b-12921d-5c5456f9d5-98m5x"
Jul 03 10:21:17.848950 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:17.848910    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-12921d-5c5456f9d5-98m5x"
Jul 03 10:21:18.034024 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:18.033991    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-12921d-5c5456f9d5-98m5x"]
Jul 03 10:21:18.038496 ip-10-0-131-117 kubenswrapper[2559]: W0703 10:21:18.038466    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a8a438d_5bdb_4299_bf97_d72206279c38.slice/crio-3f15841a489cb1e9376de5b9d5e08741a7756894f76a3c2502ce40333dd0a637 WatchSource:0}: Error finding container 3f15841a489cb1e9376de5b9d5e08741a7756894f76a3c2502ce40333dd0a637: Status 404 returned error can't find the container with id 3f15841a489cb1e9376de5b9d5e08741a7756894f76a3c2502ce40333dd0a637
Jul 03 10:21:18.587040 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:18.587003    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-12921d-5c5456f9d5-98m5x" event={"ID":"9a8a438d-5bdb-4299-bf97-d72206279c38","Type":"ContainerStarted","Data":"25a624f9d1e0c2766a139e4068fe9f15f4f1941fb2a4cc302549a0f38c756086"}
Jul 03 10:21:18.587223 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:18.587070    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-12921d-5c5456f9d5-98m5x"
Jul 03 10:21:18.587223 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:18.587097    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-12921d-5c5456f9d5-98m5x" event={"ID":"9a8a438d-5bdb-4299-bf97-d72206279c38","Type":"ContainerStarted","Data":"3f15841a489cb1e9376de5b9d5e08741a7756894f76a3c2502ce40333dd0a637"}
Jul 03 10:21:18.622380 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:18.622324    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-12921d-5c5456f9d5-98m5x" podStartSLOduration=2.191949925 podStartE2EDuration="2.622309271s" totalImagesPullingTime="430.359346ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 10:21:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 10:21:18.620048969 +0000 UTC m=+2279.490714622" watchObservedRunningTime="2026-07-03 10:21:18.622309271 +0000 UTC m=+2279.492974933"
Jul 03 10:21:24.357816 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:24.357462    2559 patch_prober.go:28] interesting pod/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": read tcp 10.134.0.2:33966->10.134.0.42:15021: read: connection reset by peer" start-of-body=
Jul 03 10:21:24.357816 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:24.357538    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv" podUID="d5e28afb-fec0-4b3b-8537-a599cdb606e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": read tcp 10.134.0.2:33966->10.134.0.42:15021: read: connection reset by peer"
Jul 03 10:21:24.597282 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:24.597194    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-12921d-5c5456f9d5-98m5x"
Jul 03 10:21:24.619299 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:24.619272    2559 generic.go:356] "Generic (PLEG): container finished" podID="d5e28afb-fec0-4b3b-8537-a599cdb606e7" containerID="d9259f457eded500c331db0e975c7844f182cd8b7abef561b6377b527b9e0484" exitCode=0
Jul 03 10:21:24.619473 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:24.619364    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv" event={"ID":"d5e28afb-fec0-4b3b-8537-a599cdb606e7","Type":"ContainerDied","Data":"d9259f457eded500c331db0e975c7844f182cd8b7abef561b6377b527b9e0484"}
Jul 03 10:21:24.619920 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:24.619904    2559 scope.go:117] "RemoveContainer" containerID="d9259f457eded500c331db0e975c7844f182cd8b7abef561b6377b527b9e0484"
Jul 03 10:21:24.620982 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:24.620954    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 03 10:21:24.621099 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:24.621028    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 03 10:21:24.621099 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:24.621072    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 03 10:21:25.625480 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:25.625448    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv" event={"ID":"d5e28afb-fec0-4b3b-8537-a599cdb606e7","Type":"ContainerStarted","Data":"78dd3bfd8ba339a87696e4bec5a3e3b4fac17ff1010b6a496c1807a7017be94a"}
Jul 03 10:21:25.887525 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:25.887436    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"
Jul 03 10:21:25.887736 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:25.887683    2559 patch_prober.go:28] interesting pod/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 03 10:21:25.887776 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:25.887729    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv" podUID="d5e28afb-fec0-4b3b-8537-a599cdb606e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 03 10:21:26.887707 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:26.887670    2559 patch_prober.go:28] interesting pod/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 03 10:21:26.888093 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:26.887737    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv" podUID="d5e28afb-fec0-4b3b-8537-a599cdb606e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 03 10:21:27.888298 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:27.888256    2559 patch_prober.go:28] interesting pod/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 03 10:21:27.888701 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:27.888318    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv" podUID="d5e28afb-fec0-4b3b-8537-a599cdb606e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 03 10:21:28.888040 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:28.888005    2559 patch_prober.go:28] interesting pod/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Jul 03 10:21:28.888191 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:28.888056    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv" podUID="d5e28afb-fec0-4b3b-8537-a599cdb606e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Jul 03 10:21:29.891676 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:29.891640    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"
Jul 03 10:21:29.892174 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:29.891989    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"
Jul 03 10:21:29.892611 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:21:29.892594    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"
Jul 03 10:22:16.512301 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:22:16.512213    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-12921d/auth-test-model-12921d-kserve-66746b6999-m9g26"]
Jul 03 10:22:16.516101 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:22:16.516081    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-12921d/auth-test-model-12921d-kserve-66746b6999-m9g26"
Jul 03 10:22:16.520012 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:22:16.519988    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-12921d\"/\"auth-test-model-12921d-kserve-self-signed-certs\""
Jul 03 10:22:16.520153 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:22:16.520061    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-12921d\"/\"default-dockercfg-5hqjb\""
Jul 03 10:22:16.520153 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:22:16.519988    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-12921d\"/\"openshift-service-ca.crt\""
Jul 03 10:22:16.520319 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:22:16.520298    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-12921d\"/\"kube-root-ca.crt\""
Jul 03 10:22:16.525312 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:22:16.525286    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-12921d/auth-test-model-12921d-kserve-66746b6999-m9g26"]
Jul 03 10:22:16.595888 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:22:16.595854    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6lxw\" (UniqueName: \"kubernetes.io/projected/63674b93-75df-402b-8540-60a6a0ad02c8-kube-api-access-p6lxw\") pod \"auth-test-model-12921d-kserve-66746b6999-m9g26\" (UID: \"63674b93-75df-402b-8540-60a6a0ad02c8\") " pod="ai-tenant-e2e-shared-b-12921d/auth-test-model-12921d-kserve-66746b6999-m9g26"
Jul 03 10:22:16.596095 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:22:16.595906    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63674b93-75df-402b-8540-60a6a0ad02c8-tls-certs\") pod \"auth-test-model-12921d-kserve-66746b6999-m9g26\" (UID: \"63674b93-75df-402b-8540-60a6a0ad02c8\") " pod="ai-tenant-e2e-shared-b-12921d/auth-test-model-12921d-kserve-66746b6999-m9g26"
Jul 03 10:22:16.596095 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:22:16.595945    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63674b93-75df-402b-8540-60a6a0ad02c8-tmp-dir\") pod \"auth-test-model-12921d-kserve-66746b6999-m9g26\" (UID: \"63674b93-75df-402b-8540-60a6a0ad02c8\") " pod="ai-tenant-e2e-shared-b-12921d/auth-test-model-12921d-kserve-66746b6999-m9g26"
Jul 03 10:22:16.596095 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:22:16.595990    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63674b93-75df-402b-8540-60a6a0ad02c8-home\") pod \"auth-test-model-12921d-kserve-66746b6999-m9g26\" (UID: \"63674b93-75df-402b-8540-60a6a0ad02c8\") " pod="ai-tenant-e2e-shared-b-12921d/auth-test-model-12921d-kserve-66746b6999-m9g26"
Jul 03 10:22:16.596095 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:22:16.596039    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63674b93-75df-402b-8540-60a6a0ad02c8-model-cache\") pod \"auth-test-model-12921d-kserve-66746b6999-m9g26\" (UID: \"63674b93-75df-402b-8540-60a6a0ad02c8\") " pod="ai-tenant-e2e-shared-b-12921d/auth-test-model-12921d-kserve-66746b6999-m9g26"
Jul 03 10:22:16.596235 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:22:16.596113    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63674b93-75df-402b-8540-60a6a0ad02c8-dshm\") pod \"auth-test-model-12921d-kserve-66746b6999-m9g26\" (UID: \"63674b93-75df-402b-8540-60a6a0ad02c8\") " pod="ai-tenant-e2e-shared-b-12921d/auth-test-model-12921d-kserve-66746b6999-m9g26"
Jul 03 10:22:16.697476 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:22:16.697442    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63674b93-75df-402b-8540-60a6a0ad02c8-model-cache\") pod \"auth-test-model-12921d-kserve-66746b6999-m9g26\" (UID: \"63674b93-75df-402b-8540-60a6a0ad02c8\") " pod="ai-tenant-e2e-shared-b-12921d/auth-test-model-12921d-kserve-66746b6999-m9g26"
Jul 03 10:22:16.697699 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:22:16.697510    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63674b93-75df-402b-8540-60a6a0ad02c8-dshm\") pod \"auth-test-model-12921d-kserve-66746b6999-m9g26\" (UID: \"63674b93-75df-402b-8540-60a6a0ad02c8\") " pod="ai-tenant-e2e-shared-b-12921d/auth-test-model-12921d-kserve-66746b6999-m9g26"
Jul 03 10:22:16.697699 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:22:16.697570    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6lxw\" (UniqueName: \"kubernetes.io/projected/63674b93-75df-402b-8540-60a6a0ad02c8-kube-api-access-p6lxw\") pod \"auth-test-model-12921d-kserve-66746b6999-m9g26\" (UID: \"63674b93-75df-402b-8540-60a6a0ad02c8\") " pod="ai-tenant-e2e-shared-b-12921d/auth-test-model-12921d-kserve-66746b6999-m9g26"
Jul 03 10:22:16.697699 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:22:16.697596    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63674b93-75df-402b-8540-60a6a0ad02c8-tls-certs\") pod \"auth-test-model-12921d-kserve-66746b6999-m9g26\" (UID: \"63674b93-75df-402b-8540-60a6a0ad02c8\") " pod="ai-tenant-e2e-shared-b-12921d/auth-test-model-12921d-kserve-66746b6999-m9g26"
Jul 03 10:22:16.697699 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:22:16.697617    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63674b93-75df-402b-8540-60a6a0ad02c8-tmp-dir\") pod \"auth-test-model-12921d-kserve-66746b6999-m9g26\" (UID: \"63674b93-75df-402b-8540-60a6a0ad02c8\") " pod="ai-tenant-e2e-shared-b-12921d/auth-test-model-12921d-kserve-66746b6999-m9g26"
Jul 03 10:22:16.697699 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:22:16.697638    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63674b93-75df-402b-8540-60a6a0ad02c8-home\") pod \"auth-test-model-12921d-kserve-66746b6999-m9g26\" (UID: \"63674b93-75df-402b-8540-60a6a0ad02c8\") " pod="ai-tenant-e2e-shared-b-12921d/auth-test-model-12921d-kserve-66746b6999-m9g26"
Jul 03 10:22:16.697966 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:22:16.697911    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63674b93-75df-402b-8540-60a6a0ad02c8-model-cache\") pod \"auth-test-model-12921d-kserve-66746b6999-m9g26\" (UID: \"63674b93-75df-402b-8540-60a6a0ad02c8\") " pod="ai-tenant-e2e-shared-b-12921d/auth-test-model-12921d-kserve-66746b6999-m9g26"
Jul 03 10:22:16.698022 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:22:16.698001    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63674b93-75df-402b-8540-60a6a0ad02c8-home\") pod \"auth-test-model-12921d-kserve-66746b6999-m9g26\" (UID: \"63674b93-75df-402b-8540-60a6a0ad02c8\") " pod="ai-tenant-e2e-shared-b-12921d/auth-test-model-12921d-kserve-66746b6999-m9g26"
Jul 03 10:22:16.698059 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:22:16.698035    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63674b93-75df-402b-8540-60a6a0ad02c8-tmp-dir\") pod \"auth-test-model-12921d-kserve-66746b6999-m9g26\" (UID: \"63674b93-75df-402b-8540-60a6a0ad02c8\") " pod="ai-tenant-e2e-shared-b-12921d/auth-test-model-12921d-kserve-66746b6999-m9g26"
Jul 03 10:22:16.699986 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:22:16.699964    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63674b93-75df-402b-8540-60a6a0ad02c8-dshm\") pod \"auth-test-model-12921d-kserve-66746b6999-m9g26\" (UID: \"63674b93-75df-402b-8540-60a6a0ad02c8\") " pod="ai-tenant-e2e-shared-b-12921d/auth-test-model-12921d-kserve-66746b6999-m9g26"
Jul 03 10:22:16.700248 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:22:16.700230    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63674b93-75df-402b-8540-60a6a0ad02c8-tls-certs\") pod \"auth-test-model-12921d-kserve-66746b6999-m9g26\" (UID: \"63674b93-75df-402b-8540-60a6a0ad02c8\") " pod="ai-tenant-e2e-shared-b-12921d/auth-test-model-12921d-kserve-66746b6999-m9g26"
Jul 03 10:22:16.706690 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:22:16.706671    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6lxw\" (UniqueName: \"kubernetes.io/projected/63674b93-75df-402b-8540-60a6a0ad02c8-kube-api-access-p6lxw\") pod \"auth-test-model-12921d-kserve-66746b6999-m9g26\" (UID: \"63674b93-75df-402b-8540-60a6a0ad02c8\") " pod="ai-tenant-e2e-shared-b-12921d/auth-test-model-12921d-kserve-66746b6999-m9g26"
Jul 03 10:22:16.827681 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:22:16.827595    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-12921d/auth-test-model-12921d-kserve-66746b6999-m9g26"
Jul 03 10:22:16.965874 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:22:16.965850    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-12921d/auth-test-model-12921d-kserve-66746b6999-m9g26"]
Jul 03 10:22:16.968018 ip-10-0-131-117 kubenswrapper[2559]: W0703 10:22:16.967990    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63674b93_75df_402b_8540_60a6a0ad02c8.slice/crio-a19a521f7ed8ab886160dc60caee3e352830425828e981fa9d12508bb62ce35c WatchSource:0}: Error finding container a19a521f7ed8ab886160dc60caee3e352830425828e981fa9d12508bb62ce35c: Status 404 returned error can't find the container with id a19a521f7ed8ab886160dc60caee3e352830425828e981fa9d12508bb62ce35c
Jul 03 10:22:17.868860 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:22:17.868829    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-12921d/auth-test-model-12921d-kserve-66746b6999-m9g26" event={"ID":"63674b93-75df-402b-8540-60a6a0ad02c8","Type":"ContainerStarted","Data":"8517ec4f5b30c0f7f70845b5d1a098786ddee0109c44787d066b039f26c31425"}
Jul 03 10:22:17.869244 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:22:17.868873    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-12921d/auth-test-model-12921d-kserve-66746b6999-m9g26" event={"ID":"63674b93-75df-402b-8540-60a6a0ad02c8","Type":"ContainerStarted","Data":"a19a521f7ed8ab886160dc60caee3e352830425828e981fa9d12508bb62ce35c"}
Jul 03 10:22:17.891449 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:22:17.891403    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-12921d/auth-test-model-12921d-kserve-66746b6999-m9g26" podStartSLOduration=1.891387787 podStartE2EDuration="1.891387787s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 10:22:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 10:22:17.88909591 +0000 UTC m=+2338.759761536" watchObservedRunningTime="2026-07-03 10:22:17.891387787 +0000 UTC m=+2338.762053435"
Jul 03 10:22:26.828167 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:22:26.828129    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-12921d/auth-test-model-12921d-kserve-66746b6999-m9g26"
Jul 03 10:22:26.828683 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:22:26.828186    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-12921d/auth-test-model-12921d-kserve-66746b6999-m9g26"
Jul 03 10:22:26.840680 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:22:26.840655    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-12921d/auth-test-model-12921d-kserve-66746b6999-m9g26"
Jul 03 10:22:26.923479 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:22:26.923455    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-12921d/auth-test-model-12921d-kserve-66746b6999-m9g26"
Jul 03 10:23:19.743936 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:23:19.743903    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c4mdt_9d052bc8-d41a-494c-9523-5bfdcfb29ec2/console-operator/2.log"
Jul 03 10:23:19.755513 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:23:19.755488    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c4mdt_9d052bc8-d41a-494c-9523-5bfdcfb29ec2/console-operator/2.log"
Jul 03 10:24:10.703700 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:24:10.703617    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-12921d/auth-test-model-12921d-kserve-66746b6999-m9g26"]
Jul 03 10:24:25.724730 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:24:25.724692    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-12921d/auth-test-model-12921d-kserve-66746b6999-m9g26" podUID="63674b93-75df-402b-8540-60a6a0ad02c8" containerName="main" containerID="cri-o://8517ec4f5b30c0f7f70845b5d1a098786ddee0109c44787d066b039f26c31425" gracePeriod=45
Jul 03 10:24:25.729736 ip-10-0-131-117 kubenswrapper[2559]: E0703 10:24:25.729709    2559 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63674b93_75df_402b_8540_60a6a0ad02c8.slice/crio-8517ec4f5b30c0f7f70845b5d1a098786ddee0109c44787d066b039f26c31425.scope\": RecentStats: unable to find data in memory cache]"
Jul 03 10:24:25.973181 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:24:25.973156    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-12921d/auth-test-model-12921d-kserve-66746b6999-m9g26"
Jul 03 10:24:26.041977 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:24:26.041891    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63674b93-75df-402b-8540-60a6a0ad02c8-dshm\") pod \"63674b93-75df-402b-8540-60a6a0ad02c8\" (UID: \"63674b93-75df-402b-8540-60a6a0ad02c8\") "
Jul 03 10:24:26.041977 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:24:26.041945    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63674b93-75df-402b-8540-60a6a0ad02c8-model-cache\") pod \"63674b93-75df-402b-8540-60a6a0ad02c8\" (UID: \"63674b93-75df-402b-8540-60a6a0ad02c8\") "
Jul 03 10:24:26.042210 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:24:26.041982    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63674b93-75df-402b-8540-60a6a0ad02c8-home\") pod \"63674b93-75df-402b-8540-60a6a0ad02c8\" (UID: \"63674b93-75df-402b-8540-60a6a0ad02c8\") "
Jul 03 10:24:26.042210 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:24:26.042018    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63674b93-75df-402b-8540-60a6a0ad02c8-tmp-dir\") pod \"63674b93-75df-402b-8540-60a6a0ad02c8\" (UID: \"63674b93-75df-402b-8540-60a6a0ad02c8\") "
Jul 03 10:24:26.042210 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:24:26.042055    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6lxw\" (UniqueName: \"kubernetes.io/projected/63674b93-75df-402b-8540-60a6a0ad02c8-kube-api-access-p6lxw\") pod \"63674b93-75df-402b-8540-60a6a0ad02c8\" (UID: \"63674b93-75df-402b-8540-60a6a0ad02c8\") "
Jul 03 10:24:26.042210 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:24:26.042079    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63674b93-75df-402b-8540-60a6a0ad02c8-tls-certs\") pod \"63674b93-75df-402b-8540-60a6a0ad02c8\" (UID: \"63674b93-75df-402b-8540-60a6a0ad02c8\") "
Jul 03 10:24:26.042414 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:24:26.042219    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63674b93-75df-402b-8540-60a6a0ad02c8-home" (OuterVolumeSpecName: "home") pod "63674b93-75df-402b-8540-60a6a0ad02c8" (UID: "63674b93-75df-402b-8540-60a6a0ad02c8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:24:26.042414 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:24:26.042254    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63674b93-75df-402b-8540-60a6a0ad02c8-model-cache" (OuterVolumeSpecName: "model-cache") pod "63674b93-75df-402b-8540-60a6a0ad02c8" (UID: "63674b93-75df-402b-8540-60a6a0ad02c8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:24:26.042414 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:24:26.042275    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63674b93-75df-402b-8540-60a6a0ad02c8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "63674b93-75df-402b-8540-60a6a0ad02c8" (UID: "63674b93-75df-402b-8540-60a6a0ad02c8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:24:26.042608 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:24:26.042415    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63674b93-75df-402b-8540-60a6a0ad02c8-model-cache\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:24:26.042608 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:24:26.042433    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63674b93-75df-402b-8540-60a6a0ad02c8-home\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:24:26.042608 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:24:26.042447    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63674b93-75df-402b-8540-60a6a0ad02c8-tmp-dir\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:24:26.044322 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:24:26.044300    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63674b93-75df-402b-8540-60a6a0ad02c8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "63674b93-75df-402b-8540-60a6a0ad02c8" (UID: "63674b93-75df-402b-8540-60a6a0ad02c8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 10:24:26.044425 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:24:26.044339    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63674b93-75df-402b-8540-60a6a0ad02c8-dshm" (OuterVolumeSpecName: "dshm") pod "63674b93-75df-402b-8540-60a6a0ad02c8" (UID: "63674b93-75df-402b-8540-60a6a0ad02c8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:24:26.044425 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:24:26.044363    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63674b93-75df-402b-8540-60a6a0ad02c8-kube-api-access-p6lxw" (OuterVolumeSpecName: "kube-api-access-p6lxw") pod "63674b93-75df-402b-8540-60a6a0ad02c8" (UID: "63674b93-75df-402b-8540-60a6a0ad02c8"). InnerVolumeSpecName "kube-api-access-p6lxw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 10:24:26.143032 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:24:26.142991    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6lxw\" (UniqueName: \"kubernetes.io/projected/63674b93-75df-402b-8540-60a6a0ad02c8-kube-api-access-p6lxw\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:24:26.143032 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:24:26.143027    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63674b93-75df-402b-8540-60a6a0ad02c8-tls-certs\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:24:26.143032 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:24:26.143037    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63674b93-75df-402b-8540-60a6a0ad02c8-dshm\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:24:26.488060 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:24:26.488026    2559 generic.go:356] "Generic (PLEG): container finished" podID="63674b93-75df-402b-8540-60a6a0ad02c8" containerID="8517ec4f5b30c0f7f70845b5d1a098786ddee0109c44787d066b039f26c31425" exitCode=0
Jul 03 10:24:26.488243 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:24:26.488068    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-12921d/auth-test-model-12921d-kserve-66746b6999-m9g26" event={"ID":"63674b93-75df-402b-8540-60a6a0ad02c8","Type":"ContainerDied","Data":"8517ec4f5b30c0f7f70845b5d1a098786ddee0109c44787d066b039f26c31425"}
Jul 03 10:24:26.488243 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:24:26.488071    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-12921d/auth-test-model-12921d-kserve-66746b6999-m9g26"
Jul 03 10:24:26.488243 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:24:26.488108    2559 scope.go:117] "RemoveContainer" containerID="8517ec4f5b30c0f7f70845b5d1a098786ddee0109c44787d066b039f26c31425"
Jul 03 10:24:26.488243 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:24:26.488097    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-12921d/auth-test-model-12921d-kserve-66746b6999-m9g26" event={"ID":"63674b93-75df-402b-8540-60a6a0ad02c8","Type":"ContainerDied","Data":"a19a521f7ed8ab886160dc60caee3e352830425828e981fa9d12508bb62ce35c"}
Jul 03 10:24:26.497768 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:24:26.497750    2559 scope.go:117] "RemoveContainer" containerID="8517ec4f5b30c0f7f70845b5d1a098786ddee0109c44787d066b039f26c31425"
Jul 03 10:24:26.498030 ip-10-0-131-117 kubenswrapper[2559]: E0703 10:24:26.498011    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8517ec4f5b30c0f7f70845b5d1a098786ddee0109c44787d066b039f26c31425\": container with ID starting with 8517ec4f5b30c0f7f70845b5d1a098786ddee0109c44787d066b039f26c31425 not found: ID does not exist" containerID="8517ec4f5b30c0f7f70845b5d1a098786ddee0109c44787d066b039f26c31425"
Jul 03 10:24:26.498080 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:24:26.498039    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8517ec4f5b30c0f7f70845b5d1a098786ddee0109c44787d066b039f26c31425"} err="failed to get container status \"8517ec4f5b30c0f7f70845b5d1a098786ddee0109c44787d066b039f26c31425\": rpc error: code = NotFound desc = could not find container \"8517ec4f5b30c0f7f70845b5d1a098786ddee0109c44787d066b039f26c31425\": container with ID starting with 8517ec4f5b30c0f7f70845b5d1a098786ddee0109c44787d066b039f26c31425 not found: ID does not exist"
Jul 03 10:24:26.517307 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:24:26.517276    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-12921d/auth-test-model-12921d-kserve-66746b6999-m9g26"]
Jul 03 10:24:26.530770 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:24:26.525537    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-12921d/auth-test-model-12921d-kserve-66746b6999-m9g26"]
Jul 03 10:24:27.690940 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:24:27.690909    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63674b93-75df-402b-8540-60a6a0ad02c8" path="/var/lib/kubelet/pods/63674b93-75df-402b-8540-60a6a0ad02c8/volumes"
Jul 03 10:25:06.808709 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:25:06.808677    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-12921d/sub-test-model-12921d-kserve-798dd5b9f7-9b5nq"]
Jul 03 10:25:06.809180 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:25:06.809052    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63674b93-75df-402b-8540-60a6a0ad02c8" containerName="main"
Jul 03 10:25:06.809180 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:25:06.809062    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="63674b93-75df-402b-8540-60a6a0ad02c8" containerName="main"
Jul 03 10:25:06.809180 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:25:06.809131    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="63674b93-75df-402b-8540-60a6a0ad02c8" containerName="main"
Jul 03 10:25:06.812123 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:25:06.812108    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-12921d/sub-test-model-12921d-kserve-798dd5b9f7-9b5nq"
Jul 03 10:25:06.815921 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:25:06.815901    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-12921d\"/\"default-dockercfg-5hqjb\""
Jul 03 10:25:06.815921 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:25:06.815909    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-12921d\"/\"openshift-service-ca.crt\""
Jul 03 10:25:06.816112 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:25:06.815933    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-12921d\"/\"kube-root-ca.crt\""
Jul 03 10:25:06.816112 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:25:06.815958    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-12921d\"/\"sub-test-model-12921d-kserve-self-signed-certs\""
Jul 03 10:25:06.823733 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:25:06.823710    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-12921d/sub-test-model-12921d-kserve-798dd5b9f7-9b5nq"]
Jul 03 10:25:06.922473 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:25:06.922442    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69fcfe20-870d-4a97-ac9c-8462b912519a-dshm\") pod \"sub-test-model-12921d-kserve-798dd5b9f7-9b5nq\" (UID: \"69fcfe20-870d-4a97-ac9c-8462b912519a\") " pod="ai-tenant-e2e-shared-b-12921d/sub-test-model-12921d-kserve-798dd5b9f7-9b5nq"
Jul 03 10:25:06.922659 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:25:06.922482    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69fcfe20-870d-4a97-ac9c-8462b912519a-tls-certs\") pod \"sub-test-model-12921d-kserve-798dd5b9f7-9b5nq\" (UID: \"69fcfe20-870d-4a97-ac9c-8462b912519a\") " pod="ai-tenant-e2e-shared-b-12921d/sub-test-model-12921d-kserve-798dd5b9f7-9b5nq"
Jul 03 10:25:06.922659 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:25:06.922509    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69fcfe20-870d-4a97-ac9c-8462b912519a-tmp-dir\") pod \"sub-test-model-12921d-kserve-798dd5b9f7-9b5nq\" (UID: \"69fcfe20-870d-4a97-ac9c-8462b912519a\") " pod="ai-tenant-e2e-shared-b-12921d/sub-test-model-12921d-kserve-798dd5b9f7-9b5nq"
Jul 03 10:25:06.922659 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:25:06.922593    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp9hx\" (UniqueName: \"kubernetes.io/projected/69fcfe20-870d-4a97-ac9c-8462b912519a-kube-api-access-hp9hx\") pod \"sub-test-model-12921d-kserve-798dd5b9f7-9b5nq\" (UID: \"69fcfe20-870d-4a97-ac9c-8462b912519a\") " pod="ai-tenant-e2e-shared-b-12921d/sub-test-model-12921d-kserve-798dd5b9f7-9b5nq"
Jul 03 10:25:06.922825 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:25:06.922657    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69fcfe20-870d-4a97-ac9c-8462b912519a-model-cache\") pod \"sub-test-model-12921d-kserve-798dd5b9f7-9b5nq\" (UID: \"69fcfe20-870d-4a97-ac9c-8462b912519a\") " pod="ai-tenant-e2e-shared-b-12921d/sub-test-model-12921d-kserve-798dd5b9f7-9b5nq"
Jul 03 10:25:06.922825 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:25:06.922678    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69fcfe20-870d-4a97-ac9c-8462b912519a-home\") pod \"sub-test-model-12921d-kserve-798dd5b9f7-9b5nq\" (UID: \"69fcfe20-870d-4a97-ac9c-8462b912519a\") " pod="ai-tenant-e2e-shared-b-12921d/sub-test-model-12921d-kserve-798dd5b9f7-9b5nq"
Jul 03 10:25:07.024300 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:25:07.024262    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69fcfe20-870d-4a97-ac9c-8462b912519a-dshm\") pod \"sub-test-model-12921d-kserve-798dd5b9f7-9b5nq\" (UID: \"69fcfe20-870d-4a97-ac9c-8462b912519a\") " pod="ai-tenant-e2e-shared-b-12921d/sub-test-model-12921d-kserve-798dd5b9f7-9b5nq"
Jul 03 10:25:07.024510 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:25:07.024315    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69fcfe20-870d-4a97-ac9c-8462b912519a-tls-certs\") pod \"sub-test-model-12921d-kserve-798dd5b9f7-9b5nq\" (UID: \"69fcfe20-870d-4a97-ac9c-8462b912519a\") " pod="ai-tenant-e2e-shared-b-12921d/sub-test-model-12921d-kserve-798dd5b9f7-9b5nq"
Jul 03 10:25:07.024510 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:25:07.024389    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69fcfe20-870d-4a97-ac9c-8462b912519a-tmp-dir\") pod \"sub-test-model-12921d-kserve-798dd5b9f7-9b5nq\" (UID: \"69fcfe20-870d-4a97-ac9c-8462b912519a\") " pod="ai-tenant-e2e-shared-b-12921d/sub-test-model-12921d-kserve-798dd5b9f7-9b5nq"
Jul 03 10:25:07.024510 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:25:07.024434    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp9hx\" (UniqueName: \"kubernetes.io/projected/69fcfe20-870d-4a97-ac9c-8462b912519a-kube-api-access-hp9hx\") pod \"sub-test-model-12921d-kserve-798dd5b9f7-9b5nq\" (UID: \"69fcfe20-870d-4a97-ac9c-8462b912519a\") " pod="ai-tenant-e2e-shared-b-12921d/sub-test-model-12921d-kserve-798dd5b9f7-9b5nq"
Jul 03 10:25:07.024510 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:25:07.024484    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69fcfe20-870d-4a97-ac9c-8462b912519a-model-cache\") pod \"sub-test-model-12921d-kserve-798dd5b9f7-9b5nq\" (UID: \"69fcfe20-870d-4a97-ac9c-8462b912519a\") " pod="ai-tenant-e2e-shared-b-12921d/sub-test-model-12921d-kserve-798dd5b9f7-9b5nq"
Jul 03 10:25:07.024510 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:25:07.024504    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69fcfe20-870d-4a97-ac9c-8462b912519a-home\") pod \"sub-test-model-12921d-kserve-798dd5b9f7-9b5nq\" (UID: \"69fcfe20-870d-4a97-ac9c-8462b912519a\") " pod="ai-tenant-e2e-shared-b-12921d/sub-test-model-12921d-kserve-798dd5b9f7-9b5nq"
Jul 03 10:25:07.024848 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:25:07.024831    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69fcfe20-870d-4a97-ac9c-8462b912519a-tmp-dir\") pod \"sub-test-model-12921d-kserve-798dd5b9f7-9b5nq\" (UID: \"69fcfe20-870d-4a97-ac9c-8462b912519a\") " pod="ai-tenant-e2e-shared-b-12921d/sub-test-model-12921d-kserve-798dd5b9f7-9b5nq"
Jul 03 10:25:07.024906 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:25:07.024853    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69fcfe20-870d-4a97-ac9c-8462b912519a-model-cache\") pod \"sub-test-model-12921d-kserve-798dd5b9f7-9b5nq\" (UID: \"69fcfe20-870d-4a97-ac9c-8462b912519a\") " pod="ai-tenant-e2e-shared-b-12921d/sub-test-model-12921d-kserve-798dd5b9f7-9b5nq"
Jul 03 10:25:07.024963 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:25:07.024921    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69fcfe20-870d-4a97-ac9c-8462b912519a-home\") pod \"sub-test-model-12921d-kserve-798dd5b9f7-9b5nq\" (UID: \"69fcfe20-870d-4a97-ac9c-8462b912519a\") " pod="ai-tenant-e2e-shared-b-12921d/sub-test-model-12921d-kserve-798dd5b9f7-9b5nq"
Jul 03 10:25:07.026691 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:25:07.026671    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69fcfe20-870d-4a97-ac9c-8462b912519a-dshm\") pod \"sub-test-model-12921d-kserve-798dd5b9f7-9b5nq\" (UID: \"69fcfe20-870d-4a97-ac9c-8462b912519a\") " pod="ai-tenant-e2e-shared-b-12921d/sub-test-model-12921d-kserve-798dd5b9f7-9b5nq"
Jul 03 10:25:07.027076 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:25:07.027055    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69fcfe20-870d-4a97-ac9c-8462b912519a-tls-certs\") pod \"sub-test-model-12921d-kserve-798dd5b9f7-9b5nq\" (UID: \"69fcfe20-870d-4a97-ac9c-8462b912519a\") " pod="ai-tenant-e2e-shared-b-12921d/sub-test-model-12921d-kserve-798dd5b9f7-9b5nq"
Jul 03 10:25:07.033422 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:25:07.033397    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp9hx\" (UniqueName: \"kubernetes.io/projected/69fcfe20-870d-4a97-ac9c-8462b912519a-kube-api-access-hp9hx\") pod \"sub-test-model-12921d-kserve-798dd5b9f7-9b5nq\" (UID: \"69fcfe20-870d-4a97-ac9c-8462b912519a\") " pod="ai-tenant-e2e-shared-b-12921d/sub-test-model-12921d-kserve-798dd5b9f7-9b5nq"
Jul 03 10:25:07.121472 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:25:07.121378    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-12921d/sub-test-model-12921d-kserve-798dd5b9f7-9b5nq"
Jul 03 10:25:07.260332 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:25:07.260305    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-12921d/sub-test-model-12921d-kserve-798dd5b9f7-9b5nq"]
Jul 03 10:25:07.261922 ip-10-0-131-117 kubenswrapper[2559]: W0703 10:25:07.261890    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod69fcfe20_870d_4a97_ac9c_8462b912519a.slice/crio-60413abad6d8bb568120d373e9fbe4f6e61c4ddc04666084962d16f222da48b0 WatchSource:0}: Error finding container 60413abad6d8bb568120d373e9fbe4f6e61c4ddc04666084962d16f222da48b0: Status 404 returned error can't find the container with id 60413abad6d8bb568120d373e9fbe4f6e61c4ddc04666084962d16f222da48b0
Jul 03 10:25:07.684410 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:25:07.684375    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-12921d/sub-test-model-12921d-kserve-798dd5b9f7-9b5nq" event={"ID":"69fcfe20-870d-4a97-ac9c-8462b912519a","Type":"ContainerStarted","Data":"7549df33f6b34111512ec72619f296c13666ba766a8e971367e445eb39887b6f"}
Jul 03 10:25:07.684626 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:25:07.684418    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-12921d/sub-test-model-12921d-kserve-798dd5b9f7-9b5nq" event={"ID":"69fcfe20-870d-4a97-ac9c-8462b912519a","Type":"ContainerStarted","Data":"60413abad6d8bb568120d373e9fbe4f6e61c4ddc04666084962d16f222da48b0"}
Jul 03 10:25:07.704107 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:25:07.704059    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-12921d/sub-test-model-12921d-kserve-798dd5b9f7-9b5nq" podStartSLOduration=1.704040666 podStartE2EDuration="1.704040666s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 10:25:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 10:25:07.701947875 +0000 UTC m=+2508.572613502" watchObservedRunningTime="2026-07-03 10:25:07.704040666 +0000 UTC m=+2508.574706294"
Jul 03 10:25:17.122174 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:25:17.122084    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-12921d/sub-test-model-12921d-kserve-798dd5b9f7-9b5nq"
Jul 03 10:25:17.122174 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:25:17.122154    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-12921d/sub-test-model-12921d-kserve-798dd5b9f7-9b5nq"
Jul 03 10:25:17.135495 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:25:17.135475    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-12921d/sub-test-model-12921d-kserve-798dd5b9f7-9b5nq"
Jul 03 10:25:17.743875 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:25:17.743837    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-12921d/sub-test-model-12921d-kserve-798dd5b9f7-9b5nq"
Jul 03 10:25:49.918486 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:25:49.918452    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-12921d/sub-test-model-12921d-kserve-798dd5b9f7-9b5nq"]
Jul 03 10:26:04.941065 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:04.941004    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-12921d/sub-test-model-12921d-kserve-798dd5b9f7-9b5nq" podUID="69fcfe20-870d-4a97-ac9c-8462b912519a" containerName="main" containerID="cri-o://7549df33f6b34111512ec72619f296c13666ba766a8e971367e445eb39887b6f" gracePeriod=45
Jul 03 10:26:05.189075 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:05.189050    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-12921d/sub-test-model-12921d-kserve-798dd5b9f7-9b5nq"
Jul 03 10:26:05.284864 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:05.284785    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69fcfe20-870d-4a97-ac9c-8462b912519a-model-cache\") pod \"69fcfe20-870d-4a97-ac9c-8462b912519a\" (UID: \"69fcfe20-870d-4a97-ac9c-8462b912519a\") "
Jul 03 10:26:05.285032 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:05.284880    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69fcfe20-870d-4a97-ac9c-8462b912519a-tls-certs\") pod \"69fcfe20-870d-4a97-ac9c-8462b912519a\" (UID: \"69fcfe20-870d-4a97-ac9c-8462b912519a\") "
Jul 03 10:26:05.285032 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:05.284902    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69fcfe20-870d-4a97-ac9c-8462b912519a-home\") pod \"69fcfe20-870d-4a97-ac9c-8462b912519a\" (UID: \"69fcfe20-870d-4a97-ac9c-8462b912519a\") "
Jul 03 10:26:05.285032 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:05.284935    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hp9hx\" (UniqueName: \"kubernetes.io/projected/69fcfe20-870d-4a97-ac9c-8462b912519a-kube-api-access-hp9hx\") pod \"69fcfe20-870d-4a97-ac9c-8462b912519a\" (UID: \"69fcfe20-870d-4a97-ac9c-8462b912519a\") "
Jul 03 10:26:05.285180 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:05.285069    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69fcfe20-870d-4a97-ac9c-8462b912519a-dshm\") pod \"69fcfe20-870d-4a97-ac9c-8462b912519a\" (UID: \"69fcfe20-870d-4a97-ac9c-8462b912519a\") "
Jul 03 10:26:05.285180 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:05.285108    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69fcfe20-870d-4a97-ac9c-8462b912519a-tmp-dir\") pod \"69fcfe20-870d-4a97-ac9c-8462b912519a\" (UID: \"69fcfe20-870d-4a97-ac9c-8462b912519a\") "
Jul 03 10:26:05.285180 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:05.285119    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69fcfe20-870d-4a97-ac9c-8462b912519a-model-cache" (OuterVolumeSpecName: "model-cache") pod "69fcfe20-870d-4a97-ac9c-8462b912519a" (UID: "69fcfe20-870d-4a97-ac9c-8462b912519a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:26:05.285180 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:05.285152    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69fcfe20-870d-4a97-ac9c-8462b912519a-home" (OuterVolumeSpecName: "home") pod "69fcfe20-870d-4a97-ac9c-8462b912519a" (UID: "69fcfe20-870d-4a97-ac9c-8462b912519a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:26:05.285421 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:05.285400    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69fcfe20-870d-4a97-ac9c-8462b912519a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "69fcfe20-870d-4a97-ac9c-8462b912519a" (UID: "69fcfe20-870d-4a97-ac9c-8462b912519a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:26:05.285536 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:05.285519    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69fcfe20-870d-4a97-ac9c-8462b912519a-tmp-dir\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:26:05.285797 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:05.285570    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69fcfe20-870d-4a97-ac9c-8462b912519a-model-cache\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:26:05.285797 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:05.285585    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69fcfe20-870d-4a97-ac9c-8462b912519a-home\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:26:05.287276 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:05.287242    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69fcfe20-870d-4a97-ac9c-8462b912519a-dshm" (OuterVolumeSpecName: "dshm") pod "69fcfe20-870d-4a97-ac9c-8462b912519a" (UID: "69fcfe20-870d-4a97-ac9c-8462b912519a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:26:05.287394 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:05.287298    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69fcfe20-870d-4a97-ac9c-8462b912519a-kube-api-access-hp9hx" (OuterVolumeSpecName: "kube-api-access-hp9hx") pod "69fcfe20-870d-4a97-ac9c-8462b912519a" (UID: "69fcfe20-870d-4a97-ac9c-8462b912519a"). InnerVolumeSpecName "kube-api-access-hp9hx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 10:26:05.287394 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:05.287319    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69fcfe20-870d-4a97-ac9c-8462b912519a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "69fcfe20-870d-4a97-ac9c-8462b912519a" (UID: "69fcfe20-870d-4a97-ac9c-8462b912519a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 10:26:05.386518 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:05.386487    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hp9hx\" (UniqueName: \"kubernetes.io/projected/69fcfe20-870d-4a97-ac9c-8462b912519a-kube-api-access-hp9hx\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:26:05.386518 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:05.386514    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69fcfe20-870d-4a97-ac9c-8462b912519a-dshm\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:26:05.386518 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:05.386525    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69fcfe20-870d-4a97-ac9c-8462b912519a-tls-certs\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:26:05.966695 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:05.966609    2559 generic.go:356] "Generic (PLEG): container finished" podID="69fcfe20-870d-4a97-ac9c-8462b912519a" containerID="7549df33f6b34111512ec72619f296c13666ba766a8e971367e445eb39887b6f" exitCode=0
Jul 03 10:26:05.966695 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:05.966651    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-12921d/sub-test-model-12921d-kserve-798dd5b9f7-9b5nq"
Jul 03 10:26:05.967223 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:05.966700    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-12921d/sub-test-model-12921d-kserve-798dd5b9f7-9b5nq" event={"ID":"69fcfe20-870d-4a97-ac9c-8462b912519a","Type":"ContainerDied","Data":"7549df33f6b34111512ec72619f296c13666ba766a8e971367e445eb39887b6f"}
Jul 03 10:26:05.967223 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:05.966749    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-12921d/sub-test-model-12921d-kserve-798dd5b9f7-9b5nq" event={"ID":"69fcfe20-870d-4a97-ac9c-8462b912519a","Type":"ContainerDied","Data":"60413abad6d8bb568120d373e9fbe4f6e61c4ddc04666084962d16f222da48b0"}
Jul 03 10:26:05.967223 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:05.966775    2559 scope.go:117] "RemoveContainer" containerID="7549df33f6b34111512ec72619f296c13666ba766a8e971367e445eb39887b6f"
Jul 03 10:26:05.975630 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:05.975622    2559 scope.go:117] "RemoveContainer" containerID="7549df33f6b34111512ec72619f296c13666ba766a8e971367e445eb39887b6f"
Jul 03 10:26:05.975890 ip-10-0-131-117 kubenswrapper[2559]: E0703 10:26:05.975859    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7549df33f6b34111512ec72619f296c13666ba766a8e971367e445eb39887b6f\": container with ID starting with 7549df33f6b34111512ec72619f296c13666ba766a8e971367e445eb39887b6f not found: ID does not exist" containerID="7549df33f6b34111512ec72619f296c13666ba766a8e971367e445eb39887b6f"
Jul 03 10:26:05.975955 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:05.975887    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7549df33f6b34111512ec72619f296c13666ba766a8e971367e445eb39887b6f"} err="failed to get container status \"7549df33f6b34111512ec72619f296c13666ba766a8e971367e445eb39887b6f\": rpc error: code = NotFound desc = could not find container \"7549df33f6b34111512ec72619f296c13666ba766a8e971367e445eb39887b6f\": container with ID starting with 7549df33f6b34111512ec72619f296c13666ba766a8e971367e445eb39887b6f not found: ID does not exist"
Jul 03 10:26:05.984522 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:05.984498    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-12921d/sub-test-model-12921d-kserve-798dd5b9f7-9b5nq"]
Jul 03 10:26:05.991701 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:05.991681    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-12921d/sub-test-model-12921d-kserve-798dd5b9f7-9b5nq"]
Jul 03 10:26:07.691301 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:07.691264    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69fcfe20-870d-4a97-ac9c-8462b912519a" path="/var/lib/kubelet/pods/69fcfe20-870d-4a97-ac9c-8462b912519a/volumes"
Jul 03 10:26:15.212411 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:15.212380    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-12921d/rate-test-model-12921d-kserve-5c8557746c-zxlql"]
Jul 03 10:26:15.212897 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:15.212803    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69fcfe20-870d-4a97-ac9c-8462b912519a" containerName="main"
Jul 03 10:26:15.212897 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:15.212816    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="69fcfe20-870d-4a97-ac9c-8462b912519a" containerName="main"
Jul 03 10:26:15.212897 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:15.212898    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="69fcfe20-870d-4a97-ac9c-8462b912519a" containerName="main"
Jul 03 10:26:15.217196 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:15.217179    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-12921d/rate-test-model-12921d-kserve-5c8557746c-zxlql"
Jul 03 10:26:15.220815 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:15.220793    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-12921d\"/\"default-dockercfg-5hqjb\""
Jul 03 10:26:15.220936 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:15.220827    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-12921d\"/\"kube-root-ca.crt\""
Jul 03 10:26:15.220936 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:15.220799    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-12921d\"/\"openshift-service-ca.crt\""
Jul 03 10:26:15.220936 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:15.220793    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-12921d\"/\"rate-test-model-12921d-kserve-self-signed-certs\""
Jul 03 10:26:15.230332 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:15.230285    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-12921d/rate-test-model-12921d-kserve-5c8557746c-zxlql"]
Jul 03 10:26:15.272282 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:15.272256    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d0209f5-1fc3-4c7c-b00b-128291438ec3-dshm\") pod \"rate-test-model-12921d-kserve-5c8557746c-zxlql\" (UID: \"9d0209f5-1fc3-4c7c-b00b-128291438ec3\") " pod="ai-tenant-e2e-shared-b-12921d/rate-test-model-12921d-kserve-5c8557746c-zxlql"
Jul 03 10:26:15.272282 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:15.272289    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d0209f5-1fc3-4c7c-b00b-128291438ec3-tls-certs\") pod \"rate-test-model-12921d-kserve-5c8557746c-zxlql\" (UID: \"9d0209f5-1fc3-4c7c-b00b-128291438ec3\") " pod="ai-tenant-e2e-shared-b-12921d/rate-test-model-12921d-kserve-5c8557746c-zxlql"
Jul 03 10:26:15.272510 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:15.272332    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d0209f5-1fc3-4c7c-b00b-128291438ec3-model-cache\") pod \"rate-test-model-12921d-kserve-5c8557746c-zxlql\" (UID: \"9d0209f5-1fc3-4c7c-b00b-128291438ec3\") " pod="ai-tenant-e2e-shared-b-12921d/rate-test-model-12921d-kserve-5c8557746c-zxlql"
Jul 03 10:26:15.272510 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:15.272357    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjpb9\" (UniqueName: \"kubernetes.io/projected/9d0209f5-1fc3-4c7c-b00b-128291438ec3-kube-api-access-jjpb9\") pod \"rate-test-model-12921d-kserve-5c8557746c-zxlql\" (UID: \"9d0209f5-1fc3-4c7c-b00b-128291438ec3\") " pod="ai-tenant-e2e-shared-b-12921d/rate-test-model-12921d-kserve-5c8557746c-zxlql"
Jul 03 10:26:15.272510 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:15.272382    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d0209f5-1fc3-4c7c-b00b-128291438ec3-home\") pod \"rate-test-model-12921d-kserve-5c8557746c-zxlql\" (UID: \"9d0209f5-1fc3-4c7c-b00b-128291438ec3\") " pod="ai-tenant-e2e-shared-b-12921d/rate-test-model-12921d-kserve-5c8557746c-zxlql"
Jul 03 10:26:15.272510 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:15.272453    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d0209f5-1fc3-4c7c-b00b-128291438ec3-tmp-dir\") pod \"rate-test-model-12921d-kserve-5c8557746c-zxlql\" (UID: \"9d0209f5-1fc3-4c7c-b00b-128291438ec3\") " pod="ai-tenant-e2e-shared-b-12921d/rate-test-model-12921d-kserve-5c8557746c-zxlql"
Jul 03 10:26:15.373423 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:15.373387    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d0209f5-1fc3-4c7c-b00b-128291438ec3-tmp-dir\") pod \"rate-test-model-12921d-kserve-5c8557746c-zxlql\" (UID: \"9d0209f5-1fc3-4c7c-b00b-128291438ec3\") " pod="ai-tenant-e2e-shared-b-12921d/rate-test-model-12921d-kserve-5c8557746c-zxlql"
Jul 03 10:26:15.373646 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:15.373518    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d0209f5-1fc3-4c7c-b00b-128291438ec3-dshm\") pod \"rate-test-model-12921d-kserve-5c8557746c-zxlql\" (UID: \"9d0209f5-1fc3-4c7c-b00b-128291438ec3\") " pod="ai-tenant-e2e-shared-b-12921d/rate-test-model-12921d-kserve-5c8557746c-zxlql"
Jul 03 10:26:15.373646 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:15.373561    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d0209f5-1fc3-4c7c-b00b-128291438ec3-tls-certs\") pod \"rate-test-model-12921d-kserve-5c8557746c-zxlql\" (UID: \"9d0209f5-1fc3-4c7c-b00b-128291438ec3\") " pod="ai-tenant-e2e-shared-b-12921d/rate-test-model-12921d-kserve-5c8557746c-zxlql"
Jul 03 10:26:15.373646 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:15.373606    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d0209f5-1fc3-4c7c-b00b-128291438ec3-model-cache\") pod \"rate-test-model-12921d-kserve-5c8557746c-zxlql\" (UID: \"9d0209f5-1fc3-4c7c-b00b-128291438ec3\") " pod="ai-tenant-e2e-shared-b-12921d/rate-test-model-12921d-kserve-5c8557746c-zxlql"
Jul 03 10:26:15.373646 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:15.373631    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjpb9\" (UniqueName: \"kubernetes.io/projected/9d0209f5-1fc3-4c7c-b00b-128291438ec3-kube-api-access-jjpb9\") pod \"rate-test-model-12921d-kserve-5c8557746c-zxlql\" (UID: \"9d0209f5-1fc3-4c7c-b00b-128291438ec3\") " pod="ai-tenant-e2e-shared-b-12921d/rate-test-model-12921d-kserve-5c8557746c-zxlql"
Jul 03 10:26:15.373860 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:15.373658    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d0209f5-1fc3-4c7c-b00b-128291438ec3-home\") pod \"rate-test-model-12921d-kserve-5c8557746c-zxlql\" (UID: \"9d0209f5-1fc3-4c7c-b00b-128291438ec3\") " pod="ai-tenant-e2e-shared-b-12921d/rate-test-model-12921d-kserve-5c8557746c-zxlql"
Jul 03 10:26:15.373860 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:15.373782    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d0209f5-1fc3-4c7c-b00b-128291438ec3-tmp-dir\") pod \"rate-test-model-12921d-kserve-5c8557746c-zxlql\" (UID: \"9d0209f5-1fc3-4c7c-b00b-128291438ec3\") " pod="ai-tenant-e2e-shared-b-12921d/rate-test-model-12921d-kserve-5c8557746c-zxlql"
Jul 03 10:26:15.374015 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:15.373993    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d0209f5-1fc3-4c7c-b00b-128291438ec3-model-cache\") pod \"rate-test-model-12921d-kserve-5c8557746c-zxlql\" (UID: \"9d0209f5-1fc3-4c7c-b00b-128291438ec3\") " pod="ai-tenant-e2e-shared-b-12921d/rate-test-model-12921d-kserve-5c8557746c-zxlql"
Jul 03 10:26:15.374075 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:15.374021    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d0209f5-1fc3-4c7c-b00b-128291438ec3-home\") pod \"rate-test-model-12921d-kserve-5c8557746c-zxlql\" (UID: \"9d0209f5-1fc3-4c7c-b00b-128291438ec3\") " pod="ai-tenant-e2e-shared-b-12921d/rate-test-model-12921d-kserve-5c8557746c-zxlql"
Jul 03 10:26:15.375740 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:15.375717    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d0209f5-1fc3-4c7c-b00b-128291438ec3-dshm\") pod \"rate-test-model-12921d-kserve-5c8557746c-zxlql\" (UID: \"9d0209f5-1fc3-4c7c-b00b-128291438ec3\") " pod="ai-tenant-e2e-shared-b-12921d/rate-test-model-12921d-kserve-5c8557746c-zxlql"
Jul 03 10:26:15.376028 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:15.376010    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d0209f5-1fc3-4c7c-b00b-128291438ec3-tls-certs\") pod \"rate-test-model-12921d-kserve-5c8557746c-zxlql\" (UID: \"9d0209f5-1fc3-4c7c-b00b-128291438ec3\") " pod="ai-tenant-e2e-shared-b-12921d/rate-test-model-12921d-kserve-5c8557746c-zxlql"
Jul 03 10:26:15.383942 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:15.383917    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjpb9\" (UniqueName: \"kubernetes.io/projected/9d0209f5-1fc3-4c7c-b00b-128291438ec3-kube-api-access-jjpb9\") pod \"rate-test-model-12921d-kserve-5c8557746c-zxlql\" (UID: \"9d0209f5-1fc3-4c7c-b00b-128291438ec3\") " pod="ai-tenant-e2e-shared-b-12921d/rate-test-model-12921d-kserve-5c8557746c-zxlql"
Jul 03 10:26:15.526856 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:15.526764    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-12921d/rate-test-model-12921d-kserve-5c8557746c-zxlql"
Jul 03 10:26:15.666747 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:15.666722    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-12921d/rate-test-model-12921d-kserve-5c8557746c-zxlql"]
Jul 03 10:26:15.669366 ip-10-0-131-117 kubenswrapper[2559]: W0703 10:26:15.669338    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9d0209f5_1fc3_4c7c_b00b_128291438ec3.slice/crio-efda87aa550abeb4fa41de83e7750d9a201be6193f325b04e67e52361b6fc56f WatchSource:0}: Error finding container efda87aa550abeb4fa41de83e7750d9a201be6193f325b04e67e52361b6fc56f: Status 404 returned error can't find the container with id efda87aa550abeb4fa41de83e7750d9a201be6193f325b04e67e52361b6fc56f
Jul 03 10:26:16.015235 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:16.015198    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-12921d/rate-test-model-12921d-kserve-5c8557746c-zxlql" event={"ID":"9d0209f5-1fc3-4c7c-b00b-128291438ec3","Type":"ContainerStarted","Data":"f91ed472a4a55ca1f6a232f30d1d094bfc42358c5b857fd22312db452ef7b201"}
Jul 03 10:26:16.015450 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:16.015245    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-12921d/rate-test-model-12921d-kserve-5c8557746c-zxlql" event={"ID":"9d0209f5-1fc3-4c7c-b00b-128291438ec3","Type":"ContainerStarted","Data":"efda87aa550abeb4fa41de83e7750d9a201be6193f325b04e67e52361b6fc56f"}
Jul 03 10:26:16.038559 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:16.038509    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-12921d/rate-test-model-12921d-kserve-5c8557746c-zxlql" podStartSLOduration=1.038494349 podStartE2EDuration="1.038494349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 10:26:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 10:26:16.037503418 +0000 UTC m=+2576.908169074" watchObservedRunningTime="2026-07-03 10:26:16.038494349 +0000 UTC m=+2576.909159995"
Jul 03 10:26:25.527294 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:25.527257    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-12921d/rate-test-model-12921d-kserve-5c8557746c-zxlql"
Jul 03 10:26:25.529792 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:25.527336    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-12921d/rate-test-model-12921d-kserve-5c8557746c-zxlql"
Jul 03 10:26:25.540442 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:25.540418    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-12921d/rate-test-model-12921d-kserve-5c8557746c-zxlql"
Jul 03 10:26:26.077187 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:26:26.077159    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-12921d/rate-test-model-12921d-kserve-5c8557746c-zxlql"
Jul 03 10:27:17.051652 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:27:17.051570    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-12921d/rate-test-model-12921d-kserve-5c8557746c-zxlql"]
Jul 03 10:27:32.071436 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:27:32.071395    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-12921d/rate-test-model-12921d-kserve-5c8557746c-zxlql" podUID="9d0209f5-1fc3-4c7c-b00b-128291438ec3" containerName="main" containerID="cri-o://f91ed472a4a55ca1f6a232f30d1d094bfc42358c5b857fd22312db452ef7b201" gracePeriod=45
Jul 03 10:27:32.321061 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:27:32.321031    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-12921d/rate-test-model-12921d-kserve-5c8557746c-zxlql"
Jul 03 10:27:32.383142 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:27:32.383043    2559 generic.go:356] "Generic (PLEG): container finished" podID="9d0209f5-1fc3-4c7c-b00b-128291438ec3" containerID="f91ed472a4a55ca1f6a232f30d1d094bfc42358c5b857fd22312db452ef7b201" exitCode=0
Jul 03 10:27:32.383142 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:27:32.383083    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-12921d/rate-test-model-12921d-kserve-5c8557746c-zxlql"
Jul 03 10:27:32.383142 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:27:32.383121    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-12921d/rate-test-model-12921d-kserve-5c8557746c-zxlql" event={"ID":"9d0209f5-1fc3-4c7c-b00b-128291438ec3","Type":"ContainerDied","Data":"f91ed472a4a55ca1f6a232f30d1d094bfc42358c5b857fd22312db452ef7b201"}
Jul 03 10:27:32.383385 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:27:32.383160    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-12921d/rate-test-model-12921d-kserve-5c8557746c-zxlql" event={"ID":"9d0209f5-1fc3-4c7c-b00b-128291438ec3","Type":"ContainerDied","Data":"efda87aa550abeb4fa41de83e7750d9a201be6193f325b04e67e52361b6fc56f"}
Jul 03 10:27:32.383385 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:27:32.383180    2559 scope.go:117] "RemoveContainer" containerID="f91ed472a4a55ca1f6a232f30d1d094bfc42358c5b857fd22312db452ef7b201"
Jul 03 10:27:32.391829 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:27:32.391799    2559 scope.go:117] "RemoveContainer" containerID="f91ed472a4a55ca1f6a232f30d1d094bfc42358c5b857fd22312db452ef7b201"
Jul 03 10:27:32.392041 ip-10-0-131-117 kubenswrapper[2559]: E0703 10:27:32.392023    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f91ed472a4a55ca1f6a232f30d1d094bfc42358c5b857fd22312db452ef7b201\": container with ID starting with f91ed472a4a55ca1f6a232f30d1d094bfc42358c5b857fd22312db452ef7b201 not found: ID does not exist" containerID="f91ed472a4a55ca1f6a232f30d1d094bfc42358c5b857fd22312db452ef7b201"
Jul 03 10:27:32.392092 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:27:32.392053    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f91ed472a4a55ca1f6a232f30d1d094bfc42358c5b857fd22312db452ef7b201"} err="failed to get container status \"f91ed472a4a55ca1f6a232f30d1d094bfc42358c5b857fd22312db452ef7b201\": rpc error: code = NotFound desc = could not find container \"f91ed472a4a55ca1f6a232f30d1d094bfc42358c5b857fd22312db452ef7b201\": container with ID starting with f91ed472a4a55ca1f6a232f30d1d094bfc42358c5b857fd22312db452ef7b201 not found: ID does not exist"
Jul 03 10:27:32.428596 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:27:32.428568    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d0209f5-1fc3-4c7c-b00b-128291438ec3-tmp-dir\") pod \"9d0209f5-1fc3-4c7c-b00b-128291438ec3\" (UID: \"9d0209f5-1fc3-4c7c-b00b-128291438ec3\") "
Jul 03 10:27:32.428719 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:27:32.428657    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d0209f5-1fc3-4c7c-b00b-128291438ec3-tls-certs\") pod \"9d0209f5-1fc3-4c7c-b00b-128291438ec3\" (UID: \"9d0209f5-1fc3-4c7c-b00b-128291438ec3\") "
Jul 03 10:27:32.428719 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:27:32.428700    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d0209f5-1fc3-4c7c-b00b-128291438ec3-dshm\") pod \"9d0209f5-1fc3-4c7c-b00b-128291438ec3\" (UID: \"9d0209f5-1fc3-4c7c-b00b-128291438ec3\") "
Jul 03 10:27:32.428793 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:27:32.428723    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d0209f5-1fc3-4c7c-b00b-128291438ec3-home\") pod \"9d0209f5-1fc3-4c7c-b00b-128291438ec3\" (UID: \"9d0209f5-1fc3-4c7c-b00b-128291438ec3\") "
Jul 03 10:27:32.428793 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:27:32.428764    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d0209f5-1fc3-4c7c-b00b-128291438ec3-model-cache\") pod \"9d0209f5-1fc3-4c7c-b00b-128291438ec3\" (UID: \"9d0209f5-1fc3-4c7c-b00b-128291438ec3\") "
Jul 03 10:27:32.428885 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:27:32.428794    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjpb9\" (UniqueName: \"kubernetes.io/projected/9d0209f5-1fc3-4c7c-b00b-128291438ec3-kube-api-access-jjpb9\") pod \"9d0209f5-1fc3-4c7c-b00b-128291438ec3\" (UID: \"9d0209f5-1fc3-4c7c-b00b-128291438ec3\") "
Jul 03 10:27:32.428885 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:27:32.428835    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d0209f5-1fc3-4c7c-b00b-128291438ec3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9d0209f5-1fc3-4c7c-b00b-128291438ec3" (UID: "9d0209f5-1fc3-4c7c-b00b-128291438ec3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:27:32.429048 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:27:32.429019    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d0209f5-1fc3-4c7c-b00b-128291438ec3-home" (OuterVolumeSpecName: "home") pod "9d0209f5-1fc3-4c7c-b00b-128291438ec3" (UID: "9d0209f5-1fc3-4c7c-b00b-128291438ec3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:27:32.429179 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:27:32.429107    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d0209f5-1fc3-4c7c-b00b-128291438ec3-model-cache" (OuterVolumeSpecName: "model-cache") pod "9d0209f5-1fc3-4c7c-b00b-128291438ec3" (UID: "9d0209f5-1fc3-4c7c-b00b-128291438ec3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:27:32.429179 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:27:32.429157    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d0209f5-1fc3-4c7c-b00b-128291438ec3-home\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:27:32.429179 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:27:32.429177    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d0209f5-1fc3-4c7c-b00b-128291438ec3-tmp-dir\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:27:32.430877 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:27:32.430852    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d0209f5-1fc3-4c7c-b00b-128291438ec3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9d0209f5-1fc3-4c7c-b00b-128291438ec3" (UID: "9d0209f5-1fc3-4c7c-b00b-128291438ec3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 10:27:32.430961 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:27:32.430880    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d0209f5-1fc3-4c7c-b00b-128291438ec3-dshm" (OuterVolumeSpecName: "dshm") pod "9d0209f5-1fc3-4c7c-b00b-128291438ec3" (UID: "9d0209f5-1fc3-4c7c-b00b-128291438ec3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:27:32.431001 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:27:32.430966    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d0209f5-1fc3-4c7c-b00b-128291438ec3-kube-api-access-jjpb9" (OuterVolumeSpecName: "kube-api-access-jjpb9") pod "9d0209f5-1fc3-4c7c-b00b-128291438ec3" (UID: "9d0209f5-1fc3-4c7c-b00b-128291438ec3"). InnerVolumeSpecName "kube-api-access-jjpb9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 10:27:32.529757 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:27:32.529726    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d0209f5-1fc3-4c7c-b00b-128291438ec3-tls-certs\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:27:32.529757 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:27:32.529751    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d0209f5-1fc3-4c7c-b00b-128291438ec3-dshm\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:27:32.529757 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:27:32.529759    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d0209f5-1fc3-4c7c-b00b-128291438ec3-model-cache\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:27:32.529973 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:27:32.529768    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjpb9\" (UniqueName: \"kubernetes.io/projected/9d0209f5-1fc3-4c7c-b00b-128291438ec3-kube-api-access-jjpb9\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:27:32.705811 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:27:32.705781    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-12921d/rate-test-model-12921d-kserve-5c8557746c-zxlql"]
Jul 03 10:27:32.710131 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:27:32.710105    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-12921d/rate-test-model-12921d-kserve-5c8557746c-zxlql"]
Jul 03 10:27:33.691111 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:27:33.691080    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d0209f5-1fc3-4c7c-b00b-128291438ec3" path="/var/lib/kubelet/pods/9d0209f5-1fc3-4c7c-b00b-128291438ec3/volumes"
Jul 03 10:28:01.526220 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:01.526185    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"]
Jul 03 10:28:01.526826 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:01.526393    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv" podUID="d5e28afb-fec0-4b3b-8537-a599cdb606e7" containerName="istio-proxy" containerID="cri-o://78dd3bfd8ba339a87696e4bec5a3e3b4fac17ff1010b6a496c1807a7017be94a" gracePeriod=30
Jul 03 10:28:02.715432 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:02.715395    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-12921d-5c5456f9d5-98m5x"]
Jul 03 10:28:02.715898 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:02.715665    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-12921d-5c5456f9d5-98m5x" podUID="9a8a438d-5bdb-4299-bf97-d72206279c38" containerName="maas-api" containerID="cri-o://25a624f9d1e0c2766a139e4068fe9f15f4f1941fb2a4cc302549a0f38c756086" gracePeriod=30
Jul 03 10:28:02.971154 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:02.971093    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-12921d-5c5456f9d5-98m5x"
Jul 03 10:28:03.134169 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:03.134139    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a8a438d-5bdb-4299-bf97-d72206279c38-maas-api-tls\") pod \"9a8a438d-5bdb-4299-bf97-d72206279c38\" (UID: \"9a8a438d-5bdb-4299-bf97-d72206279c38\") "
Jul 03 10:28:03.134346 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:03.134185    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5jcj\" (UniqueName: \"kubernetes.io/projected/9a8a438d-5bdb-4299-bf97-d72206279c38-kube-api-access-m5jcj\") pod \"9a8a438d-5bdb-4299-bf97-d72206279c38\" (UID: \"9a8a438d-5bdb-4299-bf97-d72206279c38\") "
Jul 03 10:28:03.134346 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:03.134207    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a8a438d-5bdb-4299-bf97-d72206279c38-openshift-service-ca\") pod \"9a8a438d-5bdb-4299-bf97-d72206279c38\" (UID: \"9a8a438d-5bdb-4299-bf97-d72206279c38\") "
Jul 03 10:28:03.134665 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:03.134632    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a8a438d-5bdb-4299-bf97-d72206279c38-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9a8a438d-5bdb-4299-bf97-d72206279c38" (UID: "9a8a438d-5bdb-4299-bf97-d72206279c38"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 10:28:03.136400 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:03.136372    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a8a438d-5bdb-4299-bf97-d72206279c38-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9a8a438d-5bdb-4299-bf97-d72206279c38" (UID: "9a8a438d-5bdb-4299-bf97-d72206279c38"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 10:28:03.136509 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:03.136472    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a8a438d-5bdb-4299-bf97-d72206279c38-kube-api-access-m5jcj" (OuterVolumeSpecName: "kube-api-access-m5jcj") pod "9a8a438d-5bdb-4299-bf97-d72206279c38" (UID: "9a8a438d-5bdb-4299-bf97-d72206279c38"). InnerVolumeSpecName "kube-api-access-m5jcj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 10:28:03.235969 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:03.235877    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a8a438d-5bdb-4299-bf97-d72206279c38-maas-api-tls\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:28:03.235969 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:03.235910    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5jcj\" (UniqueName: \"kubernetes.io/projected/9a8a438d-5bdb-4299-bf97-d72206279c38-kube-api-access-m5jcj\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:28:03.235969 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:03.235923    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a8a438d-5bdb-4299-bf97-d72206279c38-openshift-service-ca\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:28:03.547062 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:03.546972    2559 generic.go:356] "Generic (PLEG): container finished" podID="9a8a438d-5bdb-4299-bf97-d72206279c38" containerID="25a624f9d1e0c2766a139e4068fe9f15f4f1941fb2a4cc302549a0f38c756086" exitCode=0
Jul 03 10:28:03.547062 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:03.547022    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-12921d-5c5456f9d5-98m5x"
Jul 03 10:28:03.547255 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:03.547056    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-12921d-5c5456f9d5-98m5x" event={"ID":"9a8a438d-5bdb-4299-bf97-d72206279c38","Type":"ContainerDied","Data":"25a624f9d1e0c2766a139e4068fe9f15f4f1941fb2a4cc302549a0f38c756086"}
Jul 03 10:28:03.547255 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:03.547108    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-12921d-5c5456f9d5-98m5x" event={"ID":"9a8a438d-5bdb-4299-bf97-d72206279c38","Type":"ContainerDied","Data":"3f15841a489cb1e9376de5b9d5e08741a7756894f76a3c2502ce40333dd0a637"}
Jul 03 10:28:03.547255 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:03.547133    2559 scope.go:117] "RemoveContainer" containerID="25a624f9d1e0c2766a139e4068fe9f15f4f1941fb2a4cc302549a0f38c756086"
Jul 03 10:28:03.556627 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:03.556609    2559 scope.go:117] "RemoveContainer" containerID="25a624f9d1e0c2766a139e4068fe9f15f4f1941fb2a4cc302549a0f38c756086"
Jul 03 10:28:03.556895 ip-10-0-131-117 kubenswrapper[2559]: E0703 10:28:03.556880    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25a624f9d1e0c2766a139e4068fe9f15f4f1941fb2a4cc302549a0f38c756086\": container with ID starting with 25a624f9d1e0c2766a139e4068fe9f15f4f1941fb2a4cc302549a0f38c756086 not found: ID does not exist" containerID="25a624f9d1e0c2766a139e4068fe9f15f4f1941fb2a4cc302549a0f38c756086"
Jul 03 10:28:03.556940 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:03.556903    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25a624f9d1e0c2766a139e4068fe9f15f4f1941fb2a4cc302549a0f38c756086"} err="failed to get container status \"25a624f9d1e0c2766a139e4068fe9f15f4f1941fb2a4cc302549a0f38c756086\": rpc error: code = NotFound desc = could not find container \"25a624f9d1e0c2766a139e4068fe9f15f4f1941fb2a4cc302549a0f38c756086\": container with ID starting with 25a624f9d1e0c2766a139e4068fe9f15f4f1941fb2a4cc302549a0f38c756086 not found: ID does not exist"
Jul 03 10:28:03.574064 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:03.574037    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-12921d-5c5456f9d5-98m5x"]
Jul 03 10:28:03.578410 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:03.578386    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-12921d-5c5456f9d5-98m5x"]
Jul 03 10:28:03.698394 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:03.698360    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a8a438d-5bdb-4299-bf97-d72206279c38" path="/var/lib/kubelet/pods/9a8a438d-5bdb-4299-bf97-d72206279c38/volumes"
Jul 03 10:28:06.783120 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:06.783088    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"
Jul 03 10:28:06.867746 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:06.867668    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5e28afb-fec0-4b3b-8537-a599cdb606e7-workload-certs\") pod \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\" (UID: \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\") "
Jul 03 10:28:06.867746 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:06.867713    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5e28afb-fec0-4b3b-8537-a599cdb606e7-istio-token\") pod \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\" (UID: \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\") "
Jul 03 10:28:06.867964 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:06.867776    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5e28afb-fec0-4b3b-8537-a599cdb606e7-istio-envoy\") pod \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\" (UID: \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\") "
Jul 03 10:28:06.867964 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:06.867804    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5e28afb-fec0-4b3b-8537-a599cdb606e7-istiod-ca-cert\") pod \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\" (UID: \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\") "
Jul 03 10:28:06.867964 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:06.867822    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5e28afb-fec0-4b3b-8537-a599cdb606e7-workload-socket\") pod \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\" (UID: \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\") "
Jul 03 10:28:06.867964 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:06.867859    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5e28afb-fec0-4b3b-8537-a599cdb606e7-istio-podinfo\") pod \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\" (UID: \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\") "
Jul 03 10:28:06.867964 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:06.867894    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5e28afb-fec0-4b3b-8537-a599cdb606e7-credential-socket\") pod \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\" (UID: \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\") "
Jul 03 10:28:06.867964 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:06.867921    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5e28afb-fec0-4b3b-8537-a599cdb606e7-istio-data\") pod \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\" (UID: \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\") "
Jul 03 10:28:06.867964 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:06.867952    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2kqw\" (UniqueName: \"kubernetes.io/projected/d5e28afb-fec0-4b3b-8537-a599cdb606e7-kube-api-access-r2kqw\") pod \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\" (UID: \"d5e28afb-fec0-4b3b-8537-a599cdb606e7\") "
Jul 03 10:28:06.868286 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:06.867971    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5e28afb-fec0-4b3b-8537-a599cdb606e7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d5e28afb-fec0-4b3b-8537-a599cdb606e7" (UID: "d5e28afb-fec0-4b3b-8537-a599cdb606e7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:28:06.868286 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:06.868141    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5e28afb-fec0-4b3b-8537-a599cdb606e7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d5e28afb-fec0-4b3b-8537-a599cdb606e7" (UID: "d5e28afb-fec0-4b3b-8537-a599cdb606e7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:28:06.868286 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:06.868207    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5e28afb-fec0-4b3b-8537-a599cdb606e7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d5e28afb-fec0-4b3b-8537-a599cdb606e7" (UID: "d5e28afb-fec0-4b3b-8537-a599cdb606e7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:28:06.868286 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:06.868252    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5e28afb-fec0-4b3b-8537-a599cdb606e7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d5e28afb-fec0-4b3b-8537-a599cdb606e7" (UID: "d5e28afb-fec0-4b3b-8537-a599cdb606e7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 10:28:06.868489 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:06.868339    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5e28afb-fec0-4b3b-8537-a599cdb606e7-workload-certs\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:28:06.868489 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:06.868356    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5e28afb-fec0-4b3b-8537-a599cdb606e7-workload-socket\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:28:06.868489 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:06.868370    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5e28afb-fec0-4b3b-8537-a599cdb606e7-credential-socket\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:28:06.869064 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:06.869032    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5e28afb-fec0-4b3b-8537-a599cdb606e7-istio-data" (OuterVolumeSpecName: "istio-data") pod "d5e28afb-fec0-4b3b-8537-a599cdb606e7" (UID: "d5e28afb-fec0-4b3b-8537-a599cdb606e7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:28:06.870084 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:06.870059    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5e28afb-fec0-4b3b-8537-a599cdb606e7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d5e28afb-fec0-4b3b-8537-a599cdb606e7" (UID: "d5e28afb-fec0-4b3b-8537-a599cdb606e7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 10:28:06.870258 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:06.870236    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5e28afb-fec0-4b3b-8537-a599cdb606e7-istio-token" (OuterVolumeSpecName: "istio-token") pod "d5e28afb-fec0-4b3b-8537-a599cdb606e7" (UID: "d5e28afb-fec0-4b3b-8537-a599cdb606e7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 10:28:06.870318 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:06.870288    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5e28afb-fec0-4b3b-8537-a599cdb606e7-kube-api-access-r2kqw" (OuterVolumeSpecName: "kube-api-access-r2kqw") pod "d5e28afb-fec0-4b3b-8537-a599cdb606e7" (UID: "d5e28afb-fec0-4b3b-8537-a599cdb606e7"). InnerVolumeSpecName "kube-api-access-r2kqw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 10:28:06.870730 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:06.870708    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d5e28afb-fec0-4b3b-8537-a599cdb606e7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d5e28afb-fec0-4b3b-8537-a599cdb606e7" (UID: "d5e28afb-fec0-4b3b-8537-a599cdb606e7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 03 10:28:06.969273 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:06.969241    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5e28afb-fec0-4b3b-8537-a599cdb606e7-istio-podinfo\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:28:06.969273 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:06.969269    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5e28afb-fec0-4b3b-8537-a599cdb606e7-istio-data\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:28:06.969474 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:06.969281    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2kqw\" (UniqueName: \"kubernetes.io/projected/d5e28afb-fec0-4b3b-8537-a599cdb606e7-kube-api-access-r2kqw\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:28:06.969474 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:06.969295    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5e28afb-fec0-4b3b-8537-a599cdb606e7-istio-token\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:28:06.969474 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:06.969308    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5e28afb-fec0-4b3b-8537-a599cdb606e7-istio-envoy\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:28:06.969474 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:06.969316    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5e28afb-fec0-4b3b-8537-a599cdb606e7-istiod-ca-cert\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\""
Jul 03 10:28:07.568408 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:07.568365    2559 generic.go:356] "Generic (PLEG): container finished" podID="d5e28afb-fec0-4b3b-8537-a599cdb606e7" containerID="78dd3bfd8ba339a87696e4bec5a3e3b4fac17ff1010b6a496c1807a7017be94a" exitCode=0
Jul 03 10:28:07.568620 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:07.568416    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"
Jul 03 10:28:07.568620 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:07.568453    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv" event={"ID":"d5e28afb-fec0-4b3b-8537-a599cdb606e7","Type":"ContainerDied","Data":"78dd3bfd8ba339a87696e4bec5a3e3b4fac17ff1010b6a496c1807a7017be94a"}
Jul 03 10:28:07.568620 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:07.568509    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv" event={"ID":"d5e28afb-fec0-4b3b-8537-a599cdb606e7","Type":"ContainerDied","Data":"407dac5d2bca2f8ea1116dfbfa46585603b09c11cc95116659cfd2f82cedf01d"}
Jul 03 10:28:07.568620 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:07.568532    2559 scope.go:117] "RemoveContainer" containerID="78dd3bfd8ba339a87696e4bec5a3e3b4fac17ff1010b6a496c1807a7017be94a"
Jul 03 10:28:07.578120 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:07.578094    2559 scope.go:117] "RemoveContainer" containerID="d9259f457eded500c331db0e975c7844f182cd8b7abef561b6377b527b9e0484"
Jul 03 10:28:07.586022 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:07.586004    2559 scope.go:117] "RemoveContainer" containerID="78dd3bfd8ba339a87696e4bec5a3e3b4fac17ff1010b6a496c1807a7017be94a"
Jul 03 10:28:07.586297 ip-10-0-131-117 kubenswrapper[2559]: E0703 10:28:07.586273    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78dd3bfd8ba339a87696e4bec5a3e3b4fac17ff1010b6a496c1807a7017be94a\": container with ID starting with 78dd3bfd8ba339a87696e4bec5a3e3b4fac17ff1010b6a496c1807a7017be94a not found: ID does not exist" containerID="78dd3bfd8ba339a87696e4bec5a3e3b4fac17ff1010b6a496c1807a7017be94a"
Jul 03 10:28:07.586373 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:07.586305    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78dd3bfd8ba339a87696e4bec5a3e3b4fac17ff1010b6a496c1807a7017be94a"} err="failed to get container status \"78dd3bfd8ba339a87696e4bec5a3e3b4fac17ff1010b6a496c1807a7017be94a\": rpc error: code = NotFound desc = could not find container \"78dd3bfd8ba339a87696e4bec5a3e3b4fac17ff1010b6a496c1807a7017be94a\": container with ID starting with 78dd3bfd8ba339a87696e4bec5a3e3b4fac17ff1010b6a496c1807a7017be94a not found: ID does not exist"
Jul 03 10:28:07.586373 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:07.586325    2559 scope.go:117] "RemoveContainer" containerID="d9259f457eded500c331db0e975c7844f182cd8b7abef561b6377b527b9e0484"
Jul 03 10:28:07.586588 ip-10-0-131-117 kubenswrapper[2559]: E0703 10:28:07.586571    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9259f457eded500c331db0e975c7844f182cd8b7abef561b6377b527b9e0484\": container with ID starting with d9259f457eded500c331db0e975c7844f182cd8b7abef561b6377b527b9e0484 not found: ID does not exist" containerID="d9259f457eded500c331db0e975c7844f182cd8b7abef561b6377b527b9e0484"
Jul 03 10:28:07.586635 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:07.586592    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9259f457eded500c331db0e975c7844f182cd8b7abef561b6377b527b9e0484"} err="failed to get container status \"d9259f457eded500c331db0e975c7844f182cd8b7abef561b6377b527b9e0484\": rpc error: code = NotFound desc = could not find container \"d9259f457eded500c331db0e975c7844f182cd8b7abef561b6377b527b9e0484\": container with ID starting with d9259f457eded500c331db0e975c7844f182cd8b7abef561b6377b527b9e0484 not found: ID does not exist"
Jul 03 10:28:07.600804 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:07.600781    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"]
Jul 03 10:28:07.604708 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:07.604688    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-1fc47c-openshift-default-7f4cb6848c-dzrtv"]
Jul 03 10:28:07.692185 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:07.692155    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5e28afb-fec0-4b3b-8537-a599cdb606e7" path="/var/lib/kubelet/pods/d5e28afb-fec0-4b3b-8537-a599cdb606e7/volumes"
Jul 03 10:28:15.057509 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:15.057433    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-58447bbcb5-j4txd_699b1035-90af-4a32-bfce-152e62d81eb3/maas-api/0.log"
Jul 03 10:28:15.892723 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:15.892698    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl_8be607f2-2be4-4ab0-ae11-da355ce1c27f/copy-manifests/0.log"
Jul 03 10:28:15.899644 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:15.899616    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl_8be607f2-2be4-4ab0-ae11-da355ce1c27f/manager/0.log"
Jul 03 10:28:16.137401 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:16.137368    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-dgn4m_eeb806d8-fe96-44e1-b0e6-3de1f844fde0/postgres/0.log"
Jul 03 10:28:19.248510 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:19.248481    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f5df5b9bf-qlxc9_b4679e45-918e-4741-a4c0-730f1a8bfd28/kube-auth-proxy/0.log"
Jul 03 10:28:19.383042 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:19.383009    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-4wpm6_691d502a-0ea2-4ca0-bb5c-c05c4a56db73/istio-proxy/1.log"
Jul 03 10:28:19.519167 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:19.519097    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-nm4pd_c3fd3dbb-3234-46dd-a0e5-4d7871a1befe/payload-pre-processing/0.log"
Jul 03 10:28:19.772976 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:19.772883    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c4mdt_9d052bc8-d41a-494c-9523-5bfdcfb29ec2/console-operator/2.log"
Jul 03 10:28:19.785008 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:19.784986    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c4mdt_9d052bc8-d41a-494c-9523-5bfdcfb29ec2/console-operator/2.log"
Jul 03 10:28:20.112217 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:20.112134    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-ldmgf_80238e80-c7f9-486e-8d92-2aea565a4360/main/0.log"
Jul 03 10:28:20.495176 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:20.495130    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv6p5f_d74fcd96-4b0b-44c5-8189-7c482df358e7/main/0.log"
Jul 03 10:28:20.723807 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:20.723761    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-g9klg_4d54910f-d4cc-4a39-9f21-6f4ea2f96bd3/main/0.log"
Jul 03 10:28:28.437641 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:28.437600    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-pwxt9_20bf6cc8-63bc-4ac8-be3b-948848a5755c/global-pull-secret-syncer/0.log"
Jul 03 10:28:28.528680 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:28.528650    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gm79x_7d19e4da-d529-40d3-a8af-a0e97b870a19/konnectivity-agent/0.log"
Jul 03 10:28:28.581994 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:28.581966    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-117.ec2.internal_0caf382ca9eb296da259b7ea66c7880a/haproxy/0.log"
Jul 03 10:28:36.326956 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:36.326926    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-qg8dx_c3ebcec7-5b7d-40ad-8375-911427c94cbb/cluster-monitoring-operator/0.log"
Jul 03 10:28:36.353802 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:36.353776    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-shhkl_6d1f52c3-ee41-4420-84bb-0b168082e3e7/kube-state-metrics/0.log"
Jul 03 10:28:36.374917 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:36.374888    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-shhkl_6d1f52c3-ee41-4420-84bb-0b168082e3e7/kube-rbac-proxy-main/0.log"
Jul 03 10:28:36.396978 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:36.396923    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-shhkl_6d1f52c3-ee41-4420-84bb-0b168082e3e7/kube-rbac-proxy-self/0.log"
Jul 03 10:28:36.661908 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:36.661837    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r724b_07788d0a-514f-45e3-aeb7-3f45e91d7aa6/node-exporter/0.log"
Jul 03 10:28:36.695390 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:36.695359    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r724b_07788d0a-514f-45e3-aeb7-3f45e91d7aa6/kube-rbac-proxy/0.log"
Jul 03 10:28:36.720565 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:36.720523    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r724b_07788d0a-514f-45e3-aeb7-3f45e91d7aa6/init-textfile/0.log"
Jul 03 10:28:36.844139 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:36.844112    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3307e753-ff67-4a84-ba87-a846b4c271a7/prometheus/0.log"
Jul 03 10:28:36.873678 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:36.873652    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3307e753-ff67-4a84-ba87-a846b4c271a7/config-reloader/0.log"
Jul 03 10:28:36.907560 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:36.907520    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3307e753-ff67-4a84-ba87-a846b4c271a7/thanos-sidecar/0.log"
Jul 03 10:28:36.933372 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:36.933345    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3307e753-ff67-4a84-ba87-a846b4c271a7/kube-rbac-proxy-web/0.log"
Jul 03 10:28:36.959353 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:36.959333    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3307e753-ff67-4a84-ba87-a846b4c271a7/kube-rbac-proxy/0.log"
Jul 03 10:28:36.988714 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:36.988693    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3307e753-ff67-4a84-ba87-a846b4c271a7/kube-rbac-proxy-thanos/0.log"
Jul 03 10:28:37.023829 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:37.023803    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3307e753-ff67-4a84-ba87-a846b4c271a7/init-config-reloader/0.log"
Jul 03 10:28:37.160277 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:37.160251    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6f6d4b94d4-n6tjx_2c18068a-cf91-4ed8-b359-c9fc120c0377/telemeter-client/0.log"
Jul 03 10:28:37.198201 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:37.198139    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6f6d4b94d4-n6tjx_2c18068a-cf91-4ed8-b359-c9fc120c0377/reload/0.log"
Jul 03 10:28:37.250310 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:37.250287    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6f6d4b94d4-n6tjx_2c18068a-cf91-4ed8-b359-c9fc120c0377/kube-rbac-proxy/0.log"
Jul 03 10:28:38.244307 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:38.244269    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sldrw/perf-node-gather-daemonset-m6jl4"]
Jul 03 10:28:38.244831 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:38.244670    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d0209f5-1fc3-4c7c-b00b-128291438ec3" containerName="main"
Jul 03 10:28:38.244831 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:38.244684    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d0209f5-1fc3-4c7c-b00b-128291438ec3" containerName="main"
Jul 03 10:28:38.244831 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:38.244696    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5e28afb-fec0-4b3b-8537-a599cdb606e7" containerName="istio-proxy"
Jul 03 10:28:38.244831 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:38.244702    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5e28afb-fec0-4b3b-8537-a599cdb606e7" containerName="istio-proxy"
Jul 03 10:28:38.244831 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:38.244712    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5e28afb-fec0-4b3b-8537-a599cdb606e7" containerName="istio-proxy"
Jul 03 10:28:38.244831 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:38.244720    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5e28afb-fec0-4b3b-8537-a599cdb606e7" containerName="istio-proxy"
Jul 03 10:28:38.244831 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:38.244729    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a8a438d-5bdb-4299-bf97-d72206279c38" containerName="maas-api"
Jul 03 10:28:38.244831 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:38.244734    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a8a438d-5bdb-4299-bf97-d72206279c38" containerName="maas-api"
Jul 03 10:28:38.244831 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:38.244796    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d0209f5-1fc3-4c7c-b00b-128291438ec3" containerName="main"
Jul 03 10:28:38.244831 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:38.244805    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a8a438d-5bdb-4299-bf97-d72206279c38" containerName="maas-api"
Jul 03 10:28:38.244831 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:38.244812    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5e28afb-fec0-4b3b-8537-a599cdb606e7" containerName="istio-proxy"
Jul 03 10:28:38.244831 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:38.244818    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5e28afb-fec0-4b3b-8537-a599cdb606e7" containerName="istio-proxy"
Jul 03 10:28:38.248051 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:38.248027    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-m6jl4"
Jul 03 10:28:38.250992 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:38.250970    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sldrw\"/\"openshift-service-ca.crt\""
Jul 03 10:28:38.252003 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:38.251981    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sldrw\"/\"default-dockercfg-2snr6\""
Jul 03 10:28:38.256581 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:38.252627    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sldrw\"/\"kube-root-ca.crt\""
Jul 03 10:28:38.260959 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:38.260039    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sldrw/perf-node-gather-daemonset-m6jl4"]
Jul 03 10:28:38.370583 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:38.370537    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksl9p\" (UniqueName: \"kubernetes.io/projected/c44e335a-65a1-4fc9-b23e-f0f60afbffce-kube-api-access-ksl9p\") pod \"perf-node-gather-daemonset-m6jl4\" (UID: \"c44e335a-65a1-4fc9-b23e-f0f60afbffce\") " pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-m6jl4"
Jul 03 10:28:38.370760 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:38.370625    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c44e335a-65a1-4fc9-b23e-f0f60afbffce-proc\") pod \"perf-node-gather-daemonset-m6jl4\" (UID: \"c44e335a-65a1-4fc9-b23e-f0f60afbffce\") " pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-m6jl4"
Jul 03 10:28:38.370760 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:38.370665    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c44e335a-65a1-4fc9-b23e-f0f60afbffce-sys\") pod \"perf-node-gather-daemonset-m6jl4\" (UID: \"c44e335a-65a1-4fc9-b23e-f0f60afbffce\") " pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-m6jl4"
Jul 03 10:28:38.370760 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:38.370687    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c44e335a-65a1-4fc9-b23e-f0f60afbffce-lib-modules\") pod \"perf-node-gather-daemonset-m6jl4\" (UID: \"c44e335a-65a1-4fc9-b23e-f0f60afbffce\") " pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-m6jl4"
Jul 03 10:28:38.370760 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:38.370732    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c44e335a-65a1-4fc9-b23e-f0f60afbffce-podres\") pod \"perf-node-gather-daemonset-m6jl4\" (UID: \"c44e335a-65a1-4fc9-b23e-f0f60afbffce\") " pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-m6jl4"
Jul 03 10:28:38.471308 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:38.471278    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c44e335a-65a1-4fc9-b23e-f0f60afbffce-proc\") pod \"perf-node-gather-daemonset-m6jl4\" (UID: \"c44e335a-65a1-4fc9-b23e-f0f60afbffce\") " pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-m6jl4"
Jul 03 10:28:38.471498 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:38.471323    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c44e335a-65a1-4fc9-b23e-f0f60afbffce-sys\") pod \"perf-node-gather-daemonset-m6jl4\" (UID: \"c44e335a-65a1-4fc9-b23e-f0f60afbffce\") " pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-m6jl4"
Jul 03 10:28:38.471498 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:38.471344    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c44e335a-65a1-4fc9-b23e-f0f60afbffce-lib-modules\") pod \"perf-node-gather-daemonset-m6jl4\" (UID: \"c44e335a-65a1-4fc9-b23e-f0f60afbffce\") " pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-m6jl4"
Jul 03 10:28:38.471498 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:38.471418    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c44e335a-65a1-4fc9-b23e-f0f60afbffce-sys\") pod \"perf-node-gather-daemonset-m6jl4\" (UID: \"c44e335a-65a1-4fc9-b23e-f0f60afbffce\") " pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-m6jl4"
Jul 03 10:28:38.471498 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:38.471440    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c44e335a-65a1-4fc9-b23e-f0f60afbffce-podres\") pod \"perf-node-gather-daemonset-m6jl4\" (UID: \"c44e335a-65a1-4fc9-b23e-f0f60afbffce\") " pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-m6jl4"
Jul 03 10:28:38.471498 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:38.471452    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c44e335a-65a1-4fc9-b23e-f0f60afbffce-lib-modules\") pod \"perf-node-gather-daemonset-m6jl4\" (UID: \"c44e335a-65a1-4fc9-b23e-f0f60afbffce\") " pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-m6jl4"
Jul 03 10:28:38.471498 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:38.471417    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c44e335a-65a1-4fc9-b23e-f0f60afbffce-proc\") pod \"perf-node-gather-daemonset-m6jl4\" (UID: \"c44e335a-65a1-4fc9-b23e-f0f60afbffce\") " pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-m6jl4"
Jul 03 10:28:38.471722 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:38.471506    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c44e335a-65a1-4fc9-b23e-f0f60afbffce-podres\") pod \"perf-node-gather-daemonset-m6jl4\" (UID: \"c44e335a-65a1-4fc9-b23e-f0f60afbffce\") " pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-m6jl4"
Jul 03 10:28:38.471722 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:38.471507    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksl9p\" (UniqueName: \"kubernetes.io/projected/c44e335a-65a1-4fc9-b23e-f0f60afbffce-kube-api-access-ksl9p\") pod \"perf-node-gather-daemonset-m6jl4\" (UID: \"c44e335a-65a1-4fc9-b23e-f0f60afbffce\") " pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-m6jl4"
Jul 03 10:28:38.489816 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:38.489794    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksl9p\" (UniqueName: \"kubernetes.io/projected/c44e335a-65a1-4fc9-b23e-f0f60afbffce-kube-api-access-ksl9p\") pod \"perf-node-gather-daemonset-m6jl4\" (UID: \"c44e335a-65a1-4fc9-b23e-f0f60afbffce\") " pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-m6jl4"
Jul 03 10:28:38.563283 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:38.563198    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-m6jl4"
Jul 03 10:28:38.711227 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:38.711153    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sldrw/perf-node-gather-daemonset-m6jl4"]
Jul 03 10:28:39.379344 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:39.379315    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c4mdt_9d052bc8-d41a-494c-9523-5bfdcfb29ec2/console-operator/2.log"
Jul 03 10:28:39.382715 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:39.382691    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-c4mdt_9d052bc8-d41a-494c-9523-5bfdcfb29ec2/console-operator/3.log"
Jul 03 10:28:39.719649 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:39.719611    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-m6jl4" event={"ID":"c44e335a-65a1-4fc9-b23e-f0f60afbffce","Type":"ContainerStarted","Data":"627b168143a3df63412c3530d5ee7718738e04f69e5288b5e73b9cc34c3f4833"}
Jul 03 10:28:39.719828 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:39.719663    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-m6jl4" event={"ID":"c44e335a-65a1-4fc9-b23e-f0f60afbffce","Type":"ContainerStarted","Data":"04d8ce2d63ae7434699f9d752e54cd20e94febf8963e792c4c601eb8f7a3b3fe"}
Jul 03 10:28:39.719828 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:39.719712    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-m6jl4"
Jul 03 10:28:39.753893 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:39.753844    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-m6jl4" podStartSLOduration=1.753828532 podStartE2EDuration="1.753828532s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 10:28:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 10:28:39.75272498 +0000 UTC m=+2720.623390610" watchObservedRunningTime="2026-07-03 10:28:39.753828532 +0000 UTC m=+2720.624494160"
Jul 03 10:28:41.669908 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:41.669883    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vq4dk_0f15a368-feb7-4b3d-829a-d49e7474445b/dns/0.log"
Jul 03 10:28:41.691520 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:41.691476    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vq4dk_0f15a368-feb7-4b3d-829a-d49e7474445b/kube-rbac-proxy/0.log"
Jul 03 10:28:41.831393 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:41.831353    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nx222_7ad0ecde-3110-4f76-8c0e-f296a67153e8/dns-node-resolver/0.log"
Jul 03 10:28:42.398631 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:42.398605    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-58f58d4cf8-slxhx_a52d0d8d-584b-4b2e-95b3-59986aef8d4e/registry/0.log"
Jul 03 10:28:42.469746 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:42.469718    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xljb6_b8d41b5d-027e-4958-bf3e-422ce5ba511c/node-ca/0.log"
Jul 03 10:28:43.694208 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:43.694176    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f5df5b9bf-qlxc9_b4679e45-918e-4741-a4c0-730f1a8bfd28/kube-auth-proxy/0.log"
Jul 03 10:28:43.725839 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:43.725818    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-4wpm6_691d502a-0ea2-4ca0-bb5c-c05c4a56db73/istio-proxy/0.log"
Jul 03 10:28:43.752902 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:43.752874    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-4wpm6_691d502a-0ea2-4ca0-bb5c-c05c4a56db73/istio-proxy/1.log"
Jul 03 10:28:43.786233 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:43.786204    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-nm4pd_c3fd3dbb-3234-46dd-a0e5-4d7871a1befe/payload-pre-processing/0.log"
Jul 03 10:28:44.583327 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:44.583293    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-b7g2w_66226c20-f210-473d-854b-b6c369884a01/serve-healthcheck-canary/0.log"
Jul 03 10:28:45.138664 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:45.138637    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-7jjl2_3b40d22c-95af-41b3-a18e-d1cda05b4999/insights-operator/1.log"
Jul 03 10:28:45.139091 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:45.138908    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-7jjl2_3b40d22c-95af-41b3-a18e-d1cda05b4999/insights-operator/0.log"
Jul 03 10:28:45.164371 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:45.164332    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4nbhr_08d5db5b-4963-4c26-95e6-e7a134a87299/kube-rbac-proxy/0.log"
Jul 03 10:28:45.190779 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:45.190754    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4nbhr_08d5db5b-4963-4c26-95e6-e7a134a87299/exporter/0.log"
Jul 03 10:28:45.216508 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:45.216482    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4nbhr_08d5db5b-4963-4c26-95e6-e7a134a87299/extractor/0.log"
Jul 03 10:28:45.734830 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:45.734804    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sldrw/perf-node-gather-daemonset-m6jl4"
Jul 03 10:28:47.953679 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:47.953644    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-58447bbcb5-j4txd_699b1035-90af-4a32-bfce-152e62d81eb3/maas-api/0.log"
Jul 03 10:28:48.313034 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:48.313009    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl_8be607f2-2be4-4ab0-ae11-da355ce1c27f/manager/0.log"
Jul 03 10:28:48.336085 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:48.336065    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f66d7cdc8-qdpxl_8be607f2-2be4-4ab0-ae11-da355ce1c27f/copy-manifests/0.log"
Jul 03 10:28:48.466164 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:48.466136    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-dgn4m_eeb806d8-fe96-44e1-b0e6-3de1f844fde0/postgres/0.log"
Jul 03 10:28:49.340473 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:49.340446    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f5df5b9bf-qlxc9_b4679e45-918e-4741-a4c0-730f1a8bfd28/kube-auth-proxy/0.log"
Jul 03 10:28:49.370117 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:49.370085    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-4wpm6_691d502a-0ea2-4ca0-bb5c-c05c4a56db73/istio-proxy/0.log"
Jul 03 10:28:49.398445 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:49.398419    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-4wpm6_691d502a-0ea2-4ca0-bb5c-c05c4a56db73/istio-proxy/1.log"
Jul 03 10:28:49.418639 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:49.418613    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-nm4pd_c3fd3dbb-3234-46dd-a0e5-4d7871a1befe/payload-pre-processing/0.log"
Jul 03 10:28:49.867306 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:49.867278    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-75576cf7dd-7t9tp_3f0d6ea2-8150-4e3b-bad7-71f4de48c005/manager/0.log"
Jul 03 10:28:50.806778 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:50.806747    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f5df5b9bf-qlxc9_b4679e45-918e-4741-a4c0-730f1a8bfd28/kube-auth-proxy/0.log"
Jul 03 10:28:50.828306 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:50.828275    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-4wpm6_691d502a-0ea2-4ca0-bb5c-c05c4a56db73/istio-proxy/0.log"
Jul 03 10:28:50.859173 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:50.859152    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-4wpm6_691d502a-0ea2-4ca0-bb5c-c05c4a56db73/istio-proxy/1.log"
Jul 03 10:28:50.882178 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:50.882154    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-nm4pd_c3fd3dbb-3234-46dd-a0e5-4d7871a1befe/payload-pre-processing/0.log"
Jul 03 10:28:54.708372 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:54.708342    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-qkmpr_4859de3e-ece9-46d0-8db9-3b73d7075cd4/migrator/0.log"
Jul 03 10:28:54.734937 ip-10-0-131-117 kubenswrapper[2559]: I0703 10:28:54.734910    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-qkmpr_4859de3e-ece9-46d0-8db9-3b73d7075cd4/graceful-termination/0.log"