Jul 08 21:32:56.942574 ip-10-0-131-83 systemd[1]: Starting Kubernetes Kubelet...
Jul 08 21:32:57.376219 ip-10-0-131-83 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 21:32:57.376219 ip-10-0-131-83 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 08 21:32:57.376219 ip-10-0-131-83 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 21:32:57.376219 ip-10-0-131-83 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 08 21:32:57.376219 ip-10-0-131-83 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 21:32:57.378913 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.378828    2569 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 08 21:32:57.387149 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387131    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 21:32:57.387149 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387146    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 21:32:57.387149 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387150    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 21:32:57.387149 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387153    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 21:32:57.387266 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387156    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 21:32:57.387266 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387158    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 21:32:57.387266 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387166    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 21:32:57.387266 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387169    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 21:32:57.387266 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387172    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 21:32:57.387266 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387176    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 21:32:57.387266 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387178    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 21:32:57.387266 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387181    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 21:32:57.387266 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387184    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 21:32:57.387266 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387186    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 21:32:57.387266 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387189    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 21:32:57.387266 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387192    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 21:32:57.387266 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387195    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 21:32:57.387266 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387197    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 21:32:57.387266 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387200    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 21:32:57.387266 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387202    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 21:32:57.387266 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387205    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 21:32:57.387266 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387208    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 21:32:57.387266 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387210    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 21:32:57.387266 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387213    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 21:32:57.387798 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387216    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 21:32:57.387798 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387218    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 21:32:57.387798 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387221    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 21:32:57.387798 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387223    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 21:32:57.387798 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387226    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 21:32:57.387798 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387228    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 21:32:57.387798 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387231    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 21:32:57.387798 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387233    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 21:32:57.387798 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387235    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 21:32:57.387798 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387238    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 21:32:57.387798 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387240    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 21:32:57.387798 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387244    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 21:32:57.387798 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387246    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 21:32:57.387798 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387250    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 21:32:57.387798 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387252    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 21:32:57.387798 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387255    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 21:32:57.387798 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387258    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 21:32:57.387798 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387260    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 21:32:57.387798 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387262    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 21:32:57.387798 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387265    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 21:32:57.388276 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387267    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 21:32:57.388276 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387270    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 21:32:57.388276 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387273    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 21:32:57.388276 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387275    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 21:32:57.388276 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387278    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 21:32:57.388276 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387280    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 21:32:57.388276 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387296    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 21:32:57.388276 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387300    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 21:32:57.388276 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387304    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 21:32:57.388276 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387307    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 21:32:57.388276 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387309    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 21:32:57.388276 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387312    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 21:32:57.388276 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387315    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 21:32:57.388276 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387318    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 21:32:57.388276 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387320    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 21:32:57.388276 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387323    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 21:32:57.388276 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387325    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 21:32:57.388276 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387328    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 21:32:57.388276 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387330    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 21:32:57.388770 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387333    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 21:32:57.388770 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387335    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 21:32:57.388770 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387338    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 21:32:57.388770 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387340    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 21:32:57.388770 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387343    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 21:32:57.388770 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387345    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 21:32:57.388770 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387348    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 21:32:57.388770 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387352    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 21:32:57.388770 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387355    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 21:32:57.388770 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387359    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 21:32:57.388770 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387362    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 21:32:57.388770 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387364    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 21:32:57.388770 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387367    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 21:32:57.388770 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387370    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 21:32:57.388770 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387373    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 21:32:57.388770 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387375    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 21:32:57.388770 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387378    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 21:32:57.388770 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387380    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 21:32:57.388770 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387383    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 21:32:57.389239 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387386    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 21:32:57.389239 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387390    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 21:32:57.389239 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387393    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 21:32:57.389239 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387395    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 21:32:57.389239 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387397    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 21:32:57.389239 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387400    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 21:32:57.389239 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387402    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 21:32:57.389239 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387404    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 21:32:57.389239 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387407    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 21:32:57.389239 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387409    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 21:32:57.389239 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387411    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 21:32:57.389239 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387414    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 21:32:57.389239 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387416    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 21:32:57.389239 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387418    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 21:32:57.389239 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387421    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 21:32:57.389239 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387423    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 21:32:57.389239 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.387426    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 21:32:57.389239 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388127    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 21:32:57.389239 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388135    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 21:32:57.389239 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388139    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 21:32:57.389751 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388142    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 21:32:57.389751 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388145    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 21:32:57.389751 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388149    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 21:32:57.389751 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388152    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 21:32:57.389751 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388155    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 21:32:57.389751 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388158    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 21:32:57.389751 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388160    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 21:32:57.389751 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388163    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 21:32:57.389751 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388165    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 21:32:57.389751 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388168    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 21:32:57.389751 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388170    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 21:32:57.389751 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388173    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 21:32:57.389751 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388175    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 21:32:57.389751 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388178    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 21:32:57.389751 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388180    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 21:32:57.389751 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388183    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 21:32:57.389751 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388187    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 21:32:57.389751 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388191    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 21:32:57.389751 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388193    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 21:32:57.389751 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388196    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 21:32:57.390241 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388199    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 21:32:57.390241 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388201    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 21:32:57.390241 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388204    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 21:32:57.390241 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388206    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 21:32:57.390241 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388209    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 21:32:57.390241 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388211    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 21:32:57.390241 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388214    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 21:32:57.390241 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388216    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 21:32:57.390241 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388218    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 21:32:57.390241 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388222    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 21:32:57.390241 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388224    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 21:32:57.390241 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388227    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 21:32:57.390241 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388230    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 21:32:57.390241 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388233    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 21:32:57.390241 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388235    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 21:32:57.390241 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388237    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 21:32:57.390241 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388240    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 21:32:57.390241 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388243    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 21:32:57.390241 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388245    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 21:32:57.390241 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388248    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 21:32:57.390743 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388250    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 21:32:57.390743 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388253    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 21:32:57.390743 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388255    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 21:32:57.390743 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388258    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 21:32:57.390743 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388262    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 21:32:57.390743 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388265    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 21:32:57.390743 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388268    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 21:32:57.390743 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388271    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 21:32:57.390743 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388273    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 21:32:57.390743 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388275    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 21:32:57.390743 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388278    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 21:32:57.390743 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388280    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 21:32:57.390743 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388300    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 21:32:57.390743 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388303    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 21:32:57.390743 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388306    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 21:32:57.390743 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388308    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 21:32:57.390743 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388312    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 21:32:57.390743 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388314    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 21:32:57.390743 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388317    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 21:32:57.391209 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388319    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 21:32:57.391209 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388322    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 21:32:57.391209 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388324    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 21:32:57.391209 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388327    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 21:32:57.391209 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388330    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 21:32:57.391209 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388333    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 21:32:57.391209 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388335    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 21:32:57.391209 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388338    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 21:32:57.391209 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388340    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 21:32:57.391209 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388343    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 21:32:57.391209 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388347    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 21:32:57.391209 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388350    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 21:32:57.391209 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388352    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 21:32:57.391209 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388355    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 21:32:57.391209 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388357    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 21:32:57.391209 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388359    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 21:32:57.391209 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388362    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 21:32:57.391209 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388364    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 21:32:57.391209 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388366    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 21:32:57.391209 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388369    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 21:32:57.391736 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388371    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 21:32:57.391736 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388373    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 21:32:57.391736 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388376    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 21:32:57.391736 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388378    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 21:32:57.391736 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388381    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 21:32:57.391736 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388383    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 21:32:57.391736 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388386    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 21:32:57.391736 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388389    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 21:32:57.391736 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388393    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 21:32:57.391736 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388395    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 21:32:57.391736 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388398    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 21:32:57.391736 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388401    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 21:32:57.391736 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388403    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 21:32:57.391736 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388406    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 21:32:57.391736 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388409    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 21:32:57.391736 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388411    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 21:32:57.391736 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388414    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 21:32:57.391736 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388774    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 21:32:57.391736 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388778    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 21:32:57.392218 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388781    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 21:32:57.392218 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388784    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 21:32:57.392218 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388787    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 21:32:57.392218 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388790    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 21:32:57.392218 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388793    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 21:32:57.392218 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388795    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 21:32:57.392218 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388798    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 21:32:57.392218 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388800    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 21:32:57.392218 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388803    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 21:32:57.392218 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388805    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 21:32:57.392218 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388808    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 21:32:57.392218 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388811    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 21:32:57.392218 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388813    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 21:32:57.392218 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388815    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 21:32:57.392218 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388818    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 21:32:57.392218 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388821    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 21:32:57.392218 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388823    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 21:32:57.392218 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388825    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 21:32:57.392218 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388828    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 21:32:57.392218 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388832    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 21:32:57.392729 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388836    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 21:32:57.392729 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388839    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 21:32:57.392729 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388842    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 21:32:57.392729 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388845    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 21:32:57.392729 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388847    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 21:32:57.392729 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388850    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 21:32:57.392729 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388853    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 21:32:57.392729 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388856    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 21:32:57.392729 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388858    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 21:32:57.392729 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388863    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 21:32:57.392729 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388865    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 21:32:57.392729 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388868    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 21:32:57.392729 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388873    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 21:32:57.392729 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388876    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 21:32:57.392729 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388879    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 21:32:57.392729 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388882    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 21:32:57.392729 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388885    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 21:32:57.392729 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388888    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 21:32:57.392729 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388891    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 21:32:57.393249 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388893    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 21:32:57.393249 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388896    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 21:32:57.393249 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388898    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 21:32:57.393249 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388900    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 21:32:57.393249 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388903    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 21:32:57.393249 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388905    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 21:32:57.393249 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388908    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 21:32:57.393249 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388910    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 21:32:57.393249 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388912    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 21:32:57.393249 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388915    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 21:32:57.393249 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388918    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 21:32:57.393249 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388920    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 21:32:57.393249 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388923    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 21:32:57.393249 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388925    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 21:32:57.393249 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388928    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 21:32:57.393249 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388930    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 21:32:57.393249 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388933    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 21:32:57.393249 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388935    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 21:32:57.393249 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388937    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 21:32:57.393249 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388940    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 21:32:57.393784 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388942    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 21:32:57.393784 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388945    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 21:32:57.393784 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388949    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 21:32:57.393784 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388952    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 21:32:57.393784 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388954    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 21:32:57.393784 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388957    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 21:32:57.393784 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388961    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 21:32:57.393784 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388963    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 21:32:57.393784 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388966    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 21:32:57.393784 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388968    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 21:32:57.393784 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388972    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 21:32:57.393784 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388975    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 21:32:57.393784 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388978    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 21:32:57.393784 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388980    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 21:32:57.393784 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388984    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 21:32:57.393784 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388986    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 21:32:57.393784 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388989    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 21:32:57.393784 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388991    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 21:32:57.393784 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388994    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 21:32:57.393784 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388996    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 21:32:57.394281 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.388999    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 21:32:57.394281 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389001    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 21:32:57.394281 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389004    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 21:32:57.394281 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389006    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 21:32:57.394281 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389009    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 21:32:57.394281 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389011    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 21:32:57.394281 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389013    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 21:32:57.394281 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389016    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 21:32:57.394281 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389018    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 21:32:57.394281 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389021    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 21:32:57.394281 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389023    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 21:32:57.394281 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389025    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 21:32:57.394281 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389028    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 21:32:57.394281 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389031    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 21:32:57.394281 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389035    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 21:32:57.394281 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389037    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 21:32:57.394281 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389039    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 21:32:57.394281 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389042    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 21:32:57.394281 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389115    2569 flags.go:64] FLAG: --address="0.0.0.0"
Jul 08 21:32:57.394281 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389122    2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 08 21:32:57.394819 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389128    2569 flags.go:64] FLAG: --anonymous-auth="true"
Jul 08 21:32:57.394819 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389132    2569 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 08 21:32:57.394819 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389135    2569 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 08 21:32:57.394819 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389140    2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 08 21:32:57.394819 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389144    2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 08 21:32:57.394819 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389148    2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 08 21:32:57.394819 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389151    2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 08 21:32:57.394819 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389154    2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 08 21:32:57.394819 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389157    2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 08 21:32:57.394819 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389160    2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 08 21:32:57.394819 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389163    2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 08 21:32:57.394819 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389166    2569 flags.go:64] FLAG: --cgroup-root=""
Jul 08 21:32:57.394819 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389169    2569 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 08 21:32:57.394819 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389172    2569 flags.go:64] FLAG: --client-ca-file=""
Jul 08 21:32:57.394819 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389175    2569 flags.go:64] FLAG: --cloud-provider="external"
Jul 08 21:32:57.394819 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389177    2569 flags.go:64] FLAG: --cluster-dns="[]"
Jul 08 21:32:57.394819 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389181    2569 flags.go:64] FLAG: --cluster-domain=""
Jul 08 21:32:57.394819 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389184    2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 08 21:32:57.394819 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389187    2569 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 08 21:32:57.394819 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389190    2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 08 21:32:57.394819 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389193    2569 flags.go:64] FLAG: --container-log-max-files="5"
Jul 08 21:32:57.394819 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389197    2569 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 08 21:32:57.394819 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389200    2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 08 21:32:57.395443 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389203    2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 08 21:32:57.395443 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389206    2569 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 08 21:32:57.395443 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389209    2569 flags.go:64] FLAG: --contention-profiling="false"
Jul 08 21:32:57.395443 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389213    2569 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 08 21:32:57.395443 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389216    2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 08 21:32:57.395443 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389219    2569 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 08 21:32:57.395443 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389221    2569 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 08 21:32:57.395443 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389226    2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 08 21:32:57.395443 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389230    2569 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 08 21:32:57.395443 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389232    2569 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 08 21:32:57.395443 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389236    2569 flags.go:64] FLAG: --enable-load-reader="false"
Jul 08 21:32:57.395443 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389239    2569 flags.go:64] FLAG: --enable-server="true"
Jul 08 21:32:57.395443 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389242    2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 08 21:32:57.395443 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389246    2569 flags.go:64] FLAG: --event-burst="100"
Jul 08 21:32:57.395443 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389249    2569 flags.go:64] FLAG: --event-qps="50"
Jul 08 21:32:57.395443 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389252    2569 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 08 21:32:57.395443 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389256    2569 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 08 21:32:57.395443 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389258    2569 flags.go:64] FLAG: --eviction-hard=""
Jul 08 21:32:57.395443 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389262    2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 08 21:32:57.395443 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389265    2569 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 08 21:32:57.395443 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389268    2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 08 21:32:57.395443 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389270    2569 flags.go:64] FLAG: --eviction-soft=""
Jul 08 21:32:57.395443 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389273    2569 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 08 21:32:57.395443 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389276    2569 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 08 21:32:57.395443 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389278    2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 08 21:32:57.396074 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389281    2569 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 08 21:32:57.396074 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389298    2569 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 08 21:32:57.396074 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389301    2569 flags.go:64] FLAG: --fail-swap-on="true"
Jul 08 21:32:57.396074 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389304    2569 flags.go:64] FLAG: --feature-gates=""
Jul 08 21:32:57.396074 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389308    2569 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 08 21:32:57.396074 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389311    2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 08 21:32:57.396074 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389314    2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 08 21:32:57.396074 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389317    2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 08 21:32:57.396074 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389320    2569 flags.go:64] FLAG: --healthz-port="10248"
Jul 08 21:32:57.396074 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389323    2569 flags.go:64] FLAG: --help="false"
Jul 08 21:32:57.396074 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389327    2569 flags.go:64] FLAG: --hostname-override="ip-10-0-131-83.ec2.internal"
Jul 08 21:32:57.396074 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389331    2569 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 08 21:32:57.396074 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389333    2569 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 08 21:32:57.396074 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389336    2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 08 21:32:57.396074 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389341    2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 08 21:32:57.396074 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389344    2569 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 08 21:32:57.396074 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389347    2569 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 08 21:32:57.396074 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389350    2569 flags.go:64] FLAG: --image-service-endpoint=""
Jul 08 21:32:57.396074 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389352    2569 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 08 21:32:57.396074 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389355    2569 flags.go:64] FLAG: --kube-api-burst="100"
Jul 08 21:32:57.396074 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389358    2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 08 21:32:57.396074 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389361    2569 flags.go:64] FLAG: --kube-api-qps="50"
Jul 08 21:32:57.396074 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389364    2569 flags.go:64] FLAG: --kube-reserved=""
Jul 08 21:32:57.396074 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389367    2569 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 08 21:32:57.396910 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389370    2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 08 21:32:57.396910 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389372    2569 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 08 21:32:57.396910 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389375    2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 08 21:32:57.396910 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389378    2569 flags.go:64] FLAG: --lock-file=""
Jul 08 21:32:57.396910 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389380    2569 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 08 21:32:57.396910 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389383    2569 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 08 21:32:57.396910 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389386    2569 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 08 21:32:57.396910 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389391    2569 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 08 21:32:57.396910 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389394    2569 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 08 21:32:57.396910 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389396    2569 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 08 21:32:57.396910 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389399    2569 flags.go:64] FLAG: --logging-format="text"
Jul 08 21:32:57.396910 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389401    2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 08 21:32:57.396910 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389405    2569 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 08 21:32:57.396910 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389407    2569 flags.go:64] FLAG: --manifest-url=""
Jul 08 21:32:57.396910 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389410    2569 flags.go:64] FLAG: --manifest-url-header=""
Jul 08 21:32:57.396910 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389413    2569 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 08 21:32:57.396910 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389416    2569 flags.go:64] FLAG: --max-open-files="1000000"
Jul 08 21:32:57.396910 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389420    2569 flags.go:64] FLAG: --max-pods="110"
Jul 08 21:32:57.396910 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389424    2569 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 08 21:32:57.396910 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389426    2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 08 21:32:57.396910 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389429    2569 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 08 21:32:57.396910 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389432    2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 08 21:32:57.396910 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389436    2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 08 21:32:57.396910 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389438    2569 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 08 21:32:57.396910 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389441    2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 08 21:32:57.397925 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389448    2569 flags.go:64] FLAG: --node-status-max-images="50"
Jul 08 21:32:57.397925 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389451    2569 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 08 21:32:57.397925 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389454    2569 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 08 21:32:57.397925 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389457    2569 flags.go:64] FLAG: --pod-cidr=""
Jul 08 21:32:57.397925 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389460    2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 08 21:32:57.397925 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389466    2569 flags.go:64] FLAG: --pod-manifest-path=""
Jul 08 21:32:57.397925 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389469    2569 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 08 21:32:57.397925 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389472    2569 flags.go:64] FLAG: --pods-per-core="0"
Jul 08 21:32:57.397925 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389474    2569 flags.go:64] FLAG: --port="10250"
Jul 08 21:32:57.397925 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389477    2569 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 08 21:32:57.397925 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389480    2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04fb8723c179f3817"
Jul 08 21:32:57.397925 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389483    2569 flags.go:64] FLAG: --qos-reserved=""
Jul 08 21:32:57.397925 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389486    2569 flags.go:64] FLAG: --read-only-port="10255"
Jul 08 21:32:57.397925 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389489    2569 flags.go:64] FLAG: --register-node="true"
Jul 08 21:32:57.397925 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389491    2569 flags.go:64] FLAG: --register-with-taints=""
Jul 08 21:32:57.397925 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389494    2569 flags.go:64] FLAG: --registry-burst="10"
Jul 08 21:32:57.397925 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389497    2569 flags.go:64] FLAG: --registry-qps="5"
Jul 08 21:32:57.397925 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389500    2569 flags.go:64] FLAG: --reserved-cpus=""
Jul 08 21:32:57.397925 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389502    2569 flags.go:64] FLAG: --reserved-memory=""
Jul 08 21:32:57.397925 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389506    2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 08 21:32:57.397925 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389509    2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 08 21:32:57.397925 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389511    2569 flags.go:64] FLAG: --rotate-certificates="false"
Jul 08 21:32:57.397925 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389514    2569 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 08 21:32:57.397925 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389517    2569 flags.go:64] FLAG: --runonce="false"
Jul 08 21:32:57.397925 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389520    2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 08 21:32:57.398767 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389522    2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 08 21:32:57.398767 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389527    2569 flags.go:64] FLAG: --seccomp-default="false"
Jul 08 21:32:57.398767 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389529    2569 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 08 21:32:57.398767 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389532    2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 08 21:32:57.398767 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389536    2569 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 08 21:32:57.398767 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389539    2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 08 21:32:57.398767 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389542    2569 flags.go:64] FLAG: --storage-driver-password="root"
Jul 08 21:32:57.398767 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389545    2569 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 08 21:32:57.398767 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389548    2569 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 08 21:32:57.398767 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389550    2569 flags.go:64] FLAG: --storage-driver-user="root"
Jul 08 21:32:57.398767 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389553    2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 08 21:32:57.398767 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389556    2569 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 08 21:32:57.398767 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389559    2569 flags.go:64] FLAG: --system-cgroups=""
Jul 08 21:32:57.398767 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389565    2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 08 21:32:57.398767 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389570    2569 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 08 21:32:57.398767 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389573    2569 flags.go:64] FLAG: --tls-cert-file=""
Jul 08 21:32:57.398767 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389576    2569 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 08 21:32:57.398767 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389579    2569 flags.go:64] FLAG: --tls-min-version=""
Jul 08 21:32:57.398767 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389582    2569 flags.go:64] FLAG: --tls-private-key-file=""
Jul 08 21:32:57.398767 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389585    2569 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 08 21:32:57.398767 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389587    2569 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 08 21:32:57.398767 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389590    2569 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 08 21:32:57.398767 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389592    2569 flags.go:64] FLAG: --v="2"
Jul 08 21:32:57.398767 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389596    2569 flags.go:64] FLAG: --version="false"
Jul 08 21:32:57.398767 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389599    2569 flags.go:64] FLAG: --vmodule=""
Jul 08 21:32:57.399446 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389603    2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 08 21:32:57.399446 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.389606    2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 08 21:32:57.399446 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389753    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 21:32:57.399446 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389759    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 21:32:57.399446 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389762    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 21:32:57.399446 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389765    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 21:32:57.399446 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389768    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 21:32:57.399446 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389771    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 21:32:57.399446 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389775    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 21:32:57.399446 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389777    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 21:32:57.399446 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389780    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 21:32:57.399446 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389784    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 21:32:57.399446 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389787    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 21:32:57.399446 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389789    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 21:32:57.399446 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389792    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 21:32:57.399446 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389794    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 21:32:57.399446 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389797    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 21:32:57.399446 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389799    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 21:32:57.399446 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389802    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 21:32:57.399446 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389804    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 21:32:57.399930 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389806    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 21:32:57.399930 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389815    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 21:32:57.399930 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389817    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 21:32:57.399930 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389820    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 21:32:57.399930 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389822    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 21:32:57.399930 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389825    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 21:32:57.399930 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389827    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 21:32:57.399930 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389829    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 21:32:57.399930 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389832    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 21:32:57.399930 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389835    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 21:32:57.399930 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389837    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 21:32:57.399930 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389840    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 21:32:57.399930 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389842    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 21:32:57.399930 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389844    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 21:32:57.399930 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389847    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 21:32:57.399930 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389849    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 21:32:57.399930 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389852    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 21:32:57.399930 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389854    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 21:32:57.399930 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389856    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 21:32:57.399930 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389859    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 21:32:57.400437 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389864    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 21:32:57.400437 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389867    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 21:32:57.400437 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389870    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 21:32:57.400437 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389873    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 21:32:57.400437 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389875    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 21:32:57.400437 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389878    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 21:32:57.400437 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389880    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 21:32:57.400437 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389883    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 21:32:57.400437 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389885    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 21:32:57.400437 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389888    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 21:32:57.400437 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389890    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 21:32:57.400437 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389892    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 21:32:57.400437 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389895    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 21:32:57.400437 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389897    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 21:32:57.400437 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389905    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 21:32:57.400437 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389907    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 21:32:57.400437 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389910    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 21:32:57.400437 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389912    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 21:32:57.400437 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389914    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 21:32:57.400437 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389917    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 21:32:57.400951 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389919    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 21:32:57.400951 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389922    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 21:32:57.400951 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389924    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 21:32:57.400951 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389927    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 21:32:57.400951 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389929    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 21:32:57.400951 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389932    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 21:32:57.400951 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389934    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 21:32:57.400951 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389937    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 21:32:57.400951 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389939    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 21:32:57.400951 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389942    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 21:32:57.400951 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389944    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 21:32:57.400951 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389948    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 21:32:57.400951 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389952    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 21:32:57.400951 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389955    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 21:32:57.400951 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389958    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 21:32:57.400951 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389962    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 21:32:57.400951 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389965    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 21:32:57.400951 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389968    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 21:32:57.400951 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389971    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 21:32:57.401476 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389973    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 21:32:57.401476 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389976    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 21:32:57.401476 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389980    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 21:32:57.401476 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389984    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 21:32:57.401476 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389986    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 21:32:57.401476 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389989    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 21:32:57.401476 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389991    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 21:32:57.401476 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.389993    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 21:32:57.401476 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.390001    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 21:32:57.401476 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.390004    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 21:32:57.401476 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.390007    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 21:32:57.401476 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.390009    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 21:32:57.401476 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.390012    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 21:32:57.401476 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.390014    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 21:32:57.401476 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.390016    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 21:32:57.401476 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.390019    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 21:32:57.401476 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.390021    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 21:32:57.401476 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.390023    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 21:32:57.401476 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.390026    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 21:32:57.401476 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.390028    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 21:32:57.401959 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.390032    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 21:32:57.401959 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.390035    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 21:32:57.401959 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.390040    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 21:32:57.401959 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.398645    2569 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 08 21:32:57.401959 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.398661    2569 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 08 21:32:57.401959 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.399507    2569 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 08 21:32:57.401959 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.399515    2569 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 08 21:32:57.401959 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399571    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 21:32:57.401959 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399577    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 21:32:57.401959 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399580    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 21:32:57.401959 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399583    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 21:32:57.401959 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399586    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 21:32:57.401959 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399589    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 21:32:57.401959 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399592    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 21:32:57.402344 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399594    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 21:32:57.402344 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399597    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 21:32:57.402344 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399600    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 21:32:57.402344 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399602    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 21:32:57.402344 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399604    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 21:32:57.402344 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399607    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 21:32:57.402344 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399609    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 21:32:57.402344 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399612    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 21:32:57.402344 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399614    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 21:32:57.402344 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399617    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 21:32:57.402344 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399619    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 21:32:57.402344 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399622    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 21:32:57.402344 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399624    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 21:32:57.402344 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399627    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 21:32:57.402344 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399630    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 21:32:57.402344 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399632    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 21:32:57.402344 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399635    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 21:32:57.402344 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399638    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 21:32:57.402344 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399640    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 21:32:57.402344 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399642    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 21:32:57.402830 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399645    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 21:32:57.402830 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399647    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 21:32:57.402830 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399651    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 21:32:57.402830 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399654    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 21:32:57.402830 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399657    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 21:32:57.402830 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399659    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 21:32:57.402830 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399662    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 21:32:57.402830 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399664    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 21:32:57.402830 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399667    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 21:32:57.402830 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399669    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 21:32:57.402830 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399672    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 21:32:57.402830 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399674    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 21:32:57.402830 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399677    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 21:32:57.402830 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399680    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 21:32:57.402830 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399682    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 21:32:57.402830 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399685    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 21:32:57.402830 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399687    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 21:32:57.402830 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399690    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 21:32:57.402830 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399692    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 21:32:57.402830 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399695    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 21:32:57.403342 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399698    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 21:32:57.403342 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399700    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 21:32:57.403342 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399703    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 21:32:57.403342 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399705    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 21:32:57.403342 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399707    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 21:32:57.403342 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399710    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 21:32:57.403342 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399712    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 21:32:57.403342 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399716    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 21:32:57.403342 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399720    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 21:32:57.403342 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399723    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 21:32:57.403342 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399725    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 21:32:57.403342 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399728    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 21:32:57.403342 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399730    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 21:32:57.403342 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399733    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 21:32:57.403342 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399736    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 21:32:57.403342 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399739    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 21:32:57.403342 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399742    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 21:32:57.403342 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399744    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 21:32:57.403342 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399747    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 21:32:57.403805 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399749    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 21:32:57.403805 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399752    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 21:32:57.403805 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399754    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 21:32:57.403805 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399756    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 21:32:57.403805 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399759    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 21:32:57.403805 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399761    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 21:32:57.403805 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399764    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 21:32:57.403805 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399767    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 21:32:57.403805 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399769    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 21:32:57.403805 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399771    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 21:32:57.403805 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399774    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 21:32:57.403805 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399776    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 21:32:57.403805 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399778    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 21:32:57.403805 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399781    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 21:32:57.403805 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399784    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 21:32:57.403805 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399786    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 21:32:57.403805 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399789    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 21:32:57.403805 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399791    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 21:32:57.403805 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399794    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 21:32:57.403805 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399796    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 21:32:57.404352 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399799    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 21:32:57.404352 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399801    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 21:32:57.404352 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399804    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 21:32:57.404352 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399806    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 21:32:57.404352 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399808    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 21:32:57.404352 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399811    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 21:32:57.404352 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399813    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 21:32:57.404352 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399818    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 21:32:57.404352 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399822    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 21:32:57.404352 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399826    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 21:32:57.404352 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399829    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 21:32:57.404352 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399832    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 21:32:57.404352 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399834    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 21:32:57.404352 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.399840    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 21:32:57.404352 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399968    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 21:32:57.404786 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399973    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 21:32:57.404786 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399977    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 21:32:57.404786 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399980    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 21:32:57.404786 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399983    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 21:32:57.404786 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399986    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 21:32:57.404786 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399990    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 21:32:57.404786 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399993    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 21:32:57.404786 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399995    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 21:32:57.404786 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.399998    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 21:32:57.404786 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400001    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 21:32:57.404786 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400003    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 21:32:57.404786 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400007    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 21:32:57.404786 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400009    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 21:32:57.404786 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400012    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 21:32:57.404786 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400014    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 21:32:57.404786 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400017    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 21:32:57.404786 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400020    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 21:32:57.404786 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400022    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 21:32:57.404786 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400026    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 21:32:57.405374 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400029    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 21:32:57.405374 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400032    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 21:32:57.405374 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400034    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 21:32:57.405374 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400037    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 21:32:57.405374 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400039    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 21:32:57.405374 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400042    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 21:32:57.405374 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400045    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 21:32:57.405374 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400047    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 21:32:57.405374 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400049    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 21:32:57.405374 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400052    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 21:32:57.405374 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400054    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 21:32:57.405374 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400056    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 21:32:57.405374 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400059    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 21:32:57.405374 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400062    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 21:32:57.405374 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400064    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 21:32:57.405374 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400067    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 21:32:57.405374 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400070    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 21:32:57.405374 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400073    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 21:32:57.405374 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400075    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 21:32:57.406119 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400078    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 21:32:57.406119 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400080    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 21:32:57.406119 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400083    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 21:32:57.406119 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400085    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 21:32:57.406119 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400088    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 21:32:57.406119 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400090    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 21:32:57.406119 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400093    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 21:32:57.406119 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400095    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 21:32:57.406119 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400098    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 21:32:57.406119 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400100    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 21:32:57.406119 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400102    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 21:32:57.406119 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400105    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 21:32:57.406119 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400107    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 21:32:57.406119 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400109    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 21:32:57.406119 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400111    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 21:32:57.406119 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400114    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 21:32:57.406119 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400116    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 21:32:57.406119 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400118    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 21:32:57.406119 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400121    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 21:32:57.406119 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400124    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 21:32:57.406756 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400126    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 21:32:57.406756 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400129    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 21:32:57.406756 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400131    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 21:32:57.406756 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400133    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 21:32:57.406756 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400136    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 21:32:57.406756 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400138    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 21:32:57.406756 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400140    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 21:32:57.406756 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400143    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 21:32:57.406756 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400145    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 21:32:57.406756 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400147    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 21:32:57.406756 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400150    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 21:32:57.406756 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400152    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 21:32:57.406756 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400154    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 21:32:57.406756 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400156    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 21:32:57.406756 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400159    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 21:32:57.406756 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400161    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 21:32:57.406756 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400164    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 21:32:57.406756 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400166    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 21:32:57.406756 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400168    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 21:32:57.406756 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400171    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 21:32:57.407248 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400174    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 21:32:57.407248 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400176    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 21:32:57.407248 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400178    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 21:32:57.407248 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400180    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 21:32:57.407248 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400183    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 21:32:57.407248 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400185    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 21:32:57.407248 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400188    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 21:32:57.407248 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400190    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 21:32:57.407248 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400192    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 21:32:57.407248 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400195    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 21:32:57.407248 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400198    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 21:32:57.407248 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400201    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 21:32:57.407248 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400203    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 21:32:57.407248 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400206    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 21:32:57.407248 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400208    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 21:32:57.407248 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400210    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 21:32:57.407248 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400213    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 21:32:57.407248 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400215    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 21:32:57.407248 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400217    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 21:32:57.407248 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:57.400220    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 21:32:57.407749 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.400225    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 21:32:57.407749 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.400366    2569 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 08 21:32:57.407749 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.402604    2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 08 21:32:57.407749 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.404152    2569 server.go:1019] "Starting client certificate rotation"
Jul 08 21:32:57.407749 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.404269    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 21:32:57.407749 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.404337    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 21:32:57.407749 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.406848    2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 21:32:57.408031 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.408004    2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 21:32:57.415377 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.415361    2569 log.go:25] "Validated CRI v1 runtime API"
Jul 08 21:32:57.417616 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.417600    2569 log.go:25] "Validated CRI v1 image API"
Jul 08 21:32:57.418405 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.418376    2569 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 08 21:32:57.422708 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.422681    2569 fs.go:135] Filesystem UUIDs: map[50c0f01f-88f1-453e-904b-90eb40c52813:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 979d17c4-576f-4df0-9c23-6ac2ec8734cd:/dev/nvme0n1p3]
Jul 08 21:32:57.422779 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.422707    2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 08 21:32:57.427812 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.427685    2569 manager.go:216] Machine: {Timestamp:2026-07-08 21:32:57.427137673 +0000 UTC m=+0.365470084 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100897 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec229a2e717e5635ec6e9679b5616ddd SystemUUID:ec229a2e-717e-5635-ec6e-9679b5616ddd BootID:9c7f0512-1a70-4872-a9db-b38d90ec63bf Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:7a:c2:f7:39:bd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:7a:c2:f7:39:bd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:9d:d3:07:db:3d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 08 21:32:57.427812 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.427807    2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 08 21:32:57.427925 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.427887    2569 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 08 21:32:57.431023 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.430978    2569 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 08 21:32:57.431182 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.431030    2569 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-83.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 08 21:32:57.432153 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.432142    2569 topology_manager.go:138] "Creating topology manager with none policy"
Jul 08 21:32:57.432186 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.432156    2569 container_manager_linux.go:309] "Creating device plugin manager"
Jul 08 21:32:57.432186 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.432163    2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 21:32:57.432770 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.432759    2569 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 21:32:57.434093 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.434078    2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 21:32:57.434245 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.434234    2569 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 08 21:32:57.437056 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.437045    2569 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 21:32:57.437187 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.437178    2569 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 08 21:32:57.437241 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.437221    2569 kubelet.go:486] "Attempting to sync node with API server"
Jul 08 21:32:57.437270 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.437248    2569 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 08 21:32:57.437270 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.437266    2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 08 21:32:57.437355 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.437345    2569 kubelet.go:398] "Adding apiserver pod source"
Jul 08 21:32:57.437383 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.437360    2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 08 21:32:57.440802 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.440776    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 21:32:57.440890 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.440823    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 21:32:57.443187 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.443165    2569 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 08 21:32:57.445452 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.445440    2569 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 08 21:32:57.445494 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.445470    2569 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 08 21:32:57.446738 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.446724    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 08 21:32:57.446738 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.446741    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 08 21:32:57.446827 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.446747    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 08 21:32:57.446827 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.446753    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 08 21:32:57.446827 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.446762    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 08 21:32:57.446827 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.446767    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 08 21:32:57.446827 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.446774    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 08 21:32:57.446827 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.446781    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 08 21:32:57.446827 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.446788    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 08 21:32:57.446827 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.446793    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 08 21:32:57.446827 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.446800    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 08 21:32:57.446827 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.446807    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 08 21:32:57.447502 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.447492    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 08 21:32:57.447502 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.447502    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 08 21:32:57.448893 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:57.448871    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-83.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 08 21:32:57.448934 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:57.448873    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 08 21:32:57.450686 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.450673    2569 server.go:1268] "Started kubelet"
Jul 08 21:32:57.451301 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.450741    2569 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 08 21:32:57.451301 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.450792    2569 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 08 21:32:57.451301 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.450799    2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 08 21:32:57.451688 ip-10-0-131-83 systemd[1]: Started Kubernetes Kubelet.
Jul 08 21:32:57.453021 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.453003    2569 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-83.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 08 21:32:57.453530 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.453511    2569 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 08 21:32:57.453856 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.453842    2569 server.go:310] "Adding debug handlers to kubelet server"
Jul 08 21:32:57.456493 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:57.456471    2569 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 08 21:32:57.458215 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.458201    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-65m4f"
Jul 08 21:32:57.459916 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.459903    2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 08 21:32:57.459975 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.459919    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 08 21:32:57.460069 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:57.460052    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-83.ec2.internal\" not found"
Jul 08 21:32:57.460647 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:57.459589    2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-83.ec2.internal.18c06dfb0c617397  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-83.ec2.internal,UID:ip-10-0-131-83.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-83.ec2.internal,},FirstTimestamp:2026-07-08 21:32:57.450648471 +0000 UTC m=+0.388980861,LastTimestamp:2026-07-08 21:32:57.450648471 +0000 UTC m=+0.388980861,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-83.ec2.internal,}"
Jul 08 21:32:57.460753 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.460739    2569 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 08 21:32:57.460834 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.460820    2569 factory.go:55] Registering systemd factory
Jul 08 21:32:57.460871 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.460839    2569 factory.go:223] Registration of the systemd container factory successfully
Jul 08 21:32:57.460923 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.460819    2569 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 08 21:32:57.460923 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.460897    2569 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 08 21:32:57.461024 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.461010    2569 reconstruct.go:97] "Volume reconstruction finished"
Jul 08 21:32:57.461024 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.461023    2569 reconciler.go:29] "Reconciler: start to sync state"
Jul 08 21:32:57.461110 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.461074    2569 factory.go:153] Registering CRI-O factory
Jul 08 21:32:57.461110 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.461087    2569 factory.go:223] Registration of the crio container factory successfully
Jul 08 21:32:57.461185 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.461139    2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 08 21:32:57.461185 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.461162    2569 factory.go:103] Registering Raw factory
Jul 08 21:32:57.461185 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.461175    2569 manager.go:1196] Started watching for new ooms in manager
Jul 08 21:32:57.462689 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.462268    2569 manager.go:349] Starting recovery of all containers
Jul 08 21:32:57.463319 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:57.463271    2569 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-83.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 08 21:32:57.463319 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:57.463305    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 08 21:32:57.470383 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.470355    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-65m4f"
Jul 08 21:32:57.472176 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.472020    2569 manager.go:354] Recovery completed
Jul 08 21:32:57.474828 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:57.474808    2569 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 08 21:32:57.477785 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.477770    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 21:32:57.480080 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.480062    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 21:32:57.480165 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.480093    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 21:32:57.480165 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.480108    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasSufficientPID"
Jul 08 21:32:57.480647 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.480632    2569 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 08 21:32:57.480647 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.480647    2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 08 21:32:57.480762 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.480666    2569 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 21:32:57.480762 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.480638    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 21:32:57.481445 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.481431    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 21:32:57.481498 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.481456    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 21:32:57.481498 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.481467    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasSufficientPID"
Jul 08 21:32:57.481847 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.481836    2569 policy_none.go:49] "None policy: Start"
Jul 08 21:32:57.481881 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.481853    2569 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 08 21:32:57.481881 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.481863    2569 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 08 21:32:57.482507 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:57.482442    2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-83.ec2.internal.18c06dfb0e22899c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-83.ec2.internal,UID:ip-10-0-131-83.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-83.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-83.ec2.internal,},FirstTimestamp:2026-07-08 21:32:57.480079772 +0000 UTC m=+0.418412168,LastTimestamp:2026-07-08 21:32:57.480079772 +0000 UTC m=+0.418412168,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-83.ec2.internal,}"
Jul 08 21:32:57.482918 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.482908    2569 policy_none.go:47] "Start"
Jul 08 21:32:57.517845 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.517828    2569 manager.go:337] "Starting Device Plugin manager"
Jul 08 21:32:57.517933 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:57.517864    2569 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 08 21:32:57.517933 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.517878    2569 server.go:87] "Starting device plugin registration server"
Jul 08 21:32:57.518175 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.518160    2569 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 08 21:32:57.518210 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.518180    2569 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 08 21:32:57.518316 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.518299    2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 08 21:32:57.518455 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.518432    2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 08 21:32:57.518455 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.518445    2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 08 21:32:57.518925 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:57.518908    2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 08 21:32:57.518988 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:57.518949    2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-83.ec2.internal\" not found"
Jul 08 21:32:57.604782 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.604743    2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 08 21:32:57.606115 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.606101    2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 08 21:32:57.606167 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.606137    2569 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 08 21:32:57.606167 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.606161    2569 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 08 21:32:57.606244 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:57.606194    2569 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 08 21:32:57.608519 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.608497    2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 21:32:57.618983 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.618962    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 21:32:57.619765 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.619741    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 21:32:57.619850 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.619777    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 21:32:57.619850 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.619791    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasSufficientPID"
Jul 08 21:32:57.619850 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.619820    2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-83.ec2.internal"
Jul 08 21:32:57.628048 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.628002    2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-83.ec2.internal"
Jul 08 21:32:57.628048 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:57.628025    2569 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-83.ec2.internal\": node \"ip-10-0-131-83.ec2.internal\" not found"
Jul 08 21:32:57.641420 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:57.641404    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-83.ec2.internal\" not found"
Jul 08 21:32:57.707033 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.706994    2569 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-83.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-83.ec2.internal"]
Jul 08 21:32:57.707144 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.707086    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 21:32:57.708687 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.708672    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 21:32:57.708762 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.708700    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 21:32:57.708762 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.708711    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasSufficientPID"
Jul 08 21:32:57.710033 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.710021    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 21:32:57.710155 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.710142    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-83.ec2.internal"
Jul 08 21:32:57.710192 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.710174    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 21:32:57.710757 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.710739    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 21:32:57.710757 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.710747    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 21:32:57.710882 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.710771    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 21:32:57.710882 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.710771    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 21:32:57.710882 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.710781    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasSufficientPID"
Jul 08 21:32:57.710882 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.710790    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasSufficientPID"
Jul 08 21:32:57.711922 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.711909    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-83.ec2.internal"
Jul 08 21:32:57.711972 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.711936    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 21:32:57.712608 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.712592    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 21:32:57.712708 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.712614    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 21:32:57.712708 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.712624    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeHasSufficientPID"
Jul 08 21:32:57.737044 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:57.737023    2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-83.ec2.internal\" not found" node="ip-10-0-131-83.ec2.internal"
Jul 08 21:32:57.741434 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:57.741419    2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-83.ec2.internal\" not found" node="ip-10-0-131-83.ec2.internal"
Jul 08 21:32:57.742411 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:57.742397    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-83.ec2.internal\" not found"
Jul 08 21:32:57.762482 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.762457    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/53be9f26ebbce9e8712878906521c6f8-config\") pod \"kube-apiserver-proxy-ip-10-0-131-83.ec2.internal\" (UID: \"53be9f26ebbce9e8712878906521c6f8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-83.ec2.internal"
Jul 08 21:32:57.762560 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.762484    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4407acfac9b3a400518ad059d4a0580d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-83.ec2.internal\" (UID: \"4407acfac9b3a400518ad059d4a0580d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-83.ec2.internal"
Jul 08 21:32:57.762560 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.762507    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4407acfac9b3a400518ad059d4a0580d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-83.ec2.internal\" (UID: \"4407acfac9b3a400518ad059d4a0580d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-83.ec2.internal"
Jul 08 21:32:57.842521 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:57.842480    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-83.ec2.internal\" not found"
Jul 08 21:32:57.863508 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.863486    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/53be9f26ebbce9e8712878906521c6f8-config\") pod \"kube-apiserver-proxy-ip-10-0-131-83.ec2.internal\" (UID: \"53be9f26ebbce9e8712878906521c6f8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-83.ec2.internal"
Jul 08 21:32:57.863567 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.863512    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4407acfac9b3a400518ad059d4a0580d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-83.ec2.internal\" (UID: \"4407acfac9b3a400518ad059d4a0580d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-83.ec2.internal"
Jul 08 21:32:57.863567 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.863529    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4407acfac9b3a400518ad059d4a0580d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-83.ec2.internal\" (UID: \"4407acfac9b3a400518ad059d4a0580d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-83.ec2.internal"
Jul 08 21:32:57.863651 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.863586    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/53be9f26ebbce9e8712878906521c6f8-config\") pod \"kube-apiserver-proxy-ip-10-0-131-83.ec2.internal\" (UID: \"53be9f26ebbce9e8712878906521c6f8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-83.ec2.internal"
Jul 08 21:32:57.863651 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.863592    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4407acfac9b3a400518ad059d4a0580d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-83.ec2.internal\" (UID: \"4407acfac9b3a400518ad059d4a0580d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-83.ec2.internal"
Jul 08 21:32:57.863651 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:57.863592    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4407acfac9b3a400518ad059d4a0580d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-83.ec2.internal\" (UID: \"4407acfac9b3a400518ad059d4a0580d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-83.ec2.internal"
Jul 08 21:32:57.943432 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:57.943404    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-83.ec2.internal\" not found"
Jul 08 21:32:58.040685 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.040658    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-83.ec2.internal"
Jul 08 21:32:58.043561 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:58.043522    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-83.ec2.internal\" not found"
Jul 08 21:32:58.045219 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.045019    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-83.ec2.internal"
Jul 08 21:32:58.143681 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:58.143639    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-83.ec2.internal\" not found"
Jul 08 21:32:58.250275 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:58.250179    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-83.ec2.internal\" not found"
Jul 08 21:32:58.351355 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:58.351286    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-83.ec2.internal\" not found"
Jul 08 21:32:58.403853 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.403811    2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 08 21:32:58.404425 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.403995    2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 08 21:32:58.425722 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.425691    2569 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 21:32:58.437870 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.437834    2569 apiserver.go:52] "Watching apiserver"
Jul 08 21:32:58.448656 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.448629    2569 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 08 21:32:58.449108 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.449085    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-xnzfd","openshift-ovn-kubernetes/ovnkube-node-6cs4g","kube-system/global-pull-secret-syncer-pmsd9","kube-system/konnectivity-agent-hhqv4","openshift-multus/multus-bgl2j","openshift-network-diagnostics/network-check-target-jxssk","openshift-network-operator/iptables-alerter-6q8p8","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7t4d","openshift-cluster-node-tuning-operator/tuned-gnqw5","openshift-dns/node-resolver-5wfz7","openshift-image-registry/node-ca-mdr2r","openshift-multus/multus-additional-cni-plugins-wbw7t"]
Jul 08 21:32:58.450724 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.450704    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xnzfd"
Jul 08 21:32:58.450827 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:58.450805    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xnzfd" podUID="6dbaf20f-e3bc-4428-9365-fd159b742280"
Jul 08 21:32:58.452224 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.452184    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.453706 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.453688    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pmsd9"
Jul 08 21:32:58.453807 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:58.453787    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pmsd9" podUID="863b1cfe-1f2f-426e-9a5e-c6aee4205013"
Jul 08 21:32:58.455440 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.455119    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 08 21:32:58.455440 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.455108    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 08 21:32:58.455440 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.455334    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hhqv4"
Jul 08 21:32:58.455440 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.455166    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ctc4r\""
Jul 08 21:32:58.457774 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.455820    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 08 21:32:58.457774 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.456025    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 08 21:32:58.457774 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.456333    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 08 21:32:58.457774 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.456538    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 08 21:32:58.457774 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.457363    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.458800 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.458697    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gmr52\""
Jul 08 21:32:58.458800 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.458773    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 08 21:32:58.458969 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.458780    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 08 21:32:58.459088 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.459072    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxssk"
Jul 08 21:32:58.459190 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:58.459169    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxssk" podUID="5fde744c-b4ec-4557-aa38-a5c8e43337f4"
Jul 08 21:32:58.459621 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.459598    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 08 21:32:58.459807 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.459790    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 08 21:32:58.459876 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.459846    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 08 21:32:58.459994 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.459973    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8k4vg\""
Jul 08 21:32:58.459994 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.459989    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 08 21:32:58.460149 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.460006    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 08 21:32:58.460149 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.460094    2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-83.ec2.internal"
Jul 08 21:32:58.460594 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.460575    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6q8p8"
Jul 08 21:32:58.462011 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.461984    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7t4d"
Jul 08 21:32:58.463516 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.463499    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.464934 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.464916    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5wfz7"
Jul 08 21:32:58.466488 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.466459    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mdr2r"
Jul 08 21:32:58.467049 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.466574    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-cnibin\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.467049 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.466608    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a022d640-79f0-4d35-be9a-9c6ac708d10b-env-overrides\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.467049 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.466633    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.467049 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.466655    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a022d640-79f0-4d35-be9a-9c6ac708d10b-ovnkube-config\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.467049 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.466677    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/863b1cfe-1f2f-426e-9a5e-c6aee4205013-original-pull-secret\") pod \"global-pull-secret-syncer-pmsd9\" (UID: \"863b1cfe-1f2f-426e-9a5e-c6aee4205013\") " pod="kube-system/global-pull-secret-syncer-pmsd9"
Jul 08 21:32:58.467049 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.466705    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggqws\" (UniqueName: \"kubernetes.io/projected/5fde744c-b4ec-4557-aa38-a5c8e43337f4-kube-api-access-ggqws\") pod \"network-check-target-jxssk\" (UID: \"5fde744c-b4ec-4557-aa38-a5c8e43337f4\") " pod="openshift-network-diagnostics/network-check-target-jxssk"
Jul 08 21:32:58.467049 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.466725    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-host-kubelet\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.467049 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.466745    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-host-var-lib-cni-bin\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.467049 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.466766    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-host-var-lib-kubelet\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.467049 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.466787    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-host-var-lib-cni-multus\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.467049 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.466811    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3838e3de-7636-4c3a-8406-bab163d769ae-socket-dir\") pod \"aws-ebs-csi-driver-node-s7t4d\" (UID: \"3838e3de-7636-4c3a-8406-bab163d769ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7t4d"
Jul 08 21:32:58.467049 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.466837    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-etc-openvswitch\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.467049 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.466920    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-host-slash\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.467049 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.466945    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-var-lib-openvswitch\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.467049 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.466970    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-host-cni-netd\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.467049 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.467046    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-multus-daemon-config\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.467812 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.467088    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-etc-kubernetes\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.467812 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.467113    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3838e3de-7636-4c3a-8406-bab163d769ae-etc-selinux\") pod \"aws-ebs-csi-driver-node-s7t4d\" (UID: \"3838e3de-7636-4c3a-8406-bab163d769ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7t4d"
Jul 08 21:32:58.467812 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.467135    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-host-run-ovn-kubernetes\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.467812 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.467161    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-system-cni-dir\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.467812 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.467185    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkkjm\" (UniqueName: \"kubernetes.io/projected/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-kube-api-access-fkkjm\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.467812 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.467209    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/863b1cfe-1f2f-426e-9a5e-c6aee4205013-dbus\") pod \"global-pull-secret-syncer-pmsd9\" (UID: \"863b1cfe-1f2f-426e-9a5e-c6aee4205013\") " pod="kube-system/global-pull-secret-syncer-pmsd9"
Jul 08 21:32:58.467812 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.467231    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6dbaf20f-e3bc-4428-9365-fd159b742280-metrics-certs\") pod \"network-metrics-daemon-xnzfd\" (UID: \"6dbaf20f-e3bc-4428-9365-fd159b742280\") " pod="openshift-multus/network-metrics-daemon-xnzfd"
Jul 08 21:32:58.467812 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.467246    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-run-openvswitch\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.467812 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.467301    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-node-log\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.467812 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.467331    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a022d640-79f0-4d35-be9a-9c6ac708d10b-ovnkube-script-lib\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.467812 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.467365    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-host-run-k8s-cni-cncf-io\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.467812 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.467408    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b1915083-20cf-4eeb-8a60-98ca27325782-iptables-alerter-script\") pod \"iptables-alerter-6q8p8\" (UID: \"b1915083-20cf-4eeb-8a60-98ca27325782\") " pod="openshift-network-operator/iptables-alerter-6q8p8"
Jul 08 21:32:58.467812 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.467444    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnscb\" (UniqueName: \"kubernetes.io/projected/3838e3de-7636-4c3a-8406-bab163d769ae-kube-api-access-qnscb\") pod \"aws-ebs-csi-driver-node-s7t4d\" (UID: \"3838e3de-7636-4c3a-8406-bab163d769ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7t4d"
Jul 08 21:32:58.467812 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.467496    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/863b1cfe-1f2f-426e-9a5e-c6aee4205013-kubelet-config\") pod \"global-pull-secret-syncer-pmsd9\" (UID: \"863b1cfe-1f2f-426e-9a5e-c6aee4205013\") " pod="kube-system/global-pull-secret-syncer-pmsd9"
Jul 08 21:32:58.467812 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.467527    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-multus-cni-dir\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.467812 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.467552    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-os-release\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.468628 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.467581    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-multus-socket-dir-parent\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.468628 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.467633    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-multus-conf-dir\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.468628 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.467659    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-host-cni-bin\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.468628 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.467719    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-systemd-units\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.468628 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.467752    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-run-systemd\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.468628 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.467797    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xllx6\" (UniqueName: \"kubernetes.io/projected/a022d640-79f0-4d35-be9a-9c6ac708d10b-kube-api-access-xllx6\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.468628 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.467874    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 08 21:32:58.468628 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.467939    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-host-run-netns\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.468628 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.467982    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-host-run-netns\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.468628 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.468010    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3838e3de-7636-4c3a-8406-bab163d769ae-device-dir\") pod \"aws-ebs-csi-driver-node-s7t4d\" (UID: \"3838e3de-7636-4c3a-8406-bab163d769ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7t4d"
Jul 08 21:32:58.468628 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.468033    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 08 21:32:58.468628 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.468035    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e7921e50-7309-4703-8a27-a9e51260d4a0-konnectivity-ca\") pod \"konnectivity-agent-hhqv4\" (UID: \"e7921e50-7309-4703-8a27-a9e51260d4a0\") " pod="kube-system/konnectivity-agent-hhqv4"
Jul 08 21:32:58.468628 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.468121    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 08 21:32:58.468628 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.468135    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-log-socket\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.468628 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.468165    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-host-run-multus-certs\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.468628 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.468190    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3838e3de-7636-4c3a-8406-bab163d769ae-registration-dir\") pod \"aws-ebs-csi-driver-node-s7t4d\" (UID: \"3838e3de-7636-4c3a-8406-bab163d769ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7t4d"
Jul 08 21:32:58.468628 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.468197    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6fq6d\""
Jul 08 21:32:58.468628 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.468214    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e7921e50-7309-4703-8a27-a9e51260d4a0-agent-certs\") pod \"konnectivity-agent-hhqv4\" (UID: \"e7921e50-7309-4703-8a27-a9e51260d4a0\") " pod="kube-system/konnectivity-agent-hhqv4"
Jul 08 21:32:58.468628 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.468238    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-run-ovn\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.469486 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.468288    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-cni-binary-copy\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.469486 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.468314    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b1915083-20cf-4eeb-8a60-98ca27325782-host-slash\") pod \"iptables-alerter-6q8p8\" (UID: \"b1915083-20cf-4eeb-8a60-98ca27325782\") " pod="openshift-network-operator/iptables-alerter-6q8p8"
Jul 08 21:32:58.469486 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.468346    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 08 21:32:58.469486 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.468438    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8z5ch\""
Jul 08 21:32:58.469486 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.468344    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v85cp\" (UniqueName: \"kubernetes.io/projected/6dbaf20f-e3bc-4428-9365-fd159b742280-kube-api-access-v85cp\") pod \"network-metrics-daemon-xnzfd\" (UID: \"6dbaf20f-e3bc-4428-9365-fd159b742280\") " pod="openshift-multus/network-metrics-daemon-xnzfd"
Jul 08 21:32:58.469486 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.468478    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a022d640-79f0-4d35-be9a-9c6ac708d10b-ovn-node-metrics-cert\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.469486 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.468501    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3838e3de-7636-4c3a-8406-bab163d769ae-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s7t4d\" (UID: \"3838e3de-7636-4c3a-8406-bab163d769ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7t4d"
Jul 08 21:32:58.469486 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.468524    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3838e3de-7636-4c3a-8406-bab163d769ae-sys-fs\") pod \"aws-ebs-csi-driver-node-s7t4d\" (UID: \"3838e3de-7636-4c3a-8406-bab163d769ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7t4d"
Jul 08 21:32:58.469486 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.468550    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-hostroot\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.469486 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.468589    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k9t2\" (UniqueName: \"kubernetes.io/projected/b1915083-20cf-4eeb-8a60-98ca27325782-kube-api-access-4k9t2\") pod \"iptables-alerter-6q8p8\" (UID: \"b1915083-20cf-4eeb-8a60-98ca27325782\") " pod="openshift-network-operator/iptables-alerter-6q8p8"
Jul 08 21:32:58.469486 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.468596    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 08 21:32:58.469486 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.468673    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 08 21:32:58.469486 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.468686    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 08 21:32:58.469486 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.468703    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 08 21:32:58.469486 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.468861    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 08 21:32:58.469486 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.468938    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5rlrx\""
Jul 08 21:32:58.469486 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.469033    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 08 21:32:58.469486 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.469040    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 08 21:32:58.469486 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.469098    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-n9jc6\""
Jul 08 21:32:58.469486 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.469116    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wbw7t"
Jul 08 21:32:58.469486 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.469177    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qwrzf\""
Jul 08 21:32:58.469486 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.469241    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 08 21:32:58.469486 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.469413    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 08 21:32:58.472735 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.472719    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 08 21:32:58.472788 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.472735    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 08 21:32:58.472864 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.472850    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-v4tt4\""
Jul 08 21:32:58.473319 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.473287    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 21:27:57 +0000 UTC" deadline="2028-03-20 05:28:52.052701764 +0000 UTC"
Jul 08 21:32:58.473406 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.473351    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14887h55m53.579353974s"
Jul 08 21:32:58.477108 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.477092    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 21:32:58.477192 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.477168    2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-83.ec2.internal"
Jul 08 21:32:58.477268 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.477253    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-83.ec2.internal"]
Jul 08 21:32:58.480335 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.480317    2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 21:32:58.486603 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.486588    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 21:32:58.486731 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.486716    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-83.ec2.internal"]
Jul 08 21:32:58.505092 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.505035    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-987ps"
Jul 08 21:32:58.516233 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.516207    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-987ps"
Jul 08 21:32:58.561772 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.561746    2569 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 08 21:32:58.569243 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.569191    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/773e320a-2215-4512-a09c-2249707f24f7-system-cni-dir\") pod \"multus-additional-cni-plugins-wbw7t\" (UID: \"773e320a-2215-4512-a09c-2249707f24f7\") " pod="openshift-multus/multus-additional-cni-plugins-wbw7t"
Jul 08 21:32:58.569349 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.569256    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a9d31b5d-381f-4096-8ee4-f964085df274-etc-sysconfig\") pod \"tuned-gnqw5\" (UID: \"a9d31b5d-381f-4096-8ee4-f964085df274\") " pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.569349 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.569293    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a022d640-79f0-4d35-be9a-9c6ac708d10b-env-overrides\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.569349 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.569337    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.569517 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.569364    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a022d640-79f0-4d35-be9a-9c6ac708d10b-ovnkube-config\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.569517 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.569390    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/863b1cfe-1f2f-426e-9a5e-c6aee4205013-original-pull-secret\") pod \"global-pull-secret-syncer-pmsd9\" (UID: \"863b1cfe-1f2f-426e-9a5e-c6aee4205013\") " pod="kube-system/global-pull-secret-syncer-pmsd9"
Jul 08 21:32:58.569517 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.569416    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggqws\" (UniqueName: \"kubernetes.io/projected/5fde744c-b4ec-4557-aa38-a5c8e43337f4-kube-api-access-ggqws\") pod \"network-check-target-jxssk\" (UID: \"5fde744c-b4ec-4557-aa38-a5c8e43337f4\") " pod="openshift-network-diagnostics/network-check-target-jxssk"
Jul 08 21:32:58.569517 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.569438    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-host-kubelet\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.569517 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.569444    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.569517 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.569461    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-host-var-lib-cni-bin\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.569517 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.569510    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-host-var-lib-cni-bin\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.569957 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.569516    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-host-var-lib-kubelet\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.569957 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.569559    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-host-var-lib-cni-multus\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.569957 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.569589    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3838e3de-7636-4c3a-8406-bab163d769ae-socket-dir\") pod \"aws-ebs-csi-driver-node-s7t4d\" (UID: \"3838e3de-7636-4c3a-8406-bab163d769ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7t4d"
Jul 08 21:32:58.569957 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:58.569597    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 21:32:58.569957 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.569625    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6f70df4a-7077-418a-9afe-02c4e6792fcc-serviceca\") pod \"node-ca-mdr2r\" (UID: \"6f70df4a-7077-418a-9afe-02c4e6792fcc\") " pod="openshift-image-registry/node-ca-mdr2r"
Jul 08 21:32:58.569957 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.569561    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-host-kubelet\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.569957 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.569652    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/773e320a-2215-4512-a09c-2249707f24f7-cnibin\") pod \"multus-additional-cni-plugins-wbw7t\" (UID: \"773e320a-2215-4512-a09c-2249707f24f7\") " pod="openshift-multus/multus-additional-cni-plugins-wbw7t"
Jul 08 21:32:58.569957 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.569664    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-host-var-lib-kubelet\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.569957 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:58.569684    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/863b1cfe-1f2f-426e-9a5e-c6aee4205013-original-pull-secret podName:863b1cfe-1f2f-426e-9a5e-c6aee4205013 nodeName:}" failed. No retries permitted until 2026-07-08 21:32:59.069660674 +0000 UTC m=+2.007993086 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/863b1cfe-1f2f-426e-9a5e-c6aee4205013-original-pull-secret") pod "global-pull-secret-syncer-pmsd9" (UID: "863b1cfe-1f2f-426e-9a5e-c6aee4205013") : object "kube-system"/"original-pull-secret" not registered
Jul 08 21:32:58.569957 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.569729    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a9d31b5d-381f-4096-8ee4-f964085df274-etc-sysctl-conf\") pod \"tuned-gnqw5\" (UID: \"a9d31b5d-381f-4096-8ee4-f964085df274\") " pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.569957 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.569753    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3838e3de-7636-4c3a-8406-bab163d769ae-socket-dir\") pod \"aws-ebs-csi-driver-node-s7t4d\" (UID: \"3838e3de-7636-4c3a-8406-bab163d769ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7t4d"
Jul 08 21:32:58.569957 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.569758    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-host-var-lib-cni-multus\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.569957 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.569754    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9zll\" (UniqueName: \"kubernetes.io/projected/a9d31b5d-381f-4096-8ee4-f964085df274-kube-api-access-n9zll\") pod \"tuned-gnqw5\" (UID: \"a9d31b5d-381f-4096-8ee4-f964085df274\") " pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.569957 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.569811    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-etc-openvswitch\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.569957 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.569845    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9d31b5d-381f-4096-8ee4-f964085df274-tmp\") pod \"tuned-gnqw5\" (UID: \"a9d31b5d-381f-4096-8ee4-f964085df274\") " pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.569957 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.569848    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-etc-openvswitch\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.569957 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.569874    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a022d640-79f0-4d35-be9a-9c6ac708d10b-env-overrides\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.570869 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.569878    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-host-slash\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.570869 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.569901    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-var-lib-openvswitch\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.570869 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.569909    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-host-slash\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.570869 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.569918    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-host-cni-netd\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.570869 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.569940    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-multus-daemon-config\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.570869 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.569956    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-etc-kubernetes\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.570869 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.569960    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-host-cni-netd\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.570869 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.569976    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a9d31b5d-381f-4096-8ee4-f964085df274-etc-modprobe-d\") pod \"tuned-gnqw5\" (UID: \"a9d31b5d-381f-4096-8ee4-f964085df274\") " pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.570869 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.569977    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-var-lib-openvswitch\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.570869 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570003    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3838e3de-7636-4c3a-8406-bab163d769ae-etc-selinux\") pod \"aws-ebs-csi-driver-node-s7t4d\" (UID: \"3838e3de-7636-4c3a-8406-bab163d769ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7t4d"
Jul 08 21:32:58.570869 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570021    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-etc-kubernetes\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.570869 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570031    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-host-run-ovn-kubernetes\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.570869 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570063    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-system-cni-dir\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.570869 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570072    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-host-run-ovn-kubernetes\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.570869 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570090    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkkjm\" (UniqueName: \"kubernetes.io/projected/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-kube-api-access-fkkjm\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.570869 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570102    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3838e3de-7636-4c3a-8406-bab163d769ae-etc-selinux\") pod \"aws-ebs-csi-driver-node-s7t4d\" (UID: \"3838e3de-7636-4c3a-8406-bab163d769ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7t4d"
Jul 08 21:32:58.570869 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570116    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/773e320a-2215-4512-a09c-2249707f24f7-os-release\") pod \"multus-additional-cni-plugins-wbw7t\" (UID: \"773e320a-2215-4512-a09c-2249707f24f7\") " pod="openshift-multus/multus-additional-cni-plugins-wbw7t"
Jul 08 21:32:58.571745 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570126    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-system-cni-dir\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.571745 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570139    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a9d31b5d-381f-4096-8ee4-f964085df274-etc-sysctl-d\") pod \"tuned-gnqw5\" (UID: \"a9d31b5d-381f-4096-8ee4-f964085df274\") " pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.571745 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570163    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr5xf\" (UniqueName: \"kubernetes.io/projected/1cdf17b8-152a-4cca-9050-ef85d4131f91-kube-api-access-dr5xf\") pod \"node-resolver-5wfz7\" (UID: \"1cdf17b8-152a-4cca-9050-ef85d4131f91\") " pod="openshift-dns/node-resolver-5wfz7"
Jul 08 21:32:58.571745 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570183    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/863b1cfe-1f2f-426e-9a5e-c6aee4205013-dbus\") pod \"global-pull-secret-syncer-pmsd9\" (UID: \"863b1cfe-1f2f-426e-9a5e-c6aee4205013\") " pod="kube-system/global-pull-secret-syncer-pmsd9"
Jul 08 21:32:58.571745 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570198    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6dbaf20f-e3bc-4428-9365-fd159b742280-metrics-certs\") pod \"network-metrics-daemon-xnzfd\" (UID: \"6dbaf20f-e3bc-4428-9365-fd159b742280\") " pod="openshift-multus/network-metrics-daemon-xnzfd"
Jul 08 21:32:58.571745 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570218    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-run-openvswitch\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.571745 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570228    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a022d640-79f0-4d35-be9a-9c6ac708d10b-ovnkube-config\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.571745 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570246    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-node-log\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.571745 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570294    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a022d640-79f0-4d35-be9a-9c6ac708d10b-ovnkube-script-lib\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.571745 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570307    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-run-openvswitch\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.571745 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570322    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-host-run-k8s-cni-cncf-io\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.571745 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570355    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b1915083-20cf-4eeb-8a60-98ca27325782-iptables-alerter-script\") pod \"iptables-alerter-6q8p8\" (UID: \"b1915083-20cf-4eeb-8a60-98ca27325782\") " pod="openshift-network-operator/iptables-alerter-6q8p8"
Jul 08 21:32:58.571745 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570423    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnscb\" (UniqueName: \"kubernetes.io/projected/3838e3de-7636-4c3a-8406-bab163d769ae-kube-api-access-qnscb\") pod \"aws-ebs-csi-driver-node-s7t4d\" (UID: \"3838e3de-7636-4c3a-8406-bab163d769ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7t4d"
Jul 08 21:32:58.571745 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570419    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/863b1cfe-1f2f-426e-9a5e-c6aee4205013-dbus\") pod \"global-pull-secret-syncer-pmsd9\" (UID: \"863b1cfe-1f2f-426e-9a5e-c6aee4205013\") " pod="kube-system/global-pull-secret-syncer-pmsd9"
Jul 08 21:32:58.571745 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:58.570444    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:32:58.571745 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570470    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/773e320a-2215-4512-a09c-2249707f24f7-cni-binary-copy\") pod \"multus-additional-cni-plugins-wbw7t\" (UID: \"773e320a-2215-4512-a09c-2249707f24f7\") " pod="openshift-multus/multus-additional-cni-plugins-wbw7t"
Jul 08 21:32:58.571745 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570485    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-host-run-k8s-cni-cncf-io\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.572443 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:58.570509    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dbaf20f-e3bc-4428-9365-fd159b742280-metrics-certs podName:6dbaf20f-e3bc-4428-9365-fd159b742280 nodeName:}" failed. No retries permitted until 2026-07-08 21:32:59.070489605 +0000 UTC m=+2.008821989 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6dbaf20f-e3bc-4428-9365-fd159b742280-metrics-certs") pod "network-metrics-daemon-xnzfd" (UID: "6dbaf20f-e3bc-4428-9365-fd159b742280") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:32:58.572443 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570530    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a9d31b5d-381f-4096-8ee4-f964085df274-etc-systemd\") pod \"tuned-gnqw5\" (UID: \"a9d31b5d-381f-4096-8ee4-f964085df274\") " pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.572443 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570561    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a9d31b5d-381f-4096-8ee4-f964085df274-etc-tuned\") pod \"tuned-gnqw5\" (UID: \"a9d31b5d-381f-4096-8ee4-f964085df274\") " pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.572443 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570564    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-multus-daemon-config\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.572443 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570355    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-node-log\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.572443 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570584    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1cdf17b8-152a-4cca-9050-ef85d4131f91-hosts-file\") pod \"node-resolver-5wfz7\" (UID: \"1cdf17b8-152a-4cca-9050-ef85d4131f91\") " pod="openshift-dns/node-resolver-5wfz7"
Jul 08 21:32:58.572443 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570630    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/863b1cfe-1f2f-426e-9a5e-c6aee4205013-kubelet-config\") pod \"global-pull-secret-syncer-pmsd9\" (UID: \"863b1cfe-1f2f-426e-9a5e-c6aee4205013\") " pod="kube-system/global-pull-secret-syncer-pmsd9"
Jul 08 21:32:58.572443 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570651    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-multus-cni-dir\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.572443 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570667    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-os-release\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.572443 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570685    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-multus-socket-dir-parent\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.572443 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570709    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-multus-conf-dir\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.572443 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570735    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6f70df4a-7077-418a-9afe-02c4e6792fcc-host\") pod \"node-ca-mdr2r\" (UID: \"6f70df4a-7077-418a-9afe-02c4e6792fcc\") " pod="openshift-image-registry/node-ca-mdr2r"
Jul 08 21:32:58.572443 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570742    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-multus-cni-dir\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.572443 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570772    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/773e320a-2215-4512-a09c-2249707f24f7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wbw7t\" (UID: \"773e320a-2215-4512-a09c-2249707f24f7\") " pod="openshift-multus/multus-additional-cni-plugins-wbw7t"
Jul 08 21:32:58.572443 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570782    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-os-release\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.572443 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570802    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-host-cni-bin\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.572443 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570829    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-systemd-units\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.573069 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570834    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-multus-conf-dir\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.573069 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570843    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/863b1cfe-1f2f-426e-9a5e-c6aee4205013-kubelet-config\") pod \"global-pull-secret-syncer-pmsd9\" (UID: \"863b1cfe-1f2f-426e-9a5e-c6aee4205013\") " pod="kube-system/global-pull-secret-syncer-pmsd9"
Jul 08 21:32:58.573069 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570853    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-run-systemd\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.573069 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570803    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-multus-socket-dir-parent\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.573069 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570877    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a022d640-79f0-4d35-be9a-9c6ac708d10b-ovnkube-script-lib\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.573069 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570884    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-host-cni-bin\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.573069 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570882    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xllx6\" (UniqueName: \"kubernetes.io/projected/a022d640-79f0-4d35-be9a-9c6ac708d10b-kube-api-access-xllx6\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.573069 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570898    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-systemd-units\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.573069 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570931    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/773e320a-2215-4512-a09c-2249707f24f7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wbw7t\" (UID: \"773e320a-2215-4512-a09c-2249707f24f7\") " pod="openshift-multus/multus-additional-cni-plugins-wbw7t"
Jul 08 21:32:58.573069 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570961    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-host-run-netns\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.573069 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570986    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b1915083-20cf-4eeb-8a60-98ca27325782-iptables-alerter-script\") pod \"iptables-alerter-6q8p8\" (UID: \"b1915083-20cf-4eeb-8a60-98ca27325782\") " pod="openshift-network-operator/iptables-alerter-6q8p8"
Jul 08 21:32:58.573069 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570990    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-host-run-netns\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.573069 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.570933    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-run-systemd\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.573069 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.571014    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3838e3de-7636-4c3a-8406-bab163d769ae-device-dir\") pod \"aws-ebs-csi-driver-node-s7t4d\" (UID: \"3838e3de-7636-4c3a-8406-bab163d769ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7t4d"
Jul 08 21:32:58.573069 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.571035    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-host-run-netns\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.573069 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.571059    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-host-run-netns\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.573069 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.571068    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3838e3de-7636-4c3a-8406-bab163d769ae-device-dir\") pod \"aws-ebs-csi-driver-node-s7t4d\" (UID: \"3838e3de-7636-4c3a-8406-bab163d769ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7t4d"
Jul 08 21:32:58.573694 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.571064    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e7921e50-7309-4703-8a27-a9e51260d4a0-konnectivity-ca\") pod \"konnectivity-agent-hhqv4\" (UID: \"e7921e50-7309-4703-8a27-a9e51260d4a0\") " pod="kube-system/konnectivity-agent-hhqv4"
Jul 08 21:32:58.573694 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.571097    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-log-socket\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.573694 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.571122    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-host-run-multus-certs\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.573694 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.571152    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3838e3de-7636-4c3a-8406-bab163d769ae-registration-dir\") pod \"aws-ebs-csi-driver-node-s7t4d\" (UID: \"3838e3de-7636-4c3a-8406-bab163d769ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7t4d"
Jul 08 21:32:58.573694 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.571153    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-log-socket\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.573694 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.571170    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a9d31b5d-381f-4096-8ee4-f964085df274-run\") pod \"tuned-gnqw5\" (UID: \"a9d31b5d-381f-4096-8ee4-f964085df274\") " pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.573694 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.571185    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a9d31b5d-381f-4096-8ee4-f964085df274-sys\") pod \"tuned-gnqw5\" (UID: \"a9d31b5d-381f-4096-8ee4-f964085df274\") " pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.573694 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.571170    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-host-run-multus-certs\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.573694 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.571201    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e7921e50-7309-4703-8a27-a9e51260d4a0-agent-certs\") pod \"konnectivity-agent-hhqv4\" (UID: \"e7921e50-7309-4703-8a27-a9e51260d4a0\") " pod="kube-system/konnectivity-agent-hhqv4"
Jul 08 21:32:58.573694 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.571208    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3838e3de-7636-4c3a-8406-bab163d769ae-registration-dir\") pod \"aws-ebs-csi-driver-node-s7t4d\" (UID: \"3838e3de-7636-4c3a-8406-bab163d769ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7t4d"
Jul 08 21:32:58.573694 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.571226    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-run-ovn\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.573694 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.571251    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-cni-binary-copy\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.573694 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.571268    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b1915083-20cf-4eeb-8a60-98ca27325782-host-slash\") pod \"iptables-alerter-6q8p8\" (UID: \"b1915083-20cf-4eeb-8a60-98ca27325782\") " pod="openshift-network-operator/iptables-alerter-6q8p8"
Jul 08 21:32:58.573694 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.571287    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a9d31b5d-381f-4096-8ee4-f964085df274-lib-modules\") pod \"tuned-gnqw5\" (UID: \"a9d31b5d-381f-4096-8ee4-f964085df274\") " pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.573694 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.571311    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9d31b5d-381f-4096-8ee4-f964085df274-var-lib-kubelet\") pod \"tuned-gnqw5\" (UID: \"a9d31b5d-381f-4096-8ee4-f964085df274\") " pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.573694 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.571333    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a9d31b5d-381f-4096-8ee4-f964085df274-host\") pod \"tuned-gnqw5\" (UID: \"a9d31b5d-381f-4096-8ee4-f964085df274\") " pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.573694 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.571355    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a022d640-79f0-4d35-be9a-9c6ac708d10b-run-ovn\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.574256 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.571368    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b1915083-20cf-4eeb-8a60-98ca27325782-host-slash\") pod \"iptables-alerter-6q8p8\" (UID: \"b1915083-20cf-4eeb-8a60-98ca27325782\") " pod="openshift-network-operator/iptables-alerter-6q8p8"
Jul 08 21:32:58.574256 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.571370    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v85cp\" (UniqueName: \"kubernetes.io/projected/6dbaf20f-e3bc-4428-9365-fd159b742280-kube-api-access-v85cp\") pod \"network-metrics-daemon-xnzfd\" (UID: \"6dbaf20f-e3bc-4428-9365-fd159b742280\") " pod="openshift-multus/network-metrics-daemon-xnzfd"
Jul 08 21:32:58.574256 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.571438    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a022d640-79f0-4d35-be9a-9c6ac708d10b-ovn-node-metrics-cert\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.574256 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.571465    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3838e3de-7636-4c3a-8406-bab163d769ae-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s7t4d\" (UID: \"3838e3de-7636-4c3a-8406-bab163d769ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7t4d"
Jul 08 21:32:58.574256 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.571493    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3838e3de-7636-4c3a-8406-bab163d769ae-sys-fs\") pod \"aws-ebs-csi-driver-node-s7t4d\" (UID: \"3838e3de-7636-4c3a-8406-bab163d769ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7t4d"
Jul 08 21:32:58.574256 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.571520    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq22j\" (UniqueName: \"kubernetes.io/projected/6f70df4a-7077-418a-9afe-02c4e6792fcc-kube-api-access-fq22j\") pod \"node-ca-mdr2r\" (UID: \"6f70df4a-7077-418a-9afe-02c4e6792fcc\") " pod="openshift-image-registry/node-ca-mdr2r"
Jul 08 21:32:58.574256 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.571548    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-hostroot\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.574256 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.571559    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3838e3de-7636-4c3a-8406-bab163d769ae-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s7t4d\" (UID: \"3838e3de-7636-4c3a-8406-bab163d769ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7t4d"
Jul 08 21:32:58.574256 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.571588    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k9t2\" (UniqueName: \"kubernetes.io/projected/b1915083-20cf-4eeb-8a60-98ca27325782-kube-api-access-4k9t2\") pod \"iptables-alerter-6q8p8\" (UID: \"b1915083-20cf-4eeb-8a60-98ca27325782\") " pod="openshift-network-operator/iptables-alerter-6q8p8"
Jul 08 21:32:58.574256 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.571591    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e7921e50-7309-4703-8a27-a9e51260d4a0-konnectivity-ca\") pod \"konnectivity-agent-hhqv4\" (UID: \"e7921e50-7309-4703-8a27-a9e51260d4a0\") " pod="kube-system/konnectivity-agent-hhqv4"
Jul 08 21:32:58.574256 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.571612    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3838e3de-7636-4c3a-8406-bab163d769ae-sys-fs\") pod \"aws-ebs-csi-driver-node-s7t4d\" (UID: \"3838e3de-7636-4c3a-8406-bab163d769ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7t4d"
Jul 08 21:32:58.574256 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.571616    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9d31b5d-381f-4096-8ee4-f964085df274-etc-kubernetes\") pod \"tuned-gnqw5\" (UID: \"a9d31b5d-381f-4096-8ee4-f964085df274\") " pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.574256 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.571637    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-hostroot\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.574256 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.571546    2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 08 21:32:58.574256 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.571660    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/773e320a-2215-4512-a09c-2249707f24f7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wbw7t\" (UID: \"773e320a-2215-4512-a09c-2249707f24f7\") " pod="openshift-multus/multus-additional-cni-plugins-wbw7t"
Jul 08 21:32:58.574256 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.571688    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpnlm\" (UniqueName: \"kubernetes.io/projected/773e320a-2215-4512-a09c-2249707f24f7-kube-api-access-wpnlm\") pod \"multus-additional-cni-plugins-wbw7t\" (UID: \"773e320a-2215-4512-a09c-2249707f24f7\") " pod="openshift-multus/multus-additional-cni-plugins-wbw7t"
Jul 08 21:32:58.574256 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.571710    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cdf17b8-152a-4cca-9050-ef85d4131f91-tmp-dir\") pod \"node-resolver-5wfz7\" (UID: \"1cdf17b8-152a-4cca-9050-ef85d4131f91\") " pod="openshift-dns/node-resolver-5wfz7"
Jul 08 21:32:58.574884 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.571742    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-cnibin\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.574884 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.571772    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-cni-binary-copy\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.574884 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.571834    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-cnibin\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.574884 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.574748    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a022d640-79f0-4d35-be9a-9c6ac708d10b-ovn-node-metrics-cert\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.574884 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.574827    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e7921e50-7309-4703-8a27-a9e51260d4a0-agent-certs\") pod \"konnectivity-agent-hhqv4\" (UID: \"e7921e50-7309-4703-8a27-a9e51260d4a0\") " pod="kube-system/konnectivity-agent-hhqv4"
Jul 08 21:32:58.576993 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:58.576977    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 21:32:58.577041 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:58.576996    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 21:32:58.577041 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:58.577006    2569 projected.go:196] Error preparing data for projected volume kube-api-access-ggqws for pod openshift-network-diagnostics/network-check-target-jxssk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:32:58.577116 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:58.577072    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fde744c-b4ec-4557-aa38-a5c8e43337f4-kube-api-access-ggqws podName:5fde744c-b4ec-4557-aa38-a5c8e43337f4 nodeName:}" failed. No retries permitted until 2026-07-08 21:32:59.07706055 +0000 UTC m=+2.015392930 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ggqws" (UniqueName: "kubernetes.io/projected/5fde744c-b4ec-4557-aa38-a5c8e43337f4-kube-api-access-ggqws") pod "network-check-target-jxssk" (UID: "5fde744c-b4ec-4557-aa38-a5c8e43337f4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:32:58.583483 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.583445    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v85cp\" (UniqueName: \"kubernetes.io/projected/6dbaf20f-e3bc-4428-9365-fd159b742280-kube-api-access-v85cp\") pod \"network-metrics-daemon-xnzfd\" (UID: \"6dbaf20f-e3bc-4428-9365-fd159b742280\") " pod="openshift-multus/network-metrics-daemon-xnzfd"
Jul 08 21:32:58.583985 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.583963    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xllx6\" (UniqueName: \"kubernetes.io/projected/a022d640-79f0-4d35-be9a-9c6ac708d10b-kube-api-access-xllx6\") pod \"ovnkube-node-6cs4g\" (UID: \"a022d640-79f0-4d35-be9a-9c6ac708d10b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.585247 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.585220    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k9t2\" (UniqueName: \"kubernetes.io/projected/b1915083-20cf-4eeb-8a60-98ca27325782-kube-api-access-4k9t2\") pod \"iptables-alerter-6q8p8\" (UID: \"b1915083-20cf-4eeb-8a60-98ca27325782\") " pod="openshift-network-operator/iptables-alerter-6q8p8"
Jul 08 21:32:58.585468 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.585449    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnscb\" (UniqueName: \"kubernetes.io/projected/3838e3de-7636-4c3a-8406-bab163d769ae-kube-api-access-qnscb\") pod \"aws-ebs-csi-driver-node-s7t4d\" (UID: \"3838e3de-7636-4c3a-8406-bab163d769ae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7t4d"
Jul 08 21:32:58.585542 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.585520    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkkjm\" (UniqueName: \"kubernetes.io/projected/24a0bf73-fc2c-4fea-9e48-4692b50c95fc-kube-api-access-fkkjm\") pod \"multus-bgl2j\" (UID: \"24a0bf73-fc2c-4fea-9e48-4692b50c95fc\") " pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.664120 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:58.664082    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53be9f26ebbce9e8712878906521c6f8.slice/crio-62018213f613c4ce08a368fbfb090017a04ddcf73007f41b4291f2ba2c80f197 WatchSource:0}: Error finding container 62018213f613c4ce08a368fbfb090017a04ddcf73007f41b4291f2ba2c80f197: Status 404 returned error can't find the container with id 62018213f613c4ce08a368fbfb090017a04ddcf73007f41b4291f2ba2c80f197
Jul 08 21:32:58.664411 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:58.664389    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4407acfac9b3a400518ad059d4a0580d.slice/crio-b4a459699ec9a8e891395c9d7ca688df119c2e06f03371de03101981af8fd07b WatchSource:0}: Error finding container b4a459699ec9a8e891395c9d7ca688df119c2e06f03371de03101981af8fd07b: Status 404 returned error can't find the container with id b4a459699ec9a8e891395c9d7ca688df119c2e06f03371de03101981af8fd07b
Jul 08 21:32:58.669588 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.669568    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 21:32:58.674300 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.674276    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a9d31b5d-381f-4096-8ee4-f964085df274-run\") pod \"tuned-gnqw5\" (UID: \"a9d31b5d-381f-4096-8ee4-f964085df274\") " pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.674401 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.674306    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a9d31b5d-381f-4096-8ee4-f964085df274-sys\") pod \"tuned-gnqw5\" (UID: \"a9d31b5d-381f-4096-8ee4-f964085df274\") " pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.674401 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.674324    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a9d31b5d-381f-4096-8ee4-f964085df274-lib-modules\") pod \"tuned-gnqw5\" (UID: \"a9d31b5d-381f-4096-8ee4-f964085df274\") " pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.674401 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.674347    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9d31b5d-381f-4096-8ee4-f964085df274-var-lib-kubelet\") pod \"tuned-gnqw5\" (UID: \"a9d31b5d-381f-4096-8ee4-f964085df274\") " pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.674401 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.674388    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a9d31b5d-381f-4096-8ee4-f964085df274-host\") pod \"tuned-gnqw5\" (UID: \"a9d31b5d-381f-4096-8ee4-f964085df274\") " pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.674657 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.674418    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq22j\" (UniqueName: \"kubernetes.io/projected/6f70df4a-7077-418a-9afe-02c4e6792fcc-kube-api-access-fq22j\") pod \"node-ca-mdr2r\" (UID: \"6f70df4a-7077-418a-9afe-02c4e6792fcc\") " pod="openshift-image-registry/node-ca-mdr2r"
Jul 08 21:32:58.674657 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.674444    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9d31b5d-381f-4096-8ee4-f964085df274-etc-kubernetes\") pod \"tuned-gnqw5\" (UID: \"a9d31b5d-381f-4096-8ee4-f964085df274\") " pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.674657 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.674466    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/773e320a-2215-4512-a09c-2249707f24f7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wbw7t\" (UID: \"773e320a-2215-4512-a09c-2249707f24f7\") " pod="openshift-multus/multus-additional-cni-plugins-wbw7t"
Jul 08 21:32:58.674657 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.674485    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpnlm\" (UniqueName: \"kubernetes.io/projected/773e320a-2215-4512-a09c-2249707f24f7-kube-api-access-wpnlm\") pod \"multus-additional-cni-plugins-wbw7t\" (UID: \"773e320a-2215-4512-a09c-2249707f24f7\") " pod="openshift-multus/multus-additional-cni-plugins-wbw7t"
Jul 08 21:32:58.674657 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.674501    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cdf17b8-152a-4cca-9050-ef85d4131f91-tmp-dir\") pod \"node-resolver-5wfz7\" (UID: \"1cdf17b8-152a-4cca-9050-ef85d4131f91\") " pod="openshift-dns/node-resolver-5wfz7"
Jul 08 21:32:58.674657 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.674516    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/773e320a-2215-4512-a09c-2249707f24f7-system-cni-dir\") pod \"multus-additional-cni-plugins-wbw7t\" (UID: \"773e320a-2215-4512-a09c-2249707f24f7\") " pod="openshift-multus/multus-additional-cni-plugins-wbw7t"
Jul 08 21:32:58.674657 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.674532    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a9d31b5d-381f-4096-8ee4-f964085df274-etc-sysconfig\") pod \"tuned-gnqw5\" (UID: \"a9d31b5d-381f-4096-8ee4-f964085df274\") " pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.674657 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.674598    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9d31b5d-381f-4096-8ee4-f964085df274-etc-kubernetes\") pod \"tuned-gnqw5\" (UID: \"a9d31b5d-381f-4096-8ee4-f964085df274\") " pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.674657 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.674598    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a9d31b5d-381f-4096-8ee4-f964085df274-host\") pod \"tuned-gnqw5\" (UID: \"a9d31b5d-381f-4096-8ee4-f964085df274\") " pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.674657 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.674613    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a9d31b5d-381f-4096-8ee4-f964085df274-run\") pod \"tuned-gnqw5\" (UID: \"a9d31b5d-381f-4096-8ee4-f964085df274\") " pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.674657 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.674603    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a9d31b5d-381f-4096-8ee4-f964085df274-sys\") pod \"tuned-gnqw5\" (UID: \"a9d31b5d-381f-4096-8ee4-f964085df274\") " pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.675244 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.674681    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a9d31b5d-381f-4096-8ee4-f964085df274-etc-sysconfig\") pod \"tuned-gnqw5\" (UID: \"a9d31b5d-381f-4096-8ee4-f964085df274\") " pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.675244 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.674685    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9d31b5d-381f-4096-8ee4-f964085df274-var-lib-kubelet\") pod \"tuned-gnqw5\" (UID: \"a9d31b5d-381f-4096-8ee4-f964085df274\") " pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.675244 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.674730    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/773e320a-2215-4512-a09c-2249707f24f7-system-cni-dir\") pod \"multus-additional-cni-plugins-wbw7t\" (UID: \"773e320a-2215-4512-a09c-2249707f24f7\") " pod="openshift-multus/multus-additional-cni-plugins-wbw7t"
Jul 08 21:32:58.675244 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.674746    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6f70df4a-7077-418a-9afe-02c4e6792fcc-serviceca\") pod \"node-ca-mdr2r\" (UID: \"6f70df4a-7077-418a-9afe-02c4e6792fcc\") " pod="openshift-image-registry/node-ca-mdr2r"
Jul 08 21:32:58.675244 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.674743    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a9d31b5d-381f-4096-8ee4-f964085df274-lib-modules\") pod \"tuned-gnqw5\" (UID: \"a9d31b5d-381f-4096-8ee4-f964085df274\") " pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.675244 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.674862    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/773e320a-2215-4512-a09c-2249707f24f7-cnibin\") pod \"multus-additional-cni-plugins-wbw7t\" (UID: \"773e320a-2215-4512-a09c-2249707f24f7\") " pod="openshift-multus/multus-additional-cni-plugins-wbw7t"
Jul 08 21:32:58.675244 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.674939    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cdf17b8-152a-4cca-9050-ef85d4131f91-tmp-dir\") pod \"node-resolver-5wfz7\" (UID: \"1cdf17b8-152a-4cca-9050-ef85d4131f91\") " pod="openshift-dns/node-resolver-5wfz7"
Jul 08 21:32:58.675244 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.674996    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a9d31b5d-381f-4096-8ee4-f964085df274-etc-sysctl-conf\") pod \"tuned-gnqw5\" (UID: \"a9d31b5d-381f-4096-8ee4-f964085df274\") " pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.675244 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.675004    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/773e320a-2215-4512-a09c-2249707f24f7-cnibin\") pod \"multus-additional-cni-plugins-wbw7t\" (UID: \"773e320a-2215-4512-a09c-2249707f24f7\") " pod="openshift-multus/multus-additional-cni-plugins-wbw7t"
Jul 08 21:32:58.675244 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.675023    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9zll\" (UniqueName: \"kubernetes.io/projected/a9d31b5d-381f-4096-8ee4-f964085df274-kube-api-access-n9zll\") pod \"tuned-gnqw5\" (UID: \"a9d31b5d-381f-4096-8ee4-f964085df274\") " pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.675244 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.675050    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9d31b5d-381f-4096-8ee4-f964085df274-tmp\") pod \"tuned-gnqw5\" (UID: \"a9d31b5d-381f-4096-8ee4-f964085df274\") " pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.675244 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.675085    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a9d31b5d-381f-4096-8ee4-f964085df274-etc-modprobe-d\") pod \"tuned-gnqw5\" (UID: \"a9d31b5d-381f-4096-8ee4-f964085df274\") " pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.675244 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.675113    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a9d31b5d-381f-4096-8ee4-f964085df274-etc-sysctl-conf\") pod \"tuned-gnqw5\" (UID: \"a9d31b5d-381f-4096-8ee4-f964085df274\") " pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.675244 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.675183    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/773e320a-2215-4512-a09c-2249707f24f7-os-release\") pod \"multus-additional-cni-plugins-wbw7t\" (UID: \"773e320a-2215-4512-a09c-2249707f24f7\") " pod="openshift-multus/multus-additional-cni-plugins-wbw7t"
Jul 08 21:32:58.675244 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.675115    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/773e320a-2215-4512-a09c-2249707f24f7-os-release\") pod \"multus-additional-cni-plugins-wbw7t\" (UID: \"773e320a-2215-4512-a09c-2249707f24f7\") " pod="openshift-multus/multus-additional-cni-plugins-wbw7t"
Jul 08 21:32:58.675244 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.675218    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a9d31b5d-381f-4096-8ee4-f964085df274-etc-sysctl-d\") pod \"tuned-gnqw5\" (UID: \"a9d31b5d-381f-4096-8ee4-f964085df274\") " pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.675244 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.675224    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/773e320a-2215-4512-a09c-2249707f24f7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wbw7t\" (UID: \"773e320a-2215-4512-a09c-2249707f24f7\") " pod="openshift-multus/multus-additional-cni-plugins-wbw7t"
Jul 08 21:32:58.676023 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.675245    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr5xf\" (UniqueName: \"kubernetes.io/projected/1cdf17b8-152a-4cca-9050-ef85d4131f91-kube-api-access-dr5xf\") pod \"node-resolver-5wfz7\" (UID: \"1cdf17b8-152a-4cca-9050-ef85d4131f91\") " pod="openshift-dns/node-resolver-5wfz7"
Jul 08 21:32:58.676023 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.675258    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a9d31b5d-381f-4096-8ee4-f964085df274-etc-modprobe-d\") pod \"tuned-gnqw5\" (UID: \"a9d31b5d-381f-4096-8ee4-f964085df274\") " pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.676023 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.675329    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/773e320a-2215-4512-a09c-2249707f24f7-cni-binary-copy\") pod \"multus-additional-cni-plugins-wbw7t\" (UID: \"773e320a-2215-4512-a09c-2249707f24f7\") " pod="openshift-multus/multus-additional-cni-plugins-wbw7t"
Jul 08 21:32:58.676023 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.675350    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a9d31b5d-381f-4096-8ee4-f964085df274-etc-sysctl-d\") pod \"tuned-gnqw5\" (UID: \"a9d31b5d-381f-4096-8ee4-f964085df274\") " pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.676023 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.675387    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a9d31b5d-381f-4096-8ee4-f964085df274-etc-systemd\") pod \"tuned-gnqw5\" (UID: \"a9d31b5d-381f-4096-8ee4-f964085df274\") " pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.676023 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.675385    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6f70df4a-7077-418a-9afe-02c4e6792fcc-serviceca\") pod \"node-ca-mdr2r\" (UID: \"6f70df4a-7077-418a-9afe-02c4e6792fcc\") " pod="openshift-image-registry/node-ca-mdr2r"
Jul 08 21:32:58.676023 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.675356    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a9d31b5d-381f-4096-8ee4-f964085df274-etc-systemd\") pod \"tuned-gnqw5\" (UID: \"a9d31b5d-381f-4096-8ee4-f964085df274\") " pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.676023 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.675421    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a9d31b5d-381f-4096-8ee4-f964085df274-etc-tuned\") pod \"tuned-gnqw5\" (UID: \"a9d31b5d-381f-4096-8ee4-f964085df274\") " pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.676023 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.675438    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1cdf17b8-152a-4cca-9050-ef85d4131f91-hosts-file\") pod \"node-resolver-5wfz7\" (UID: \"1cdf17b8-152a-4cca-9050-ef85d4131f91\") " pod="openshift-dns/node-resolver-5wfz7"
Jul 08 21:32:58.676023 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.675460    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6f70df4a-7077-418a-9afe-02c4e6792fcc-host\") pod \"node-ca-mdr2r\" (UID: \"6f70df4a-7077-418a-9afe-02c4e6792fcc\") " pod="openshift-image-registry/node-ca-mdr2r"
Jul 08 21:32:58.676023 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.675490    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/773e320a-2215-4512-a09c-2249707f24f7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wbw7t\" (UID: \"773e320a-2215-4512-a09c-2249707f24f7\") " pod="openshift-multus/multus-additional-cni-plugins-wbw7t"
Jul 08 21:32:58.676023 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.675523    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/773e320a-2215-4512-a09c-2249707f24f7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wbw7t\" (UID: \"773e320a-2215-4512-a09c-2249707f24f7\") " pod="openshift-multus/multus-additional-cni-plugins-wbw7t"
Jul 08 21:32:58.676023 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.675535    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1cdf17b8-152a-4cca-9050-ef85d4131f91-hosts-file\") pod \"node-resolver-5wfz7\" (UID: \"1cdf17b8-152a-4cca-9050-ef85d4131f91\") " pod="openshift-dns/node-resolver-5wfz7"
Jul 08 21:32:58.676023 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.675534    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6f70df4a-7077-418a-9afe-02c4e6792fcc-host\") pod \"node-ca-mdr2r\" (UID: \"6f70df4a-7077-418a-9afe-02c4e6792fcc\") " pod="openshift-image-registry/node-ca-mdr2r"
Jul 08 21:32:58.676023 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.675752    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/773e320a-2215-4512-a09c-2249707f24f7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wbw7t\" (UID: \"773e320a-2215-4512-a09c-2249707f24f7\") " pod="openshift-multus/multus-additional-cni-plugins-wbw7t"
Jul 08 21:32:58.676023 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.676003    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/773e320a-2215-4512-a09c-2249707f24f7-cni-binary-copy\") pod \"multus-additional-cni-plugins-wbw7t\" (UID: \"773e320a-2215-4512-a09c-2249707f24f7\") " pod="openshift-multus/multus-additional-cni-plugins-wbw7t"
Jul 08 21:32:58.676654 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.676141    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/773e320a-2215-4512-a09c-2249707f24f7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wbw7t\" (UID: \"773e320a-2215-4512-a09c-2249707f24f7\") " pod="openshift-multus/multus-additional-cni-plugins-wbw7t"
Jul 08 21:32:58.678062 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.678037    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a9d31b5d-381f-4096-8ee4-f964085df274-etc-tuned\") pod \"tuned-gnqw5\" (UID: \"a9d31b5d-381f-4096-8ee4-f964085df274\") " pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.678141 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.678076    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9d31b5d-381f-4096-8ee4-f964085df274-tmp\") pod \"tuned-gnqw5\" (UID: \"a9d31b5d-381f-4096-8ee4-f964085df274\") " pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.683755 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.683719    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr5xf\" (UniqueName: \"kubernetes.io/projected/1cdf17b8-152a-4cca-9050-ef85d4131f91-kube-api-access-dr5xf\") pod \"node-resolver-5wfz7\" (UID: \"1cdf17b8-152a-4cca-9050-ef85d4131f91\") " pod="openshift-dns/node-resolver-5wfz7"
Jul 08 21:32:58.683871 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.683757    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9zll\" (UniqueName: \"kubernetes.io/projected/a9d31b5d-381f-4096-8ee4-f964085df274-kube-api-access-n9zll\") pod \"tuned-gnqw5\" (UID: \"a9d31b5d-381f-4096-8ee4-f964085df274\") " pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.683994 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.683974    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq22j\" (UniqueName: \"kubernetes.io/projected/6f70df4a-7077-418a-9afe-02c4e6792fcc-kube-api-access-fq22j\") pod \"node-ca-mdr2r\" (UID: \"6f70df4a-7077-418a-9afe-02c4e6792fcc\") " pod="openshift-image-registry/node-ca-mdr2r"
Jul 08 21:32:58.684123 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.684105    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpnlm\" (UniqueName: \"kubernetes.io/projected/773e320a-2215-4512-a09c-2249707f24f7-kube-api-access-wpnlm\") pod \"multus-additional-cni-plugins-wbw7t\" (UID: \"773e320a-2215-4512-a09c-2249707f24f7\") " pod="openshift-multus/multus-additional-cni-plugins-wbw7t"
Jul 08 21:32:58.723523 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.723487    2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 21:32:58.782006 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.781917    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:32:58.786989 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.786963    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hhqv4"
Jul 08 21:32:58.791010 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:58.790989    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda022d640_79f0_4d35_be9a_9c6ac708d10b.slice/crio-1662e747bc59267d14234334341875223a92f84970d5d97e384ba36d6559b1fa WatchSource:0}: Error finding container 1662e747bc59267d14234334341875223a92f84970d5d97e384ba36d6559b1fa: Status 404 returned error can't find the container with id 1662e747bc59267d14234334341875223a92f84970d5d97e384ba36d6559b1fa
Jul 08 21:32:58.794961 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:58.794938    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7921e50_7309_4703_8a27_a9e51260d4a0.slice/crio-2beaa9fa7154d52fdeffa8f87b2bcb1fb8f94edebea315fb6933bf94694b4fc4 WatchSource:0}: Error finding container 2beaa9fa7154d52fdeffa8f87b2bcb1fb8f94edebea315fb6933bf94694b4fc4: Status 404 returned error can't find the container with id 2beaa9fa7154d52fdeffa8f87b2bcb1fb8f94edebea315fb6933bf94694b4fc4
Jul 08 21:32:58.808689 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.808671    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bgl2j"
Jul 08 21:32:58.816358 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:58.816339    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24a0bf73_fc2c_4fea_9e48_4692b50c95fc.slice/crio-51e3d077b5877815eccc2ebf02cea1553d047d6c29967cef03af8dde846cba06 WatchSource:0}: Error finding container 51e3d077b5877815eccc2ebf02cea1553d047d6c29967cef03af8dde846cba06: Status 404 returned error can't find the container with id 51e3d077b5877815eccc2ebf02cea1553d047d6c29967cef03af8dde846cba06
Jul 08 21:32:58.821731 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.821714    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6q8p8"
Jul 08 21:32:58.829000 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:58.828980    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1915083_20cf_4eeb_8a60_98ca27325782.slice/crio-590d579cc8062a521c4e10bab1eca6d3ae4c74c3759a6bd07b49451b1fb3b6a3 WatchSource:0}: Error finding container 590d579cc8062a521c4e10bab1eca6d3ae4c74c3759a6bd07b49451b1fb3b6a3: Status 404 returned error can't find the container with id 590d579cc8062a521c4e10bab1eca6d3ae4c74c3759a6bd07b49451b1fb3b6a3
Jul 08 21:32:58.840496 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.840478    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7t4d"
Jul 08 21:32:58.848500 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:58.848476    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3838e3de_7636_4c3a_8406_bab163d769ae.slice/crio-020609d82d8fc97eeba143f407e6b3ddb88b98b21624b9056141b85cd3d15714 WatchSource:0}: Error finding container 020609d82d8fc97eeba143f407e6b3ddb88b98b21624b9056141b85cd3d15714: Status 404 returned error can't find the container with id 020609d82d8fc97eeba143f407e6b3ddb88b98b21624b9056141b85cd3d15714
Jul 08 21:32:58.851693 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.851663    2569 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 21:32:58.853507 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.853475    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gnqw5"
Jul 08 21:32:58.860665 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:58.860644    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9d31b5d_381f_4096_8ee4_f964085df274.slice/crio-882c0b1d75677742ca4bc90c5da4ff9c7e9d1f67288815b0bef38427f82e598c WatchSource:0}: Error finding container 882c0b1d75677742ca4bc90c5da4ff9c7e9d1f67288815b0bef38427f82e598c: Status 404 returned error can't find the container with id 882c0b1d75677742ca4bc90c5da4ff9c7e9d1f67288815b0bef38427f82e598c
Jul 08 21:32:58.860814 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.860799    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5wfz7"
Jul 08 21:32:58.868040 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:58.868018    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cdf17b8_152a_4cca_9050_ef85d4131f91.slice/crio-b8090c77b9e80c319a8d0aa069bb219281a3405256eea48fde95a435d1b0f477 WatchSource:0}: Error finding container b8090c77b9e80c319a8d0aa069bb219281a3405256eea48fde95a435d1b0f477: Status 404 returned error can't find the container with id b8090c77b9e80c319a8d0aa069bb219281a3405256eea48fde95a435d1b0f477
Jul 08 21:32:58.868142 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.868083    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mdr2r"
Jul 08 21:32:58.876647 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:58.876621    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f70df4a_7077_418a_9afe_02c4e6792fcc.slice/crio-e22cb377264318e2014ba9fce71df178fbd745c5087e0c079a0234737449210a WatchSource:0}: Error finding container e22cb377264318e2014ba9fce71df178fbd745c5087e0c079a0234737449210a: Status 404 returned error can't find the container with id e22cb377264318e2014ba9fce71df178fbd745c5087e0c079a0234737449210a
Jul 08 21:32:58.891499 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:58.891479    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wbw7t"
Jul 08 21:32:58.900078 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:32:58.900055    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod773e320a_2215_4512_a09c_2249707f24f7.slice/crio-1f6bbd40f23bccb2efb585c517b988bfa965b655fd0502e92105c118515499e0 WatchSource:0}: Error finding container 1f6bbd40f23bccb2efb585c517b988bfa965b655fd0502e92105c118515499e0: Status 404 returned error can't find the container with id 1f6bbd40f23bccb2efb585c517b988bfa965b655fd0502e92105c118515499e0
Jul 08 21:32:59.080441 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:59.078154    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/863b1cfe-1f2f-426e-9a5e-c6aee4205013-original-pull-secret\") pod \"global-pull-secret-syncer-pmsd9\" (UID: \"863b1cfe-1f2f-426e-9a5e-c6aee4205013\") " pod="kube-system/global-pull-secret-syncer-pmsd9"
Jul 08 21:32:59.080441 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:59.078216    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggqws\" (UniqueName: \"kubernetes.io/projected/5fde744c-b4ec-4557-aa38-a5c8e43337f4-kube-api-access-ggqws\") pod \"network-check-target-jxssk\" (UID: \"5fde744c-b4ec-4557-aa38-a5c8e43337f4\") " pod="openshift-network-diagnostics/network-check-target-jxssk"
Jul 08 21:32:59.080441 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:59.078271    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6dbaf20f-e3bc-4428-9365-fd159b742280-metrics-certs\") pod \"network-metrics-daemon-xnzfd\" (UID: \"6dbaf20f-e3bc-4428-9365-fd159b742280\") " pod="openshift-multus/network-metrics-daemon-xnzfd"
Jul 08 21:32:59.080441 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:59.078552    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:32:59.080441 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:59.078642    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dbaf20f-e3bc-4428-9365-fd159b742280-metrics-certs podName:6dbaf20f-e3bc-4428-9365-fd159b742280 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:00.078620509 +0000 UTC m=+3.016952907 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6dbaf20f-e3bc-4428-9365-fd159b742280-metrics-certs") pod "network-metrics-daemon-xnzfd" (UID: "6dbaf20f-e3bc-4428-9365-fd159b742280") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:32:59.080441 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:59.079126    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 21:32:59.080441 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:59.079192    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/863b1cfe-1f2f-426e-9a5e-c6aee4205013-original-pull-secret podName:863b1cfe-1f2f-426e-9a5e-c6aee4205013 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:00.079172219 +0000 UTC m=+3.017504602 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/863b1cfe-1f2f-426e-9a5e-c6aee4205013-original-pull-secret") pod "global-pull-secret-syncer-pmsd9" (UID: "863b1cfe-1f2f-426e-9a5e-c6aee4205013") : object "kube-system"/"original-pull-secret" not registered
Jul 08 21:32:59.080441 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:59.079296    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 21:32:59.080441 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:59.079313    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 21:32:59.080441 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:59.079333    2569 projected.go:196] Error preparing data for projected volume kube-api-access-ggqws for pod openshift-network-diagnostics/network-check-target-jxssk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:32:59.080441 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:59.079409    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fde744c-b4ec-4557-aa38-a5c8e43337f4-kube-api-access-ggqws podName:5fde744c-b4ec-4557-aa38-a5c8e43337f4 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:00.079387473 +0000 UTC m=+3.017719855 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ggqws" (UniqueName: "kubernetes.io/projected/5fde744c-b4ec-4557-aa38-a5c8e43337f4-kube-api-access-ggqws") pod "network-check-target-jxssk" (UID: "5fde744c-b4ec-4557-aa38-a5c8e43337f4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:32:59.518433 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:59.518272    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 21:27:58 +0000 UTC" deadline="2027-12-21 20:08:22.317538001 +0000 UTC"
Jul 08 21:32:59.518433 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:59.518358    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12742h35m22.799184556s"
Jul 08 21:32:59.629138 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:59.628992    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxssk"
Jul 08 21:32:59.629138 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:32:59.629118    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxssk" podUID="5fde744c-b4ec-4557-aa38-a5c8e43337f4"
Jul 08 21:32:59.633873 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:59.633737    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5wfz7" event={"ID":"1cdf17b8-152a-4cca-9050-ef85d4131f91","Type":"ContainerStarted","Data":"b8090c77b9e80c319a8d0aa069bb219281a3405256eea48fde95a435d1b0f477"}
Jul 08 21:32:59.644438 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:59.644412    2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 21:32:59.652676 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:59.652641    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7t4d" event={"ID":"3838e3de-7636-4c3a-8406-bab163d769ae","Type":"ContainerStarted","Data":"020609d82d8fc97eeba143f407e6b3ddb88b98b21624b9056141b85cd3d15714"}
Jul 08 21:32:59.664534 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:59.664501    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6q8p8" event={"ID":"b1915083-20cf-4eeb-8a60-98ca27325782","Type":"ContainerStarted","Data":"590d579cc8062a521c4e10bab1eca6d3ae4c74c3759a6bd07b49451b1fb3b6a3"}
Jul 08 21:32:59.667238 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:59.667209    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bgl2j" event={"ID":"24a0bf73-fc2c-4fea-9e48-4692b50c95fc","Type":"ContainerStarted","Data":"51e3d077b5877815eccc2ebf02cea1553d047d6c29967cef03af8dde846cba06"}
Jul 08 21:32:59.683577 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:59.683457    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hhqv4" event={"ID":"e7921e50-7309-4703-8a27-a9e51260d4a0","Type":"ContainerStarted","Data":"2beaa9fa7154d52fdeffa8f87b2bcb1fb8f94edebea315fb6933bf94694b4fc4"}
Jul 08 21:32:59.699543 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:59.699509    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-83.ec2.internal" event={"ID":"53be9f26ebbce9e8712878906521c6f8","Type":"ContainerStarted","Data":"62018213f613c4ce08a368fbfb090017a04ddcf73007f41b4291f2ba2c80f197"}
Jul 08 21:32:59.714402 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:59.714131    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wbw7t" event={"ID":"773e320a-2215-4512-a09c-2249707f24f7","Type":"ContainerStarted","Data":"1f6bbd40f23bccb2efb585c517b988bfa965b655fd0502e92105c118515499e0"}
Jul 08 21:32:59.733604 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:59.733544    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mdr2r" event={"ID":"6f70df4a-7077-418a-9afe-02c4e6792fcc","Type":"ContainerStarted","Data":"e22cb377264318e2014ba9fce71df178fbd745c5087e0c079a0234737449210a"}
Jul 08 21:32:59.737468 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:59.737431    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gnqw5" event={"ID":"a9d31b5d-381f-4096-8ee4-f964085df274","Type":"ContainerStarted","Data":"882c0b1d75677742ca4bc90c5da4ff9c7e9d1f67288815b0bef38427f82e598c"}
Jul 08 21:32:59.757935 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:59.757836    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g" event={"ID":"a022d640-79f0-4d35-be9a-9c6ac708d10b","Type":"ContainerStarted","Data":"1662e747bc59267d14234334341875223a92f84970d5d97e384ba36d6559b1fa"}
Jul 08 21:32:59.784616 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:32:59.784531    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-83.ec2.internal" event={"ID":"4407acfac9b3a400518ad059d4a0580d","Type":"ContainerStarted","Data":"b4a459699ec9a8e891395c9d7ca688df119c2e06f03371de03101981af8fd07b"}
Jul 08 21:33:00.088756 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:00.088659    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/863b1cfe-1f2f-426e-9a5e-c6aee4205013-original-pull-secret\") pod \"global-pull-secret-syncer-pmsd9\" (UID: \"863b1cfe-1f2f-426e-9a5e-c6aee4205013\") " pod="kube-system/global-pull-secret-syncer-pmsd9"
Jul 08 21:33:00.088756 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:00.088713    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggqws\" (UniqueName: \"kubernetes.io/projected/5fde744c-b4ec-4557-aa38-a5c8e43337f4-kube-api-access-ggqws\") pod \"network-check-target-jxssk\" (UID: \"5fde744c-b4ec-4557-aa38-a5c8e43337f4\") " pod="openshift-network-diagnostics/network-check-target-jxssk"
Jul 08 21:33:00.089200 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:00.088758    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6dbaf20f-e3bc-4428-9365-fd159b742280-metrics-certs\") pod \"network-metrics-daemon-xnzfd\" (UID: \"6dbaf20f-e3bc-4428-9365-fd159b742280\") " pod="openshift-multus/network-metrics-daemon-xnzfd"
Jul 08 21:33:00.089200 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:00.088925    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:33:00.089200 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:00.088997    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dbaf20f-e3bc-4428-9365-fd159b742280-metrics-certs podName:6dbaf20f-e3bc-4428-9365-fd159b742280 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:02.088976577 +0000 UTC m=+5.027308966 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6dbaf20f-e3bc-4428-9365-fd159b742280-metrics-certs") pod "network-metrics-daemon-xnzfd" (UID: "6dbaf20f-e3bc-4428-9365-fd159b742280") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:33:00.089477 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:00.089456    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 21:33:00.089553 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:00.089514    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/863b1cfe-1f2f-426e-9a5e-c6aee4205013-original-pull-secret podName:863b1cfe-1f2f-426e-9a5e-c6aee4205013 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:02.089497924 +0000 UTC m=+5.027830311 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/863b1cfe-1f2f-426e-9a5e-c6aee4205013-original-pull-secret") pod "global-pull-secret-syncer-pmsd9" (UID: "863b1cfe-1f2f-426e-9a5e-c6aee4205013") : object "kube-system"/"original-pull-secret" not registered
Jul 08 21:33:00.089627 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:00.089596    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 21:33:00.089627 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:00.089612    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 21:33:00.089627 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:00.089624    2569 projected.go:196] Error preparing data for projected volume kube-api-access-ggqws for pod openshift-network-diagnostics/network-check-target-jxssk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:33:00.089786 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:00.089663    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fde744c-b4ec-4557-aa38-a5c8e43337f4-kube-api-access-ggqws podName:5fde744c-b4ec-4557-aa38-a5c8e43337f4 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:02.089650266 +0000 UTC m=+5.027982648 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ggqws" (UniqueName: "kubernetes.io/projected/5fde744c-b4ec-4557-aa38-a5c8e43337f4-kube-api-access-ggqws") pod "network-check-target-jxssk" (UID: "5fde744c-b4ec-4557-aa38-a5c8e43337f4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:33:00.519501 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:00.519430    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 21:27:58 +0000 UTC" deadline="2027-12-19 19:37:27.412099876 +0000 UTC"
Jul 08 21:33:00.519501 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:00.519472    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12694h4m26.892632801s"
Jul 08 21:33:00.607169 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:00.607124    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xnzfd"
Jul 08 21:33:00.607458 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:00.607261    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xnzfd" podUID="6dbaf20f-e3bc-4428-9365-fd159b742280"
Jul 08 21:33:00.607724 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:00.607704    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pmsd9"
Jul 08 21:33:00.607858 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:00.607808    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pmsd9" podUID="863b1cfe-1f2f-426e-9a5e-c6aee4205013"
Jul 08 21:33:01.609464 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:01.609264    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxssk"
Jul 08 21:33:01.609464 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:01.609425    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxssk" podUID="5fde744c-b4ec-4557-aa38-a5c8e43337f4"
Jul 08 21:33:02.109322 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:02.108327    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/863b1cfe-1f2f-426e-9a5e-c6aee4205013-original-pull-secret\") pod \"global-pull-secret-syncer-pmsd9\" (UID: \"863b1cfe-1f2f-426e-9a5e-c6aee4205013\") " pod="kube-system/global-pull-secret-syncer-pmsd9"
Jul 08 21:33:02.109322 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:02.108401    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggqws\" (UniqueName: \"kubernetes.io/projected/5fde744c-b4ec-4557-aa38-a5c8e43337f4-kube-api-access-ggqws\") pod \"network-check-target-jxssk\" (UID: \"5fde744c-b4ec-4557-aa38-a5c8e43337f4\") " pod="openshift-network-diagnostics/network-check-target-jxssk"
Jul 08 21:33:02.109322 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:02.108451    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6dbaf20f-e3bc-4428-9365-fd159b742280-metrics-certs\") pod \"network-metrics-daemon-xnzfd\" (UID: \"6dbaf20f-e3bc-4428-9365-fd159b742280\") " pod="openshift-multus/network-metrics-daemon-xnzfd"
Jul 08 21:33:02.109322 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:02.108582    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:33:02.109322 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:02.108649    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dbaf20f-e3bc-4428-9365-fd159b742280-metrics-certs podName:6dbaf20f-e3bc-4428-9365-fd159b742280 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:06.108629612 +0000 UTC m=+9.046961996 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6dbaf20f-e3bc-4428-9365-fd159b742280-metrics-certs") pod "network-metrics-daemon-xnzfd" (UID: "6dbaf20f-e3bc-4428-9365-fd159b742280") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:33:02.109322 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:02.109070    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 21:33:02.109322 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:02.109123    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/863b1cfe-1f2f-426e-9a5e-c6aee4205013-original-pull-secret podName:863b1cfe-1f2f-426e-9a5e-c6aee4205013 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:06.109107366 +0000 UTC m=+9.047439750 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/863b1cfe-1f2f-426e-9a5e-c6aee4205013-original-pull-secret") pod "global-pull-secret-syncer-pmsd9" (UID: "863b1cfe-1f2f-426e-9a5e-c6aee4205013") : object "kube-system"/"original-pull-secret" not registered
Jul 08 21:33:02.109322 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:02.109214    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 21:33:02.109322 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:02.109229    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 21:33:02.109322 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:02.109242    2569 projected.go:196] Error preparing data for projected volume kube-api-access-ggqws for pod openshift-network-diagnostics/network-check-target-jxssk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:33:02.109322 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:02.109282    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fde744c-b4ec-4557-aa38-a5c8e43337f4-kube-api-access-ggqws podName:5fde744c-b4ec-4557-aa38-a5c8e43337f4 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:06.109269963 +0000 UTC m=+9.047602348 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ggqws" (UniqueName: "kubernetes.io/projected/5fde744c-b4ec-4557-aa38-a5c8e43337f4-kube-api-access-ggqws") pod "network-check-target-jxssk" (UID: "5fde744c-b4ec-4557-aa38-a5c8e43337f4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:33:02.606516 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:02.606417    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pmsd9"
Jul 08 21:33:02.606516 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:02.606459    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xnzfd"
Jul 08 21:33:02.606763 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:02.606566    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pmsd9" podUID="863b1cfe-1f2f-426e-9a5e-c6aee4205013"
Jul 08 21:33:02.606968 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:02.606933    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xnzfd" podUID="6dbaf20f-e3bc-4428-9365-fd159b742280"
Jul 08 21:33:03.608433 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:03.608400    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxssk"
Jul 08 21:33:03.608875 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:03.608503    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxssk" podUID="5fde744c-b4ec-4557-aa38-a5c8e43337f4"
Jul 08 21:33:04.607993 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:04.607252    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pmsd9"
Jul 08 21:33:04.607993 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:04.607446    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pmsd9" podUID="863b1cfe-1f2f-426e-9a5e-c6aee4205013"
Jul 08 21:33:04.607993 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:04.607829    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xnzfd"
Jul 08 21:33:04.607993 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:04.607935    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xnzfd" podUID="6dbaf20f-e3bc-4428-9365-fd159b742280"
Jul 08 21:33:05.607036 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:05.607006    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxssk"
Jul 08 21:33:05.607450 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:05.607112    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxssk" podUID="5fde744c-b4ec-4557-aa38-a5c8e43337f4"
Jul 08 21:33:06.141497 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:06.141458    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/863b1cfe-1f2f-426e-9a5e-c6aee4205013-original-pull-secret\") pod \"global-pull-secret-syncer-pmsd9\" (UID: \"863b1cfe-1f2f-426e-9a5e-c6aee4205013\") " pod="kube-system/global-pull-secret-syncer-pmsd9"
Jul 08 21:33:06.141691 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:06.141508    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggqws\" (UniqueName: \"kubernetes.io/projected/5fde744c-b4ec-4557-aa38-a5c8e43337f4-kube-api-access-ggqws\") pod \"network-check-target-jxssk\" (UID: \"5fde744c-b4ec-4557-aa38-a5c8e43337f4\") " pod="openshift-network-diagnostics/network-check-target-jxssk"
Jul 08 21:33:06.141691 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:06.141548    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6dbaf20f-e3bc-4428-9365-fd159b742280-metrics-certs\") pod \"network-metrics-daemon-xnzfd\" (UID: \"6dbaf20f-e3bc-4428-9365-fd159b742280\") " pod="openshift-multus/network-metrics-daemon-xnzfd"
Jul 08 21:33:06.141691 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:06.141675    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:33:06.141691 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:06.141675    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 21:33:06.141899 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:06.141691    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 21:33:06.141899 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:06.141710    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 21:33:06.141899 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:06.141722    2569 projected.go:196] Error preparing data for projected volume kube-api-access-ggqws for pod openshift-network-diagnostics/network-check-target-jxssk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:33:06.141899 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:06.141739    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dbaf20f-e3bc-4428-9365-fd159b742280-metrics-certs podName:6dbaf20f-e3bc-4428-9365-fd159b742280 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:14.141716496 +0000 UTC m=+17.080048874 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6dbaf20f-e3bc-4428-9365-fd159b742280-metrics-certs") pod "network-metrics-daemon-xnzfd" (UID: "6dbaf20f-e3bc-4428-9365-fd159b742280") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:33:06.141899 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:06.141763    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fde744c-b4ec-4557-aa38-a5c8e43337f4-kube-api-access-ggqws podName:5fde744c-b4ec-4557-aa38-a5c8e43337f4 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:14.141747675 +0000 UTC m=+17.080080067 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ggqws" (UniqueName: "kubernetes.io/projected/5fde744c-b4ec-4557-aa38-a5c8e43337f4-kube-api-access-ggqws") pod "network-check-target-jxssk" (UID: "5fde744c-b4ec-4557-aa38-a5c8e43337f4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:33:06.141899 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:06.141781    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/863b1cfe-1f2f-426e-9a5e-c6aee4205013-original-pull-secret podName:863b1cfe-1f2f-426e-9a5e-c6aee4205013 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:14.141772122 +0000 UTC m=+17.080104501 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/863b1cfe-1f2f-426e-9a5e-c6aee4205013-original-pull-secret") pod "global-pull-secret-syncer-pmsd9" (UID: "863b1cfe-1f2f-426e-9a5e-c6aee4205013") : object "kube-system"/"original-pull-secret" not registered
Jul 08 21:33:06.607224 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:06.606682    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pmsd9"
Jul 08 21:33:06.607224 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:06.606709    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xnzfd"
Jul 08 21:33:06.607224 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:06.606825    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pmsd9" podUID="863b1cfe-1f2f-426e-9a5e-c6aee4205013"
Jul 08 21:33:06.607224 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:06.606937    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xnzfd" podUID="6dbaf20f-e3bc-4428-9365-fd159b742280"
Jul 08 21:33:07.608091 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:07.608059    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxssk"
Jul 08 21:33:07.608540 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:07.608205    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxssk" podUID="5fde744c-b4ec-4557-aa38-a5c8e43337f4"
Jul 08 21:33:08.606781 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:08.606748    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pmsd9"
Jul 08 21:33:08.606949 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:08.606866    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xnzfd"
Jul 08 21:33:08.606949 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:08.606880    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pmsd9" podUID="863b1cfe-1f2f-426e-9a5e-c6aee4205013"
Jul 08 21:33:08.607062 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:08.607002    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xnzfd" podUID="6dbaf20f-e3bc-4428-9365-fd159b742280"
Jul 08 21:33:09.611135 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:09.610668    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxssk"
Jul 08 21:33:09.611135 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:09.610789    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxssk" podUID="5fde744c-b4ec-4557-aa38-a5c8e43337f4"
Jul 08 21:33:10.606539 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:10.606504    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pmsd9"
Jul 08 21:33:10.606719 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:10.606513    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xnzfd"
Jul 08 21:33:10.606719 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:10.606625    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pmsd9" podUID="863b1cfe-1f2f-426e-9a5e-c6aee4205013"
Jul 08 21:33:10.606812 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:10.606719    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xnzfd" podUID="6dbaf20f-e3bc-4428-9365-fd159b742280"
Jul 08 21:33:11.607112 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:11.607070    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxssk"
Jul 08 21:33:11.607614 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:11.607222    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxssk" podUID="5fde744c-b4ec-4557-aa38-a5c8e43337f4"
Jul 08 21:33:12.607370 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:12.607331    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pmsd9"
Jul 08 21:33:12.607800 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:12.607381    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xnzfd"
Jul 08 21:33:12.607800 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:12.607478    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pmsd9" podUID="863b1cfe-1f2f-426e-9a5e-c6aee4205013"
Jul 08 21:33:12.607800 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:12.607587    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xnzfd" podUID="6dbaf20f-e3bc-4428-9365-fd159b742280"
Jul 08 21:33:13.609739 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:13.609490    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxssk"
Jul 08 21:33:13.610124 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:13.609837    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxssk" podUID="5fde744c-b4ec-4557-aa38-a5c8e43337f4"
Jul 08 21:33:14.205364 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:14.205330    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/863b1cfe-1f2f-426e-9a5e-c6aee4205013-original-pull-secret\") pod \"global-pull-secret-syncer-pmsd9\" (UID: \"863b1cfe-1f2f-426e-9a5e-c6aee4205013\") " pod="kube-system/global-pull-secret-syncer-pmsd9"
Jul 08 21:33:14.205364 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:14.205366    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggqws\" (UniqueName: \"kubernetes.io/projected/5fde744c-b4ec-4557-aa38-a5c8e43337f4-kube-api-access-ggqws\") pod \"network-check-target-jxssk\" (UID: \"5fde744c-b4ec-4557-aa38-a5c8e43337f4\") " pod="openshift-network-diagnostics/network-check-target-jxssk"
Jul 08 21:33:14.205590 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:14.205402    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6dbaf20f-e3bc-4428-9365-fd159b742280-metrics-certs\") pod \"network-metrics-daemon-xnzfd\" (UID: \"6dbaf20f-e3bc-4428-9365-fd159b742280\") " pod="openshift-multus/network-metrics-daemon-xnzfd"
Jul 08 21:33:14.205590 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:14.205528    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:33:14.205590 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:14.205588    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dbaf20f-e3bc-4428-9365-fd159b742280-metrics-certs podName:6dbaf20f-e3bc-4428-9365-fd159b742280 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:30.205569859 +0000 UTC m=+33.143902252 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6dbaf20f-e3bc-4428-9365-fd159b742280-metrics-certs") pod "network-metrics-daemon-xnzfd" (UID: "6dbaf20f-e3bc-4428-9365-fd159b742280") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:33:14.205735 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:14.205654    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 21:33:14.205735 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:14.205688    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/863b1cfe-1f2f-426e-9a5e-c6aee4205013-original-pull-secret podName:863b1cfe-1f2f-426e-9a5e-c6aee4205013 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:30.205676919 +0000 UTC m=+33.144009302 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/863b1cfe-1f2f-426e-9a5e-c6aee4205013-original-pull-secret") pod "global-pull-secret-syncer-pmsd9" (UID: "863b1cfe-1f2f-426e-9a5e-c6aee4205013") : object "kube-system"/"original-pull-secret" not registered
Jul 08 21:33:14.205844 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:14.205778    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 21:33:14.205844 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:14.205796    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 21:33:14.205844 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:14.205806    2569 projected.go:196] Error preparing data for projected volume kube-api-access-ggqws for pod openshift-network-diagnostics/network-check-target-jxssk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:33:14.205970 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:14.205866    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fde744c-b4ec-4557-aa38-a5c8e43337f4-kube-api-access-ggqws podName:5fde744c-b4ec-4557-aa38-a5c8e43337f4 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:30.205855569 +0000 UTC m=+33.144187950 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ggqws" (UniqueName: "kubernetes.io/projected/5fde744c-b4ec-4557-aa38-a5c8e43337f4-kube-api-access-ggqws") pod "network-check-target-jxssk" (UID: "5fde744c-b4ec-4557-aa38-a5c8e43337f4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:33:14.606969 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:14.606849    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xnzfd"
Jul 08 21:33:14.607206 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:14.606976    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xnzfd" podUID="6dbaf20f-e3bc-4428-9365-fd159b742280"
Jul 08 21:33:14.607206 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:14.607037    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pmsd9"
Jul 08 21:33:14.607206 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:14.607158    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pmsd9" podUID="863b1cfe-1f2f-426e-9a5e-c6aee4205013"
Jul 08 21:33:15.606901 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:15.606866    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxssk"
Jul 08 21:33:15.607369 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:15.607004    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxssk" podUID="5fde744c-b4ec-4557-aa38-a5c8e43337f4"
Jul 08 21:33:16.606876 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:16.606834    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xnzfd"
Jul 08 21:33:16.607055 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:16.606995    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xnzfd" podUID="6dbaf20f-e3bc-4428-9365-fd159b742280"
Jul 08 21:33:16.607417 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:16.607379    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pmsd9"
Jul 08 21:33:16.607506 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:16.607482    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pmsd9" podUID="863b1cfe-1f2f-426e-9a5e-c6aee4205013"
Jul 08 21:33:17.607170 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:17.607133    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxssk"
Jul 08 21:33:17.607664 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:17.607239    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxssk" podUID="5fde744c-b4ec-4557-aa38-a5c8e43337f4"
Jul 08 21:33:18.606418 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:18.606383    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pmsd9"
Jul 08 21:33:18.606625 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:18.606516    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pmsd9" podUID="863b1cfe-1f2f-426e-9a5e-c6aee4205013"
Jul 08 21:33:18.606871 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:18.606850    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xnzfd"
Jul 08 21:33:18.606957 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:18.606941    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xnzfd" podUID="6dbaf20f-e3bc-4428-9365-fd159b742280"
Jul 08 21:33:19.607110 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:19.607092    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxssk"
Jul 08 21:33:19.607406 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:19.607203    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxssk" podUID="5fde744c-b4ec-4557-aa38-a5c8e43337f4"
Jul 08 21:33:19.836814 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:19.836786    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gnqw5" event={"ID":"a9d31b5d-381f-4096-8ee4-f964085df274","Type":"ContainerStarted","Data":"423fe20998d5cc21444910a8eb8b989e1c50072b1c2118df876d6750ca17e8d8"}
Jul 08 21:33:19.838375 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:19.838315    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bgl2j" event={"ID":"24a0bf73-fc2c-4fea-9e48-4692b50c95fc","Type":"ContainerStarted","Data":"d3854706f6ed1f267ac069897ea86f5f175ac0cfe12a7621c7368f68e4858018"}
Jul 08 21:33:19.842043 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:19.842018    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-83.ec2.internal" event={"ID":"53be9f26ebbce9e8712878906521c6f8","Type":"ContainerStarted","Data":"328d7673836ae92803be1a2cd0b0fe14c33f8a17cfcd6e1d9502d5d91afba622"}
Jul 08 21:33:19.853882 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:19.853834    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-gnqw5" podStartSLOduration=1.162299438 podStartE2EDuration="21.853818039s" totalImagesPullingTime="20.691518601s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:19.853277494 +0000 UTC m=+22.791609919" watchObservedRunningTime="2026-07-08 21:33:19.853818039 +0000 UTC m=+22.792150434"
Jul 08 21:33:19.867061 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:19.867005    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-83.ec2.internal" podStartSLOduration=21.866981931 podStartE2EDuration="21.866981931s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:32:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:19.866324607 +0000 UTC m=+22.804657027" watchObservedRunningTime="2026-07-08 21:33:19.866981931 +0000 UTC m=+22.805314333"
Jul 08 21:33:19.882998 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:19.882861    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bgl2j" podStartSLOduration=1.148270047 podStartE2EDuration="21.882840608s" totalImagesPullingTime="20.734570561s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:19.882243195 +0000 UTC m=+22.820575597" watchObservedRunningTime="2026-07-08 21:33:19.882840608 +0000 UTC m=+22.821173008"
Jul 08 21:33:20.606975 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:20.606923    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xnzfd"
Jul 08 21:33:20.607091 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:20.607038    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xnzfd" podUID="6dbaf20f-e3bc-4428-9365-fd159b742280"
Jul 08 21:33:20.607131 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:20.607088    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pmsd9"
Jul 08 21:33:20.607725 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:20.607166    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pmsd9" podUID="863b1cfe-1f2f-426e-9a5e-c6aee4205013"
Jul 08 21:33:20.845099 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:20.844908    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hhqv4" event={"ID":"e7921e50-7309-4703-8a27-a9e51260d4a0","Type":"ContainerStarted","Data":"462ad89ced4a137a5b16dc85d4a90a1db50feb70d949af40925817ef5042155b"}
Jul 08 21:33:20.846465 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:20.846442    2569 generic.go:356] "Generic (PLEG): container finished" podID="773e320a-2215-4512-a09c-2249707f24f7" containerID="d8be3e12a8071332059d5985ca40122688d60ad3c0de6a3d0d65b14df38d7eb8" exitCode=0
Jul 08 21:33:20.846558 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:20.846512    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wbw7t" event={"ID":"773e320a-2215-4512-a09c-2249707f24f7","Type":"ContainerDied","Data":"d8be3e12a8071332059d5985ca40122688d60ad3c0de6a3d0d65b14df38d7eb8"}
Jul 08 21:33:20.847963 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:20.847909    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mdr2r" event={"ID":"6f70df4a-7077-418a-9afe-02c4e6792fcc","Type":"ContainerStarted","Data":"b2d68f251d8da170531ffee6fc304581c091bcd9a4432de61f1fd07ed64f6046"}
Jul 08 21:33:20.854205 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:20.854187    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6cs4g_a022d640-79f0-4d35-be9a-9c6ac708d10b/ovn-acl-logging/0.log"
Jul 08 21:33:20.854501 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:20.854481    2569 generic.go:356] "Generic (PLEG): container finished" podID="a022d640-79f0-4d35-be9a-9c6ac708d10b" containerID="c1464b924c068b74f270e56c678d4cf24a40548ee90051a42763f17bd44471bd" exitCode=1
Jul 08 21:33:20.854501 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:20.854505    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g" event={"ID":"a022d640-79f0-4d35-be9a-9c6ac708d10b","Type":"ContainerStarted","Data":"516c79adca95407322c84af1e4599fb9631240396d1b4e96e33e422107cc1349"}
Jul 08 21:33:20.854658 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:20.854575    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g" event={"ID":"a022d640-79f0-4d35-be9a-9c6ac708d10b","Type":"ContainerStarted","Data":"2ac0f5c06bc608394396ba36405b5a7fbdee69eeb7f43626350b3ceed5fc6ea4"}
Jul 08 21:33:20.854658 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:20.854653    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g" event={"ID":"a022d640-79f0-4d35-be9a-9c6ac708d10b","Type":"ContainerStarted","Data":"66ab5f99bcd8c9d3a74e33f0c2928db0a5815bd0b612dd80b7125105f9a481ff"}
Jul 08 21:33:20.854730 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:20.854704    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g" event={"ID":"a022d640-79f0-4d35-be9a-9c6ac708d10b","Type":"ContainerStarted","Data":"69021d94a9f4864c786e937f990ad7c140e8fd1f5dcb2dd77727fe7e1261bd64"}
Jul 08 21:33:20.854772 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:20.854739    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g" event={"ID":"a022d640-79f0-4d35-be9a-9c6ac708d10b","Type":"ContainerDied","Data":"c1464b924c068b74f270e56c678d4cf24a40548ee90051a42763f17bd44471bd"}
Jul 08 21:33:20.854812 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:20.854771    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g" event={"ID":"a022d640-79f0-4d35-be9a-9c6ac708d10b","Type":"ContainerStarted","Data":"706dce7947ac3d88f0cc3629e154260faa4ca6ffe8ede6c9ea0c6fda45c476f6"}
Jul 08 21:33:20.855799 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:20.855781    2569 generic.go:356] "Generic (PLEG): container finished" podID="4407acfac9b3a400518ad059d4a0580d" containerID="fb1577e99c990d563e91705e5c5f4d4b63167a692d029f9afe5fa45665b824d3" exitCode=0
Jul 08 21:33:20.855864 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:20.855841    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-83.ec2.internal" event={"ID":"4407acfac9b3a400518ad059d4a0580d","Type":"ContainerDied","Data":"fb1577e99c990d563e91705e5c5f4d4b63167a692d029f9afe5fa45665b824d3"}
Jul 08 21:33:20.857345 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:20.857258    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5wfz7" event={"ID":"1cdf17b8-152a-4cca-9050-ef85d4131f91","Type":"ContainerStarted","Data":"48bc690b4b9ae43ade4444a954325153c6d2bab7d1d9ca18ec88d1e23bf11151"}
Jul 08 21:33:20.858780 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:20.858758    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7t4d" event={"ID":"3838e3de-7636-4c3a-8406-bab163d769ae","Type":"ContainerStarted","Data":"0d8009233ca947e16ea1e5d8c0947b9455fd3753c1867adb6bd0f4e9cedc6f95"}
Jul 08 21:33:20.860375 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:20.860066    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6q8p8" event={"ID":"b1915083-20cf-4eeb-8a60-98ca27325782","Type":"ContainerStarted","Data":"07146c74fd286de0b9ae565511b1363e407a540d19426781c216af691911c44c"}
Jul 08 21:33:20.864042 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:20.863995    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hhqv4" podStartSLOduration=2.107726534 podStartE2EDuration="22.863979021s" totalImagesPullingTime="20.756252487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:20.862596205 +0000 UTC m=+23.800928605" watchObservedRunningTime="2026-07-08 21:33:20.863979021 +0000 UTC m=+23.802311425"
Jul 08 21:33:20.878769 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:20.878732    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5wfz7" podStartSLOduration=2.196795225 podStartE2EDuration="22.878719567s" totalImagesPullingTime="20.681924342s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:20.8784242 +0000 UTC m=+23.816756599" watchObservedRunningTime="2026-07-08 21:33:20.878719567 +0000 UTC m=+23.817051968"
Jul 08 21:33:20.910381 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:20.910320    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mdr2r" podStartSLOduration=2.238514934 podStartE2EDuration="22.910278298s" totalImagesPullingTime="20.671763364s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:20.909822584 +0000 UTC m=+23.848154984" watchObservedRunningTime="2026-07-08 21:33:20.910278298 +0000 UTC m=+23.848610705"
Jul 08 21:33:21.387334 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:21.387305    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hhqv4"
Jul 08 21:33:21.387874 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:21.387850    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hhqv4"
Jul 08 21:33:21.409553 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:21.409501    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6q8p8" podStartSLOduration=2.6866205499999998 podStartE2EDuration="23.409484574s" totalImagesPullingTime="20.722864024s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:20.955631256 +0000 UTC m=+23.893963676" watchObservedRunningTime="2026-07-08 21:33:21.409484574 +0000 UTC m=+24.347816973"
Jul 08 21:33:21.606968 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:21.606928    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxssk"
Jul 08 21:33:21.607135 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:21.607085    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxssk" podUID="5fde744c-b4ec-4557-aa38-a5c8e43337f4"
Jul 08 21:33:21.864544 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:21.864506    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-83.ec2.internal" event={"ID":"4407acfac9b3a400518ad059d4a0580d","Type":"ContainerStarted","Data":"ef2b303fc21ff4c47380d57fef89f3886c1d08cb0e076ae9f6967740471bd09a"}
Jul 08 21:33:21.865580 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:21.865561    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hhqv4"
Jul 08 21:33:21.866358 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:21.866238    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hhqv4"
Jul 08 21:33:21.909652 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:21.909576    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-83.ec2.internal" podStartSLOduration=23.909560156 podStartE2EDuration="23.909560156s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:32:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:21.890399713 +0000 UTC m=+24.828732137" watchObservedRunningTime="2026-07-08 21:33:21.909560156 +0000 UTC m=+24.847892579"
Jul 08 21:33:21.968023 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:21.967996    2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 08 21:33:22.537493 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:22.537389    2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T21:33:21.968017537Z","UUID":"2513d936-8ee8-4960-b0ad-41a24fd7cf21","Handler":null,"Name":"","Endpoint":""}
Jul 08 21:33:22.538932 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:22.538912    2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 08 21:33:22.539048 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:22.538954    2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 08 21:33:22.606365 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:22.606337    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xnzfd"
Jul 08 21:33:22.606508 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:22.606382    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pmsd9"
Jul 08 21:33:22.606508 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:22.606453    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xnzfd" podUID="6dbaf20f-e3bc-4428-9365-fd159b742280"
Jul 08 21:33:22.606609 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:22.606589    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pmsd9" podUID="863b1cfe-1f2f-426e-9a5e-c6aee4205013"
Jul 08 21:33:22.869060 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:22.868971    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7t4d" event={"ID":"3838e3de-7636-4c3a-8406-bab163d769ae","Type":"ContainerStarted","Data":"6861fae2382fbf1b1c67428587ece95ca12698891eadd04c4cee3e404c6f0c01"}
Jul 08 21:33:22.873145 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:22.873124    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6cs4g_a022d640-79f0-4d35-be9a-9c6ac708d10b/ovn-acl-logging/0.log"
Jul 08 21:33:22.874041 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:22.874021    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g" event={"ID":"a022d640-79f0-4d35-be9a-9c6ac708d10b","Type":"ContainerStarted","Data":"dc7449b0a2b4f20a3cba1396a55e2dec91aa7f4f29bf9e92ca5ba211d7b1669a"}
Jul 08 21:33:23.610533 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:23.610451    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxssk"
Jul 08 21:33:23.610679 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:23.610554    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxssk" podUID="5fde744c-b4ec-4557-aa38-a5c8e43337f4"
Jul 08 21:33:23.877630 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:23.877545    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7t4d" event={"ID":"3838e3de-7636-4c3a-8406-bab163d769ae","Type":"ContainerStarted","Data":"7b2df3f958677543d0285a7b35799ace7ac7757c4a3765347439fb21e4dadbb2"}
Jul 08 21:33:23.899542 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:23.898040    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7t4d" podStartSLOduration=2.687598002 podStartE2EDuration="25.898020888s" totalImagesPullingTime="23.210422886s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:32:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:23.896858186 +0000 UTC m=+26.835190609" watchObservedRunningTime="2026-07-08 21:33:23.898020888 +0000 UTC m=+26.836353292"
Jul 08 21:33:24.606945 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:24.606910    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pmsd9"
Jul 08 21:33:24.607073 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:24.606938    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xnzfd"
Jul 08 21:33:24.607073 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:24.607042    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pmsd9" podUID="863b1cfe-1f2f-426e-9a5e-c6aee4205013"
Jul 08 21:33:24.607168 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:24.607127    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xnzfd" podUID="6dbaf20f-e3bc-4428-9365-fd159b742280"
Jul 08 21:33:25.607378 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:25.607075    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxssk"
Jul 08 21:33:25.607833 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:25.607453    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxssk" podUID="5fde744c-b4ec-4557-aa38-a5c8e43337f4"
Jul 08 21:33:26.607032 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:26.606958    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pmsd9"
Jul 08 21:33:26.607032 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:26.606979    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xnzfd"
Jul 08 21:33:26.607247 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:26.607051    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pmsd9" podUID="863b1cfe-1f2f-426e-9a5e-c6aee4205013"
Jul 08 21:33:26.607247 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:26.607176    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xnzfd" podUID="6dbaf20f-e3bc-4428-9365-fd159b742280"
Jul 08 21:33:26.885957 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:26.885870    2569 generic.go:356] "Generic (PLEG): container finished" podID="773e320a-2215-4512-a09c-2249707f24f7" containerID="3688743417ee1f3d682d3ae5d0331d43c8c6f64327b3f2e867ada8e0fa263a60" exitCode=0
Jul 08 21:33:26.885957 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:26.885926    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wbw7t" event={"ID":"773e320a-2215-4512-a09c-2249707f24f7","Type":"ContainerDied","Data":"3688743417ee1f3d682d3ae5d0331d43c8c6f64327b3f2e867ada8e0fa263a60"}
Jul 08 21:33:26.889441 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:26.889426    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6cs4g_a022d640-79f0-4d35-be9a-9c6ac708d10b/ovn-acl-logging/0.log"
Jul 08 21:33:26.889816 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:26.889796    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g" event={"ID":"a022d640-79f0-4d35-be9a-9c6ac708d10b","Type":"ContainerStarted","Data":"ebe8ad0bec3a7f561f6e5eba90bf673ee2ef16e4f3731342ffb39a35265cc51e"}
Jul 08 21:33:26.890058 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:26.890038    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:33:26.890172 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:26.890100    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:33:26.890241 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:26.890205    2569 scope.go:117] "RemoveContainer" containerID="c1464b924c068b74f270e56c678d4cf24a40548ee90051a42763f17bd44471bd"
Jul 08 21:33:26.906997 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:26.906979    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:33:27.607674 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:27.607518    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxssk"
Jul 08 21:33:27.607950 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:27.607732    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxssk" podUID="5fde744c-b4ec-4557-aa38-a5c8e43337f4"
Jul 08 21:33:27.895589 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:27.895565    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6cs4g_a022d640-79f0-4d35-be9a-9c6ac708d10b/ovn-acl-logging/0.log"
Jul 08 21:33:27.896052 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:27.895907    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g" event={"ID":"a022d640-79f0-4d35-be9a-9c6ac708d10b","Type":"ContainerStarted","Data":"0907bf30a41983f1365e57564bb755cd0100f3621cac73aadcd70ac4251b3bd0"}
Jul 08 21:33:27.896097 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:27.896071    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:33:27.911256 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:27.911231    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:33:27.941047 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:27.940985    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g" podStartSLOduration=8.897985943 podStartE2EDuration="29.940965186s" totalImagesPullingTime="21.042979243s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:27.940911031 +0000 UTC m=+30.879243449" watchObservedRunningTime="2026-07-08 21:33:27.940965186 +0000 UTC m=+30.879297589"
Jul 08 21:33:28.232128 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:28.232104    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pmsd9"]
Jul 08 21:33:28.232244 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:28.232233    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pmsd9"
Jul 08 21:33:28.232359 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:28.232341    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pmsd9" podUID="863b1cfe-1f2f-426e-9a5e-c6aee4205013"
Jul 08 21:33:28.236623 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:28.236590    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jxssk"]
Jul 08 21:33:28.236747 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:28.236697    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxssk"
Jul 08 21:33:28.236805 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:28.236772    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxssk" podUID="5fde744c-b4ec-4557-aa38-a5c8e43337f4"
Jul 08 21:33:28.237261 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:28.237239    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xnzfd"]
Jul 08 21:33:28.237393 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:28.237360    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xnzfd"
Jul 08 21:33:28.237483 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:28.237462    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xnzfd" podUID="6dbaf20f-e3bc-4428-9365-fd159b742280"
Jul 08 21:33:28.901530 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:28.901495    2569 generic.go:356] "Generic (PLEG): container finished" podID="773e320a-2215-4512-a09c-2249707f24f7" containerID="4197c0f3d692d12f3b530465b1ccca7b014609b1dab6dcb953b00f76f46911a6" exitCode=0
Jul 08 21:33:28.901951 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:28.901633    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wbw7t" event={"ID":"773e320a-2215-4512-a09c-2249707f24f7","Type":"ContainerDied","Data":"4197c0f3d692d12f3b530465b1ccca7b014609b1dab6dcb953b00f76f46911a6"}
Jul 08 21:33:29.606716 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:29.606636    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xnzfd"
Jul 08 21:33:29.606872 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:29.606776    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xnzfd" podUID="6dbaf20f-e3bc-4428-9365-fd159b742280"
Jul 08 21:33:30.216639 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:30.216598    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/863b1cfe-1f2f-426e-9a5e-c6aee4205013-original-pull-secret\") pod \"global-pull-secret-syncer-pmsd9\" (UID: \"863b1cfe-1f2f-426e-9a5e-c6aee4205013\") " pod="kube-system/global-pull-secret-syncer-pmsd9"
Jul 08 21:33:30.216639 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:30.216642    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggqws\" (UniqueName: \"kubernetes.io/projected/5fde744c-b4ec-4557-aa38-a5c8e43337f4-kube-api-access-ggqws\") pod \"network-check-target-jxssk\" (UID: \"5fde744c-b4ec-4557-aa38-a5c8e43337f4\") " pod="openshift-network-diagnostics/network-check-target-jxssk"
Jul 08 21:33:30.217083 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:30.216752    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 21:33:30.217083 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:30.216775    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 21:33:30.217083 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:30.216791    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 21:33:30.217083 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:30.216795    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6dbaf20f-e3bc-4428-9365-fd159b742280-metrics-certs\") pod \"network-metrics-daemon-xnzfd\" (UID: \"6dbaf20f-e3bc-4428-9365-fd159b742280\") " pod="openshift-multus/network-metrics-daemon-xnzfd"
Jul 08 21:33:30.217083 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:30.216804    2569 projected.go:196] Error preparing data for projected volume kube-api-access-ggqws for pod openshift-network-diagnostics/network-check-target-jxssk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:33:30.217083 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:30.216857    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:33:30.217083 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:30.216823    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/863b1cfe-1f2f-426e-9a5e-c6aee4205013-original-pull-secret podName:863b1cfe-1f2f-426e-9a5e-c6aee4205013 nodeName:}" failed. No retries permitted until 2026-07-08 21:34:02.2168052 +0000 UTC m=+65.155137583 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/863b1cfe-1f2f-426e-9a5e-c6aee4205013-original-pull-secret") pod "global-pull-secret-syncer-pmsd9" (UID: "863b1cfe-1f2f-426e-9a5e-c6aee4205013") : object "kube-system"/"original-pull-secret" not registered
Jul 08 21:33:30.217083 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:30.216884    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fde744c-b4ec-4557-aa38-a5c8e43337f4-kube-api-access-ggqws podName:5fde744c-b4ec-4557-aa38-a5c8e43337f4 nodeName:}" failed. No retries permitted until 2026-07-08 21:34:02.21686901 +0000 UTC m=+65.155201388 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ggqws" (UniqueName: "kubernetes.io/projected/5fde744c-b4ec-4557-aa38-a5c8e43337f4-kube-api-access-ggqws") pod "network-check-target-jxssk" (UID: "5fde744c-b4ec-4557-aa38-a5c8e43337f4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:33:30.217083 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:30.216896    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dbaf20f-e3bc-4428-9365-fd159b742280-metrics-certs podName:6dbaf20f-e3bc-4428-9365-fd159b742280 nodeName:}" failed. No retries permitted until 2026-07-08 21:34:02.216889639 +0000 UTC m=+65.155222017 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6dbaf20f-e3bc-4428-9365-fd159b742280-metrics-certs") pod "network-metrics-daemon-xnzfd" (UID: "6dbaf20f-e3bc-4428-9365-fd159b742280") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:33:30.606702 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:30.606673    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxssk"
Jul 08 21:33:30.606849 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:30.606686    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pmsd9"
Jul 08 21:33:30.606849 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:30.606769    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxssk" podUID="5fde744c-b4ec-4557-aa38-a5c8e43337f4"
Jul 08 21:33:30.606964 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:30.606873    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pmsd9" podUID="863b1cfe-1f2f-426e-9a5e-c6aee4205013"
Jul 08 21:33:30.908074 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:30.908044    2569 generic.go:356] "Generic (PLEG): container finished" podID="773e320a-2215-4512-a09c-2249707f24f7" containerID="bd65166eb3458b0e9c0776ad265947f9147e1f63123244f06368be10cd052471" exitCode=0
Jul 08 21:33:30.908074 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:30.908079    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wbw7t" event={"ID":"773e320a-2215-4512-a09c-2249707f24f7","Type":"ContainerDied","Data":"bd65166eb3458b0e9c0776ad265947f9147e1f63123244f06368be10cd052471"}
Jul 08 21:33:31.606546 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:31.606505    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xnzfd"
Jul 08 21:33:31.606969 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:31.606667    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xnzfd" podUID="6dbaf20f-e3bc-4428-9365-fd159b742280"
Jul 08 21:33:32.384429 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.384229    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-83.ec2.internal" event="NodeReady"
Jul 08 21:33:32.384599 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.384542    2569 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 08 21:33:32.432950 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.432921    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5f6f4c745f-hznbc"]
Jul 08 21:33:32.434813 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.434788    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f6f4c745f-hznbc"
Jul 08 21:33:32.437626 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.437192    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-z9lcg\""
Jul 08 21:33:32.437626 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.437232    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 08 21:33:32.437626 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.437307    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 08 21:33:32.437626 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.437507    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 08 21:33:32.443093 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.443075    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 08 21:33:32.449267 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.449248    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wp7gn"]
Jul 08 21:33:32.450935 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.450918    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4ppnj"]
Jul 08 21:33:32.451056 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.451041    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wp7gn"
Jul 08 21:33:32.453036 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.452675    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4ppnj"
Jul 08 21:33:32.453312 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.453269    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n8f5q\""
Jul 08 21:33:32.453312 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.453276    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 08 21:33:32.453520 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.453317    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 08 21:33:32.454692 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.454676    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 08 21:33:32.454962 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.454947    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dvhrx\""
Jul 08 21:33:32.455042 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.454975    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 08 21:33:32.455335 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.455273    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 08 21:33:32.461425 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.461408    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f6f4c745f-hznbc"]
Jul 08 21:33:32.462785 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.462765    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4ppnj"]
Jul 08 21:33:32.468182 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.468160    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wp7gn"]
Jul 08 21:33:32.537112 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.537039    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlgbl\" (UniqueName: \"kubernetes.io/projected/e2dbdfdb-4d51-44b2-8387-7ebc24441008-kube-api-access-vlgbl\") pod \"image-registry-5f6f4c745f-hznbc\" (UID: \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\") " pod="openshift-image-registry/image-registry-5f6f4c745f-hznbc"
Jul 08 21:33:32.537112 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.537068    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/519c6282-5e7c-4c40-bf12-c64727f8ab86-config-volume\") pod \"dns-default-wp7gn\" (UID: \"519c6282-5e7c-4c40-bf12-c64727f8ab86\") " pod="openshift-dns/dns-default-wp7gn"
Jul 08 21:33:32.537112 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.537088    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/519c6282-5e7c-4c40-bf12-c64727f8ab86-metrics-tls\") pod \"dns-default-wp7gn\" (UID: \"519c6282-5e7c-4c40-bf12-c64727f8ab86\") " pod="openshift-dns/dns-default-wp7gn"
Jul 08 21:33:32.537112 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.537108    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e2dbdfdb-4d51-44b2-8387-7ebc24441008-image-registry-private-configuration\") pod \"image-registry-5f6f4c745f-hznbc\" (UID: \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\") " pod="openshift-image-registry/image-registry-5f6f4c745f-hznbc"
Jul 08 21:33:32.537379 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.537138    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e2dbdfdb-4d51-44b2-8387-7ebc24441008-ca-trust-extracted\") pod \"image-registry-5f6f4c745f-hznbc\" (UID: \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\") " pod="openshift-image-registry/image-registry-5f6f4c745f-hznbc"
Jul 08 21:33:32.537379 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.537166    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2dbdfdb-4d51-44b2-8387-7ebc24441008-trusted-ca\") pod \"image-registry-5f6f4c745f-hznbc\" (UID: \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\") " pod="openshift-image-registry/image-registry-5f6f4c745f-hznbc"
Jul 08 21:33:32.537379 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.537184    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e2dbdfdb-4d51-44b2-8387-7ebc24441008-installation-pull-secrets\") pod \"image-registry-5f6f4c745f-hznbc\" (UID: \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\") " pod="openshift-image-registry/image-registry-5f6f4c745f-hznbc"
Jul 08 21:33:32.537379 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.537243    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2dbdfdb-4d51-44b2-8387-7ebc24441008-registry-tls\") pod \"image-registry-5f6f4c745f-hznbc\" (UID: \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\") " pod="openshift-image-registry/image-registry-5f6f4c745f-hznbc"
Jul 08 21:33:32.537379 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.537269    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2dbdfdb-4d51-44b2-8387-7ebc24441008-bound-sa-token\") pod \"image-registry-5f6f4c745f-hznbc\" (UID: \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\") " pod="openshift-image-registry/image-registry-5f6f4c745f-hznbc"
Jul 08 21:33:32.537379 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.537305    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxmhx\" (UniqueName: \"kubernetes.io/projected/3fd2f0f8-98cb-4352-b6bd-3f7ef41af8de-kube-api-access-cxmhx\") pod \"ingress-canary-4ppnj\" (UID: \"3fd2f0f8-98cb-4352-b6bd-3f7ef41af8de\") " pod="openshift-ingress-canary/ingress-canary-4ppnj"
Jul 08 21:33:32.537379 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.537371    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3fd2f0f8-98cb-4352-b6bd-3f7ef41af8de-cert\") pod \"ingress-canary-4ppnj\" (UID: \"3fd2f0f8-98cb-4352-b6bd-3f7ef41af8de\") " pod="openshift-ingress-canary/ingress-canary-4ppnj"
Jul 08 21:33:32.537603 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.537395    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/519c6282-5e7c-4c40-bf12-c64727f8ab86-tmp-dir\") pod \"dns-default-wp7gn\" (UID: \"519c6282-5e7c-4c40-bf12-c64727f8ab86\") " pod="openshift-dns/dns-default-wp7gn"
Jul 08 21:33:32.537603 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.537422    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxhfs\" (UniqueName: \"kubernetes.io/projected/519c6282-5e7c-4c40-bf12-c64727f8ab86-kube-api-access-dxhfs\") pod \"dns-default-wp7gn\" (UID: \"519c6282-5e7c-4c40-bf12-c64727f8ab86\") " pod="openshift-dns/dns-default-wp7gn"
Jul 08 21:33:32.537603 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.537442    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e2dbdfdb-4d51-44b2-8387-7ebc24441008-registry-certificates\") pod \"image-registry-5f6f4c745f-hznbc\" (UID: \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\") " pod="openshift-image-registry/image-registry-5f6f4c745f-hznbc"
Jul 08 21:33:32.551583 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.551560    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-dp8p7"]
Jul 08 21:33:32.553620 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.553593    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-dp8p7"
Jul 08 21:33:32.556459 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.556441    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-7mhdp\""
Jul 08 21:33:32.556831 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.556810    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 08 21:33:32.557201 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.557183    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 08 21:33:32.579962 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.579939    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-dp8p7"]
Jul 08 21:33:32.607162 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.607136    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxssk"
Jul 08 21:33:32.607162 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.607156    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pmsd9"
Jul 08 21:33:32.610410 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.610381    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 21:33:32.610520 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.610457    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jnwkj\""
Jul 08 21:33:32.610520 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.610501    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 21:33:32.610644 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.610633    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 21:33:32.638596 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.638569    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3fd2f0f8-98cb-4352-b6bd-3f7ef41af8de-cert\") pod \"ingress-canary-4ppnj\" (UID: \"3fd2f0f8-98cb-4352-b6bd-3f7ef41af8de\") " pod="openshift-ingress-canary/ingress-canary-4ppnj"
Jul 08 21:33:32.638713 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.638603    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/519c6282-5e7c-4c40-bf12-c64727f8ab86-tmp-dir\") pod \"dns-default-wp7gn\" (UID: \"519c6282-5e7c-4c40-bf12-c64727f8ab86\") " pod="openshift-dns/dns-default-wp7gn"
Jul 08 21:33:32.638713 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.638623    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxhfs\" (UniqueName: \"kubernetes.io/projected/519c6282-5e7c-4c40-bf12-c64727f8ab86-kube-api-access-dxhfs\") pod \"dns-default-wp7gn\" (UID: \"519c6282-5e7c-4c40-bf12-c64727f8ab86\") " pod="openshift-dns/dns-default-wp7gn"
Jul 08 21:33:32.638713 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.638643    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e2dbdfdb-4d51-44b2-8387-7ebc24441008-registry-certificates\") pod \"image-registry-5f6f4c745f-hznbc\" (UID: \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\") " pod="openshift-image-registry/image-registry-5f6f4c745f-hznbc"
Jul 08 21:33:32.638713 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.638683    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlgbl\" (UniqueName: \"kubernetes.io/projected/e2dbdfdb-4d51-44b2-8387-7ebc24441008-kube-api-access-vlgbl\") pod \"image-registry-5f6f4c745f-hznbc\" (UID: \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\") " pod="openshift-image-registry/image-registry-5f6f4c745f-hznbc"
Jul 08 21:33:32.638713 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.638707    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/519c6282-5e7c-4c40-bf12-c64727f8ab86-config-volume\") pod \"dns-default-wp7gn\" (UID: \"519c6282-5e7c-4c40-bf12-c64727f8ab86\") " pod="openshift-dns/dns-default-wp7gn"
Jul 08 21:33:32.638958 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.638737    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/519c6282-5e7c-4c40-bf12-c64727f8ab86-metrics-tls\") pod \"dns-default-wp7gn\" (UID: \"519c6282-5e7c-4c40-bf12-c64727f8ab86\") " pod="openshift-dns/dns-default-wp7gn"
Jul 08 21:33:32.638958 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.638767    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e2dbdfdb-4d51-44b2-8387-7ebc24441008-image-registry-private-configuration\") pod \"image-registry-5f6f4c745f-hznbc\" (UID: \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\") " pod="openshift-image-registry/image-registry-5f6f4c745f-hznbc"
Jul 08 21:33:32.638958 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.638798    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e2dbdfdb-4d51-44b2-8387-7ebc24441008-ca-trust-extracted\") pod \"image-registry-5f6f4c745f-hznbc\" (UID: \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\") " pod="openshift-image-registry/image-registry-5f6f4c745f-hznbc"
Jul 08 21:33:32.638958 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.638820    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2dbdfdb-4d51-44b2-8387-7ebc24441008-trusted-ca\") pod \"image-registry-5f6f4c745f-hznbc\" (UID: \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\") " pod="openshift-image-registry/image-registry-5f6f4c745f-hznbc"
Jul 08 21:33:32.638958 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.638843    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e2dbdfdb-4d51-44b2-8387-7ebc24441008-installation-pull-secrets\") pod \"image-registry-5f6f4c745f-hznbc\" (UID: \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\") " pod="openshift-image-registry/image-registry-5f6f4c745f-hznbc"
Jul 08 21:33:32.638958 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.638894    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm8sp\" (UniqueName: \"kubernetes.io/projected/d9b15199-4f38-4e8c-b9a6-917b2f1ba64d-kube-api-access-dm8sp\") pod \"migrator-d57d58cc9-dp8p7\" (UID: \"d9b15199-4f38-4e8c-b9a6-917b2f1ba64d\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-dp8p7"
Jul 08 21:33:32.638958 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.638921    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2dbdfdb-4d51-44b2-8387-7ebc24441008-registry-tls\") pod \"image-registry-5f6f4c745f-hznbc\" (UID: \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\") " pod="openshift-image-registry/image-registry-5f6f4c745f-hznbc"
Jul 08 21:33:32.638958 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.638945    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2dbdfdb-4d51-44b2-8387-7ebc24441008-bound-sa-token\") pod \"image-registry-5f6f4c745f-hznbc\" (UID: \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\") " pod="openshift-image-registry/image-registry-5f6f4c745f-hznbc"
Jul 08 21:33:32.639307 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.638977    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxmhx\" (UniqueName: \"kubernetes.io/projected/3fd2f0f8-98cb-4352-b6bd-3f7ef41af8de-kube-api-access-cxmhx\") pod \"ingress-canary-4ppnj\" (UID: \"3fd2f0f8-98cb-4352-b6bd-3f7ef41af8de\") " pod="openshift-ingress-canary/ingress-canary-4ppnj"
Jul 08 21:33:32.639396 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:32.639366    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 21:33:32.639458 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:32.639445    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/519c6282-5e7c-4c40-bf12-c64727f8ab86-metrics-tls podName:519c6282-5e7c-4c40-bf12-c64727f8ab86 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:33.139427012 +0000 UTC m=+36.077759395 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/519c6282-5e7c-4c40-bf12-c64727f8ab86-metrics-tls") pod "dns-default-wp7gn" (UID: "519c6282-5e7c-4c40-bf12-c64727f8ab86") : secret "dns-default-metrics-tls" not found
Jul 08 21:33:32.639534 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.639470    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/519c6282-5e7c-4c40-bf12-c64727f8ab86-config-volume\") pod \"dns-default-wp7gn\" (UID: \"519c6282-5e7c-4c40-bf12-c64727f8ab86\") " pod="openshift-dns/dns-default-wp7gn"
Jul 08 21:33:32.640617 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.640593    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/519c6282-5e7c-4c40-bf12-c64727f8ab86-tmp-dir\") pod \"dns-default-wp7gn\" (UID: \"519c6282-5e7c-4c40-bf12-c64727f8ab86\") " pod="openshift-dns/dns-default-wp7gn"
Jul 08 21:33:32.640729 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.640632    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e2dbdfdb-4d51-44b2-8387-7ebc24441008-ca-trust-extracted\") pod \"image-registry-5f6f4c745f-hznbc\" (UID: \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\") " pod="openshift-image-registry/image-registry-5f6f4c745f-hznbc"
Jul 08 21:33:32.640794 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:32.640733    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 21:33:32.640794 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:32.640750    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f6f4c745f-hznbc: secret "image-registry-tls" not found
Jul 08 21:33:32.640891 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:32.640804    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2dbdfdb-4d51-44b2-8387-7ebc24441008-registry-tls podName:e2dbdfdb-4d51-44b2-8387-7ebc24441008 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:33.140788525 +0000 UTC m=+36.079120913 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e2dbdfdb-4d51-44b2-8387-7ebc24441008-registry-tls") pod "image-registry-5f6f4c745f-hznbc" (UID: "e2dbdfdb-4d51-44b2-8387-7ebc24441008") : secret "image-registry-tls" not found
Jul 08 21:33:32.640891 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.640861    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e2dbdfdb-4d51-44b2-8387-7ebc24441008-registry-certificates\") pod \"image-registry-5f6f4c745f-hznbc\" (UID: \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\") " pod="openshift-image-registry/image-registry-5f6f4c745f-hznbc"
Jul 08 21:33:32.641187 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.641164    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2dbdfdb-4d51-44b2-8387-7ebc24441008-trusted-ca\") pod \"image-registry-5f6f4c745f-hznbc\" (UID: \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\") " pod="openshift-image-registry/image-registry-5f6f4c745f-hznbc"
Jul 08 21:33:32.644060 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.644038    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e2dbdfdb-4d51-44b2-8387-7ebc24441008-installation-pull-secrets\") pod \"image-registry-5f6f4c745f-hznbc\" (UID: \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\") " pod="openshift-image-registry/image-registry-5f6f4c745f-hznbc"
Jul 08 21:33:32.644169 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.644071    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3fd2f0f8-98cb-4352-b6bd-3f7ef41af8de-cert\") pod \"ingress-canary-4ppnj\" (UID: \"3fd2f0f8-98cb-4352-b6bd-3f7ef41af8de\") " pod="openshift-ingress-canary/ingress-canary-4ppnj"
Jul 08 21:33:32.644169 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.644093    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e2dbdfdb-4d51-44b2-8387-7ebc24441008-image-registry-private-configuration\") pod \"image-registry-5f6f4c745f-hznbc\" (UID: \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\") " pod="openshift-image-registry/image-registry-5f6f4c745f-hznbc"
Jul 08 21:33:32.647701 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.647670    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxmhx\" (UniqueName: \"kubernetes.io/projected/3fd2f0f8-98cb-4352-b6bd-3f7ef41af8de-kube-api-access-cxmhx\") pod \"ingress-canary-4ppnj\" (UID: \"3fd2f0f8-98cb-4352-b6bd-3f7ef41af8de\") " pod="openshift-ingress-canary/ingress-canary-4ppnj"
Jul 08 21:33:32.653632 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.653610    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxhfs\" (UniqueName: \"kubernetes.io/projected/519c6282-5e7c-4c40-bf12-c64727f8ab86-kube-api-access-dxhfs\") pod \"dns-default-wp7gn\" (UID: \"519c6282-5e7c-4c40-bf12-c64727f8ab86\") " pod="openshift-dns/dns-default-wp7gn"
Jul 08 21:33:32.657797 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.657775    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlgbl\" (UniqueName: \"kubernetes.io/projected/e2dbdfdb-4d51-44b2-8387-7ebc24441008-kube-api-access-vlgbl\") pod \"image-registry-5f6f4c745f-hznbc\" (UID: \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\") " pod="openshift-image-registry/image-registry-5f6f4c745f-hznbc"
Jul 08 21:33:32.657980 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.657964    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2dbdfdb-4d51-44b2-8387-7ebc24441008-bound-sa-token\") pod \"image-registry-5f6f4c745f-hznbc\" (UID: \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\") " pod="openshift-image-registry/image-registry-5f6f4c745f-hznbc"
Jul 08 21:33:32.740235 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.740204    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm8sp\" (UniqueName: \"kubernetes.io/projected/d9b15199-4f38-4e8c-b9a6-917b2f1ba64d-kube-api-access-dm8sp\") pod \"migrator-d57d58cc9-dp8p7\" (UID: \"d9b15199-4f38-4e8c-b9a6-917b2f1ba64d\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-dp8p7"
Jul 08 21:33:32.749168 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.749136    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm8sp\" (UniqueName: \"kubernetes.io/projected/d9b15199-4f38-4e8c-b9a6-917b2f1ba64d-kube-api-access-dm8sp\") pod \"migrator-d57d58cc9-dp8p7\" (UID: \"d9b15199-4f38-4e8c-b9a6-917b2f1ba64d\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-dp8p7"
Jul 08 21:33:32.768263 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.768239    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4ppnj"
Jul 08 21:33:32.864833 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.864092    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-dp8p7"
Jul 08 21:33:32.880677 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.880549    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-j4qdz"]
Jul 08 21:33:32.883775 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.883754    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j4qdz"
Jul 08 21:33:32.887874 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.887750    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 08 21:33:32.887874 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.887775    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 08 21:33:32.888005 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.887906    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 08 21:33:32.888349 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.888150    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 08 21:33:32.888349 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.888153    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vqcnc\""
Jul 08 21:33:32.900228 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.900186    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j4qdz"]
Jul 08 21:33:32.929541 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:32.929476    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4ppnj"]
Jul 08 21:33:32.933571 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:33:32.933533    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fd2f0f8_98cb_4352_b6bd_3f7ef41af8de.slice/crio-efd6472f92c64b4baebe422cfddd524b87f3d6233c30619e580f535b4a3e2b9d WatchSource:0}: Error finding container efd6472f92c64b4baebe422cfddd524b87f3d6233c30619e580f535b4a3e2b9d: Status 404 returned error can't find the container with id efd6472f92c64b4baebe422cfddd524b87f3d6233c30619e580f535b4a3e2b9d
Jul 08 21:33:33.009533 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:33.009227    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-dp8p7"]
Jul 08 21:33:33.012240 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:33:33.012214    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9b15199_4f38_4e8c_b9a6_917b2f1ba64d.slice/crio-1983996a6e96a0ac130262d192b25371b5f148ed463f9677e2bf567e8a52acf4 WatchSource:0}: Error finding container 1983996a6e96a0ac130262d192b25371b5f148ed463f9677e2bf567e8a52acf4: Status 404 returned error can't find the container with id 1983996a6e96a0ac130262d192b25371b5f148ed463f9677e2bf567e8a52acf4
Jul 08 21:33:33.043650 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:33.043623    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/01ac1d4d-312a-4c8e-972a-ac9543c11c52-crio-socket\") pod \"insights-runtime-extractor-j4qdz\" (UID: \"01ac1d4d-312a-4c8e-972a-ac9543c11c52\") " pod="openshift-insights/insights-runtime-extractor-j4qdz"
Jul 08 21:33:33.043797 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:33.043775    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01ac1d4d-312a-4c8e-972a-ac9543c11c52-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j4qdz\" (UID: \"01ac1d4d-312a-4c8e-972a-ac9543c11c52\") " pod="openshift-insights/insights-runtime-extractor-j4qdz"
Jul 08 21:33:33.043859 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:33.043827    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpr57\" (UniqueName: \"kubernetes.io/projected/01ac1d4d-312a-4c8e-972a-ac9543c11c52-kube-api-access-dpr57\") pod \"insights-runtime-extractor-j4qdz\" (UID: \"01ac1d4d-312a-4c8e-972a-ac9543c11c52\") " pod="openshift-insights/insights-runtime-extractor-j4qdz"
Jul 08 21:33:33.043916 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:33.043864    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01ac1d4d-312a-4c8e-972a-ac9543c11c52-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j4qdz\" (UID: \"01ac1d4d-312a-4c8e-972a-ac9543c11c52\") " pod="openshift-insights/insights-runtime-extractor-j4qdz"
Jul 08 21:33:33.043916 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:33.043891    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/01ac1d4d-312a-4c8e-972a-ac9543c11c52-data-volume\") pod \"insights-runtime-extractor-j4qdz\" (UID: \"01ac1d4d-312a-4c8e-972a-ac9543c11c52\") " pod="openshift-insights/insights-runtime-extractor-j4qdz"
Jul 08 21:33:33.145185 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:33.145148    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01ac1d4d-312a-4c8e-972a-ac9543c11c52-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j4qdz\" (UID: \"01ac1d4d-312a-4c8e-972a-ac9543c11c52\") " pod="openshift-insights/insights-runtime-extractor-j4qdz"
Jul 08 21:33:33.145373 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:33.145215    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpr57\" (UniqueName: \"kubernetes.io/projected/01ac1d4d-312a-4c8e-972a-ac9543c11c52-kube-api-access-dpr57\") pod \"insights-runtime-extractor-j4qdz\" (UID: \"01ac1d4d-312a-4c8e-972a-ac9543c11c52\") " pod="openshift-insights/insights-runtime-extractor-j4qdz"
Jul 08 21:33:33.145373 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:33.145251    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01ac1d4d-312a-4c8e-972a-ac9543c11c52-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j4qdz\" (UID: \"01ac1d4d-312a-4c8e-972a-ac9543c11c52\") " pod="openshift-insights/insights-runtime-extractor-j4qdz"
Jul 08 21:33:33.145373 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:33.145277    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/01ac1d4d-312a-4c8e-972a-ac9543c11c52-data-volume\") pod \"insights-runtime-extractor-j4qdz\" (UID: \"01ac1d4d-312a-4c8e-972a-ac9543c11c52\") " pod="openshift-insights/insights-runtime-extractor-j4qdz"
Jul 08 21:33:33.145373 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:33.145327    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/519c6282-5e7c-4c40-bf12-c64727f8ab86-metrics-tls\") pod \"dns-default-wp7gn\" (UID: \"519c6282-5e7c-4c40-bf12-c64727f8ab86\") " pod="openshift-dns/dns-default-wp7gn"
Jul 08 21:33:33.145373 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:33.145340    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 21:33:33.145593 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:33.145386    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 21:33:33.145593 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:33.145414    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01ac1d4d-312a-4c8e-972a-ac9543c11c52-insights-runtime-extractor-tls podName:01ac1d4d-312a-4c8e-972a-ac9543c11c52 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:33.645393911 +0000 UTC m=+36.583726307 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01ac1d4d-312a-4c8e-972a-ac9543c11c52-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j4qdz" (UID: "01ac1d4d-312a-4c8e-972a-ac9543c11c52") : secret "insights-runtime-extractor-tls" not found
Jul 08 21:33:33.145593 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:33.145421    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 21:33:33.145593 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:33.145451    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01ac1d4d-312a-4c8e-972a-ac9543c11c52-kube-rbac-proxy-cm podName:01ac1d4d-312a-4c8e-972a-ac9543c11c52 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:33.64543345 +0000 UTC m=+36.583765847 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01ac1d4d-312a-4c8e-972a-ac9543c11c52-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j4qdz" (UID: "01ac1d4d-312a-4c8e-972a-ac9543c11c52") : configmap "kube-rbac-proxy" not found
Jul 08 21:33:33.145593 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:33.145470    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/519c6282-5e7c-4c40-bf12-c64727f8ab86-metrics-tls podName:519c6282-5e7c-4c40-bf12-c64727f8ab86 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:34.145460315 +0000 UTC m=+37.083792705 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/519c6282-5e7c-4c40-bf12-c64727f8ab86-metrics-tls") pod "dns-default-wp7gn" (UID: "519c6282-5e7c-4c40-bf12-c64727f8ab86") : secret "dns-default-metrics-tls" not found
Jul 08 21:33:33.145593 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:33.145492    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/01ac1d4d-312a-4c8e-972a-ac9543c11c52-crio-socket\") pod \"insights-runtime-extractor-j4qdz\" (UID: \"01ac1d4d-312a-4c8e-972a-ac9543c11c52\") " pod="openshift-insights/insights-runtime-extractor-j4qdz"
Jul 08 21:33:33.145593 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:33.145535    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2dbdfdb-4d51-44b2-8387-7ebc24441008-registry-tls\") pod \"image-registry-5f6f4c745f-hznbc\" (UID: \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\") " pod="openshift-image-registry/image-registry-5f6f4c745f-hznbc"
Jul 08 21:33:33.145827 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:33.145643    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 21:33:33.145827 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:33.145653    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f6f4c745f-hznbc: secret "image-registry-tls" not found
Jul 08 21:33:33.145827 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:33.145656    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/01ac1d4d-312a-4c8e-972a-ac9543c11c52-data-volume\") pod \"insights-runtime-extractor-j4qdz\" (UID: \"01ac1d4d-312a-4c8e-972a-ac9543c11c52\") " pod="openshift-insights/insights-runtime-extractor-j4qdz"
Jul 08 21:33:33.145827 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:33.145678    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2dbdfdb-4d51-44b2-8387-7ebc24441008-registry-tls podName:e2dbdfdb-4d51-44b2-8387-7ebc24441008 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:34.145669661 +0000 UTC m=+37.084002039 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e2dbdfdb-4d51-44b2-8387-7ebc24441008-registry-tls") pod "image-registry-5f6f4c745f-hznbc" (UID: "e2dbdfdb-4d51-44b2-8387-7ebc24441008") : secret "image-registry-tls" not found
Jul 08 21:33:33.145827 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:33.145764    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/01ac1d4d-312a-4c8e-972a-ac9543c11c52-crio-socket\") pod \"insights-runtime-extractor-j4qdz\" (UID: \"01ac1d4d-312a-4c8e-972a-ac9543c11c52\") " pod="openshift-insights/insights-runtime-extractor-j4qdz"
Jul 08 21:33:33.154088 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:33.154067    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpr57\" (UniqueName: \"kubernetes.io/projected/01ac1d4d-312a-4c8e-972a-ac9543c11c52-kube-api-access-dpr57\") pod \"insights-runtime-extractor-j4qdz\" (UID: \"01ac1d4d-312a-4c8e-972a-ac9543c11c52\") " pod="openshift-insights/insights-runtime-extractor-j4qdz"
Jul 08 21:33:33.606865 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:33.606768    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xnzfd"
Jul 08 21:33:33.609072 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:33.609013    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 21:33:33.609854 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:33.609079    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-khhml\""
Jul 08 21:33:33.650178 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:33.650139    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01ac1d4d-312a-4c8e-972a-ac9543c11c52-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j4qdz\" (UID: \"01ac1d4d-312a-4c8e-972a-ac9543c11c52\") " pod="openshift-insights/insights-runtime-extractor-j4qdz"
Jul 08 21:33:33.650352 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:33.650280    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 21:33:33.650434 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:33.650377    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01ac1d4d-312a-4c8e-972a-ac9543c11c52-kube-rbac-proxy-cm podName:01ac1d4d-312a-4c8e-972a-ac9543c11c52 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:34.650356606 +0000 UTC m=+37.588688988 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01ac1d4d-312a-4c8e-972a-ac9543c11c52-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j4qdz" (UID: "01ac1d4d-312a-4c8e-972a-ac9543c11c52") : configmap "kube-rbac-proxy" not found
Jul 08 21:33:33.650434 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:33.650406    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 21:33:33.650519 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:33.650458    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01ac1d4d-312a-4c8e-972a-ac9543c11c52-insights-runtime-extractor-tls podName:01ac1d4d-312a-4c8e-972a-ac9543c11c52 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:34.650443323 +0000 UTC m=+37.588775704 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01ac1d4d-312a-4c8e-972a-ac9543c11c52-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j4qdz" (UID: "01ac1d4d-312a-4c8e-972a-ac9543c11c52") : secret "insights-runtime-extractor-tls" not found
Jul 08 21:33:33.650519 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:33.650307    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01ac1d4d-312a-4c8e-972a-ac9543c11c52-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j4qdz\" (UID: \"01ac1d4d-312a-4c8e-972a-ac9543c11c52\") " pod="openshift-insights/insights-runtime-extractor-j4qdz"
Jul 08 21:33:33.918831 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:33.918783    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-dp8p7" event={"ID":"d9b15199-4f38-4e8c-b9a6-917b2f1ba64d","Type":"ContainerStarted","Data":"1983996a6e96a0ac130262d192b25371b5f148ed463f9677e2bf567e8a52acf4"}
Jul 08 21:33:33.920724 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:33.920653    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4ppnj" event={"ID":"3fd2f0f8-98cb-4352-b6bd-3f7ef41af8de","Type":"ContainerStarted","Data":"efd6472f92c64b4baebe422cfddd524b87f3d6233c30619e580f535b4a3e2b9d"}
Jul 08 21:33:34.154807 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:34.154771    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2dbdfdb-4d51-44b2-8387-7ebc24441008-registry-tls\") pod \"image-registry-5f6f4c745f-hznbc\" (UID: \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\") " pod="openshift-image-registry/image-registry-5f6f4c745f-hznbc"
Jul 08 21:33:34.154978 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:34.154906    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/519c6282-5e7c-4c40-bf12-c64727f8ab86-metrics-tls\") pod \"dns-default-wp7gn\" (UID: \"519c6282-5e7c-4c40-bf12-c64727f8ab86\") " pod="openshift-dns/dns-default-wp7gn"
Jul 08 21:33:34.154978 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:34.154944    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 21:33:34.154978 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:34.154963    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f6f4c745f-hznbc: secret "image-registry-tls" not found
Jul 08 21:33:34.155138 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:34.155025    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 21:33:34.155138 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:34.155028    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2dbdfdb-4d51-44b2-8387-7ebc24441008-registry-tls podName:e2dbdfdb-4d51-44b2-8387-7ebc24441008 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:36.155012676 +0000 UTC m=+39.093345053 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e2dbdfdb-4d51-44b2-8387-7ebc24441008-registry-tls") pod "image-registry-5f6f4c745f-hznbc" (UID: "e2dbdfdb-4d51-44b2-8387-7ebc24441008") : secret "image-registry-tls" not found
Jul 08 21:33:34.155138 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:34.155088    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/519c6282-5e7c-4c40-bf12-c64727f8ab86-metrics-tls podName:519c6282-5e7c-4c40-bf12-c64727f8ab86 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:36.155071679 +0000 UTC m=+39.093404058 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/519c6282-5e7c-4c40-bf12-c64727f8ab86-metrics-tls") pod "dns-default-wp7gn" (UID: "519c6282-5e7c-4c40-bf12-c64727f8ab86") : secret "dns-default-metrics-tls" not found
Jul 08 21:33:34.658639 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:34.658589    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01ac1d4d-312a-4c8e-972a-ac9543c11c52-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j4qdz\" (UID: \"01ac1d4d-312a-4c8e-972a-ac9543c11c52\") " pod="openshift-insights/insights-runtime-extractor-j4qdz"
Jul 08 21:33:34.659087 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:34.658678    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01ac1d4d-312a-4c8e-972a-ac9543c11c52-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j4qdz\" (UID: \"01ac1d4d-312a-4c8e-972a-ac9543c11c52\") " pod="openshift-insights/insights-runtime-extractor-j4qdz"
Jul 08 21:33:34.659087 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:34.658757    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 21:33:34.659087 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:34.658784    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 21:33:34.659087 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:34.658840    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01ac1d4d-312a-4c8e-972a-ac9543c11c52-insights-runtime-extractor-tls podName:01ac1d4d-312a-4c8e-972a-ac9543c11c52 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:36.658817594 +0000 UTC m=+39.597149977 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01ac1d4d-312a-4c8e-972a-ac9543c11c52-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j4qdz" (UID: "01ac1d4d-312a-4c8e-972a-ac9543c11c52") : secret "insights-runtime-extractor-tls" not found
Jul 08 21:33:34.659087 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:34.658860    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01ac1d4d-312a-4c8e-972a-ac9543c11c52-kube-rbac-proxy-cm podName:01ac1d4d-312a-4c8e-972a-ac9543c11c52 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:36.658850391 +0000 UTC m=+39.597182776 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01ac1d4d-312a-4c8e-972a-ac9543c11c52-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j4qdz" (UID: "01ac1d4d-312a-4c8e-972a-ac9543c11c52") : configmap "kube-rbac-proxy" not found
Jul 08 21:33:35.455593 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:35.455558    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5wfz7_1cdf17b8-152a-4cca-9050-ef85d4131f91/dns-node-resolver/0.log"
Jul 08 21:33:36.173260 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:36.173216    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/519c6282-5e7c-4c40-bf12-c64727f8ab86-metrics-tls\") pod \"dns-default-wp7gn\" (UID: \"519c6282-5e7c-4c40-bf12-c64727f8ab86\") " pod="openshift-dns/dns-default-wp7gn"
Jul 08 21:33:36.173731 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:36.173299    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2dbdfdb-4d51-44b2-8387-7ebc24441008-registry-tls\") pod \"image-registry-5f6f4c745f-hznbc\" (UID: \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\") " pod="openshift-image-registry/image-registry-5f6f4c745f-hznbc"
Jul 08 21:33:36.173731 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:36.173394    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 21:33:36.173731 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:36.173469    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 21:33:36.173731 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:36.173486    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f6f4c745f-hznbc: secret "image-registry-tls" not found
Jul 08 21:33:36.173731 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:36.173485    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/519c6282-5e7c-4c40-bf12-c64727f8ab86-metrics-tls podName:519c6282-5e7c-4c40-bf12-c64727f8ab86 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:40.173465593 +0000 UTC m=+43.111797979 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/519c6282-5e7c-4c40-bf12-c64727f8ab86-metrics-tls") pod "dns-default-wp7gn" (UID: "519c6282-5e7c-4c40-bf12-c64727f8ab86") : secret "dns-default-metrics-tls" not found
Jul 08 21:33:36.173731 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:36.173547    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2dbdfdb-4d51-44b2-8387-7ebc24441008-registry-tls podName:e2dbdfdb-4d51-44b2-8387-7ebc24441008 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:40.173531765 +0000 UTC m=+43.111864149 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e2dbdfdb-4d51-44b2-8387-7ebc24441008-registry-tls") pod "image-registry-5f6f4c745f-hznbc" (UID: "e2dbdfdb-4d51-44b2-8387-7ebc24441008") : secret "image-registry-tls" not found
Jul 08 21:33:36.677446 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:36.677401    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01ac1d4d-312a-4c8e-972a-ac9543c11c52-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j4qdz\" (UID: \"01ac1d4d-312a-4c8e-972a-ac9543c11c52\") " pod="openshift-insights/insights-runtime-extractor-j4qdz"
Jul 08 21:33:36.677608 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:36.677470    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01ac1d4d-312a-4c8e-972a-ac9543c11c52-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j4qdz\" (UID: \"01ac1d4d-312a-4c8e-972a-ac9543c11c52\") " pod="openshift-insights/insights-runtime-extractor-j4qdz"
Jul 08 21:33:36.677608 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:36.677551    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 21:33:36.677608 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:36.677561    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 21:33:36.677726 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:36.677624    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01ac1d4d-312a-4c8e-972a-ac9543c11c52-insights-runtime-extractor-tls podName:01ac1d4d-312a-4c8e-972a-ac9543c11c52 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:40.677608715 +0000 UTC m=+43.615941093 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01ac1d4d-312a-4c8e-972a-ac9543c11c52-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j4qdz" (UID: "01ac1d4d-312a-4c8e-972a-ac9543c11c52") : secret "insights-runtime-extractor-tls" not found
Jul 08 21:33:36.677726 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:36.677641    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01ac1d4d-312a-4c8e-972a-ac9543c11c52-kube-rbac-proxy-cm podName:01ac1d4d-312a-4c8e-972a-ac9543c11c52 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:40.677631664 +0000 UTC m=+43.615964043 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01ac1d4d-312a-4c8e-972a-ac9543c11c52-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j4qdz" (UID: "01ac1d4d-312a-4c8e-972a-ac9543c11c52") : configmap "kube-rbac-proxy" not found
Jul 08 21:33:36.859644 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:36.859617    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mdr2r_6f70df4a-7077-418a-9afe-02c4e6792fcc/node-ca/0.log"
Jul 08 21:33:37.931536 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:37.931323    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-dp8p7" event={"ID":"d9b15199-4f38-4e8c-b9a6-917b2f1ba64d","Type":"ContainerStarted","Data":"08faab5ac7224625ab1d38c76bcb365afdbb2bd720ccf99afa7d7184d273dd03"}
Jul 08 21:33:37.931962 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:37.931572    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-dp8p7" event={"ID":"d9b15199-4f38-4e8c-b9a6-917b2f1ba64d","Type":"ContainerStarted","Data":"bb65a6950f797de591170c0cb020fcd751b9ff812c3c3728626566d79ed9f9b6"}
Jul 08 21:33:37.932787 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:37.932755    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4ppnj" event={"ID":"3fd2f0f8-98cb-4352-b6bd-3f7ef41af8de","Type":"ContainerStarted","Data":"c963977eacb725bbf9c9825909a05cd1d096dfb4fd8b8642b66cdf86bb8d2639"}
Jul 08 21:33:37.935500 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:37.935477    2569 generic.go:356] "Generic (PLEG): container finished" podID="773e320a-2215-4512-a09c-2249707f24f7" containerID="66617ca91e8cb4a324b7f1b778de2098a0f4e3c688ba3fb302508804c19abf59" exitCode=0
Jul 08 21:33:37.935593 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:37.935526    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wbw7t" event={"ID":"773e320a-2215-4512-a09c-2249707f24f7","Type":"ContainerDied","Data":"66617ca91e8cb4a324b7f1b778de2098a0f4e3c688ba3fb302508804c19abf59"}
Jul 08 21:33:37.948502 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:37.948464    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-dp8p7" podStartSLOduration=2.027155006 podStartE2EDuration="5.948451814s" totalImagesPullingTime="3.921296808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:37.947717796 +0000 UTC m=+40.886050195" watchObservedRunningTime="2026-07-08 21:33:37.948451814 +0000 UTC m=+40.886784210"
Jul 08 21:33:37.965121 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:37.965078    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4ppnj" podStartSLOduration=1.95933772 podStartE2EDuration="5.965060771s" totalImagesPullingTime="4.005723051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:37.964427103 +0000 UTC m=+40.902759528" watchObservedRunningTime="2026-07-08 21:33:37.965060771 +0000 UTC m=+40.903393170"
Jul 08 21:33:38.055907 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:38.055886    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-dp8p7_d9b15199-4f38-4e8c-b9a6-917b2f1ba64d/graceful-termination/0.log"
Jul 08 21:33:38.940705 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:38.940669    2569 generic.go:356] "Generic (PLEG): container finished" podID="773e320a-2215-4512-a09c-2249707f24f7" containerID="bcf148f1844aefac4280315d44ec58e06f291534ecdaf39890c12c34379a5461" exitCode=0
Jul 08 21:33:38.941140 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:38.940752    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wbw7t" event={"ID":"773e320a-2215-4512-a09c-2249707f24f7","Type":"ContainerDied","Data":"bcf148f1844aefac4280315d44ec58e06f291534ecdaf39890c12c34379a5461"}
Jul 08 21:33:39.946510 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:39.946470    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wbw7t" event={"ID":"773e320a-2215-4512-a09c-2249707f24f7","Type":"ContainerStarted","Data":"c87f54994cac041a807c6b6cf135b8a9ee783c4c353eade5e3ff65eef69e4d64"}
Jul 08 21:33:39.974006 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:39.973960    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wbw7t" podStartSLOduration=7.522797639 podStartE2EDuration="41.973945615s" totalImagesPullingTime="34.451147976s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:32:58 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:39.972809436 +0000 UTC m=+42.911141860" watchObservedRunningTime="2026-07-08 21:33:39.973945615 +0000 UTC m=+42.912278015"
Jul 08 21:33:40.209099 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:40.209004    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2dbdfdb-4d51-44b2-8387-7ebc24441008-registry-tls\") pod \"image-registry-5f6f4c745f-hznbc\" (UID: \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\") " pod="openshift-image-registry/image-registry-5f6f4c745f-hznbc"
Jul 08 21:33:40.209244 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:40.209105    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/519c6282-5e7c-4c40-bf12-c64727f8ab86-metrics-tls\") pod \"dns-default-wp7gn\" (UID: \"519c6282-5e7c-4c40-bf12-c64727f8ab86\") " pod="openshift-dns/dns-default-wp7gn"
Jul 08 21:33:40.209244 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:40.209163    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 21:33:40.209244 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:40.209182    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f6f4c745f-hznbc: secret "image-registry-tls" not found
Jul 08 21:33:40.209244 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:40.209195    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 21:33:40.209244 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:40.209237    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/519c6282-5e7c-4c40-bf12-c64727f8ab86-metrics-tls podName:519c6282-5e7c-4c40-bf12-c64727f8ab86 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:48.209223758 +0000 UTC m=+51.147556136 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/519c6282-5e7c-4c40-bf12-c64727f8ab86-metrics-tls") pod "dns-default-wp7gn" (UID: "519c6282-5e7c-4c40-bf12-c64727f8ab86") : secret "dns-default-metrics-tls" not found
Jul 08 21:33:40.209448 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:40.209249    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2dbdfdb-4d51-44b2-8387-7ebc24441008-registry-tls podName:e2dbdfdb-4d51-44b2-8387-7ebc24441008 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:48.209244015 +0000 UTC m=+51.147576393 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e2dbdfdb-4d51-44b2-8387-7ebc24441008-registry-tls") pod "image-registry-5f6f4c745f-hznbc" (UID: "e2dbdfdb-4d51-44b2-8387-7ebc24441008") : secret "image-registry-tls" not found
Jul 08 21:33:40.712371 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:40.712328    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01ac1d4d-312a-4c8e-972a-ac9543c11c52-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j4qdz\" (UID: \"01ac1d4d-312a-4c8e-972a-ac9543c11c52\") " pod="openshift-insights/insights-runtime-extractor-j4qdz"
Jul 08 21:33:40.712549 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:40.712385    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01ac1d4d-312a-4c8e-972a-ac9543c11c52-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j4qdz\" (UID: \"01ac1d4d-312a-4c8e-972a-ac9543c11c52\") " pod="openshift-insights/insights-runtime-extractor-j4qdz"
Jul 08 21:33:40.712549 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:40.712475    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 21:33:40.712549 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:33:40.712537    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01ac1d4d-312a-4c8e-972a-ac9543c11c52-insights-runtime-extractor-tls podName:01ac1d4d-312a-4c8e-972a-ac9543c11c52 nodeName:}" failed. No retries permitted until 2026-07-08 21:33:48.71252241 +0000 UTC m=+51.650854788 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01ac1d4d-312a-4c8e-972a-ac9543c11c52-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j4qdz" (UID: "01ac1d4d-312a-4c8e-972a-ac9543c11c52") : secret "insights-runtime-extractor-tls" not found
Jul 08 21:33:40.712862 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:40.712846    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01ac1d4d-312a-4c8e-972a-ac9543c11c52-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j4qdz\" (UID: \"01ac1d4d-312a-4c8e-972a-ac9543c11c52\") " pod="openshift-insights/insights-runtime-extractor-j4qdz"
Jul 08 21:33:48.266425 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:48.266392    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/519c6282-5e7c-4c40-bf12-c64727f8ab86-metrics-tls\") pod \"dns-default-wp7gn\" (UID: \"519c6282-5e7c-4c40-bf12-c64727f8ab86\") " pod="openshift-dns/dns-default-wp7gn"
Jul 08 21:33:48.266425 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:48.266435    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2dbdfdb-4d51-44b2-8387-7ebc24441008-registry-tls\") pod \"image-registry-5f6f4c745f-hznbc\" (UID: \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\") " pod="openshift-image-registry/image-registry-5f6f4c745f-hznbc"
Jul 08 21:33:48.270058 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:48.270037    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2dbdfdb-4d51-44b2-8387-7ebc24441008-registry-tls\") pod \"image-registry-5f6f4c745f-hznbc\" (UID: \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\") " pod="openshift-image-registry/image-registry-5f6f4c745f-hznbc"
Jul 08 21:33:48.270129 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:48.270051    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/519c6282-5e7c-4c40-bf12-c64727f8ab86-metrics-tls\") pod \"dns-default-wp7gn\" (UID: \"519c6282-5e7c-4c40-bf12-c64727f8ab86\") " pod="openshift-dns/dns-default-wp7gn"
Jul 08 21:33:48.344545 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:48.344522    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f6f4c745f-hznbc"
Jul 08 21:33:48.361758 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:48.361736    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wp7gn"
Jul 08 21:33:48.512823 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:48.512798    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f6f4c745f-hznbc"]
Jul 08 21:33:48.515910 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:33:48.515878    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2dbdfdb_4d51_44b2_8387_7ebc24441008.slice/crio-a2b5ae6199f9b1912ef8fa9ae2284ef9e4cd56d98a8e58bcfe83245e5e7c941d WatchSource:0}: Error finding container a2b5ae6199f9b1912ef8fa9ae2284ef9e4cd56d98a8e58bcfe83245e5e7c941d: Status 404 returned error can't find the container with id a2b5ae6199f9b1912ef8fa9ae2284ef9e4cd56d98a8e58bcfe83245e5e7c941d
Jul 08 21:33:48.528059 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:48.528035    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wp7gn"]
Jul 08 21:33:48.531555 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:33:48.531535    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod519c6282_5e7c_4c40_bf12_c64727f8ab86.slice/crio-10d8da79b4e7fc3f43aaec7323157396f3b3e80b8dbf1f96281f5694bfb977df WatchSource:0}: Error finding container 10d8da79b4e7fc3f43aaec7323157396f3b3e80b8dbf1f96281f5694bfb977df: Status 404 returned error can't find the container with id 10d8da79b4e7fc3f43aaec7323157396f3b3e80b8dbf1f96281f5694bfb977df
Jul 08 21:33:48.770626 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:48.770544    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01ac1d4d-312a-4c8e-972a-ac9543c11c52-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j4qdz\" (UID: \"01ac1d4d-312a-4c8e-972a-ac9543c11c52\") " pod="openshift-insights/insights-runtime-extractor-j4qdz"
Jul 08 21:33:48.773006 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:48.772983    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01ac1d4d-312a-4c8e-972a-ac9543c11c52-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j4qdz\" (UID: \"01ac1d4d-312a-4c8e-972a-ac9543c11c52\") " pod="openshift-insights/insights-runtime-extractor-j4qdz"
Jul 08 21:33:48.797048 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:48.797020    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j4qdz"
Jul 08 21:33:48.961580 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:48.961498    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j4qdz"]
Jul 08 21:33:48.965675 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:33:48.965649    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01ac1d4d_312a_4c8e_972a_ac9543c11c52.slice/crio-a77d89ffcfed560dcb829013cf5725b044cb289093e34213ee1f9c88e970e1f2 WatchSource:0}: Error finding container a77d89ffcfed560dcb829013cf5725b044cb289093e34213ee1f9c88e970e1f2: Status 404 returned error can't find the container with id a77d89ffcfed560dcb829013cf5725b044cb289093e34213ee1f9c88e970e1f2
Jul 08 21:33:48.969071 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:48.968959    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f6f4c745f-hznbc" event={"ID":"e2dbdfdb-4d51-44b2-8387-7ebc24441008","Type":"ContainerStarted","Data":"f34ef29fb892adf0c86cc9a4427de783fe1f573988625cedfe02c9c6bff0b67e"}
Jul 08 21:33:48.969071 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:48.969014    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f6f4c745f-hznbc" event={"ID":"e2dbdfdb-4d51-44b2-8387-7ebc24441008","Type":"ContainerStarted","Data":"a2b5ae6199f9b1912ef8fa9ae2284ef9e4cd56d98a8e58bcfe83245e5e7c941d"}
Jul 08 21:33:48.969071 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:48.969054    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5f6f4c745f-hznbc"
Jul 08 21:33:48.970413 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:48.970381    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wp7gn" event={"ID":"519c6282-5e7c-4c40-bf12-c64727f8ab86","Type":"ContainerStarted","Data":"10d8da79b4e7fc3f43aaec7323157396f3b3e80b8dbf1f96281f5694bfb977df"}
Jul 08 21:33:48.997675 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:48.997563    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5f6f4c745f-hznbc" podStartSLOduration=57.997542237 podStartE2EDuration="57.997542237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:32:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:48.996137062 +0000 UTC m=+51.934469475" watchObservedRunningTime="2026-07-08 21:33:48.997542237 +0000 UTC m=+51.935874634"
Jul 08 21:33:49.977070 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:49.976837    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j4qdz" event={"ID":"01ac1d4d-312a-4c8e-972a-ac9543c11c52","Type":"ContainerStarted","Data":"a77d89ffcfed560dcb829013cf5725b044cb289093e34213ee1f9c88e970e1f2"}
Jul 08 21:33:53.993395 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:53.993298    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j4qdz" event={"ID":"01ac1d4d-312a-4c8e-972a-ac9543c11c52","Type":"ContainerStarted","Data":"efd4d02b87b403bddcfe7c21d7fdba3b92e58ab91a37a12167823391445eff5e"}
Jul 08 21:33:53.993804 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:53.993405    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j4qdz" event={"ID":"01ac1d4d-312a-4c8e-972a-ac9543c11c52","Type":"ContainerStarted","Data":"1c5b2e98ebd60225e7b786130a53af1edcded4922e1c3a071aaf6e307fa6272d"}
Jul 08 21:33:53.994962 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:53.994935    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wp7gn" event={"ID":"519c6282-5e7c-4c40-bf12-c64727f8ab86","Type":"ContainerStarted","Data":"5cc5a3b45a0d5428e32354d218e45d284709657b2b605746e11ecc7bb3b95bc5"}
Jul 08 21:33:53.995080 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:53.994974    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wp7gn" event={"ID":"519c6282-5e7c-4c40-bf12-c64727f8ab86","Type":"ContainerStarted","Data":"a6159c6e7178e4181a1b4eb5ac5e758dd3ba43e6f3860d8bba1dc5c9fdd0f647"}
Jul 08 21:33:53.995080 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:53.995073    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wp7gn"
Jul 08 21:33:54.012203 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:54.012159    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wp7gn" podStartSLOduration=17.427868761 podStartE2EDuration="22.012144447s" totalImagesPullingTime="4.584275686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:54.011150592 +0000 UTC m=+56.949483049" watchObservedRunningTime="2026-07-08 21:33:54.012144447 +0000 UTC m=+56.950476846"
Jul 08 21:33:57.006904 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:57.006869    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j4qdz" event={"ID":"01ac1d4d-312a-4c8e-972a-ac9543c11c52","Type":"ContainerStarted","Data":"2e25cb06ea0435a688d7e10e73288431272c173b92de172dad4222a684ba287d"}
Jul 08 21:33:57.023732 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:57.023685    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-j4qdz" podStartSLOduration=17.794104555 podStartE2EDuration="25.023670161s" totalImagesPullingTime="7.229565606s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:33:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:33:57.023091374 +0000 UTC m=+59.961423774" watchObservedRunningTime="2026-07-08 21:33:57.023670161 +0000 UTC m=+59.962002561"
Jul 08 21:33:59.031077 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:59.031043    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bb8969897-4bz4m"]
Jul 08 21:33:59.055818 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:59.055787    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bb8969897-4bz4m"]
Jul 08 21:33:59.055980 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:59.055918    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bb8969897-4bz4m"
Jul 08 21:33:59.058280 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:59.058253    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 08 21:33:59.058280 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:59.058277    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 08 21:33:59.058598 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:59.058350    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 08 21:33:59.058598 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:59.058488    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 08 21:33:59.058598 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:59.058488    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 08 21:33:59.058598 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:59.058557    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 08 21:33:59.058598 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:59.058566    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 08 21:33:59.104907 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:59.104874    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5f6f4c745f-hznbc"]
Jul 08 21:33:59.147868 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:59.147829    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pldvm\" (UniqueName: \"kubernetes.io/projected/a5feee22-eee5-4915-8aa2-99776406bedf-kube-api-access-pldvm\") pod \"cluster-proxy-proxy-agent-6bb8969897-4bz4m\" (UID: \"a5feee22-eee5-4915-8aa2-99776406bedf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bb8969897-4bz4m"
Jul 08 21:33:59.148031 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:59.147949    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a5feee22-eee5-4915-8aa2-99776406bedf-hub\") pod \"cluster-proxy-proxy-agent-6bb8969897-4bz4m\" (UID: \"a5feee22-eee5-4915-8aa2-99776406bedf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bb8969897-4bz4m"
Jul 08 21:33:59.148031 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:59.147978    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a5feee22-eee5-4915-8aa2-99776406bedf-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6bb8969897-4bz4m\" (UID: \"a5feee22-eee5-4915-8aa2-99776406bedf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bb8969897-4bz4m"
Jul 08 21:33:59.148031 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:59.147995    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5feee22-eee5-4915-8aa2-99776406bedf-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6bb8969897-4bz4m\" (UID: \"a5feee22-eee5-4915-8aa2-99776406bedf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bb8969897-4bz4m"
Jul 08 21:33:59.148031 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:59.148017    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a5feee22-eee5-4915-8aa2-99776406bedf-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6bb8969897-4bz4m\" (UID: \"a5feee22-eee5-4915-8aa2-99776406bedf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bb8969897-4bz4m"
Jul 08 21:33:59.148188 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:59.148040    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a5feee22-eee5-4915-8aa2-99776406bedf-ca\") pod \"cluster-proxy-proxy-agent-6bb8969897-4bz4m\" (UID: \"a5feee22-eee5-4915-8aa2-99776406bedf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bb8969897-4bz4m"
Jul 08 21:33:59.249368 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:59.249330    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a5feee22-eee5-4915-8aa2-99776406bedf-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6bb8969897-4bz4m\" (UID: \"a5feee22-eee5-4915-8aa2-99776406bedf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bb8969897-4bz4m"
Jul 08 21:33:59.249368 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:59.249367    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a5feee22-eee5-4915-8aa2-99776406bedf-ca\") pod \"cluster-proxy-proxy-agent-6bb8969897-4bz4m\" (UID: \"a5feee22-eee5-4915-8aa2-99776406bedf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bb8969897-4bz4m"
Jul 08 21:33:59.249610 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:59.249389    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pldvm\" (UniqueName: \"kubernetes.io/projected/a5feee22-eee5-4915-8aa2-99776406bedf-kube-api-access-pldvm\") pod \"cluster-proxy-proxy-agent-6bb8969897-4bz4m\" (UID: \"a5feee22-eee5-4915-8aa2-99776406bedf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bb8969897-4bz4m"
Jul 08 21:33:59.249610 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:59.249476    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a5feee22-eee5-4915-8aa2-99776406bedf-hub\") pod \"cluster-proxy-proxy-agent-6bb8969897-4bz4m\" (UID: \"a5feee22-eee5-4915-8aa2-99776406bedf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bb8969897-4bz4m"
Jul 08 21:33:59.249610 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:59.249498    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a5feee22-eee5-4915-8aa2-99776406bedf-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6bb8969897-4bz4m\" (UID: \"a5feee22-eee5-4915-8aa2-99776406bedf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bb8969897-4bz4m"
Jul 08 21:33:59.249610 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:59.249523    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5feee22-eee5-4915-8aa2-99776406bedf-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6bb8969897-4bz4m\" (UID: \"a5feee22-eee5-4915-8aa2-99776406bedf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bb8969897-4bz4m"
Jul 08 21:33:59.250263 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:59.250187    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5feee22-eee5-4915-8aa2-99776406bedf-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6bb8969897-4bz4m\" (UID: \"a5feee22-eee5-4915-8aa2-99776406bedf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bb8969897-4bz4m"
Jul 08 21:33:59.252058 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:59.252034    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a5feee22-eee5-4915-8aa2-99776406bedf-ca\") pod \"cluster-proxy-proxy-agent-6bb8969897-4bz4m\" (UID: \"a5feee22-eee5-4915-8aa2-99776406bedf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bb8969897-4bz4m"
Jul 08 21:33:59.252058 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:59.252052    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a5feee22-eee5-4915-8aa2-99776406bedf-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6bb8969897-4bz4m\" (UID: \"a5feee22-eee5-4915-8aa2-99776406bedf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bb8969897-4bz4m"
Jul 08 21:33:59.252527 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:59.252508    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a5feee22-eee5-4915-8aa2-99776406bedf-hub\") pod \"cluster-proxy-proxy-agent-6bb8969897-4bz4m\" (UID: \"a5feee22-eee5-4915-8aa2-99776406bedf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bb8969897-4bz4m"
Jul 08 21:33:59.252603 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:59.252527    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a5feee22-eee5-4915-8aa2-99776406bedf-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6bb8969897-4bz4m\" (UID: \"a5feee22-eee5-4915-8aa2-99776406bedf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bb8969897-4bz4m"
Jul 08 21:33:59.257837 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:59.257813    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pldvm\" (UniqueName: \"kubernetes.io/projected/a5feee22-eee5-4915-8aa2-99776406bedf-kube-api-access-pldvm\") pod \"cluster-proxy-proxy-agent-6bb8969897-4bz4m\" (UID: \"a5feee22-eee5-4915-8aa2-99776406bedf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bb8969897-4bz4m"
Jul 08 21:33:59.377191 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:59.377106    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bb8969897-4bz4m"
Jul 08 21:33:59.509691 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:59.509658    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bb8969897-4bz4m"]
Jul 08 21:33:59.512393 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:33:59.512352    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5feee22_eee5_4915_8aa2_99776406bedf.slice/crio-60fe8079336264843cbca1b82b5796323a6eab0407044502c315b63191f7d399 WatchSource:0}: Error finding container 60fe8079336264843cbca1b82b5796323a6eab0407044502c315b63191f7d399: Status 404 returned error can't find the container with id 60fe8079336264843cbca1b82b5796323a6eab0407044502c315b63191f7d399
Jul 08 21:33:59.915532 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:33:59.915504    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6cs4g"
Jul 08 21:34:00.018670 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:00.018624    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bb8969897-4bz4m" event={"ID":"a5feee22-eee5-4915-8aa2-99776406bedf","Type":"ContainerStarted","Data":"60fe8079336264843cbca1b82b5796323a6eab0407044502c315b63191f7d399"}
Jul 08 21:34:02.276798 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:02.276756    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/863b1cfe-1f2f-426e-9a5e-c6aee4205013-original-pull-secret\") pod \"global-pull-secret-syncer-pmsd9\" (UID: \"863b1cfe-1f2f-426e-9a5e-c6aee4205013\") " pod="kube-system/global-pull-secret-syncer-pmsd9"
Jul 08 21:34:02.277278 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:02.276811    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggqws\" (UniqueName: \"kubernetes.io/projected/5fde744c-b4ec-4557-aa38-a5c8e43337f4-kube-api-access-ggqws\") pod \"network-check-target-jxssk\" (UID: \"5fde744c-b4ec-4557-aa38-a5c8e43337f4\") " pod="openshift-network-diagnostics/network-check-target-jxssk"
Jul 08 21:34:02.277278 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:02.276856    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6dbaf20f-e3bc-4428-9365-fd159b742280-metrics-certs\") pod \"network-metrics-daemon-xnzfd\" (UID: \"6dbaf20f-e3bc-4428-9365-fd159b742280\") " pod="openshift-multus/network-metrics-daemon-xnzfd"
Jul 08 21:34:02.279679 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:02.279651    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 21:34:02.280422 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:02.280398    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 21:34:02.280524 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:02.280483    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 21:34:02.289913 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:02.289749    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 21:34:02.290128 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:02.290108    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/863b1cfe-1f2f-426e-9a5e-c6aee4205013-original-pull-secret\") pod \"global-pull-secret-syncer-pmsd9\" (UID: \"863b1cfe-1f2f-426e-9a5e-c6aee4205013\") " pod="kube-system/global-pull-secret-syncer-pmsd9"
Jul 08 21:34:02.290208 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:02.290148    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6dbaf20f-e3bc-4428-9365-fd159b742280-metrics-certs\") pod \"network-metrics-daemon-xnzfd\" (UID: \"6dbaf20f-e3bc-4428-9365-fd159b742280\") " pod="openshift-multus/network-metrics-daemon-xnzfd"
Jul 08 21:34:02.301466 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:02.301438    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggqws\" (UniqueName: \"kubernetes.io/projected/5fde744c-b4ec-4557-aa38-a5c8e43337f4-kube-api-access-ggqws\") pod \"network-check-target-jxssk\" (UID: \"5fde744c-b4ec-4557-aa38-a5c8e43337f4\") " pod="openshift-network-diagnostics/network-check-target-jxssk"
Jul 08 21:34:02.321560 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:02.321525    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jnwkj\""
Jul 08 21:34:02.325603 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:02.325577    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pmsd9"
Jul 08 21:34:02.330253 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:02.330230    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxssk"
Jul 08 21:34:02.421117 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:02.421081    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-khhml\""
Jul 08 21:34:02.429166 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:02.429136    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xnzfd"
Jul 08 21:34:02.978280 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:02.978210    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pmsd9"]
Jul 08 21:34:02.983190 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:34:02.983162    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod863b1cfe_1f2f_426e_9a5e_c6aee4205013.slice/crio-e3ff36cb412f94b01250a7ce81863e37998d2b3de991fc35f3a83f259b457d88 WatchSource:0}: Error finding container e3ff36cb412f94b01250a7ce81863e37998d2b3de991fc35f3a83f259b457d88: Status 404 returned error can't find the container with id e3ff36cb412f94b01250a7ce81863e37998d2b3de991fc35f3a83f259b457d88
Jul 08 21:34:03.005626 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:03.005597    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jxssk"]
Jul 08 21:34:03.008825 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:34:03.008796    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fde744c_b4ec_4557_aa38_a5c8e43337f4.slice/crio-079cc3a1f087bc1477991395f814c28db001512fc6379d0acabf189245f18cd3 WatchSource:0}: Error finding container 079cc3a1f087bc1477991395f814c28db001512fc6379d0acabf189245f18cd3: Status 404 returned error can't find the container with id 079cc3a1f087bc1477991395f814c28db001512fc6379d0acabf189245f18cd3
Jul 08 21:34:03.029685 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:03.029654    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jxssk" event={"ID":"5fde744c-b4ec-4557-aa38-a5c8e43337f4","Type":"ContainerStarted","Data":"079cc3a1f087bc1477991395f814c28db001512fc6379d0acabf189245f18cd3"}
Jul 08 21:34:03.030834 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:03.030810    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pmsd9" event={"ID":"863b1cfe-1f2f-426e-9a5e-c6aee4205013","Type":"ContainerStarted","Data":"e3ff36cb412f94b01250a7ce81863e37998d2b3de991fc35f3a83f259b457d88"}
Jul 08 21:34:03.032556 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:03.032526    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bb8969897-4bz4m" event={"ID":"a5feee22-eee5-4915-8aa2-99776406bedf","Type":"ContainerStarted","Data":"d1b3b933204a280eb5cfad6cccad0d265ac3138463753a9297b731e4560b6c40"}
Jul 08 21:34:03.204480 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:03.204447    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xnzfd"]
Jul 08 21:34:03.207801 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:34:03.207773    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dbaf20f_e3bc_4428_9365_fd159b742280.slice/crio-576e46dfb66e9d63280bf1e28ed1d48c78e6fbc84e240adfb7b15f94ebccb247 WatchSource:0}: Error finding container 576e46dfb66e9d63280bf1e28ed1d48c78e6fbc84e240adfb7b15f94ebccb247: Status 404 returned error can't find the container with id 576e46dfb66e9d63280bf1e28ed1d48c78e6fbc84e240adfb7b15f94ebccb247
Jul 08 21:34:04.000500 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:04.000394    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wp7gn"
Jul 08 21:34:04.039328 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:04.039267    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bb8969897-4bz4m" event={"ID":"a5feee22-eee5-4915-8aa2-99776406bedf","Type":"ContainerStarted","Data":"56caedda32ad11654aa474fd1d2cc1333f2b6083c77a8bb834cc7351e5492f18"}
Jul 08 21:34:04.039519 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:04.039347    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bb8969897-4bz4m" event={"ID":"a5feee22-eee5-4915-8aa2-99776406bedf","Type":"ContainerStarted","Data":"9ce97c1051b4d1be2a2d078692c5a251e24a6bc396f23c065b71002a67ce053f"}
Jul 08 21:34:04.041487 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:04.041461    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xnzfd" event={"ID":"6dbaf20f-e3bc-4428-9365-fd159b742280","Type":"ContainerStarted","Data":"576e46dfb66e9d63280bf1e28ed1d48c78e6fbc84e240adfb7b15f94ebccb247"}
Jul 08 21:34:04.061879 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:04.061643    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bb8969897-4bz4m" podStartSLOduration=1.690990701 podStartE2EDuration="5.061623263s" totalImagesPullingTime="3.370632562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:33:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:34:04.061535044 +0000 UTC m=+66.999867445" watchObservedRunningTime="2026-07-08 21:34:04.061623263 +0000 UTC m=+66.999955663"
Jul 08 21:34:05.047696 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:05.047658    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xnzfd" event={"ID":"6dbaf20f-e3bc-4428-9365-fd159b742280","Type":"ContainerStarted","Data":"beaf84d86d20334c862bb8e8ef405e7f0371bbf02c78111cf114311a886035d3"}
Jul 08 21:34:05.048179 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:05.047748    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xnzfd" event={"ID":"6dbaf20f-e3bc-4428-9365-fd159b742280","Type":"ContainerStarted","Data":"71be93eb478d5d2e03784b8c7ddbfd5a941584401b375ad7e1611cc8cd2e7d4b"}
Jul 08 21:34:05.064040 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:05.063791    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xnzfd" podStartSLOduration=66.072764052 podStartE2EDuration="1m7.063776312s" totalImagesPullingTime="991.01226ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:34:05.062696165 +0000 UTC m=+68.001028590" watchObservedRunningTime="2026-07-08 21:34:05.063776312 +0000 UTC m=+68.002108713"
Jul 08 21:34:05.681051 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:05.681019    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-c66mk"]
Jul 08 21:34:05.691604 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:05.691574    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c66mk"
Jul 08 21:34:05.694610 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:05.694579    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 08 21:34:05.694760 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:05.694650    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-c66mk"]
Jul 08 21:34:05.694760 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:05.694684    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 08 21:34:05.694760 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:05.694655    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 08 21:34:05.695453 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:05.695431    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 08 21:34:05.695453 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:05.695459    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-2rbnl\""
Jul 08 21:34:05.698008 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:05.697697    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 08 21:34:05.811100 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:05.811061    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f5acf9f-3a72-4646-9cb7-5d94b2eff7e8-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-c66mk\" (UID: \"1f5acf9f-3a72-4646-9cb7-5d94b2eff7e8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c66mk"
Jul 08 21:34:05.811313 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:05.811152    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f5acf9f-3a72-4646-9cb7-5d94b2eff7e8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-c66mk\" (UID: \"1f5acf9f-3a72-4646-9cb7-5d94b2eff7e8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c66mk"
Jul 08 21:34:05.811313 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:05.811202    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrtkw\" (UniqueName: \"kubernetes.io/projected/1f5acf9f-3a72-4646-9cb7-5d94b2eff7e8-kube-api-access-lrtkw\") pod \"prometheus-operator-567f7b8b7c-c66mk\" (UID: \"1f5acf9f-3a72-4646-9cb7-5d94b2eff7e8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c66mk"
Jul 08 21:34:05.811313 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:05.811235    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f5acf9f-3a72-4646-9cb7-5d94b2eff7e8-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-c66mk\" (UID: \"1f5acf9f-3a72-4646-9cb7-5d94b2eff7e8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c66mk"
Jul 08 21:34:05.911858 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:05.911825    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f5acf9f-3a72-4646-9cb7-5d94b2eff7e8-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-c66mk\" (UID: \"1f5acf9f-3a72-4646-9cb7-5d94b2eff7e8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c66mk"
Jul 08 21:34:05.912022 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:05.911885    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f5acf9f-3a72-4646-9cb7-5d94b2eff7e8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-c66mk\" (UID: \"1f5acf9f-3a72-4646-9cb7-5d94b2eff7e8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c66mk"
Jul 08 21:34:05.912022 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:05.911909    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrtkw\" (UniqueName: \"kubernetes.io/projected/1f5acf9f-3a72-4646-9cb7-5d94b2eff7e8-kube-api-access-lrtkw\") pod \"prometheus-operator-567f7b8b7c-c66mk\" (UID: \"1f5acf9f-3a72-4646-9cb7-5d94b2eff7e8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c66mk"
Jul 08 21:34:05.912022 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:05.911931    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f5acf9f-3a72-4646-9cb7-5d94b2eff7e8-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-c66mk\" (UID: \"1f5acf9f-3a72-4646-9cb7-5d94b2eff7e8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c66mk"
Jul 08 21:34:05.912141 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:34:05.912044    2569 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 08 21:34:05.912141 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:34:05.912101    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f5acf9f-3a72-4646-9cb7-5d94b2eff7e8-prometheus-operator-tls podName:1f5acf9f-3a72-4646-9cb7-5d94b2eff7e8 nodeName:}" failed. No retries permitted until 2026-07-08 21:34:06.412083843 +0000 UTC m=+69.350416222 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/1f5acf9f-3a72-4646-9cb7-5d94b2eff7e8-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-c66mk" (UID: "1f5acf9f-3a72-4646-9cb7-5d94b2eff7e8") : secret "prometheus-operator-tls" not found
Jul 08 21:34:05.912996 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:05.912974    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f5acf9f-3a72-4646-9cb7-5d94b2eff7e8-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-c66mk\" (UID: \"1f5acf9f-3a72-4646-9cb7-5d94b2eff7e8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c66mk"
Jul 08 21:34:05.916277 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:05.916253    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f5acf9f-3a72-4646-9cb7-5d94b2eff7e8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-c66mk\" (UID: \"1f5acf9f-3a72-4646-9cb7-5d94b2eff7e8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c66mk"
Jul 08 21:34:05.924453 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:05.924427    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrtkw\" (UniqueName: \"kubernetes.io/projected/1f5acf9f-3a72-4646-9cb7-5d94b2eff7e8-kube-api-access-lrtkw\") pod \"prometheus-operator-567f7b8b7c-c66mk\" (UID: \"1f5acf9f-3a72-4646-9cb7-5d94b2eff7e8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c66mk"
Jul 08 21:34:06.415678 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:06.415634    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f5acf9f-3a72-4646-9cb7-5d94b2eff7e8-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-c66mk\" (UID: \"1f5acf9f-3a72-4646-9cb7-5d94b2eff7e8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c66mk"
Jul 08 21:34:06.418535 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:06.418506    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f5acf9f-3a72-4646-9cb7-5d94b2eff7e8-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-c66mk\" (UID: \"1f5acf9f-3a72-4646-9cb7-5d94b2eff7e8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c66mk"
Jul 08 21:34:06.606542 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:06.606500    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c66mk"
Jul 08 21:34:08.362039 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:08.362007    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-c66mk"]
Jul 08 21:34:08.364701 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:34:08.364660    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f5acf9f_3a72_4646_9cb7_5d94b2eff7e8.slice/crio-35c75e517ccd20fe1c6a566b345f7b3f83155327192fe0fdd0881e6e536e9e80 WatchSource:0}: Error finding container 35c75e517ccd20fe1c6a566b345f7b3f83155327192fe0fdd0881e6e536e9e80: Status 404 returned error can't find the container with id 35c75e517ccd20fe1c6a566b345f7b3f83155327192fe0fdd0881e6e536e9e80
Jul 08 21:34:09.064410 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:09.064365    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jxssk" event={"ID":"5fde744c-b4ec-4557-aa38-a5c8e43337f4","Type":"ContainerStarted","Data":"0ec6c2490b140198b0d9b8ab08b2b4a0b1e260386462956cadd99c008630ce36"}
Jul 08 21:34:09.064586 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:09.064467    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jxssk"
Jul 08 21:34:09.066093 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:09.066060    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pmsd9" event={"ID":"863b1cfe-1f2f-426e-9a5e-c6aee4205013","Type":"ContainerStarted","Data":"1635d5b83c6e3c3bec305b07e83d94782fc62e55286a39098fd861b5a2ce403c"}
Jul 08 21:34:09.067259 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:09.067226    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c66mk" event={"ID":"1f5acf9f-3a72-4646-9cb7-5d94b2eff7e8","Type":"ContainerStarted","Data":"35c75e517ccd20fe1c6a566b345f7b3f83155327192fe0fdd0881e6e536e9e80"}
Jul 08 21:34:09.081114 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:09.081064    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jxssk" podStartSLOduration=65.855606559 podStartE2EDuration="1m11.081051419s" totalImagesPullingTime="5.22544486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:34:09.079420297 +0000 UTC m=+72.017752696" watchObservedRunningTime="2026-07-08 21:34:09.081051419 +0000 UTC m=+72.019383819"
Jul 08 21:34:09.094862 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:09.094525    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-pmsd9" podStartSLOduration=65.846902619 podStartE2EDuration="1m11.09450955s" totalImagesPullingTime="5.247606931s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:34:09.094457697 +0000 UTC m=+72.032790124" watchObservedRunningTime="2026-07-08 21:34:09.09450955 +0000 UTC m=+72.032841950"
Jul 08 21:34:09.111133 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:09.111103    2569 patch_prober.go:28] interesting pod/image-registry-5f6f4c745f-hznbc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 08 21:34:09.111268 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:09.111153    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5f6f4c745f-hznbc" podUID="e2dbdfdb-4d51-44b2-8387-7ebc24441008" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 21:34:10.072454 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:10.072410    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c66mk" event={"ID":"1f5acf9f-3a72-4646-9cb7-5d94b2eff7e8","Type":"ContainerStarted","Data":"24a2ce229038a28e8f60d25eb836a8189052d056bfa9882335fe3d2d57c18da9"}
Jul 08 21:34:10.072982 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:10.072478    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c66mk" event={"ID":"1f5acf9f-3a72-4646-9cb7-5d94b2eff7e8","Type":"ContainerStarted","Data":"94c8a72a73a8b26d180f1bbb7a6b8e2b17f8f0f60a7385849592268e50652198"}
Jul 08 21:34:10.098773 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:10.098728    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-c66mk" podStartSLOduration=3.937787287 podStartE2EDuration="5.098712464s" totalImagesPullingTime="1.160925177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:34:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:34:10.096275184 +0000 UTC m=+73.034607600" watchObservedRunningTime="2026-07-08 21:34:10.098712464 +0000 UTC m=+73.037044864"
Jul 08 21:34:12.071835 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:12.071801    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jpv5h"]
Jul 08 21:34:12.076892 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:12.076864    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jpv5h"
Jul 08 21:34:12.081427 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:12.081394    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 08 21:34:12.081427 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:12.081396    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 08 21:34:12.081833 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:12.081740    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 08 21:34:12.081930 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:12.081914    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-lvlkr\""
Jul 08 21:34:12.163132 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:12.163100    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ad794e7-84bd-4227-b444-4a136303fbcc-sys\") pod \"node-exporter-jpv5h\" (UID: \"9ad794e7-84bd-4227-b444-4a136303fbcc\") " pod="openshift-monitoring/node-exporter-jpv5h"
Jul 08 21:34:12.163132 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:12.163145    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ad794e7-84bd-4227-b444-4a136303fbcc-metrics-client-ca\") pod \"node-exporter-jpv5h\" (UID: \"9ad794e7-84bd-4227-b444-4a136303fbcc\") " pod="openshift-monitoring/node-exporter-jpv5h"
Jul 08 21:34:12.163435 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:12.163175    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9ad794e7-84bd-4227-b444-4a136303fbcc-node-exporter-tls\") pod \"node-exporter-jpv5h\" (UID: \"9ad794e7-84bd-4227-b444-4a136303fbcc\") " pod="openshift-monitoring/node-exporter-jpv5h"
Jul 08 21:34:12.163435 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:12.163207    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9ad794e7-84bd-4227-b444-4a136303fbcc-node-exporter-textfile\") pod \"node-exporter-jpv5h\" (UID: \"9ad794e7-84bd-4227-b444-4a136303fbcc\") " pod="openshift-monitoring/node-exporter-jpv5h"
Jul 08 21:34:12.163435 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:12.163311    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9ad794e7-84bd-4227-b444-4a136303fbcc-node-exporter-wtmp\") pod \"node-exporter-jpv5h\" (UID: \"9ad794e7-84bd-4227-b444-4a136303fbcc\") " pod="openshift-monitoring/node-exporter-jpv5h"
Jul 08 21:34:12.163435 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:12.163357    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt9dr\" (UniqueName: \"kubernetes.io/projected/9ad794e7-84bd-4227-b444-4a136303fbcc-kube-api-access-kt9dr\") pod \"node-exporter-jpv5h\" (UID: \"9ad794e7-84bd-4227-b444-4a136303fbcc\") " pod="openshift-monitoring/node-exporter-jpv5h"
Jul 08 21:34:12.163435 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:12.163392    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9ad794e7-84bd-4227-b444-4a136303fbcc-node-exporter-accelerators-collector-config\") pod \"node-exporter-jpv5h\" (UID: \"9ad794e7-84bd-4227-b444-4a136303fbcc\") " pod="openshift-monitoring/node-exporter-jpv5h"
Jul 08 21:34:12.163435 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:12.163433    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9ad794e7-84bd-4227-b444-4a136303fbcc-root\") pod \"node-exporter-jpv5h\" (UID: \"9ad794e7-84bd-4227-b444-4a136303fbcc\") " pod="openshift-monitoring/node-exporter-jpv5h"
Jul 08 21:34:12.163655 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:12.163462    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9ad794e7-84bd-4227-b444-4a136303fbcc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jpv5h\" (UID: \"9ad794e7-84bd-4227-b444-4a136303fbcc\") " pod="openshift-monitoring/node-exporter-jpv5h"
Jul 08 21:34:12.264491 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:12.264450    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ad794e7-84bd-4227-b444-4a136303fbcc-sys\") pod \"node-exporter-jpv5h\" (UID: \"9ad794e7-84bd-4227-b444-4a136303fbcc\") " pod="openshift-monitoring/node-exporter-jpv5h"
Jul 08 21:34:12.264491 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:12.264496    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ad794e7-84bd-4227-b444-4a136303fbcc-metrics-client-ca\") pod \"node-exporter-jpv5h\" (UID: \"9ad794e7-84bd-4227-b444-4a136303fbcc\") " pod="openshift-monitoring/node-exporter-jpv5h"
Jul 08 21:34:12.264752 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:12.264522    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9ad794e7-84bd-4227-b444-4a136303fbcc-node-exporter-tls\") pod \"node-exporter-jpv5h\" (UID: \"9ad794e7-84bd-4227-b444-4a136303fbcc\") " pod="openshift-monitoring/node-exporter-jpv5h"
Jul 08 21:34:12.264752 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:12.264544    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9ad794e7-84bd-4227-b444-4a136303fbcc-node-exporter-textfile\") pod \"node-exporter-jpv5h\" (UID: \"9ad794e7-84bd-4227-b444-4a136303fbcc\") " pod="openshift-monitoring/node-exporter-jpv5h"
Jul 08 21:34:12.264752 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:12.264579    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9ad794e7-84bd-4227-b444-4a136303fbcc-node-exporter-wtmp\") pod \"node-exporter-jpv5h\" (UID: \"9ad794e7-84bd-4227-b444-4a136303fbcc\") " pod="openshift-monitoring/node-exporter-jpv5h"
Jul 08 21:34:12.264752 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:12.264584    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ad794e7-84bd-4227-b444-4a136303fbcc-sys\") pod \"node-exporter-jpv5h\" (UID: \"9ad794e7-84bd-4227-b444-4a136303fbcc\") " pod="openshift-monitoring/node-exporter-jpv5h"
Jul 08 21:34:12.264752 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:34:12.264653    2569 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 08 21:34:12.264752 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:12.264716    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9ad794e7-84bd-4227-b444-4a136303fbcc-node-exporter-wtmp\") pod \"node-exporter-jpv5h\" (UID: \"9ad794e7-84bd-4227-b444-4a136303fbcc\") " pod="openshift-monitoring/node-exporter-jpv5h"
Jul 08 21:34:12.264752 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:34:12.264720    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ad794e7-84bd-4227-b444-4a136303fbcc-node-exporter-tls podName:9ad794e7-84bd-4227-b444-4a136303fbcc nodeName:}" failed. No retries permitted until 2026-07-08 21:34:12.764698941 +0000 UTC m=+75.703031336 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/9ad794e7-84bd-4227-b444-4a136303fbcc-node-exporter-tls") pod "node-exporter-jpv5h" (UID: "9ad794e7-84bd-4227-b444-4a136303fbcc") : secret "node-exporter-tls" not found
Jul 08 21:34:12.264752 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:12.264748    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt9dr\" (UniqueName: \"kubernetes.io/projected/9ad794e7-84bd-4227-b444-4a136303fbcc-kube-api-access-kt9dr\") pod \"node-exporter-jpv5h\" (UID: \"9ad794e7-84bd-4227-b444-4a136303fbcc\") " pod="openshift-monitoring/node-exporter-jpv5h"
Jul 08 21:34:12.265101 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:12.264777    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9ad794e7-84bd-4227-b444-4a136303fbcc-node-exporter-accelerators-collector-config\") pod \"node-exporter-jpv5h\" (UID: \"9ad794e7-84bd-4227-b444-4a136303fbcc\") " pod="openshift-monitoring/node-exporter-jpv5h"
Jul 08 21:34:12.265101 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:12.264842    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9ad794e7-84bd-4227-b444-4a136303fbcc-root\") pod \"node-exporter-jpv5h\" (UID: \"9ad794e7-84bd-4227-b444-4a136303fbcc\") " pod="openshift-monitoring/node-exporter-jpv5h"
Jul 08 21:34:12.265101 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:12.264884    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9ad794e7-84bd-4227-b444-4a136303fbcc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jpv5h\" (UID: \"9ad794e7-84bd-4227-b444-4a136303fbcc\") " pod="openshift-monitoring/node-exporter-jpv5h"
Jul 08 21:34:12.265101 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:12.264956    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9ad794e7-84bd-4227-b444-4a136303fbcc-node-exporter-textfile\") pod \"node-exporter-jpv5h\" (UID: \"9ad794e7-84bd-4227-b444-4a136303fbcc\") " pod="openshift-monitoring/node-exporter-jpv5h"
Jul 08 21:34:12.265101 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:12.264961    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9ad794e7-84bd-4227-b444-4a136303fbcc-root\") pod \"node-exporter-jpv5h\" (UID: \"9ad794e7-84bd-4227-b444-4a136303fbcc\") " pod="openshift-monitoring/node-exporter-jpv5h"
Jul 08 21:34:12.265101 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:12.265060    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ad794e7-84bd-4227-b444-4a136303fbcc-metrics-client-ca\") pod \"node-exporter-jpv5h\" (UID: \"9ad794e7-84bd-4227-b444-4a136303fbcc\") " pod="openshift-monitoring/node-exporter-jpv5h"
Jul 08 21:34:12.265313 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:12.265216    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9ad794e7-84bd-4227-b444-4a136303fbcc-node-exporter-accelerators-collector-config\") pod \"node-exporter-jpv5h\" (UID: \"9ad794e7-84bd-4227-b444-4a136303fbcc\") " pod="openshift-monitoring/node-exporter-jpv5h"
Jul 08 21:34:12.267305 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:12.267267    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9ad794e7-84bd-4227-b444-4a136303fbcc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jpv5h\" (UID: \"9ad794e7-84bd-4227-b444-4a136303fbcc\") " pod="openshift-monitoring/node-exporter-jpv5h"
Jul 08 21:34:12.273189 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:12.273169    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt9dr\" (UniqueName: \"kubernetes.io/projected/9ad794e7-84bd-4227-b444-4a136303fbcc-kube-api-access-kt9dr\") pod \"node-exporter-jpv5h\" (UID: \"9ad794e7-84bd-4227-b444-4a136303fbcc\") " pod="openshift-monitoring/node-exporter-jpv5h"
Jul 08 21:34:12.769393 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:12.769357    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9ad794e7-84bd-4227-b444-4a136303fbcc-node-exporter-tls\") pod \"node-exporter-jpv5h\" (UID: \"9ad794e7-84bd-4227-b444-4a136303fbcc\") " pod="openshift-monitoring/node-exporter-jpv5h"
Jul 08 21:34:12.771813 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:12.771791    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9ad794e7-84bd-4227-b444-4a136303fbcc-node-exporter-tls\") pod \"node-exporter-jpv5h\" (UID: \"9ad794e7-84bd-4227-b444-4a136303fbcc\") " pod="openshift-monitoring/node-exporter-jpv5h"
Jul 08 21:34:12.986531 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:12.986495    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jpv5h"
Jul 08 21:34:12.996742 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:34:12.996705    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ad794e7_84bd_4227_b444_4a136303fbcc.slice/crio-6ece90b9e2fa8b8e9607a0f53dca136f46e8a17664ebe010795cb398ba28fdad WatchSource:0}: Error finding container 6ece90b9e2fa8b8e9607a0f53dca136f46e8a17664ebe010795cb398ba28fdad: Status 404 returned error can't find the container with id 6ece90b9e2fa8b8e9607a0f53dca136f46e8a17664ebe010795cb398ba28fdad
Jul 08 21:34:13.084142 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:13.084046    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jpv5h" event={"ID":"9ad794e7-84bd-4227-b444-4a136303fbcc","Type":"ContainerStarted","Data":"6ece90b9e2fa8b8e9607a0f53dca136f46e8a17664ebe010795cb398ba28fdad"}
Jul 08 21:34:14.089121 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:14.089028    2569 generic.go:356] "Generic (PLEG): container finished" podID="9ad794e7-84bd-4227-b444-4a136303fbcc" containerID="3f90dba1b92c674daf65d0acdf0c321c8b99f23d276384550b394b5bccbb6ac5" exitCode=0
Jul 08 21:34:14.089121 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:14.089098    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jpv5h" event={"ID":"9ad794e7-84bd-4227-b444-4a136303fbcc","Type":"ContainerDied","Data":"3f90dba1b92c674daf65d0acdf0c321c8b99f23d276384550b394b5bccbb6ac5"}
Jul 08 21:34:15.095226 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:15.095187    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jpv5h" event={"ID":"9ad794e7-84bd-4227-b444-4a136303fbcc","Type":"ContainerStarted","Data":"591d119df585a64bfbff79b98e9a04485f7c74dc03f23cf9be643796e17a9dd6"}
Jul 08 21:34:15.095699 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:15.095250    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jpv5h" event={"ID":"9ad794e7-84bd-4227-b444-4a136303fbcc","Type":"ContainerStarted","Data":"1da4365e4612fa625cc48311a9984e558e99666fbb3ac9e2820dfa6e2d5c2e9a"}
Jul 08 21:34:15.126099 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:15.126040    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jpv5h" podStartSLOduration=2.258679461 podStartE2EDuration="3.126024309s" totalImagesPullingTime="794.043437ms" totalInitContainerRuntime="73.301411ms" isStatefulPod=true podCreationTimestamp="2026-07-08 21:34:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:34:15.125373814 +0000 UTC m=+78.063706215" watchObservedRunningTime="2026-07-08 21:34:15.126024309 +0000 UTC m=+78.064356709"
Jul 08 21:34:18.304142 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.304009    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 21:34:18.308800 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.308778    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.313189 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.313164    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 08 21:34:18.313475 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.313458    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 08 21:34:18.313535 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.313497    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 08 21:34:18.314808 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.314783    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 08 21:34:18.314918 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.314816    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 08 21:34:18.315357 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.315339    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 08 21:34:18.317498 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.315760    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 08 21:34:18.317498 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.315999    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 08 21:34:18.317498 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.316026    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 08 21:34:18.317498 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.316207    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 08 21:34:18.317498 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.316242    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 08 21:34:18.317498 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.316440    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 08 21:34:18.317498 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.316553    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-mrmqm\""
Jul 08 21:34:18.317498 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.316611    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-c395s6nkodia2\""
Jul 08 21:34:18.317498 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.316774    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 08 21:34:18.318272 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.317607    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 08 21:34:18.318272 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.317704    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 08 21:34:18.331488 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.331456    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 21:34:18.418470 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.418439    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.418658 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.418477    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.418658 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.418504    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a54ee6f-662c-4e85-892e-6604b63d770c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.418658 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.418526    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-web-config\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.418658 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.418551    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8a54ee6f-662c-4e85-892e-6604b63d770c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.418658 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.418568    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a54ee6f-662c-4e85-892e-6604b63d770c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.418658 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.418592    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.418861 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.418667    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.418861 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.418723    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8a54ee6f-662c-4e85-892e-6604b63d770c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.418861 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.418744    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8a54ee6f-662c-4e85-892e-6604b63d770c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.418861 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.418765    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.418861 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.418791    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8a54ee6f-662c-4e85-892e-6604b63d770c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.418861 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.418821    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8a54ee6f-662c-4e85-892e-6604b63d770c-config-out\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.418861 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.418836    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-config\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.418861 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.418855    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8a54ee6f-662c-4e85-892e-6604b63d770c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.419185 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.418871    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.419185 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.418885    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.419185 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.418940    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a54ee6f-662c-4e85-892e-6604b63d770c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.419185 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.418992    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slx4w\" (UniqueName: \"kubernetes.io/projected/8a54ee6f-662c-4e85-892e-6604b63d770c-kube-api-access-slx4w\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.419185 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.419037    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a54ee6f-662c-4e85-892e-6604b63d770c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.519905 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.519860    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.520105 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.519921    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.520105 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.519954    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a54ee6f-662c-4e85-892e-6604b63d770c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.520105 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.519979    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-web-config\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.520105 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.520010    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8a54ee6f-662c-4e85-892e-6604b63d770c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.520105 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.520070    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a54ee6f-662c-4e85-892e-6604b63d770c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.523334 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.520785    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.523334 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.520852    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.523334 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.520906    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8a54ee6f-662c-4e85-892e-6604b63d770c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.523334 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.521116    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8a54ee6f-662c-4e85-892e-6604b63d770c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.523334 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.521153    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.523334 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.521362    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8a54ee6f-662c-4e85-892e-6604b63d770c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.523334 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.521516    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8a54ee6f-662c-4e85-892e-6604b63d770c-config-out\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.523334 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.521595    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-config\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.523334 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.521689    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8a54ee6f-662c-4e85-892e-6604b63d770c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.523334 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.521794    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.523334 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.521932    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.523334 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.521972    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a54ee6f-662c-4e85-892e-6604b63d770c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.523334 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.522090    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slx4w\" (UniqueName: \"kubernetes.io/projected/8a54ee6f-662c-4e85-892e-6604b63d770c-kube-api-access-slx4w\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.523334 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.522139    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a54ee6f-662c-4e85-892e-6604b63d770c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.523334 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.522433    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a54ee6f-662c-4e85-892e-6604b63d770c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.523984 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.523510    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a54ee6f-662c-4e85-892e-6604b63d770c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.524050 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.524025    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8a54ee6f-662c-4e85-892e-6604b63d770c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.525322 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.525279    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8a54ee6f-662c-4e85-892e-6604b63d770c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.526807 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.526330    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-config\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.527039 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.527012    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8a54ee6f-662c-4e85-892e-6604b63d770c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.528037 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.528012    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a54ee6f-662c-4e85-892e-6604b63d770c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.529983 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.529957    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8a54ee6f-662c-4e85-892e-6604b63d770c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.530125 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.530012    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.531093 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.530938    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-web-config\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.531756 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.531733    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.532165 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.532138    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a54ee6f-662c-4e85-892e-6604b63d770c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.532316 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.532273    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.532557 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.532537    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.533768 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.533703    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8a54ee6f-662c-4e85-892e-6604b63d770c-config-out\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.534131 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.534089    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.534869 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.534837    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8a54ee6f-662c-4e85-892e-6604b63d770c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.535077 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.535023    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.535400 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.535377    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.536031 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.536015    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slx4w\" (UniqueName: \"kubernetes.io/projected/8a54ee6f-662c-4e85-892e-6604b63d770c-kube-api-access-slx4w\") pod \"prometheus-k8s-0\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.621115 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.621022    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:18.803197 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:18.803139    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 21:34:18.807776 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:34:18.807745    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a54ee6f_662c_4e85_892e_6604b63d770c.slice/crio-374352555efd555e1c04684730f4ff4e41f11c7c45dd724cab6e90fce631af48 WatchSource:0}: Error finding container 374352555efd555e1c04684730f4ff4e41f11c7c45dd724cab6e90fce631af48: Status 404 returned error can't find the container with id 374352555efd555e1c04684730f4ff4e41f11c7c45dd724cab6e90fce631af48
Jul 08 21:34:19.110011 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:19.109970    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5f6f4c745f-hznbc"
Jul 08 21:34:19.112730 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:19.112703    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a54ee6f-662c-4e85-892e-6604b63d770c","Type":"ContainerStarted","Data":"374352555efd555e1c04684730f4ff4e41f11c7c45dd724cab6e90fce631af48"}
Jul 08 21:34:21.120948 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:21.120914    2569 generic.go:356] "Generic (PLEG): container finished" podID="8a54ee6f-662c-4e85-892e-6604b63d770c" containerID="cdc564494e46ef76137110987e74a6d0573f9c34a50b0ae473704168e4f20dcc" exitCode=0
Jul 08 21:34:21.121330 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:21.120975    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a54ee6f-662c-4e85-892e-6604b63d770c","Type":"ContainerDied","Data":"cdc564494e46ef76137110987e74a6d0573f9c34a50b0ae473704168e4f20dcc"}
Jul 08 21:34:24.124495 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:24.124444    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5f6f4c745f-hznbc" podUID="e2dbdfdb-4d51-44b2-8387-7ebc24441008" containerName="registry" containerID="cri-o://f34ef29fb892adf0c86cc9a4427de783fe1f573988625cedfe02c9c6bff0b67e" gracePeriod=30
Jul 08 21:34:24.613858 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:24.613832    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f6f4c745f-hznbc"
Jul 08 21:34:24.782444 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:24.782409    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2dbdfdb-4d51-44b2-8387-7ebc24441008-bound-sa-token\") pod \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\" (UID: \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\") "
Jul 08 21:34:24.782585 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:24.782457    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2dbdfdb-4d51-44b2-8387-7ebc24441008-trusted-ca\") pod \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\" (UID: \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\") "
Jul 08 21:34:24.782585 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:24.782474    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2dbdfdb-4d51-44b2-8387-7ebc24441008-registry-tls\") pod \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\" (UID: \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\") "
Jul 08 21:34:24.782585 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:24.782512    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e2dbdfdb-4d51-44b2-8387-7ebc24441008-registry-certificates\") pod \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\" (UID: \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\") "
Jul 08 21:34:24.782585 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:24.782552    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e2dbdfdb-4d51-44b2-8387-7ebc24441008-ca-trust-extracted\") pod \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\" (UID: \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\") "
Jul 08 21:34:24.782585 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:24.782580    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e2dbdfdb-4d51-44b2-8387-7ebc24441008-image-registry-private-configuration\") pod \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\" (UID: \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\") "
Jul 08 21:34:24.782834 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:24.782641    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlgbl\" (UniqueName: \"kubernetes.io/projected/e2dbdfdb-4d51-44b2-8387-7ebc24441008-kube-api-access-vlgbl\") pod \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\" (UID: \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\") "
Jul 08 21:34:24.782834 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:24.782666    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e2dbdfdb-4d51-44b2-8387-7ebc24441008-installation-pull-secrets\") pod \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\" (UID: \"e2dbdfdb-4d51-44b2-8387-7ebc24441008\") "
Jul 08 21:34:24.782935 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:24.782850    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2dbdfdb-4d51-44b2-8387-7ebc24441008-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e2dbdfdb-4d51-44b2-8387-7ebc24441008" (UID: "e2dbdfdb-4d51-44b2-8387-7ebc24441008"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:34:24.782935 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:24.782924    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e2dbdfdb-4d51-44b2-8387-7ebc24441008-trusted-ca\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 21:34:24.783034 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:24.783000    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2dbdfdb-4d51-44b2-8387-7ebc24441008-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e2dbdfdb-4d51-44b2-8387-7ebc24441008" (UID: "e2dbdfdb-4d51-44b2-8387-7ebc24441008"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:34:24.785390 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:24.785218    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2dbdfdb-4d51-44b2-8387-7ebc24441008-kube-api-access-vlgbl" (OuterVolumeSpecName: "kube-api-access-vlgbl") pod "e2dbdfdb-4d51-44b2-8387-7ebc24441008" (UID: "e2dbdfdb-4d51-44b2-8387-7ebc24441008"). InnerVolumeSpecName "kube-api-access-vlgbl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:34:24.785537 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:24.785420    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2dbdfdb-4d51-44b2-8387-7ebc24441008-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e2dbdfdb-4d51-44b2-8387-7ebc24441008" (UID: "e2dbdfdb-4d51-44b2-8387-7ebc24441008"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:34:24.785537 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:24.785501    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2dbdfdb-4d51-44b2-8387-7ebc24441008-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e2dbdfdb-4d51-44b2-8387-7ebc24441008" (UID: "e2dbdfdb-4d51-44b2-8387-7ebc24441008"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:34:24.785537 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:24.785506    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2dbdfdb-4d51-44b2-8387-7ebc24441008-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e2dbdfdb-4d51-44b2-8387-7ebc24441008" (UID: "e2dbdfdb-4d51-44b2-8387-7ebc24441008"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:34:24.785709 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:24.785557    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2dbdfdb-4d51-44b2-8387-7ebc24441008-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e2dbdfdb-4d51-44b2-8387-7ebc24441008" (UID: "e2dbdfdb-4d51-44b2-8387-7ebc24441008"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:34:24.793150 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:24.793113    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2dbdfdb-4d51-44b2-8387-7ebc24441008-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e2dbdfdb-4d51-44b2-8387-7ebc24441008" (UID: "e2dbdfdb-4d51-44b2-8387-7ebc24441008"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:34:24.885158 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:24.884542    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlgbl\" (UniqueName: \"kubernetes.io/projected/e2dbdfdb-4d51-44b2-8387-7ebc24441008-kube-api-access-vlgbl\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 21:34:24.885158 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:24.884575    2569 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e2dbdfdb-4d51-44b2-8387-7ebc24441008-installation-pull-secrets\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 21:34:24.885158 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:24.884590    2569 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e2dbdfdb-4d51-44b2-8387-7ebc24441008-bound-sa-token\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 21:34:24.885158 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:24.884602    2569 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e2dbdfdb-4d51-44b2-8387-7ebc24441008-registry-tls\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 21:34:24.885158 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:24.884615    2569 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e2dbdfdb-4d51-44b2-8387-7ebc24441008-registry-certificates\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 21:34:24.885158 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:24.884627    2569 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e2dbdfdb-4d51-44b2-8387-7ebc24441008-ca-trust-extracted\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 21:34:24.885158 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:24.884642    2569 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e2dbdfdb-4d51-44b2-8387-7ebc24441008-image-registry-private-configuration\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 21:34:25.137430 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:25.137339    2569 generic.go:356] "Generic (PLEG): container finished" podID="e2dbdfdb-4d51-44b2-8387-7ebc24441008" containerID="f34ef29fb892adf0c86cc9a4427de783fe1f573988625cedfe02c9c6bff0b67e" exitCode=0
Jul 08 21:34:25.137430 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:25.137390    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f6f4c745f-hznbc"
Jul 08 21:34:25.137965 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:25.137425    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f6f4c745f-hznbc" event={"ID":"e2dbdfdb-4d51-44b2-8387-7ebc24441008","Type":"ContainerDied","Data":"f34ef29fb892adf0c86cc9a4427de783fe1f573988625cedfe02c9c6bff0b67e"}
Jul 08 21:34:25.137965 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:25.137484    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f6f4c745f-hznbc" event={"ID":"e2dbdfdb-4d51-44b2-8387-7ebc24441008","Type":"ContainerDied","Data":"a2b5ae6199f9b1912ef8fa9ae2284ef9e4cd56d98a8e58bcfe83245e5e7c941d"}
Jul 08 21:34:25.137965 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:25.137513    2569 scope.go:117] "RemoveContainer" containerID="f34ef29fb892adf0c86cc9a4427de783fe1f573988625cedfe02c9c6bff0b67e"
Jul 08 21:34:25.139959 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:25.139934    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a54ee6f-662c-4e85-892e-6604b63d770c","Type":"ContainerStarted","Data":"9218d07be75adc0c9833b4884b69ebef25cd510776aae18c2640815983deedc8"}
Jul 08 21:34:25.140116 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:25.139991    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a54ee6f-662c-4e85-892e-6604b63d770c","Type":"ContainerStarted","Data":"88a124739e4b077efe82db92782138a35999e9922ee2133f613033bdf0143b60"}
Jul 08 21:34:25.146225 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:25.146209    2569 scope.go:117] "RemoveContainer" containerID="f34ef29fb892adf0c86cc9a4427de783fe1f573988625cedfe02c9c6bff0b67e"
Jul 08 21:34:25.146507 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:34:25.146487    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f34ef29fb892adf0c86cc9a4427de783fe1f573988625cedfe02c9c6bff0b67e\": container with ID starting with f34ef29fb892adf0c86cc9a4427de783fe1f573988625cedfe02c9c6bff0b67e not found: ID does not exist" containerID="f34ef29fb892adf0c86cc9a4427de783fe1f573988625cedfe02c9c6bff0b67e"
Jul 08 21:34:25.146570 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:25.146521    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f34ef29fb892adf0c86cc9a4427de783fe1f573988625cedfe02c9c6bff0b67e"} err="failed to get container status \"f34ef29fb892adf0c86cc9a4427de783fe1f573988625cedfe02c9c6bff0b67e\": rpc error: code = NotFound desc = could not find container \"f34ef29fb892adf0c86cc9a4427de783fe1f573988625cedfe02c9c6bff0b67e\": container with ID starting with f34ef29fb892adf0c86cc9a4427de783fe1f573988625cedfe02c9c6bff0b67e not found: ID does not exist"
Jul 08 21:34:25.158688 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:25.158666    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5f6f4c745f-hznbc"]
Jul 08 21:34:25.162425 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:25.162406    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5f6f4c745f-hznbc"]
Jul 08 21:34:25.612074 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:25.612038    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2dbdfdb-4d51-44b2-8387-7ebc24441008" path="/var/lib/kubelet/pods/e2dbdfdb-4d51-44b2-8387-7ebc24441008/volumes"
Jul 08 21:34:27.150705 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:27.150672    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a54ee6f-662c-4e85-892e-6604b63d770c","Type":"ContainerStarted","Data":"55b702a489d183d4ba51c11803c9aa4dc4c4caca2c9c400a6f47e28f3df28f4e"}
Jul 08 21:34:28.161564 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:28.161528    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a54ee6f-662c-4e85-892e-6604b63d770c","Type":"ContainerStarted","Data":"4e39c2bcb5200637daa4574ba21f5d3a770f80dd91f9a8e2f98f26632ddd02dc"}
Jul 08 21:34:28.162117 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:28.162085    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a54ee6f-662c-4e85-892e-6604b63d770c","Type":"ContainerStarted","Data":"5d4e1228acf917d94a8ce6b360e215327911e2f2313b8000dcbff2d2b94b7459"}
Jul 08 21:34:28.162247 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:28.162144    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a54ee6f-662c-4e85-892e-6604b63d770c","Type":"ContainerStarted","Data":"1a642b284b02b58850430bfb2d1f92ab95f4ee2762831278f52e0ee9c67ad943"}
Jul 08 21:34:28.214982 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:28.214931    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.295964856 podStartE2EDuration="10.214905491s" totalImagesPullingTime="6.901539446s" totalInitContainerRuntime="17.401189ms" isStatefulPod=false podCreationTimestamp="2026-07-08 21:34:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:34:28.213279193 +0000 UTC m=+91.151611627" watchObservedRunningTime="2026-07-08 21:34:28.214905491 +0000 UTC m=+91.153237892"
Jul 08 21:34:28.621614 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:28.621517    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:34:40.075414 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:34:40.075382    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jxssk"
Jul 08 21:35:18.622047 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:18.622007    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:18.642719 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:18.642691    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:19.357258 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:19.357230    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:36.685569 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:36.685530    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 21:35:36.685994 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:36.685831    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8a54ee6f-662c-4e85-892e-6604b63d770c" containerName="prometheus" containerID="cri-o://88a124739e4b077efe82db92782138a35999e9922ee2133f613033bdf0143b60" gracePeriod=600
Jul 08 21:35:36.685994 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:36.685885    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8a54ee6f-662c-4e85-892e-6604b63d770c" containerName="kube-rbac-proxy-thanos" containerID="cri-o://4e39c2bcb5200637daa4574ba21f5d3a770f80dd91f9a8e2f98f26632ddd02dc" gracePeriod=600
Jul 08 21:35:36.685994 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:36.685899    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8a54ee6f-662c-4e85-892e-6604b63d770c" containerName="thanos-sidecar" containerID="cri-o://55b702a489d183d4ba51c11803c9aa4dc4c4caca2c9c400a6f47e28f3df28f4e" gracePeriod=600
Jul 08 21:35:36.685994 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:36.685940    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8a54ee6f-662c-4e85-892e-6604b63d770c" containerName="config-reloader" containerID="cri-o://9218d07be75adc0c9833b4884b69ebef25cd510776aae18c2640815983deedc8" gracePeriod=600
Jul 08 21:35:36.686208 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:36.685852    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8a54ee6f-662c-4e85-892e-6604b63d770c" containerName="kube-rbac-proxy" containerID="cri-o://5d4e1228acf917d94a8ce6b360e215327911e2f2313b8000dcbff2d2b94b7459" gracePeriod=600
Jul 08 21:35:36.686208 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:36.685932    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8a54ee6f-662c-4e85-892e-6604b63d770c" containerName="kube-rbac-proxy-web" containerID="cri-o://1a642b284b02b58850430bfb2d1f92ab95f4ee2762831278f52e0ee9c67ad943" gracePeriod=600
Jul 08 21:35:36.947967 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:36.947938    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.139066 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.139024    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a54ee6f-662c-4e85-892e-6604b63d770c-configmap-serving-certs-ca-bundle\") pod \"8a54ee6f-662c-4e85-892e-6604b63d770c\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") "
Jul 08 21:35:37.139066 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.139067    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8a54ee6f-662c-4e85-892e-6604b63d770c-prometheus-k8s-rulefiles-2\") pod \"8a54ee6f-662c-4e85-892e-6604b63d770c\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") "
Jul 08 21:35:37.139281 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.139102    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-thanos-prometheus-http-client-file\") pod \"8a54ee6f-662c-4e85-892e-6604b63d770c\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") "
Jul 08 21:35:37.139281 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.139131    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8a54ee6f-662c-4e85-892e-6604b63d770c-prometheus-k8s-rulefiles-0\") pod \"8a54ee6f-662c-4e85-892e-6604b63d770c\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") "
Jul 08 21:35:37.139281 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.139163    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-slx4w\" (UniqueName: \"kubernetes.io/projected/8a54ee6f-662c-4e85-892e-6604b63d770c-kube-api-access-slx4w\") pod \"8a54ee6f-662c-4e85-892e-6604b63d770c\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") "
Jul 08 21:35:37.139281 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.139195    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8a54ee6f-662c-4e85-892e-6604b63d770c-tls-assets\") pod \"8a54ee6f-662c-4e85-892e-6604b63d770c\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") "
Jul 08 21:35:37.139281 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.139218    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a54ee6f-662c-4e85-892e-6604b63d770c-configmap-kubelet-serving-ca-bundle\") pod \"8a54ee6f-662c-4e85-892e-6604b63d770c\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") "
Jul 08 21:35:37.139281 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.139245    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a54ee6f-662c-4e85-892e-6604b63d770c-prometheus-trusted-ca-bundle\") pod \"8a54ee6f-662c-4e85-892e-6604b63d770c\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") "
Jul 08 21:35:37.139281 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.139279    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"8a54ee6f-662c-4e85-892e-6604b63d770c\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") "
Jul 08 21:35:37.139640 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.139330    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8a54ee6f-662c-4e85-892e-6604b63d770c-prometheus-k8s-rulefiles-1\") pod \"8a54ee6f-662c-4e85-892e-6604b63d770c\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") "
Jul 08 21:35:37.139640 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.139353    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a54ee6f-662c-4e85-892e-6604b63d770c-configmap-metrics-client-ca\") pod \"8a54ee6f-662c-4e85-892e-6604b63d770c\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") "
Jul 08 21:35:37.139640 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.139384    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-secret-kube-rbac-proxy\") pod \"8a54ee6f-662c-4e85-892e-6604b63d770c\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") "
Jul 08 21:35:37.139640 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.139419    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-web-config\") pod \"8a54ee6f-662c-4e85-892e-6604b63d770c\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") "
Jul 08 21:35:37.139640 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.139443    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a54ee6f-662c-4e85-892e-6604b63d770c-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "8a54ee6f-662c-4e85-892e-6604b63d770c" (UID: "8a54ee6f-662c-4e85-892e-6604b63d770c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:35:37.139640 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.139453    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8a54ee6f-662c-4e85-892e-6604b63d770c-prometheus-k8s-db\") pod \"8a54ee6f-662c-4e85-892e-6604b63d770c\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") "
Jul 08 21:35:37.139640 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.139520    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-secret-metrics-client-certs\") pod \"8a54ee6f-662c-4e85-892e-6604b63d770c\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") "
Jul 08 21:35:37.139640 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.139558    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-config\") pod \"8a54ee6f-662c-4e85-892e-6604b63d770c\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") "
Jul 08 21:35:37.139640 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.139590    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"8a54ee6f-662c-4e85-892e-6604b63d770c\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") "
Jul 08 21:35:37.139640 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.139624    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-secret-grpc-tls\") pod \"8a54ee6f-662c-4e85-892e-6604b63d770c\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") "
Jul 08 21:35:37.140272 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.139666    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8a54ee6f-662c-4e85-892e-6604b63d770c-config-out\") pod \"8a54ee6f-662c-4e85-892e-6604b63d770c\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") "
Jul 08 21:35:37.140272 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.139689    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-secret-prometheus-k8s-tls\") pod \"8a54ee6f-662c-4e85-892e-6604b63d770c\" (UID: \"8a54ee6f-662c-4e85-892e-6604b63d770c\") "
Jul 08 21:35:37.140272 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.139700    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a54ee6f-662c-4e85-892e-6604b63d770c-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "8a54ee6f-662c-4e85-892e-6604b63d770c" (UID: "8a54ee6f-662c-4e85-892e-6604b63d770c"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:35:37.140272 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.139918    2569 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a54ee6f-662c-4e85-892e-6604b63d770c-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 21:35:37.140272 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.139939    2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8a54ee6f-662c-4e85-892e-6604b63d770c-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 21:35:37.140272 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.139971    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a54ee6f-662c-4e85-892e-6604b63d770c-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "8a54ee6f-662c-4e85-892e-6604b63d770c" (UID: "8a54ee6f-662c-4e85-892e-6604b63d770c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:35:37.140272 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.139985    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a54ee6f-662c-4e85-892e-6604b63d770c-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "8a54ee6f-662c-4e85-892e-6604b63d770c" (UID: "8a54ee6f-662c-4e85-892e-6604b63d770c"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:35:37.140706 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.140475    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a54ee6f-662c-4e85-892e-6604b63d770c-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "8a54ee6f-662c-4e85-892e-6604b63d770c" (UID: "8a54ee6f-662c-4e85-892e-6604b63d770c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:35:37.140706 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.140651    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a54ee6f-662c-4e85-892e-6604b63d770c-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "8a54ee6f-662c-4e85-892e-6604b63d770c" (UID: "8a54ee6f-662c-4e85-892e-6604b63d770c"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:35:37.140804 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.140777    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a54ee6f-662c-4e85-892e-6604b63d770c-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "8a54ee6f-662c-4e85-892e-6604b63d770c" (UID: "8a54ee6f-662c-4e85-892e-6604b63d770c"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:35:37.142561 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.142275    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a54ee6f-662c-4e85-892e-6604b63d770c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8a54ee6f-662c-4e85-892e-6604b63d770c" (UID: "8a54ee6f-662c-4e85-892e-6604b63d770c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:35:37.142561 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.142417    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "8a54ee6f-662c-4e85-892e-6604b63d770c" (UID: "8a54ee6f-662c-4e85-892e-6604b63d770c"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:35:37.142561 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.142417    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a54ee6f-662c-4e85-892e-6604b63d770c-kube-api-access-slx4w" (OuterVolumeSpecName: "kube-api-access-slx4w") pod "8a54ee6f-662c-4e85-892e-6604b63d770c" (UID: "8a54ee6f-662c-4e85-892e-6604b63d770c"). InnerVolumeSpecName "kube-api-access-slx4w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:35:37.142884 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.142641    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "8a54ee6f-662c-4e85-892e-6604b63d770c" (UID: "8a54ee6f-662c-4e85-892e-6604b63d770c"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:35:37.142945 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.142927    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "8a54ee6f-662c-4e85-892e-6604b63d770c" (UID: "8a54ee6f-662c-4e85-892e-6604b63d770c"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:35:37.143156 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.143008    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a54ee6f-662c-4e85-892e-6604b63d770c-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "8a54ee6f-662c-4e85-892e-6604b63d770c" (UID: "8a54ee6f-662c-4e85-892e-6604b63d770c"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:35:37.143364 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.143332    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "8a54ee6f-662c-4e85-892e-6604b63d770c" (UID: "8a54ee6f-662c-4e85-892e-6604b63d770c"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:35:37.144267 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.144235    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "8a54ee6f-662c-4e85-892e-6604b63d770c" (UID: "8a54ee6f-662c-4e85-892e-6604b63d770c"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:35:37.144699 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.144673    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "8a54ee6f-662c-4e85-892e-6604b63d770c" (UID: "8a54ee6f-662c-4e85-892e-6604b63d770c"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:35:37.144874 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.144855    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "8a54ee6f-662c-4e85-892e-6604b63d770c" (UID: "8a54ee6f-662c-4e85-892e-6604b63d770c"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:35:37.144874 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.144860    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a54ee6f-662c-4e85-892e-6604b63d770c-config-out" (OuterVolumeSpecName: "config-out") pod "8a54ee6f-662c-4e85-892e-6604b63d770c" (UID: "8a54ee6f-662c-4e85-892e-6604b63d770c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:35:37.144992 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.144978    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-config" (OuterVolumeSpecName: "config") pod "8a54ee6f-662c-4e85-892e-6604b63d770c" (UID: "8a54ee6f-662c-4e85-892e-6604b63d770c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:35:37.152879 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.152860    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-web-config" (OuterVolumeSpecName: "web-config") pod "8a54ee6f-662c-4e85-892e-6604b63d770c" (UID: "8a54ee6f-662c-4e85-892e-6604b63d770c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:35:37.241373 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.241268    2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8a54ee6f-662c-4e85-892e-6604b63d770c-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 21:35:37.241373 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.241323    2569 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a54ee6f-662c-4e85-892e-6604b63d770c-configmap-metrics-client-ca\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 21:35:37.241373 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.241332    2569 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-secret-kube-rbac-proxy\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 21:35:37.241373 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.241361    2569 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-web-config\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 21:35:37.241373 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.241370    2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8a54ee6f-662c-4e85-892e-6604b63d770c-prometheus-k8s-db\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 21:35:37.241373 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.241379    2569 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-secret-metrics-client-certs\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 21:35:37.241650 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.241387    2569 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-config\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 21:35:37.241650 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.241396    2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 21:35:37.241650 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.241405    2569 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-secret-grpc-tls\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 21:35:37.241650 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.241413    2569 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8a54ee6f-662c-4e85-892e-6604b63d770c-config-out\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 21:35:37.241650 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.241420    2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-secret-prometheus-k8s-tls\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 21:35:37.241650 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.241428    2569 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-thanos-prometheus-http-client-file\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 21:35:37.241650 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.241438    2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8a54ee6f-662c-4e85-892e-6604b63d770c-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 21:35:37.241650 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.241445    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-slx4w\" (UniqueName: \"kubernetes.io/projected/8a54ee6f-662c-4e85-892e-6604b63d770c-kube-api-access-slx4w\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 21:35:37.241650 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.241453    2569 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8a54ee6f-662c-4e85-892e-6604b63d770c-tls-assets\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 21:35:37.241650 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.241462    2569 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a54ee6f-662c-4e85-892e-6604b63d770c-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 21:35:37.241650 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.241472    2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a54ee6f-662c-4e85-892e-6604b63d770c-prometheus-trusted-ca-bundle\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 21:35:37.241650 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.241480    2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8a54ee6f-662c-4e85-892e-6604b63d770c-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 21:35:37.406648 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.406614    2569 generic.go:356] "Generic (PLEG): container finished" podID="8a54ee6f-662c-4e85-892e-6604b63d770c" containerID="4e39c2bcb5200637daa4574ba21f5d3a770f80dd91f9a8e2f98f26632ddd02dc" exitCode=0
Jul 08 21:35:37.406648 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.406639    2569 generic.go:356] "Generic (PLEG): container finished" podID="8a54ee6f-662c-4e85-892e-6604b63d770c" containerID="5d4e1228acf917d94a8ce6b360e215327911e2f2313b8000dcbff2d2b94b7459" exitCode=0
Jul 08 21:35:37.406648 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.406645    2569 generic.go:356] "Generic (PLEG): container finished" podID="8a54ee6f-662c-4e85-892e-6604b63d770c" containerID="1a642b284b02b58850430bfb2d1f92ab95f4ee2762831278f52e0ee9c67ad943" exitCode=0
Jul 08 21:35:37.406648 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.406651    2569 generic.go:356] "Generic (PLEG): container finished" podID="8a54ee6f-662c-4e85-892e-6604b63d770c" containerID="55b702a489d183d4ba51c11803c9aa4dc4c4caca2c9c400a6f47e28f3df28f4e" exitCode=0
Jul 08 21:35:37.406648 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.406656    2569 generic.go:356] "Generic (PLEG): container finished" podID="8a54ee6f-662c-4e85-892e-6604b63d770c" containerID="9218d07be75adc0c9833b4884b69ebef25cd510776aae18c2640815983deedc8" exitCode=0
Jul 08 21:35:37.406648 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.406661    2569 generic.go:356] "Generic (PLEG): container finished" podID="8a54ee6f-662c-4e85-892e-6604b63d770c" containerID="88a124739e4b077efe82db92782138a35999e9922ee2133f613033bdf0143b60" exitCode=0
Jul 08 21:35:37.406949 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.406684    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.406949 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.406698    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a54ee6f-662c-4e85-892e-6604b63d770c","Type":"ContainerDied","Data":"4e39c2bcb5200637daa4574ba21f5d3a770f80dd91f9a8e2f98f26632ddd02dc"}
Jul 08 21:35:37.406949 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.406771    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a54ee6f-662c-4e85-892e-6604b63d770c","Type":"ContainerDied","Data":"5d4e1228acf917d94a8ce6b360e215327911e2f2313b8000dcbff2d2b94b7459"}
Jul 08 21:35:37.406949 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.406801    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a54ee6f-662c-4e85-892e-6604b63d770c","Type":"ContainerDied","Data":"1a642b284b02b58850430bfb2d1f92ab95f4ee2762831278f52e0ee9c67ad943"}
Jul 08 21:35:37.406949 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.406833    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a54ee6f-662c-4e85-892e-6604b63d770c","Type":"ContainerDied","Data":"55b702a489d183d4ba51c11803c9aa4dc4c4caca2c9c400a6f47e28f3df28f4e"}
Jul 08 21:35:37.406949 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.406839    2569 scope.go:117] "RemoveContainer" containerID="4e39c2bcb5200637daa4574ba21f5d3a770f80dd91f9a8e2f98f26632ddd02dc"
Jul 08 21:35:37.406949 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.406872    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a54ee6f-662c-4e85-892e-6604b63d770c","Type":"ContainerDied","Data":"9218d07be75adc0c9833b4884b69ebef25cd510776aae18c2640815983deedc8"}
Jul 08 21:35:37.406949 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.406910    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a54ee6f-662c-4e85-892e-6604b63d770c","Type":"ContainerDied","Data":"88a124739e4b077efe82db92782138a35999e9922ee2133f613033bdf0143b60"}
Jul 08 21:35:37.406949 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.406950    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a54ee6f-662c-4e85-892e-6604b63d770c","Type":"ContainerDied","Data":"374352555efd555e1c04684730f4ff4e41f11c7c45dd724cab6e90fce631af48"}
Jul 08 21:35:37.414830 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.414812    2569 scope.go:117] "RemoveContainer" containerID="5d4e1228acf917d94a8ce6b360e215327911e2f2313b8000dcbff2d2b94b7459"
Jul 08 21:35:37.421418 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.421400    2569 scope.go:117] "RemoveContainer" containerID="1a642b284b02b58850430bfb2d1f92ab95f4ee2762831278f52e0ee9c67ad943"
Jul 08 21:35:37.427541 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.427519    2569 scope.go:117] "RemoveContainer" containerID="55b702a489d183d4ba51c11803c9aa4dc4c4caca2c9c400a6f47e28f3df28f4e"
Jul 08 21:35:37.429593 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.429572    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 21:35:37.434076 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.434054    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 21:35:37.434989 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.434969    2569 scope.go:117] "RemoveContainer" containerID="9218d07be75adc0c9833b4884b69ebef25cd510776aae18c2640815983deedc8"
Jul 08 21:35:37.441455 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.441440    2569 scope.go:117] "RemoveContainer" containerID="88a124739e4b077efe82db92782138a35999e9922ee2133f613033bdf0143b60"
Jul 08 21:35:37.448196 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.448179    2569 scope.go:117] "RemoveContainer" containerID="cdc564494e46ef76137110987e74a6d0573f9c34a50b0ae473704168e4f20dcc"
Jul 08 21:35:37.454250 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.454229    2569 scope.go:117] "RemoveContainer" containerID="4e39c2bcb5200637daa4574ba21f5d3a770f80dd91f9a8e2f98f26632ddd02dc"
Jul 08 21:35:37.454532 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:35:37.454514    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e39c2bcb5200637daa4574ba21f5d3a770f80dd91f9a8e2f98f26632ddd02dc\": container with ID starting with 4e39c2bcb5200637daa4574ba21f5d3a770f80dd91f9a8e2f98f26632ddd02dc not found: ID does not exist" containerID="4e39c2bcb5200637daa4574ba21f5d3a770f80dd91f9a8e2f98f26632ddd02dc"
Jul 08 21:35:37.454589 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.454542    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e39c2bcb5200637daa4574ba21f5d3a770f80dd91f9a8e2f98f26632ddd02dc"} err="failed to get container status \"4e39c2bcb5200637daa4574ba21f5d3a770f80dd91f9a8e2f98f26632ddd02dc\": rpc error: code = NotFound desc = could not find container \"4e39c2bcb5200637daa4574ba21f5d3a770f80dd91f9a8e2f98f26632ddd02dc\": container with ID starting with 4e39c2bcb5200637daa4574ba21f5d3a770f80dd91f9a8e2f98f26632ddd02dc not found: ID does not exist"
Jul 08 21:35:37.454589 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.454559    2569 scope.go:117] "RemoveContainer" containerID="5d4e1228acf917d94a8ce6b360e215327911e2f2313b8000dcbff2d2b94b7459"
Jul 08 21:35:37.454810 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:35:37.454795    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d4e1228acf917d94a8ce6b360e215327911e2f2313b8000dcbff2d2b94b7459\": container with ID starting with 5d4e1228acf917d94a8ce6b360e215327911e2f2313b8000dcbff2d2b94b7459 not found: ID does not exist" containerID="5d4e1228acf917d94a8ce6b360e215327911e2f2313b8000dcbff2d2b94b7459"
Jul 08 21:35:37.454848 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.454814    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d4e1228acf917d94a8ce6b360e215327911e2f2313b8000dcbff2d2b94b7459"} err="failed to get container status \"5d4e1228acf917d94a8ce6b360e215327911e2f2313b8000dcbff2d2b94b7459\": rpc error: code = NotFound desc = could not find container \"5d4e1228acf917d94a8ce6b360e215327911e2f2313b8000dcbff2d2b94b7459\": container with ID starting with 5d4e1228acf917d94a8ce6b360e215327911e2f2313b8000dcbff2d2b94b7459 not found: ID does not exist"
Jul 08 21:35:37.454848 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.454828    2569 scope.go:117] "RemoveContainer" containerID="1a642b284b02b58850430bfb2d1f92ab95f4ee2762831278f52e0ee9c67ad943"
Jul 08 21:35:37.455080 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:35:37.455062    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a642b284b02b58850430bfb2d1f92ab95f4ee2762831278f52e0ee9c67ad943\": container with ID starting with 1a642b284b02b58850430bfb2d1f92ab95f4ee2762831278f52e0ee9c67ad943 not found: ID does not exist" containerID="1a642b284b02b58850430bfb2d1f92ab95f4ee2762831278f52e0ee9c67ad943"
Jul 08 21:35:37.455128 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.455087    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a642b284b02b58850430bfb2d1f92ab95f4ee2762831278f52e0ee9c67ad943"} err="failed to get container status \"1a642b284b02b58850430bfb2d1f92ab95f4ee2762831278f52e0ee9c67ad943\": rpc error: code = NotFound desc = could not find container \"1a642b284b02b58850430bfb2d1f92ab95f4ee2762831278f52e0ee9c67ad943\": container with ID starting with 1a642b284b02b58850430bfb2d1f92ab95f4ee2762831278f52e0ee9c67ad943 not found: ID does not exist"
Jul 08 21:35:37.455128 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.455104    2569 scope.go:117] "RemoveContainer" containerID="55b702a489d183d4ba51c11803c9aa4dc4c4caca2c9c400a6f47e28f3df28f4e"
Jul 08 21:35:37.455354 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:35:37.455339    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55b702a489d183d4ba51c11803c9aa4dc4c4caca2c9c400a6f47e28f3df28f4e\": container with ID starting with 55b702a489d183d4ba51c11803c9aa4dc4c4caca2c9c400a6f47e28f3df28f4e not found: ID does not exist" containerID="55b702a489d183d4ba51c11803c9aa4dc4c4caca2c9c400a6f47e28f3df28f4e"
Jul 08 21:35:37.455402 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.455358    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55b702a489d183d4ba51c11803c9aa4dc4c4caca2c9c400a6f47e28f3df28f4e"} err="failed to get container status \"55b702a489d183d4ba51c11803c9aa4dc4c4caca2c9c400a6f47e28f3df28f4e\": rpc error: code = NotFound desc = could not find container \"55b702a489d183d4ba51c11803c9aa4dc4c4caca2c9c400a6f47e28f3df28f4e\": container with ID starting with 55b702a489d183d4ba51c11803c9aa4dc4c4caca2c9c400a6f47e28f3df28f4e not found: ID does not exist"
Jul 08 21:35:37.455402 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.455371    2569 scope.go:117] "RemoveContainer" containerID="9218d07be75adc0c9833b4884b69ebef25cd510776aae18c2640815983deedc8"
Jul 08 21:35:37.455601 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:35:37.455584    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9218d07be75adc0c9833b4884b69ebef25cd510776aae18c2640815983deedc8\": container with ID starting with 9218d07be75adc0c9833b4884b69ebef25cd510776aae18c2640815983deedc8 not found: ID does not exist" containerID="9218d07be75adc0c9833b4884b69ebef25cd510776aae18c2640815983deedc8"
Jul 08 21:35:37.455644 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.455605    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9218d07be75adc0c9833b4884b69ebef25cd510776aae18c2640815983deedc8"} err="failed to get container status \"9218d07be75adc0c9833b4884b69ebef25cd510776aae18c2640815983deedc8\": rpc error: code = NotFound desc = could not find container \"9218d07be75adc0c9833b4884b69ebef25cd510776aae18c2640815983deedc8\": container with ID starting with 9218d07be75adc0c9833b4884b69ebef25cd510776aae18c2640815983deedc8 not found: ID does not exist"
Jul 08 21:35:37.455644 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.455616    2569 scope.go:117] "RemoveContainer" containerID="88a124739e4b077efe82db92782138a35999e9922ee2133f613033bdf0143b60"
Jul 08 21:35:37.455830 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:35:37.455814    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88a124739e4b077efe82db92782138a35999e9922ee2133f613033bdf0143b60\": container with ID starting with 88a124739e4b077efe82db92782138a35999e9922ee2133f613033bdf0143b60 not found: ID does not exist" containerID="88a124739e4b077efe82db92782138a35999e9922ee2133f613033bdf0143b60"
Jul 08 21:35:37.455873 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.455835    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88a124739e4b077efe82db92782138a35999e9922ee2133f613033bdf0143b60"} err="failed to get container status \"88a124739e4b077efe82db92782138a35999e9922ee2133f613033bdf0143b60\": rpc error: code = NotFound desc = could not find container \"88a124739e4b077efe82db92782138a35999e9922ee2133f613033bdf0143b60\": container with ID starting with 88a124739e4b077efe82db92782138a35999e9922ee2133f613033bdf0143b60 not found: ID does not exist"
Jul 08 21:35:37.455873 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.455850    2569 scope.go:117] "RemoveContainer" containerID="cdc564494e46ef76137110987e74a6d0573f9c34a50b0ae473704168e4f20dcc"
Jul 08 21:35:37.456038 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:35:37.456024    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdc564494e46ef76137110987e74a6d0573f9c34a50b0ae473704168e4f20dcc\": container with ID starting with cdc564494e46ef76137110987e74a6d0573f9c34a50b0ae473704168e4f20dcc not found: ID does not exist" containerID="cdc564494e46ef76137110987e74a6d0573f9c34a50b0ae473704168e4f20dcc"
Jul 08 21:35:37.456081 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.456042    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdc564494e46ef76137110987e74a6d0573f9c34a50b0ae473704168e4f20dcc"} err="failed to get container status \"cdc564494e46ef76137110987e74a6d0573f9c34a50b0ae473704168e4f20dcc\": rpc error: code = NotFound desc = could not find container \"cdc564494e46ef76137110987e74a6d0573f9c34a50b0ae473704168e4f20dcc\": container with ID starting with cdc564494e46ef76137110987e74a6d0573f9c34a50b0ae473704168e4f20dcc not found: ID does not exist"
Jul 08 21:35:37.456081 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.456053    2569 scope.go:117] "RemoveContainer" containerID="4e39c2bcb5200637daa4574ba21f5d3a770f80dd91f9a8e2f98f26632ddd02dc"
Jul 08 21:35:37.456264 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.456250    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e39c2bcb5200637daa4574ba21f5d3a770f80dd91f9a8e2f98f26632ddd02dc"} err="failed to get container status \"4e39c2bcb5200637daa4574ba21f5d3a770f80dd91f9a8e2f98f26632ddd02dc\": rpc error: code = NotFound desc = could not find container \"4e39c2bcb5200637daa4574ba21f5d3a770f80dd91f9a8e2f98f26632ddd02dc\": container with ID starting with 4e39c2bcb5200637daa4574ba21f5d3a770f80dd91f9a8e2f98f26632ddd02dc not found: ID does not exist"
Jul 08 21:35:37.456324 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.456264    2569 scope.go:117] "RemoveContainer" containerID="5d4e1228acf917d94a8ce6b360e215327911e2f2313b8000dcbff2d2b94b7459"
Jul 08 21:35:37.456473 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.456444    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d4e1228acf917d94a8ce6b360e215327911e2f2313b8000dcbff2d2b94b7459"} err="failed to get container status \"5d4e1228acf917d94a8ce6b360e215327911e2f2313b8000dcbff2d2b94b7459\": rpc error: code = NotFound desc = could not find container \"5d4e1228acf917d94a8ce6b360e215327911e2f2313b8000dcbff2d2b94b7459\": container with ID starting with 5d4e1228acf917d94a8ce6b360e215327911e2f2313b8000dcbff2d2b94b7459 not found: ID does not exist"
Jul 08 21:35:37.456473 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.456460    2569 scope.go:117] "RemoveContainer" containerID="1a642b284b02b58850430bfb2d1f92ab95f4ee2762831278f52e0ee9c67ad943"
Jul 08 21:35:37.456661 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.456641    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a642b284b02b58850430bfb2d1f92ab95f4ee2762831278f52e0ee9c67ad943"} err="failed to get container status \"1a642b284b02b58850430bfb2d1f92ab95f4ee2762831278f52e0ee9c67ad943\": rpc error: code = NotFound desc = could not find container \"1a642b284b02b58850430bfb2d1f92ab95f4ee2762831278f52e0ee9c67ad943\": container with ID starting with 1a642b284b02b58850430bfb2d1f92ab95f4ee2762831278f52e0ee9c67ad943 not found: ID does not exist"
Jul 08 21:35:37.456702 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.456663    2569 scope.go:117] "RemoveContainer" containerID="55b702a489d183d4ba51c11803c9aa4dc4c4caca2c9c400a6f47e28f3df28f4e"
Jul 08 21:35:37.456847 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.456828    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55b702a489d183d4ba51c11803c9aa4dc4c4caca2c9c400a6f47e28f3df28f4e"} err="failed to get container status \"55b702a489d183d4ba51c11803c9aa4dc4c4caca2c9c400a6f47e28f3df28f4e\": rpc error: code = NotFound desc = could not find container \"55b702a489d183d4ba51c11803c9aa4dc4c4caca2c9c400a6f47e28f3df28f4e\": container with ID starting with 55b702a489d183d4ba51c11803c9aa4dc4c4caca2c9c400a6f47e28f3df28f4e not found: ID does not exist"
Jul 08 21:35:37.456889 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.456847    2569 scope.go:117] "RemoveContainer" containerID="9218d07be75adc0c9833b4884b69ebef25cd510776aae18c2640815983deedc8"
Jul 08 21:35:37.457029 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.457012    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9218d07be75adc0c9833b4884b69ebef25cd510776aae18c2640815983deedc8"} err="failed to get container status \"9218d07be75adc0c9833b4884b69ebef25cd510776aae18c2640815983deedc8\": rpc error: code = NotFound desc = could not find container \"9218d07be75adc0c9833b4884b69ebef25cd510776aae18c2640815983deedc8\": container with ID starting with 9218d07be75adc0c9833b4884b69ebef25cd510776aae18c2640815983deedc8 not found: ID does not exist"
Jul 08 21:35:37.457077 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.457030    2569 scope.go:117] "RemoveContainer" containerID="88a124739e4b077efe82db92782138a35999e9922ee2133f613033bdf0143b60"
Jul 08 21:35:37.457235 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.457221    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88a124739e4b077efe82db92782138a35999e9922ee2133f613033bdf0143b60"} err="failed to get container status \"88a124739e4b077efe82db92782138a35999e9922ee2133f613033bdf0143b60\": rpc error: code = NotFound desc = could not find container \"88a124739e4b077efe82db92782138a35999e9922ee2133f613033bdf0143b60\": container with ID starting with 88a124739e4b077efe82db92782138a35999e9922ee2133f613033bdf0143b60 not found: ID does not exist"
Jul 08 21:35:37.457280 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.457236    2569 scope.go:117] "RemoveContainer" containerID="cdc564494e46ef76137110987e74a6d0573f9c34a50b0ae473704168e4f20dcc"
Jul 08 21:35:37.457684 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.457653    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdc564494e46ef76137110987e74a6d0573f9c34a50b0ae473704168e4f20dcc"} err="failed to get container status \"cdc564494e46ef76137110987e74a6d0573f9c34a50b0ae473704168e4f20dcc\": rpc error: code = NotFound desc = could not find container \"cdc564494e46ef76137110987e74a6d0573f9c34a50b0ae473704168e4f20dcc\": container with ID starting with cdc564494e46ef76137110987e74a6d0573f9c34a50b0ae473704168e4f20dcc not found: ID does not exist"
Jul 08 21:35:37.457684 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.457676    2569 scope.go:117] "RemoveContainer" containerID="4e39c2bcb5200637daa4574ba21f5d3a770f80dd91f9a8e2f98f26632ddd02dc"
Jul 08 21:35:37.457976 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.457944    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e39c2bcb5200637daa4574ba21f5d3a770f80dd91f9a8e2f98f26632ddd02dc"} err="failed to get container status \"4e39c2bcb5200637daa4574ba21f5d3a770f80dd91f9a8e2f98f26632ddd02dc\": rpc error: code = NotFound desc = could not find container \"4e39c2bcb5200637daa4574ba21f5d3a770f80dd91f9a8e2f98f26632ddd02dc\": container with ID starting with 4e39c2bcb5200637daa4574ba21f5d3a770f80dd91f9a8e2f98f26632ddd02dc not found: ID does not exist"
Jul 08 21:35:37.457976 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.457969    2569 scope.go:117] "RemoveContainer" containerID="5d4e1228acf917d94a8ce6b360e215327911e2f2313b8000dcbff2d2b94b7459"
Jul 08 21:35:37.458257 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.458238    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d4e1228acf917d94a8ce6b360e215327911e2f2313b8000dcbff2d2b94b7459"} err="failed to get container status \"5d4e1228acf917d94a8ce6b360e215327911e2f2313b8000dcbff2d2b94b7459\": rpc error: code = NotFound desc = could not find container \"5d4e1228acf917d94a8ce6b360e215327911e2f2313b8000dcbff2d2b94b7459\": container with ID starting with 5d4e1228acf917d94a8ce6b360e215327911e2f2313b8000dcbff2d2b94b7459 not found: ID does not exist"
Jul 08 21:35:37.458357 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.458259    2569 scope.go:117] "RemoveContainer" containerID="1a642b284b02b58850430bfb2d1f92ab95f4ee2762831278f52e0ee9c67ad943"
Jul 08 21:35:37.458580 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.458562    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a642b284b02b58850430bfb2d1f92ab95f4ee2762831278f52e0ee9c67ad943"} err="failed to get container status \"1a642b284b02b58850430bfb2d1f92ab95f4ee2762831278f52e0ee9c67ad943\": rpc error: code = NotFound desc = could not find container \"1a642b284b02b58850430bfb2d1f92ab95f4ee2762831278f52e0ee9c67ad943\": container with ID starting with 1a642b284b02b58850430bfb2d1f92ab95f4ee2762831278f52e0ee9c67ad943 not found: ID does not exist"
Jul 08 21:35:37.458640 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.458581    2569 scope.go:117] "RemoveContainer" containerID="55b702a489d183d4ba51c11803c9aa4dc4c4caca2c9c400a6f47e28f3df28f4e"
Jul 08 21:35:37.458811 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.458795    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55b702a489d183d4ba51c11803c9aa4dc4c4caca2c9c400a6f47e28f3df28f4e"} err="failed to get container status \"55b702a489d183d4ba51c11803c9aa4dc4c4caca2c9c400a6f47e28f3df28f4e\": rpc error: code = NotFound desc = could not find container \"55b702a489d183d4ba51c11803c9aa4dc4c4caca2c9c400a6f47e28f3df28f4e\": container with ID starting with 55b702a489d183d4ba51c11803c9aa4dc4c4caca2c9c400a6f47e28f3df28f4e not found: ID does not exist"
Jul 08 21:35:37.458859 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.458812    2569 scope.go:117] "RemoveContainer" containerID="9218d07be75adc0c9833b4884b69ebef25cd510776aae18c2640815983deedc8"
Jul 08 21:35:37.459041 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.459022    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 21:35:37.459157 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.459024    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9218d07be75adc0c9833b4884b69ebef25cd510776aae18c2640815983deedc8"} err="failed to get container status \"9218d07be75adc0c9833b4884b69ebef25cd510776aae18c2640815983deedc8\": rpc error: code = NotFound desc = could not find container \"9218d07be75adc0c9833b4884b69ebef25cd510776aae18c2640815983deedc8\": container with ID starting with 9218d07be75adc0c9833b4884b69ebef25cd510776aae18c2640815983deedc8 not found: ID does not exist"
Jul 08 21:35:37.459221 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.459165    2569 scope.go:117] "RemoveContainer" containerID="88a124739e4b077efe82db92782138a35999e9922ee2133f613033bdf0143b60"
Jul 08 21:35:37.459267 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.459225    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a54ee6f-662c-4e85-892e-6604b63d770c" containerName="kube-rbac-proxy"
Jul 08 21:35:37.459267 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.459235    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a54ee6f-662c-4e85-892e-6604b63d770c" containerName="kube-rbac-proxy"
Jul 08 21:35:37.459267 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.459243    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a54ee6f-662c-4e85-892e-6604b63d770c" containerName="config-reloader"
Jul 08 21:35:37.459267 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.459249    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a54ee6f-662c-4e85-892e-6604b63d770c" containerName="config-reloader"
Jul 08 21:35:37.459267 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.459256    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a54ee6f-662c-4e85-892e-6604b63d770c" containerName="kube-rbac-proxy-web"
Jul 08 21:35:37.459267 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.459262    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a54ee6f-662c-4e85-892e-6604b63d770c" containerName="kube-rbac-proxy-web"
Jul 08 21:35:37.459497 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.459273    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2dbdfdb-4d51-44b2-8387-7ebc24441008" containerName="registry"
Jul 08 21:35:37.459497 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.459298    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2dbdfdb-4d51-44b2-8387-7ebc24441008" containerName="registry"
Jul 08 21:35:37.459497 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.459348    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a54ee6f-662c-4e85-892e-6604b63d770c" containerName="init-config-reloader"
Jul 08 21:35:37.459497 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.459358    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a54ee6f-662c-4e85-892e-6604b63d770c" containerName="init-config-reloader"
Jul 08 21:35:37.459497 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.459365    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a54ee6f-662c-4e85-892e-6604b63d770c" containerName="prometheus"
Jul 08 21:35:37.459497 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.459370    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a54ee6f-662c-4e85-892e-6604b63d770c" containerName="prometheus"
Jul 08 21:35:37.459497 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.459378    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a54ee6f-662c-4e85-892e-6604b63d770c" containerName="thanos-sidecar"
Jul 08 21:35:37.459497 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.459383    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a54ee6f-662c-4e85-892e-6604b63d770c" containerName="thanos-sidecar"
Jul 08 21:35:37.459497 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.459388    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a54ee6f-662c-4e85-892e-6604b63d770c" containerName="kube-rbac-proxy-thanos"
Jul 08 21:35:37.459497 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.459395    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a54ee6f-662c-4e85-892e-6604b63d770c" containerName="kube-rbac-proxy-thanos"
Jul 08 21:35:37.459497 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.459413    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88a124739e4b077efe82db92782138a35999e9922ee2133f613033bdf0143b60"} err="failed to get container status \"88a124739e4b077efe82db92782138a35999e9922ee2133f613033bdf0143b60\": rpc error: code = NotFound desc = could not find container \"88a124739e4b077efe82db92782138a35999e9922ee2133f613033bdf0143b60\": container with ID starting with 88a124739e4b077efe82db92782138a35999e9922ee2133f613033bdf0143b60 not found: ID does not exist"
Jul 08 21:35:37.459497 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.459428    2569 scope.go:117] "RemoveContainer" containerID="cdc564494e46ef76137110987e74a6d0573f9c34a50b0ae473704168e4f20dcc"
Jul 08 21:35:37.459497 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.459445    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a54ee6f-662c-4e85-892e-6604b63d770c" containerName="prometheus"
Jul 08 21:35:37.459497 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.459453    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a54ee6f-662c-4e85-892e-6604b63d770c" containerName="kube-rbac-proxy-web"
Jul 08 21:35:37.459497 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.459462    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2dbdfdb-4d51-44b2-8387-7ebc24441008" containerName="registry"
Jul 08 21:35:37.459497 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.459469    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a54ee6f-662c-4e85-892e-6604b63d770c" containerName="config-reloader"
Jul 08 21:35:37.459497 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.459474    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a54ee6f-662c-4e85-892e-6604b63d770c" containerName="kube-rbac-proxy-thanos"
Jul 08 21:35:37.459497 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.459480    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a54ee6f-662c-4e85-892e-6604b63d770c" containerName="thanos-sidecar"
Jul 08 21:35:37.459497 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.459485    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a54ee6f-662c-4e85-892e-6604b63d770c" containerName="kube-rbac-proxy"
Jul 08 21:35:37.460144 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.459654    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdc564494e46ef76137110987e74a6d0573f9c34a50b0ae473704168e4f20dcc"} err="failed to get container status \"cdc564494e46ef76137110987e74a6d0573f9c34a50b0ae473704168e4f20dcc\": rpc error: code = NotFound desc = could not find container \"cdc564494e46ef76137110987e74a6d0573f9c34a50b0ae473704168e4f20dcc\": container with ID starting with cdc564494e46ef76137110987e74a6d0573f9c34a50b0ae473704168e4f20dcc not found: ID does not exist"
Jul 08 21:35:37.460144 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.459676    2569 scope.go:117] "RemoveContainer" containerID="4e39c2bcb5200637daa4574ba21f5d3a770f80dd91f9a8e2f98f26632ddd02dc"
Jul 08 21:35:37.460144 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.459914    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e39c2bcb5200637daa4574ba21f5d3a770f80dd91f9a8e2f98f26632ddd02dc"} err="failed to get container status \"4e39c2bcb5200637daa4574ba21f5d3a770f80dd91f9a8e2f98f26632ddd02dc\": rpc error: code = NotFound desc = could not find container \"4e39c2bcb5200637daa4574ba21f5d3a770f80dd91f9a8e2f98f26632ddd02dc\": container with ID starting with 4e39c2bcb5200637daa4574ba21f5d3a770f80dd91f9a8e2f98f26632ddd02dc not found: ID does not exist"
Jul 08 21:35:37.460144 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.459936    2569 scope.go:117] "RemoveContainer" containerID="5d4e1228acf917d94a8ce6b360e215327911e2f2313b8000dcbff2d2b94b7459"
Jul 08 21:35:37.460275 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.460140    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d4e1228acf917d94a8ce6b360e215327911e2f2313b8000dcbff2d2b94b7459"} err="failed to get container status \"5d4e1228acf917d94a8ce6b360e215327911e2f2313b8000dcbff2d2b94b7459\": rpc error: code = NotFound desc = could not find container \"5d4e1228acf917d94a8ce6b360e215327911e2f2313b8000dcbff2d2b94b7459\": container with ID starting with 5d4e1228acf917d94a8ce6b360e215327911e2f2313b8000dcbff2d2b94b7459 not found: ID does not exist"
Jul 08 21:35:37.460275 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.460159    2569 scope.go:117] "RemoveContainer" containerID="1a642b284b02b58850430bfb2d1f92ab95f4ee2762831278f52e0ee9c67ad943"
Jul 08 21:35:37.460441 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.460425    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a642b284b02b58850430bfb2d1f92ab95f4ee2762831278f52e0ee9c67ad943"} err="failed to get container status \"1a642b284b02b58850430bfb2d1f92ab95f4ee2762831278f52e0ee9c67ad943\": rpc error: code = NotFound desc = could not find container \"1a642b284b02b58850430bfb2d1f92ab95f4ee2762831278f52e0ee9c67ad943\": container with ID starting with 1a642b284b02b58850430bfb2d1f92ab95f4ee2762831278f52e0ee9c67ad943 not found: ID does not exist"
Jul 08 21:35:37.460484 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.460443    2569 scope.go:117] "RemoveContainer" containerID="55b702a489d183d4ba51c11803c9aa4dc4c4caca2c9c400a6f47e28f3df28f4e"
Jul 08 21:35:37.460683 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.460666    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55b702a489d183d4ba51c11803c9aa4dc4c4caca2c9c400a6f47e28f3df28f4e"} err="failed to get container status \"55b702a489d183d4ba51c11803c9aa4dc4c4caca2c9c400a6f47e28f3df28f4e\": rpc error: code = NotFound desc = could not find container \"55b702a489d183d4ba51c11803c9aa4dc4c4caca2c9c400a6f47e28f3df28f4e\": container with ID starting with 55b702a489d183d4ba51c11803c9aa4dc4c4caca2c9c400a6f47e28f3df28f4e not found: ID does not exist"
Jul 08 21:35:37.460744 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.460685    2569 scope.go:117] "RemoveContainer" containerID="9218d07be75adc0c9833b4884b69ebef25cd510776aae18c2640815983deedc8"
Jul 08 21:35:37.460907 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.460890    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9218d07be75adc0c9833b4884b69ebef25cd510776aae18c2640815983deedc8"} err="failed to get container status \"9218d07be75adc0c9833b4884b69ebef25cd510776aae18c2640815983deedc8\": rpc error: code = NotFound desc = could not find container \"9218d07be75adc0c9833b4884b69ebef25cd510776aae18c2640815983deedc8\": container with ID starting with 9218d07be75adc0c9833b4884b69ebef25cd510776aae18c2640815983deedc8 not found: ID does not exist"
Jul 08 21:35:37.460973 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.460908    2569 scope.go:117] "RemoveContainer" containerID="88a124739e4b077efe82db92782138a35999e9922ee2133f613033bdf0143b60"
Jul 08 21:35:37.461117 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.461102    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88a124739e4b077efe82db92782138a35999e9922ee2133f613033bdf0143b60"} err="failed to get container status \"88a124739e4b077efe82db92782138a35999e9922ee2133f613033bdf0143b60\": rpc error: code = NotFound desc = could not find container \"88a124739e4b077efe82db92782138a35999e9922ee2133f613033bdf0143b60\": container with ID starting with 88a124739e4b077efe82db92782138a35999e9922ee2133f613033bdf0143b60 not found: ID does not exist"
Jul 08 21:35:37.461181 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.461118    2569 scope.go:117] "RemoveContainer" containerID="cdc564494e46ef76137110987e74a6d0573f9c34a50b0ae473704168e4f20dcc"
Jul 08 21:35:37.461382 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.461363    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdc564494e46ef76137110987e74a6d0573f9c34a50b0ae473704168e4f20dcc"} err="failed to get container status \"cdc564494e46ef76137110987e74a6d0573f9c34a50b0ae473704168e4f20dcc\": rpc error: code = NotFound desc = could not find container \"cdc564494e46ef76137110987e74a6d0573f9c34a50b0ae473704168e4f20dcc\": container with ID starting with cdc564494e46ef76137110987e74a6d0573f9c34a50b0ae473704168e4f20dcc not found: ID does not exist"
Jul 08 21:35:37.461424 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.461382    2569 scope.go:117] "RemoveContainer" containerID="4e39c2bcb5200637daa4574ba21f5d3a770f80dd91f9a8e2f98f26632ddd02dc"
Jul 08 21:35:37.466473 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.462148    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e39c2bcb5200637daa4574ba21f5d3a770f80dd91f9a8e2f98f26632ddd02dc"} err="failed to get container status \"4e39c2bcb5200637daa4574ba21f5d3a770f80dd91f9a8e2f98f26632ddd02dc\": rpc error: code = NotFound desc = could not find container \"4e39c2bcb5200637daa4574ba21f5d3a770f80dd91f9a8e2f98f26632ddd02dc\": container with ID starting with 4e39c2bcb5200637daa4574ba21f5d3a770f80dd91f9a8e2f98f26632ddd02dc not found: ID does not exist"
Jul 08 21:35:37.466473 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.462192    2569 scope.go:117] "RemoveContainer" containerID="5d4e1228acf917d94a8ce6b360e215327911e2f2313b8000dcbff2d2b94b7459"
Jul 08 21:35:37.466931 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.466884    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.467887 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.467608    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d4e1228acf917d94a8ce6b360e215327911e2f2313b8000dcbff2d2b94b7459"} err="failed to get container status \"5d4e1228acf917d94a8ce6b360e215327911e2f2313b8000dcbff2d2b94b7459\": rpc error: code = NotFound desc = could not find container \"5d4e1228acf917d94a8ce6b360e215327911e2f2313b8000dcbff2d2b94b7459\": container with ID starting with 5d4e1228acf917d94a8ce6b360e215327911e2f2313b8000dcbff2d2b94b7459 not found: ID does not exist"
Jul 08 21:35:37.467887 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.467640    2569 scope.go:117] "RemoveContainer" containerID="1a642b284b02b58850430bfb2d1f92ab95f4ee2762831278f52e0ee9c67ad943"
Jul 08 21:35:37.468252 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.468098    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a642b284b02b58850430bfb2d1f92ab95f4ee2762831278f52e0ee9c67ad943"} err="failed to get container status \"1a642b284b02b58850430bfb2d1f92ab95f4ee2762831278f52e0ee9c67ad943\": rpc error: code = NotFound desc = could not find container \"1a642b284b02b58850430bfb2d1f92ab95f4ee2762831278f52e0ee9c67ad943\": container with ID starting with 1a642b284b02b58850430bfb2d1f92ab95f4ee2762831278f52e0ee9c67ad943 not found: ID does not exist"
Jul 08 21:35:37.468252 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.468150    2569 scope.go:117] "RemoveContainer" containerID="55b702a489d183d4ba51c11803c9aa4dc4c4caca2c9c400a6f47e28f3df28f4e"
Jul 08 21:35:37.468548 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.468511    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55b702a489d183d4ba51c11803c9aa4dc4c4caca2c9c400a6f47e28f3df28f4e"} err="failed to get container status \"55b702a489d183d4ba51c11803c9aa4dc4c4caca2c9c400a6f47e28f3df28f4e\": rpc error: code = NotFound desc = could not find container \"55b702a489d183d4ba51c11803c9aa4dc4c4caca2c9c400a6f47e28f3df28f4e\": container with ID starting with 55b702a489d183d4ba51c11803c9aa4dc4c4caca2c9c400a6f47e28f3df28f4e not found: ID does not exist"
Jul 08 21:35:37.468548 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.468530    2569 scope.go:117] "RemoveContainer" containerID="9218d07be75adc0c9833b4884b69ebef25cd510776aae18c2640815983deedc8"
Jul 08 21:35:37.468769 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.468750    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9218d07be75adc0c9833b4884b69ebef25cd510776aae18c2640815983deedc8"} err="failed to get container status \"9218d07be75adc0c9833b4884b69ebef25cd510776aae18c2640815983deedc8\": rpc error: code = NotFound desc = could not find container \"9218d07be75adc0c9833b4884b69ebef25cd510776aae18c2640815983deedc8\": container with ID starting with 9218d07be75adc0c9833b4884b69ebef25cd510776aae18c2640815983deedc8 not found: ID does not exist"
Jul 08 21:35:37.468849 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.468769    2569 scope.go:117] "RemoveContainer" containerID="88a124739e4b077efe82db92782138a35999e9922ee2133f613033bdf0143b60"
Jul 08 21:35:37.468974 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.468958    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88a124739e4b077efe82db92782138a35999e9922ee2133f613033bdf0143b60"} err="failed to get container status \"88a124739e4b077efe82db92782138a35999e9922ee2133f613033bdf0143b60\": rpc error: code = NotFound desc = could not find container \"88a124739e4b077efe82db92782138a35999e9922ee2133f613033bdf0143b60\": container with ID starting with 88a124739e4b077efe82db92782138a35999e9922ee2133f613033bdf0143b60 not found: ID does not exist"
Jul 08 21:35:37.469036 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.468976    2569 scope.go:117] "RemoveContainer" containerID="cdc564494e46ef76137110987e74a6d0573f9c34a50b0ae473704168e4f20dcc"
Jul 08 21:35:37.469227 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.469208    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdc564494e46ef76137110987e74a6d0573f9c34a50b0ae473704168e4f20dcc"} err="failed to get container status \"cdc564494e46ef76137110987e74a6d0573f9c34a50b0ae473704168e4f20dcc\": rpc error: code = NotFound desc = could not find container \"cdc564494e46ef76137110987e74a6d0573f9c34a50b0ae473704168e4f20dcc\": container with ID starting with cdc564494e46ef76137110987e74a6d0573f9c34a50b0ae473704168e4f20dcc not found: ID does not exist"
Jul 08 21:35:37.469276 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.469229    2569 scope.go:117] "RemoveContainer" containerID="4e39c2bcb5200637daa4574ba21f5d3a770f80dd91f9a8e2f98f26632ddd02dc"
Jul 08 21:35:37.469478 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.469457    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e39c2bcb5200637daa4574ba21f5d3a770f80dd91f9a8e2f98f26632ddd02dc"} err="failed to get container status \"4e39c2bcb5200637daa4574ba21f5d3a770f80dd91f9a8e2f98f26632ddd02dc\": rpc error: code = NotFound desc = could not find container \"4e39c2bcb5200637daa4574ba21f5d3a770f80dd91f9a8e2f98f26632ddd02dc\": container with ID starting with 4e39c2bcb5200637daa4574ba21f5d3a770f80dd91f9a8e2f98f26632ddd02dc not found: ID does not exist"
Jul 08 21:35:37.469526 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.469479    2569 scope.go:117] "RemoveContainer" containerID="5d4e1228acf917d94a8ce6b360e215327911e2f2313b8000dcbff2d2b94b7459"
Jul 08 21:35:37.469799 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.469771    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d4e1228acf917d94a8ce6b360e215327911e2f2313b8000dcbff2d2b94b7459"} err="failed to get container status \"5d4e1228acf917d94a8ce6b360e215327911e2f2313b8000dcbff2d2b94b7459\": rpc error: code = NotFound desc = could not find container \"5d4e1228acf917d94a8ce6b360e215327911e2f2313b8000dcbff2d2b94b7459\": container with ID starting with 5d4e1228acf917d94a8ce6b360e215327911e2f2313b8000dcbff2d2b94b7459 not found: ID does not exist"
Jul 08 21:35:37.469861 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.469802    2569 scope.go:117] "RemoveContainer" containerID="1a642b284b02b58850430bfb2d1f92ab95f4ee2762831278f52e0ee9c67ad943"
Jul 08 21:35:37.470114 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.470078    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a642b284b02b58850430bfb2d1f92ab95f4ee2762831278f52e0ee9c67ad943"} err="failed to get container status \"1a642b284b02b58850430bfb2d1f92ab95f4ee2762831278f52e0ee9c67ad943\": rpc error: code = NotFound desc = could not find container \"1a642b284b02b58850430bfb2d1f92ab95f4ee2762831278f52e0ee9c67ad943\": container with ID starting with 1a642b284b02b58850430bfb2d1f92ab95f4ee2762831278f52e0ee9c67ad943 not found: ID does not exist"
Jul 08 21:35:37.470218 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.470116    2569 scope.go:117] "RemoveContainer" containerID="55b702a489d183d4ba51c11803c9aa4dc4c4caca2c9c400a6f47e28f3df28f4e"
Jul 08 21:35:37.470280 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.470246    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 08 21:35:37.470280 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.470270    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 08 21:35:37.470422 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.470352    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 08 21:35:37.470545 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.470525    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 08 21:35:37.470647 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.470552    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55b702a489d183d4ba51c11803c9aa4dc4c4caca2c9c400a6f47e28f3df28f4e"} err="failed to get container status \"55b702a489d183d4ba51c11803c9aa4dc4c4caca2c9c400a6f47e28f3df28f4e\": rpc error: code = NotFound desc = could not find container \"55b702a489d183d4ba51c11803c9aa4dc4c4caca2c9c400a6f47e28f3df28f4e\": container with ID starting with 55b702a489d183d4ba51c11803c9aa4dc4c4caca2c9c400a6f47e28f3df28f4e not found: ID does not exist"
Jul 08 21:35:37.470647 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.470578    2569 scope.go:117] "RemoveContainer" containerID="9218d07be75adc0c9833b4884b69ebef25cd510776aae18c2640815983deedc8"
Jul 08 21:35:37.470771 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.470673    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 08 21:35:37.470823 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.470782    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-mrmqm\""
Jul 08 21:35:37.470939 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.470907    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9218d07be75adc0c9833b4884b69ebef25cd510776aae18c2640815983deedc8"} err="failed to get container status \"9218d07be75adc0c9833b4884b69ebef25cd510776aae18c2640815983deedc8\": rpc error: code = NotFound desc = could not find container \"9218d07be75adc0c9833b4884b69ebef25cd510776aae18c2640815983deedc8\": container with ID starting with 9218d07be75adc0c9833b4884b69ebef25cd510776aae18c2640815983deedc8 not found: ID does not exist"
Jul 08 21:35:37.470939 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.470936    2569 scope.go:117] "RemoveContainer" containerID="88a124739e4b077efe82db92782138a35999e9922ee2133f613033bdf0143b60"
Jul 08 21:35:37.471064 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.470947    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 08 21:35:37.471064 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.470948    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 08 21:35:37.471064 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.470971    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 08 21:35:37.471064 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.471008    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 08 21:35:37.471064 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.471044    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 08 21:35:37.471064 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.471058    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 08 21:35:37.471375 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.471129    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 08 21:35:37.471375 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.471241    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 08 21:35:37.471375 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.471271    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-c395s6nkodia2\""
Jul 08 21:35:37.471973 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.471938    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88a124739e4b077efe82db92782138a35999e9922ee2133f613033bdf0143b60"} err="failed to get container status \"88a124739e4b077efe82db92782138a35999e9922ee2133f613033bdf0143b60\": rpc error: code = NotFound desc = could not find container \"88a124739e4b077efe82db92782138a35999e9922ee2133f613033bdf0143b60\": container with ID starting with 88a124739e4b077efe82db92782138a35999e9922ee2133f613033bdf0143b60 not found: ID does not exist"
Jul 08 21:35:37.471973 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.471969    2569 scope.go:117] "RemoveContainer" containerID="cdc564494e46ef76137110987e74a6d0573f9c34a50b0ae473704168e4f20dcc"
Jul 08 21:35:37.472353 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.472302    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdc564494e46ef76137110987e74a6d0573f9c34a50b0ae473704168e4f20dcc"} err="failed to get container status \"cdc564494e46ef76137110987e74a6d0573f9c34a50b0ae473704168e4f20dcc\": rpc error: code = NotFound desc = could not find container \"cdc564494e46ef76137110987e74a6d0573f9c34a50b0ae473704168e4f20dcc\": container with ID starting with cdc564494e46ef76137110987e74a6d0573f9c34a50b0ae473704168e4f20dcc not found: ID does not exist"
Jul 08 21:35:37.473436 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.473416    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 08 21:35:37.476489 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.476399    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 08 21:35:37.479081 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.479059    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 21:35:37.612169 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.612134    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a54ee6f-662c-4e85-892e-6604b63d770c" path="/var/lib/kubelet/pods/8a54ee6f-662c-4e85-892e-6604b63d770c/volumes"
Jul 08 21:35:37.644776 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.644745    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/616cabd0-d6cc-4d63-bb79-b17309267714-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.644921 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.644779    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/616cabd0-d6cc-4d63-bb79-b17309267714-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.644921 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.644801    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/616cabd0-d6cc-4d63-bb79-b17309267714-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.644921 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.644825    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/616cabd0-d6cc-4d63-bb79-b17309267714-config-out\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.644921 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.644879    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/616cabd0-d6cc-4d63-bb79-b17309267714-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.644921 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.644912    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/616cabd0-d6cc-4d63-bb79-b17309267714-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.645182 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.644953    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfl8x\" (UniqueName: \"kubernetes.io/projected/616cabd0-d6cc-4d63-bb79-b17309267714-kube-api-access-rfl8x\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.645182 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.644990    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/616cabd0-d6cc-4d63-bb79-b17309267714-config\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.645182 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.645010    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/616cabd0-d6cc-4d63-bb79-b17309267714-web-config\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.645182 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.645029    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/616cabd0-d6cc-4d63-bb79-b17309267714-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.645182 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.645069    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/616cabd0-d6cc-4d63-bb79-b17309267714-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.645182 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.645091    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/616cabd0-d6cc-4d63-bb79-b17309267714-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.645182 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.645112    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/616cabd0-d6cc-4d63-bb79-b17309267714-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.645182 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.645132    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/616cabd0-d6cc-4d63-bb79-b17309267714-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.645182 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.645146    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/616cabd0-d6cc-4d63-bb79-b17309267714-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.645182 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.645165    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/616cabd0-d6cc-4d63-bb79-b17309267714-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.645182 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.645183    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/616cabd0-d6cc-4d63-bb79-b17309267714-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.645591 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.645227    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/616cabd0-d6cc-4d63-bb79-b17309267714-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.645591 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.645313    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/616cabd0-d6cc-4d63-bb79-b17309267714-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.645591 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.645339    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/616cabd0-d6cc-4d63-bb79-b17309267714-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.746200 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.746163    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/616cabd0-d6cc-4d63-bb79-b17309267714-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.746612 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.746205    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/616cabd0-d6cc-4d63-bb79-b17309267714-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.746612 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.746221    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/616cabd0-d6cc-4d63-bb79-b17309267714-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.746612 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.746236    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/616cabd0-d6cc-4d63-bb79-b17309267714-config-out\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.746612 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.746359    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/616cabd0-d6cc-4d63-bb79-b17309267714-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.746612 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.746397    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/616cabd0-d6cc-4d63-bb79-b17309267714-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.746612 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.746419    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfl8x\" (UniqueName: \"kubernetes.io/projected/616cabd0-d6cc-4d63-bb79-b17309267714-kube-api-access-rfl8x\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.746612 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.746449    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/616cabd0-d6cc-4d63-bb79-b17309267714-config\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.746612 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.746475    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/616cabd0-d6cc-4d63-bb79-b17309267714-web-config\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.746612 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.746503    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/616cabd0-d6cc-4d63-bb79-b17309267714-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.746612 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.746535    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/616cabd0-d6cc-4d63-bb79-b17309267714-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.746612 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.746565    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/616cabd0-d6cc-4d63-bb79-b17309267714-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.746612 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.746596    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/616cabd0-d6cc-4d63-bb79-b17309267714-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.747198 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.746628    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/616cabd0-d6cc-4d63-bb79-b17309267714-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.747198 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.746653    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/616cabd0-d6cc-4d63-bb79-b17309267714-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.747198 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.746680    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/616cabd0-d6cc-4d63-bb79-b17309267714-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.747198 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.746707    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/616cabd0-d6cc-4d63-bb79-b17309267714-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.747198 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.746731    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/616cabd0-d6cc-4d63-bb79-b17309267714-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.747198 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.746762    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/616cabd0-d6cc-4d63-bb79-b17309267714-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.747198 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.747092    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/616cabd0-d6cc-4d63-bb79-b17309267714-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.747198 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.747165    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/616cabd0-d6cc-4d63-bb79-b17309267714-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.747632 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.747336    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/616cabd0-d6cc-4d63-bb79-b17309267714-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.748226 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.747928    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/616cabd0-d6cc-4d63-bb79-b17309267714-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.748226 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.747984    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/616cabd0-d6cc-4d63-bb79-b17309267714-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.748226 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.748025    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/616cabd0-d6cc-4d63-bb79-b17309267714-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.748475 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.748331    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/616cabd0-d6cc-4d63-bb79-b17309267714-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.749920 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.749722    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/616cabd0-d6cc-4d63-bb79-b17309267714-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.749920 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.749792    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/616cabd0-d6cc-4d63-bb79-b17309267714-config-out\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.749920 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.749830    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/616cabd0-d6cc-4d63-bb79-b17309267714-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.750671 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.750649    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/616cabd0-d6cc-4d63-bb79-b17309267714-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.751100 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.751044    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/616cabd0-d6cc-4d63-bb79-b17309267714-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.751100 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.751054    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/616cabd0-d6cc-4d63-bb79-b17309267714-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.751600 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.751576    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/616cabd0-d6cc-4d63-bb79-b17309267714-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.751901 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.751879    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/616cabd0-d6cc-4d63-bb79-b17309267714-web-config\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.751993 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.751944    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/616cabd0-d6cc-4d63-bb79-b17309267714-config\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.752708 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.752668    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/616cabd0-d6cc-4d63-bb79-b17309267714-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.752902 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.752884    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/616cabd0-d6cc-4d63-bb79-b17309267714-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.753013 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.752994    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/616cabd0-d6cc-4d63-bb79-b17309267714-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.753073 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.753059    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/616cabd0-d6cc-4d63-bb79-b17309267714-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.755400 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.755370    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfl8x\" (UniqueName: \"kubernetes.io/projected/616cabd0-d6cc-4d63-bb79-b17309267714-kube-api-access-rfl8x\") pod \"prometheus-k8s-0\" (UID: \"616cabd0-d6cc-4d63-bb79-b17309267714\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.780272 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.780244    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:35:37.917838 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:37.917808    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 21:35:37.921679 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:35:37.921655    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod616cabd0_d6cc_4d63_bb79_b17309267714.slice/crio-1b706858444f1909aff21fa82676241c132670edda81d62a63b0bf94eb45dd0a WatchSource:0}: Error finding container 1b706858444f1909aff21fa82676241c132670edda81d62a63b0bf94eb45dd0a: Status 404 returned error can't find the container with id 1b706858444f1909aff21fa82676241c132670edda81d62a63b0bf94eb45dd0a
Jul 08 21:35:38.412030 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:38.411997    2569 generic.go:356] "Generic (PLEG): container finished" podID="616cabd0-d6cc-4d63-bb79-b17309267714" containerID="228359b8fdd9a3e840067cbcfa9569c7ba3ff40a604d06e187912546f8eb8471" exitCode=0
Jul 08 21:35:38.412230 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:38.412092    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"616cabd0-d6cc-4d63-bb79-b17309267714","Type":"ContainerDied","Data":"228359b8fdd9a3e840067cbcfa9569c7ba3ff40a604d06e187912546f8eb8471"}
Jul 08 21:35:38.412230 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:38.412157    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"616cabd0-d6cc-4d63-bb79-b17309267714","Type":"ContainerStarted","Data":"1b706858444f1909aff21fa82676241c132670edda81d62a63b0bf94eb45dd0a"}
Jul 08 21:35:39.420117 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:39.420082    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"616cabd0-d6cc-4d63-bb79-b17309267714","Type":"ContainerStarted","Data":"3e45f52b348054370b7874abd7cba8b1b86a263476210c5d3c16594425c9f24d"}
Jul 08 21:35:39.420495 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:39.420148    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"616cabd0-d6cc-4d63-bb79-b17309267714","Type":"ContainerStarted","Data":"21640ce4bcf1f061df9ebf146fd9be9c498bd5233e9f0878aec820f9ea42c72f"}
Jul 08 21:35:39.420495 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:39.420175    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"616cabd0-d6cc-4d63-bb79-b17309267714","Type":"ContainerStarted","Data":"ec87efb131bc5bdb5fb7afdf97d5f7156a1b858829f2d7dac1775c123e2312c5"}
Jul 08 21:35:39.420495 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:39.420200    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"616cabd0-d6cc-4d63-bb79-b17309267714","Type":"ContainerStarted","Data":"bb12d64cd4e7cabbb0b8ec37e1159f12ed56580f9a1fe0b19b4656da469d570b"}
Jul 08 21:35:39.420495 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:39.420224    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"616cabd0-d6cc-4d63-bb79-b17309267714","Type":"ContainerStarted","Data":"cc1c9a6cc906b8bb15f524ba1e327b85de8b92b093a0849142c6f3cfe2440b7f"}
Jul 08 21:35:39.420495 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:39.420246    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"616cabd0-d6cc-4d63-bb79-b17309267714","Type":"ContainerStarted","Data":"8deba61b99e7d4238a21b0639e7b3bf6820a6ba2499d3b559793065c5bc41cd1"}
Jul 08 21:35:39.448794 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:39.448741    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.430391688 podStartE2EDuration="2.448723303s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.331615ms" isStatefulPod=false podCreationTimestamp="2026-07-08 21:35:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:35:39.44622661 +0000 UTC m=+162.384559021" watchObservedRunningTime="2026-07-08 21:35:39.448723303 +0000 UTC m=+162.387055702"
Jul 08 21:35:42.780375 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:35:42.780333    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:36:37.780638 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:36:37.780603    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:36:37.796228 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:36:37.796198    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:36:38.641646 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:36:38.641617    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 21:37:57.475303 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:37:57.475257    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6cs4g_a022d640-79f0-4d35-be9a-9c6ac708d10b/ovn-acl-logging/0.log"
Jul 08 21:37:57.478139 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:37:57.478118    2569 kubelet.go:1648] "Image garbage collection succeeded"
Jul 08 21:37:57.486164 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:37:57.486140    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6cs4g_a022d640-79f0-4d35-be9a-9c6ac708d10b/ovn-acl-logging/0.log"
Jul 08 21:40:35.394099 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:40:35.394021    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-697f9f6747-j4fkf"]
Jul 08 21:40:35.396181 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:40:35.396166    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-697f9f6747-j4fkf"
Jul 08 21:40:35.402339 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:40:35.402310    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 08 21:40:35.402492 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:40:35.402454    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jnwhn\""
Jul 08 21:40:35.402571 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:40:35.402398    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 08 21:40:35.402571 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:40:35.402408    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 08 21:40:35.402683 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:40:35.402358    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 08 21:40:35.411850 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:40:35.411823    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-697f9f6747-j4fkf"]
Jul 08 21:40:35.460766 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:40:35.460733    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/311e0f15-cd19-4f00-9770-2c15217b7c1f-manifests\") pod \"opendatahub-operator-controller-manager-697f9f6747-j4fkf\" (UID: \"311e0f15-cd19-4f00-9770-2c15217b7c1f\") " pod="opendatahub/opendatahub-operator-controller-manager-697f9f6747-j4fkf"
Jul 08 21:40:35.460766 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:40:35.460764    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/311e0f15-cd19-4f00-9770-2c15217b7c1f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-697f9f6747-j4fkf\" (UID: \"311e0f15-cd19-4f00-9770-2c15217b7c1f\") " pod="opendatahub/opendatahub-operator-controller-manager-697f9f6747-j4fkf"
Jul 08 21:40:35.460979 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:40:35.460802    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxwn9\" (UniqueName: \"kubernetes.io/projected/311e0f15-cd19-4f00-9770-2c15217b7c1f-kube-api-access-gxwn9\") pod \"opendatahub-operator-controller-manager-697f9f6747-j4fkf\" (UID: \"311e0f15-cd19-4f00-9770-2c15217b7c1f\") " pod="opendatahub/opendatahub-operator-controller-manager-697f9f6747-j4fkf"
Jul 08 21:40:35.460979 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:40:35.460845    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/311e0f15-cd19-4f00-9770-2c15217b7c1f-tmp\") pod \"opendatahub-operator-controller-manager-697f9f6747-j4fkf\" (UID: \"311e0f15-cd19-4f00-9770-2c15217b7c1f\") " pod="opendatahub/opendatahub-operator-controller-manager-697f9f6747-j4fkf"
Jul 08 21:40:35.460979 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:40:35.460866    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/311e0f15-cd19-4f00-9770-2c15217b7c1f-webhook-cert\") pod \"opendatahub-operator-controller-manager-697f9f6747-j4fkf\" (UID: \"311e0f15-cd19-4f00-9770-2c15217b7c1f\") " pod="opendatahub/opendatahub-operator-controller-manager-697f9f6747-j4fkf"
Jul 08 21:40:35.562068 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:40:35.562032    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/311e0f15-cd19-4f00-9770-2c15217b7c1f-manifests\") pod \"opendatahub-operator-controller-manager-697f9f6747-j4fkf\" (UID: \"311e0f15-cd19-4f00-9770-2c15217b7c1f\") " pod="opendatahub/opendatahub-operator-controller-manager-697f9f6747-j4fkf"
Jul 08 21:40:35.562239 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:40:35.562074    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/311e0f15-cd19-4f00-9770-2c15217b7c1f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-697f9f6747-j4fkf\" (UID: \"311e0f15-cd19-4f00-9770-2c15217b7c1f\") " pod="opendatahub/opendatahub-operator-controller-manager-697f9f6747-j4fkf"
Jul 08 21:40:35.562239 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:40:35.562106    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxwn9\" (UniqueName: \"kubernetes.io/projected/311e0f15-cd19-4f00-9770-2c15217b7c1f-kube-api-access-gxwn9\") pod \"opendatahub-operator-controller-manager-697f9f6747-j4fkf\" (UID: \"311e0f15-cd19-4f00-9770-2c15217b7c1f\") " pod="opendatahub/opendatahub-operator-controller-manager-697f9f6747-j4fkf"
Jul 08 21:40:35.562239 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:40:35.562136    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/311e0f15-cd19-4f00-9770-2c15217b7c1f-tmp\") pod \"opendatahub-operator-controller-manager-697f9f6747-j4fkf\" (UID: \"311e0f15-cd19-4f00-9770-2c15217b7c1f\") " pod="opendatahub/opendatahub-operator-controller-manager-697f9f6747-j4fkf"
Jul 08 21:40:35.562239 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:40:35.562158    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/311e0f15-cd19-4f00-9770-2c15217b7c1f-webhook-cert\") pod \"opendatahub-operator-controller-manager-697f9f6747-j4fkf\" (UID: \"311e0f15-cd19-4f00-9770-2c15217b7c1f\") " pod="opendatahub/opendatahub-operator-controller-manager-697f9f6747-j4fkf"
Jul 08 21:40:35.562536 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:40:35.562510    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/311e0f15-cd19-4f00-9770-2c15217b7c1f-manifests\") pod \"opendatahub-operator-controller-manager-697f9f6747-j4fkf\" (UID: \"311e0f15-cd19-4f00-9770-2c15217b7c1f\") " pod="opendatahub/opendatahub-operator-controller-manager-697f9f6747-j4fkf"
Jul 08 21:40:35.564551 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:40:35.564522    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/311e0f15-cd19-4f00-9770-2c15217b7c1f-tmp\") pod \"opendatahub-operator-controller-manager-697f9f6747-j4fkf\" (UID: \"311e0f15-cd19-4f00-9770-2c15217b7c1f\") " pod="opendatahub/opendatahub-operator-controller-manager-697f9f6747-j4fkf"
Jul 08 21:40:35.564755 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:40:35.564740    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/311e0f15-cd19-4f00-9770-2c15217b7c1f-webhook-cert\") pod \"opendatahub-operator-controller-manager-697f9f6747-j4fkf\" (UID: \"311e0f15-cd19-4f00-9770-2c15217b7c1f\") " pod="opendatahub/opendatahub-operator-controller-manager-697f9f6747-j4fkf"
Jul 08 21:40:35.564800 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:40:35.564784    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/311e0f15-cd19-4f00-9770-2c15217b7c1f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-697f9f6747-j4fkf\" (UID: \"311e0f15-cd19-4f00-9770-2c15217b7c1f\") " pod="opendatahub/opendatahub-operator-controller-manager-697f9f6747-j4fkf"
Jul 08 21:40:35.583198 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:40:35.583175    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxwn9\" (UniqueName: \"kubernetes.io/projected/311e0f15-cd19-4f00-9770-2c15217b7c1f-kube-api-access-gxwn9\") pod \"opendatahub-operator-controller-manager-697f9f6747-j4fkf\" (UID: \"311e0f15-cd19-4f00-9770-2c15217b7c1f\") " pod="opendatahub/opendatahub-operator-controller-manager-697f9f6747-j4fkf"
Jul 08 21:40:35.712751 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:40:35.712654    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-697f9f6747-j4fkf"
Jul 08 21:40:35.847451 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:40:35.847420    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-697f9f6747-j4fkf"]
Jul 08 21:40:35.849590 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:40:35.849566    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod311e0f15_cd19_4f00_9770_2c15217b7c1f.slice/crio-60f88115d700f7e897d903426a9aae7a305ecf6010a9e0861923c0176ab0421b WatchSource:0}: Error finding container 60f88115d700f7e897d903426a9aae7a305ecf6010a9e0861923c0176ab0421b: Status 404 returned error can't find the container with id 60f88115d700f7e897d903426a9aae7a305ecf6010a9e0861923c0176ab0421b
Jul 08 21:40:35.851326 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:40:35.851308    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 21:40:36.425672 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:40:36.425636    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-697f9f6747-j4fkf" event={"ID":"311e0f15-cd19-4f00-9770-2c15217b7c1f","Type":"ContainerStarted","Data":"60f88115d700f7e897d903426a9aae7a305ecf6010a9e0861923c0176ab0421b"}
Jul 08 21:40:39.438297 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:40:39.438261    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-697f9f6747-j4fkf" event={"ID":"311e0f15-cd19-4f00-9770-2c15217b7c1f","Type":"ContainerStarted","Data":"753125ae608f84068868f66077362660671b0f2c92a5b1b367a89ae8a0b10288"}
Jul 08 21:40:40.443601 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:40:40.443566    2569 generic.go:356] "Generic (PLEG): container finished" podID="311e0f15-cd19-4f00-9770-2c15217b7c1f" containerID="753125ae608f84068868f66077362660671b0f2c92a5b1b367a89ae8a0b10288" exitCode=0
Jul 08 21:40:40.443992 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:40:40.443639    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-697f9f6747-j4fkf" event={"ID":"311e0f15-cd19-4f00-9770-2c15217b7c1f","Type":"ContainerDied","Data":"753125ae608f84068868f66077362660671b0f2c92a5b1b367a89ae8a0b10288"}
Jul 08 21:40:41.449065 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:40:41.449027    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-697f9f6747-j4fkf" event={"ID":"311e0f15-cd19-4f00-9770-2c15217b7c1f","Type":"ContainerStarted","Data":"a24e2290416f8fd9b9b125913c36bb6ed32b34818231d58765b9b8a3a6bb04df"}
Jul 08 21:40:41.449512 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:40:41.449139    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-697f9f6747-j4fkf"
Jul 08 21:40:41.470333 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:40:41.470261    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-697f9f6747-j4fkf" podStartSLOduration=2.001180241 podStartE2EDuration="6.470246697s" totalImagesPullingTime="3.417951667s" totalInitContainerRuntime="1.051114789s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:40:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:40:41.468981139 +0000 UTC m=+464.407313541" watchObservedRunningTime="2026-07-08 21:40:41.470246697 +0000 UTC m=+464.408579096"
Jul 08 21:40:52.455043 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:40:52.455010    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-697f9f6747-j4fkf"
Jul 08 21:41:03.194945 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.194902    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5947469944-tdgk4"]
Jul 08 21:41:03.202530 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.202502    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5947469944-tdgk4"
Jul 08 21:41:03.204635 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.204614    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5947469944-tdgk4"]
Jul 08 21:41:03.205509 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.205488    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 08 21:41:03.206088 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.206056    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 08 21:41:03.206088 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.206076    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 08 21:41:03.206088 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.206061    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 08 21:41:03.206272 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.206079    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 08 21:41:03.206272 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.206204    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-bp25t\""
Jul 08 21:41:03.377168 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.377130    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8131d178-f3e1-44ad-ba15-796677ad213a-metrics-cert\") pod \"lws-controller-manager-5947469944-tdgk4\" (UID: \"8131d178-f3e1-44ad-ba15-796677ad213a\") " pod="openshift-lws-operator/lws-controller-manager-5947469944-tdgk4"
Jul 08 21:41:03.377168 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.377165    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8131d178-f3e1-44ad-ba15-796677ad213a-manager-config\") pod \"lws-controller-manager-5947469944-tdgk4\" (UID: \"8131d178-f3e1-44ad-ba15-796677ad213a\") " pod="openshift-lws-operator/lws-controller-manager-5947469944-tdgk4"
Jul 08 21:41:03.377421 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.377192    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9srnn\" (UniqueName: \"kubernetes.io/projected/8131d178-f3e1-44ad-ba15-796677ad213a-kube-api-access-9srnn\") pod \"lws-controller-manager-5947469944-tdgk4\" (UID: \"8131d178-f3e1-44ad-ba15-796677ad213a\") " pod="openshift-lws-operator/lws-controller-manager-5947469944-tdgk4"
Jul 08 21:41:03.377421 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.377281    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8131d178-f3e1-44ad-ba15-796677ad213a-cert\") pod \"lws-controller-manager-5947469944-tdgk4\" (UID: \"8131d178-f3e1-44ad-ba15-796677ad213a\") " pod="openshift-lws-operator/lws-controller-manager-5947469944-tdgk4"
Jul 08 21:41:03.392855 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.392818    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-czj5t"]
Jul 08 21:41:03.394945 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.394925    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-czj5t"
Jul 08 21:41:03.399011 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.398985    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 08 21:41:03.399144 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.398983    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 08 21:41:03.399563 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.399547    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-nb24c\""
Jul 08 21:41:03.399760 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.399744    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 08 21:41:03.400463 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.400433    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 08 21:41:03.400566 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.400480    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 08 21:41:03.400725 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.400705    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 08 21:41:03.423527 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.423498    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-czj5t"]
Jul 08 21:41:03.477937 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.477838    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8131d178-f3e1-44ad-ba15-796677ad213a-manager-config\") pod \"lws-controller-manager-5947469944-tdgk4\" (UID: \"8131d178-f3e1-44ad-ba15-796677ad213a\") " pod="openshift-lws-operator/lws-controller-manager-5947469944-tdgk4"
Jul 08 21:41:03.477937 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.477876    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9srnn\" (UniqueName: \"kubernetes.io/projected/8131d178-f3e1-44ad-ba15-796677ad213a-kube-api-access-9srnn\") pod \"lws-controller-manager-5947469944-tdgk4\" (UID: \"8131d178-f3e1-44ad-ba15-796677ad213a\") " pod="openshift-lws-operator/lws-controller-manager-5947469944-tdgk4"
Jul 08 21:41:03.477937 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.477913    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8131d178-f3e1-44ad-ba15-796677ad213a-cert\") pod \"lws-controller-manager-5947469944-tdgk4\" (UID: \"8131d178-f3e1-44ad-ba15-796677ad213a\") " pod="openshift-lws-operator/lws-controller-manager-5947469944-tdgk4"
Jul 08 21:41:03.478218 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.477949    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8131d178-f3e1-44ad-ba15-796677ad213a-metrics-cert\") pod \"lws-controller-manager-5947469944-tdgk4\" (UID: \"8131d178-f3e1-44ad-ba15-796677ad213a\") " pod="openshift-lws-operator/lws-controller-manager-5947469944-tdgk4"
Jul 08 21:41:03.478637 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.478615    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8131d178-f3e1-44ad-ba15-796677ad213a-manager-config\") pod \"lws-controller-manager-5947469944-tdgk4\" (UID: \"8131d178-f3e1-44ad-ba15-796677ad213a\") " pod="openshift-lws-operator/lws-controller-manager-5947469944-tdgk4"
Jul 08 21:41:03.480634 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.480613    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8131d178-f3e1-44ad-ba15-796677ad213a-metrics-cert\") pod \"lws-controller-manager-5947469944-tdgk4\" (UID: \"8131d178-f3e1-44ad-ba15-796677ad213a\") " pod="openshift-lws-operator/lws-controller-manager-5947469944-tdgk4"
Jul 08 21:41:03.480725 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.480659    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8131d178-f3e1-44ad-ba15-796677ad213a-cert\") pod \"lws-controller-manager-5947469944-tdgk4\" (UID: \"8131d178-f3e1-44ad-ba15-796677ad213a\") " pod="openshift-lws-operator/lws-controller-manager-5947469944-tdgk4"
Jul 08 21:41:03.490309 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.490258    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9srnn\" (UniqueName: \"kubernetes.io/projected/8131d178-f3e1-44ad-ba15-796677ad213a-kube-api-access-9srnn\") pod \"lws-controller-manager-5947469944-tdgk4\" (UID: \"8131d178-f3e1-44ad-ba15-796677ad213a\") " pod="openshift-lws-operator/lws-controller-manager-5947469944-tdgk4"
Jul 08 21:41:03.512133 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.512101    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5947469944-tdgk4"
Jul 08 21:41:03.579116 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.578743    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/285ec293-34e7-4e34-a97b-95e2b44d94e0-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-czj5t\" (UID: \"285ec293-34e7-4e34-a97b-95e2b44d94e0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-czj5t"
Jul 08 21:41:03.579116 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.578796    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/285ec293-34e7-4e34-a97b-95e2b44d94e0-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-czj5t\" (UID: \"285ec293-34e7-4e34-a97b-95e2b44d94e0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-czj5t"
Jul 08 21:41:03.579116 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.578823    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/285ec293-34e7-4e34-a97b-95e2b44d94e0-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-czj5t\" (UID: \"285ec293-34e7-4e34-a97b-95e2b44d94e0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-czj5t"
Jul 08 21:41:03.579116 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.578852    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/285ec293-34e7-4e34-a97b-95e2b44d94e0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-czj5t\" (UID: \"285ec293-34e7-4e34-a97b-95e2b44d94e0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-czj5t"
Jul 08 21:41:03.579116 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.578928    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdzrl\" (UniqueName: \"kubernetes.io/projected/285ec293-34e7-4e34-a97b-95e2b44d94e0-kube-api-access-pdzrl\") pod \"istiod-openshift-gateway-94bb8fbfd-czj5t\" (UID: \"285ec293-34e7-4e34-a97b-95e2b44d94e0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-czj5t"
Jul 08 21:41:03.579116 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.578963    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/285ec293-34e7-4e34-a97b-95e2b44d94e0-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-czj5t\" (UID: \"285ec293-34e7-4e34-a97b-95e2b44d94e0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-czj5t"
Jul 08 21:41:03.579116 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.578986    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/285ec293-34e7-4e34-a97b-95e2b44d94e0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-czj5t\" (UID: \"285ec293-34e7-4e34-a97b-95e2b44d94e0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-czj5t"
Jul 08 21:41:03.643617 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.643588    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5947469944-tdgk4"]
Jul 08 21:41:03.647449 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:41:03.647416    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8131d178_f3e1_44ad_ba15_796677ad213a.slice/crio-e690644bca5ec10da4bdf338825161d3f2ad92927ac3492198e8c213416005fa WatchSource:0}: Error finding container e690644bca5ec10da4bdf338825161d3f2ad92927ac3492198e8c213416005fa: Status 404 returned error can't find the container with id e690644bca5ec10da4bdf338825161d3f2ad92927ac3492198e8c213416005fa
Jul 08 21:41:03.680172 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.680131    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/285ec293-34e7-4e34-a97b-95e2b44d94e0-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-czj5t\" (UID: \"285ec293-34e7-4e34-a97b-95e2b44d94e0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-czj5t"
Jul 08 21:41:03.680172 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.680171    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/285ec293-34e7-4e34-a97b-95e2b44d94e0-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-czj5t\" (UID: \"285ec293-34e7-4e34-a97b-95e2b44d94e0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-czj5t"
Jul 08 21:41:03.680440 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.680198    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/285ec293-34e7-4e34-a97b-95e2b44d94e0-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-czj5t\" (UID: \"285ec293-34e7-4e34-a97b-95e2b44d94e0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-czj5t"
Jul 08 21:41:03.680440 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.680226    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/285ec293-34e7-4e34-a97b-95e2b44d94e0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-czj5t\" (UID: \"285ec293-34e7-4e34-a97b-95e2b44d94e0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-czj5t"
Jul 08 21:41:03.680440 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.680309    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdzrl\" (UniqueName: \"kubernetes.io/projected/285ec293-34e7-4e34-a97b-95e2b44d94e0-kube-api-access-pdzrl\") pod \"istiod-openshift-gateway-94bb8fbfd-czj5t\" (UID: \"285ec293-34e7-4e34-a97b-95e2b44d94e0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-czj5t"
Jul 08 21:41:03.680440 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.680343    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/285ec293-34e7-4e34-a97b-95e2b44d94e0-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-czj5t\" (UID: \"285ec293-34e7-4e34-a97b-95e2b44d94e0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-czj5t"
Jul 08 21:41:03.680440 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.680364    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/285ec293-34e7-4e34-a97b-95e2b44d94e0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-czj5t\" (UID: \"285ec293-34e7-4e34-a97b-95e2b44d94e0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-czj5t"
Jul 08 21:41:03.681371 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.681343    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/285ec293-34e7-4e34-a97b-95e2b44d94e0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-czj5t\" (UID: \"285ec293-34e7-4e34-a97b-95e2b44d94e0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-czj5t"
Jul 08 21:41:03.682792 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.682761    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/285ec293-34e7-4e34-a97b-95e2b44d94e0-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-czj5t\" (UID: \"285ec293-34e7-4e34-a97b-95e2b44d94e0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-czj5t"
Jul 08 21:41:03.682792 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.682777    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/285ec293-34e7-4e34-a97b-95e2b44d94e0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-czj5t\" (UID: \"285ec293-34e7-4e34-a97b-95e2b44d94e0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-czj5t"
Jul 08 21:41:03.682935 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.682817    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/285ec293-34e7-4e34-a97b-95e2b44d94e0-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-czj5t\" (UID: \"285ec293-34e7-4e34-a97b-95e2b44d94e0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-czj5t"
Jul 08 21:41:03.682935 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.682889    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/285ec293-34e7-4e34-a97b-95e2b44d94e0-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-czj5t\" (UID: \"285ec293-34e7-4e34-a97b-95e2b44d94e0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-czj5t"
Jul 08 21:41:03.687992 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.687971    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdzrl\" (UniqueName: \"kubernetes.io/projected/285ec293-34e7-4e34-a97b-95e2b44d94e0-kube-api-access-pdzrl\") pod \"istiod-openshift-gateway-94bb8fbfd-czj5t\" (UID: \"285ec293-34e7-4e34-a97b-95e2b44d94e0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-czj5t"
Jul 08 21:41:03.688605 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.688586    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/285ec293-34e7-4e34-a97b-95e2b44d94e0-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-czj5t\" (UID: \"285ec293-34e7-4e34-a97b-95e2b44d94e0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-czj5t"
Jul 08 21:41:03.704597 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.704570    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-czj5t"
Jul 08 21:41:03.835058 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:03.835034    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-czj5t"]
Jul 08 21:41:03.837352 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:41:03.837327    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod285ec293_34e7_4e34_a97b_95e2b44d94e0.slice/crio-cbcb3b986fd336675dab8ae7b39eb494748a8b5f7f5692d4084fed946fb25f42 WatchSource:0}: Error finding container cbcb3b986fd336675dab8ae7b39eb494748a8b5f7f5692d4084fed946fb25f42: Status 404 returned error can't find the container with id cbcb3b986fd336675dab8ae7b39eb494748a8b5f7f5692d4084fed946fb25f42
Jul 08 21:41:04.532620 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:04.532545    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-czj5t" event={"ID":"285ec293-34e7-4e34-a97b-95e2b44d94e0","Type":"ContainerStarted","Data":"cbcb3b986fd336675dab8ae7b39eb494748a8b5f7f5692d4084fed946fb25f42"}
Jul 08 21:41:04.534639 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:04.534576    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5947469944-tdgk4" event={"ID":"8131d178-f3e1-44ad-ba15-796677ad213a","Type":"ContainerStarted","Data":"e690644bca5ec10da4bdf338825161d3f2ad92927ac3492198e8c213416005fa"}
Jul 08 21:41:07.027316 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:07.027255    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 08 21:41:07.027735 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:07.027355    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 08 21:41:07.550837 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:07.550800    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5947469944-tdgk4" event={"ID":"8131d178-f3e1-44ad-ba15-796677ad213a","Type":"ContainerStarted","Data":"2b2aa6309d250fbc5e3d98068ad13a60c996878a50fb64879b7594ae2ba8e0ff"}
Jul 08 21:41:07.551260 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:07.551233    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5947469944-tdgk4"
Jul 08 21:41:07.553041 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:07.553008    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-czj5t" event={"ID":"285ec293-34e7-4e34-a97b-95e2b44d94e0","Type":"ContainerStarted","Data":"15934cdf2f8c2e791de2d425ee570e396ed6413862f37cb33055b959dfb104b4"}
Jul 08 21:41:07.553181 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:07.553164    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-czj5t"
Jul 08 21:41:07.578205 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:07.578130    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5947469944-tdgk4" podStartSLOduration=1.201441707 podStartE2EDuration="4.578113377s" totalImagesPullingTime="3.37667167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:41:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:41:07.577116852 +0000 UTC m=+490.515449271" watchObservedRunningTime="2026-07-08 21:41:07.578113377 +0000 UTC m=+490.516445775"
Jul 08 21:41:07.603498 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:07.603427    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-czj5t" podStartSLOduration=1.4156260010000001 podStartE2EDuration="4.603409074s" totalImagesPullingTime="3.187783073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:41:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:41:07.601739358 +0000 UTC m=+490.540071769" watchObservedRunningTime="2026-07-08 21:41:07.603409074 +0000 UTC m=+490.541741474"
Jul 08 21:41:08.558880 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:08.558847    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-czj5t"
Jul 08 21:41:18.560150 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:41:18.559410    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5947469944-tdgk4"
Jul 08 21:42:57.499087 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:42:57.499054    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6cs4g_a022d640-79f0-4d35-be9a-9c6ac708d10b/ovn-acl-logging/0.log"
Jul 08 21:42:57.506763 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:42:57.506744    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6cs4g_a022d640-79f0-4d35-be9a-9c6ac708d10b/ovn-acl-logging/0.log"
Jul 08 21:43:37.192861 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:37.192822    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-srmm7"]
Jul 08 21:43:37.195955 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:37.195939    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-srmm7"
Jul 08 21:43:37.198463 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:37.198439    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 08 21:43:37.198463 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:37.198473    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 08 21:43:37.198650 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:37.198473    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 08 21:43:37.199282 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:37.199268    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6h9fl\""
Jul 08 21:43:37.203670 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:37.203650    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-srmm7"]
Jul 08 21:43:37.291372 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:37.291344    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-srmm7"]
Jul 08 21:43:37.321233 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:37.321191    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkjx6\" (UniqueName: \"kubernetes.io/projected/d081dd32-6a3c-488d-8d75-ba0f03059d86-kube-api-access-wkjx6\") pod \"limitador-limitador-64c94fd64f-srmm7\" (UID: \"d081dd32-6a3c-488d-8d75-ba0f03059d86\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-srmm7"
Jul 08 21:43:37.321412 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:37.321246    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d081dd32-6a3c-488d-8d75-ba0f03059d86-config-file\") pod \"limitador-limitador-64c94fd64f-srmm7\" (UID: \"d081dd32-6a3c-488d-8d75-ba0f03059d86\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-srmm7"
Jul 08 21:43:37.422087 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:37.422051    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkjx6\" (UniqueName: \"kubernetes.io/projected/d081dd32-6a3c-488d-8d75-ba0f03059d86-kube-api-access-wkjx6\") pod \"limitador-limitador-64c94fd64f-srmm7\" (UID: \"d081dd32-6a3c-488d-8d75-ba0f03059d86\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-srmm7"
Jul 08 21:43:37.422260 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:37.422094    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d081dd32-6a3c-488d-8d75-ba0f03059d86-config-file\") pod \"limitador-limitador-64c94fd64f-srmm7\" (UID: \"d081dd32-6a3c-488d-8d75-ba0f03059d86\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-srmm7"
Jul 08 21:43:37.422717 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:37.422698    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d081dd32-6a3c-488d-8d75-ba0f03059d86-config-file\") pod \"limitador-limitador-64c94fd64f-srmm7\" (UID: \"d081dd32-6a3c-488d-8d75-ba0f03059d86\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-srmm7"
Jul 08 21:43:37.430466 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:37.430440    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkjx6\" (UniqueName: \"kubernetes.io/projected/d081dd32-6a3c-488d-8d75-ba0f03059d86-kube-api-access-wkjx6\") pod \"limitador-limitador-64c94fd64f-srmm7\" (UID: \"d081dd32-6a3c-488d-8d75-ba0f03059d86\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-srmm7"
Jul 08 21:43:37.506572 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:37.506475    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-srmm7"
Jul 08 21:43:37.642547 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:37.642513    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-srmm7"]
Jul 08 21:43:37.646123 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:43:37.646099    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd081dd32_6a3c_488d_8d75_ba0f03059d86.slice/crio-1f98df68020699e0ed904df9bc3df3109a8b25c208624518070e5a9ee43db79d WatchSource:0}: Error finding container 1f98df68020699e0ed904df9bc3df3109a8b25c208624518070e5a9ee43db79d: Status 404 returned error can't find the container with id 1f98df68020699e0ed904df9bc3df3109a8b25c208624518070e5a9ee43db79d
Jul 08 21:43:38.083985 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:38.083944    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-srmm7" event={"ID":"d081dd32-6a3c-488d-8d75-ba0f03059d86","Type":"ContainerStarted","Data":"1f98df68020699e0ed904df9bc3df3109a8b25c208624518070e5a9ee43db79d"}
Jul 08 21:43:41.096324 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:41.096196    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-srmm7" event={"ID":"d081dd32-6a3c-488d-8d75-ba0f03059d86","Type":"ContainerStarted","Data":"faf9e3951d16c370e256b6f17e900776ee898a42470f7ec085bbe898d268a50a"}
Jul 08 21:43:41.108632 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:41.096348    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-srmm7"
Jul 08 21:43:41.115276 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:41.115234    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-srmm7" podStartSLOduration=1.30309101 podStartE2EDuration="4.115218992s" totalImagesPullingTime="2.812127982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:43:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:43:41.114325023 +0000 UTC m=+644.052657443" watchObservedRunningTime="2026-07-08 21:43:41.115218992 +0000 UTC m=+644.053551393"
Jul 08 21:43:52.101361 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:52.101332    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-srmm7"
Jul 08 21:43:52.308850 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:52.308816    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-srmm7"]
Jul 08 21:43:52.309014 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:52.308995    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-srmm7" podUID="d081dd32-6a3c-488d-8d75-ba0f03059d86" containerName="limitador" containerID="cri-o://faf9e3951d16c370e256b6f17e900776ee898a42470f7ec085bbe898d268a50a" gracePeriod=30
Jul 08 21:43:52.843641 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:52.843615    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-srmm7"
Jul 08 21:43:52.960198 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:52.960165    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wkjx6\" (UniqueName: \"kubernetes.io/projected/d081dd32-6a3c-488d-8d75-ba0f03059d86-kube-api-access-wkjx6\") pod \"d081dd32-6a3c-488d-8d75-ba0f03059d86\" (UID: \"d081dd32-6a3c-488d-8d75-ba0f03059d86\") "
Jul 08 21:43:52.960385 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:52.960223    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d081dd32-6a3c-488d-8d75-ba0f03059d86-config-file\") pod \"d081dd32-6a3c-488d-8d75-ba0f03059d86\" (UID: \"d081dd32-6a3c-488d-8d75-ba0f03059d86\") "
Jul 08 21:43:52.960577 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:52.960556    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d081dd32-6a3c-488d-8d75-ba0f03059d86-config-file" (OuterVolumeSpecName: "config-file") pod "d081dd32-6a3c-488d-8d75-ba0f03059d86" (UID: "d081dd32-6a3c-488d-8d75-ba0f03059d86"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:43:52.962610 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:52.962589    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d081dd32-6a3c-488d-8d75-ba0f03059d86-kube-api-access-wkjx6" (OuterVolumeSpecName: "kube-api-access-wkjx6") pod "d081dd32-6a3c-488d-8d75-ba0f03059d86" (UID: "d081dd32-6a3c-488d-8d75-ba0f03059d86"). InnerVolumeSpecName "kube-api-access-wkjx6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:43:53.060905 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:53.060878    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wkjx6\" (UniqueName: \"kubernetes.io/projected/d081dd32-6a3c-488d-8d75-ba0f03059d86-kube-api-access-wkjx6\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 21:43:53.060905 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:53.060901    2569 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d081dd32-6a3c-488d-8d75-ba0f03059d86-config-file\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 21:43:53.140888 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:53.140851    2569 generic.go:356] "Generic (PLEG): container finished" podID="d081dd32-6a3c-488d-8d75-ba0f03059d86" containerID="faf9e3951d16c370e256b6f17e900776ee898a42470f7ec085bbe898d268a50a" exitCode=0
Jul 08 21:43:53.141265 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:53.140899    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-srmm7"
Jul 08 21:43:53.141265 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:53.140913    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-srmm7" event={"ID":"d081dd32-6a3c-488d-8d75-ba0f03059d86","Type":"ContainerDied","Data":"faf9e3951d16c370e256b6f17e900776ee898a42470f7ec085bbe898d268a50a"}
Jul 08 21:43:53.141265 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:53.140964    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-srmm7" event={"ID":"d081dd32-6a3c-488d-8d75-ba0f03059d86","Type":"ContainerDied","Data":"1f98df68020699e0ed904df9bc3df3109a8b25c208624518070e5a9ee43db79d"}
Jul 08 21:43:53.141265 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:53.140993    2569 scope.go:117] "RemoveContainer" containerID="faf9e3951d16c370e256b6f17e900776ee898a42470f7ec085bbe898d268a50a"
Jul 08 21:43:53.149330 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:53.149311    2569 scope.go:117] "RemoveContainer" containerID="faf9e3951d16c370e256b6f17e900776ee898a42470f7ec085bbe898d268a50a"
Jul 08 21:43:53.149575 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:43:53.149557    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"faf9e3951d16c370e256b6f17e900776ee898a42470f7ec085bbe898d268a50a\": container with ID starting with faf9e3951d16c370e256b6f17e900776ee898a42470f7ec085bbe898d268a50a not found: ID does not exist" containerID="faf9e3951d16c370e256b6f17e900776ee898a42470f7ec085bbe898d268a50a"
Jul 08 21:43:53.149614 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:53.149583    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"faf9e3951d16c370e256b6f17e900776ee898a42470f7ec085bbe898d268a50a"} err="failed to get container status \"faf9e3951d16c370e256b6f17e900776ee898a42470f7ec085bbe898d268a50a\": rpc error: code = NotFound desc = could not find container \"faf9e3951d16c370e256b6f17e900776ee898a42470f7ec085bbe898d268a50a\": container with ID starting with faf9e3951d16c370e256b6f17e900776ee898a42470f7ec085bbe898d268a50a not found: ID does not exist"
Jul 08 21:43:53.160905 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:53.160883    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-srmm7"]
Jul 08 21:43:53.164801 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:53.164782    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-srmm7"]
Jul 08 21:43:53.610759 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:53.610730    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d081dd32-6a3c-488d-8d75-ba0f03059d86" path="/var/lib/kubelet/pods/d081dd32-6a3c-488d-8d75-ba0f03059d86/volumes"
Jul 08 21:43:53.792437 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:53.792405    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-vd7pj"]
Jul 08 21:43:53.792751 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:53.792734    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d081dd32-6a3c-488d-8d75-ba0f03059d86" containerName="limitador"
Jul 08 21:43:53.792835 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:53.792754    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d081dd32-6a3c-488d-8d75-ba0f03059d86" containerName="limitador"
Jul 08 21:43:53.792889 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:53.792839    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d081dd32-6a3c-488d-8d75-ba0f03059d86" containerName="limitador"
Jul 08 21:43:53.796850 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:53.796829    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vd7pj"
Jul 08 21:43:53.799085 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:53.799062    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 08 21:43:53.799199 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:53.799065    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 21:43:53.799199 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:53.799071    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-7pfc6\""
Jul 08 21:43:53.800023 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:53.800004    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 21:43:53.802332 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:53.802312    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-vd7pj"]
Jul 08 21:43:53.967050 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:53.967009    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhtt8\" (UniqueName: \"kubernetes.io/projected/b57c4af5-cc7f-4636-8ff3-e711a7d5e074-kube-api-access-zhtt8\") pod \"postgres-69fb4594cf-vd7pj\" (UID: \"b57c4af5-cc7f-4636-8ff3-e711a7d5e074\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vd7pj"
Jul 08 21:43:53.967245 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:53.967128    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b57c4af5-cc7f-4636-8ff3-e711a7d5e074-data\") pod \"postgres-69fb4594cf-vd7pj\" (UID: \"b57c4af5-cc7f-4636-8ff3-e711a7d5e074\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vd7pj"
Jul 08 21:43:54.067864 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:54.067817    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b57c4af5-cc7f-4636-8ff3-e711a7d5e074-data\") pod \"postgres-69fb4594cf-vd7pj\" (UID: \"b57c4af5-cc7f-4636-8ff3-e711a7d5e074\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vd7pj"
Jul 08 21:43:54.067864 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:54.067879    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhtt8\" (UniqueName: \"kubernetes.io/projected/b57c4af5-cc7f-4636-8ff3-e711a7d5e074-kube-api-access-zhtt8\") pod \"postgres-69fb4594cf-vd7pj\" (UID: \"b57c4af5-cc7f-4636-8ff3-e711a7d5e074\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vd7pj"
Jul 08 21:43:54.068194 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:54.068175    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b57c4af5-cc7f-4636-8ff3-e711a7d5e074-data\") pod \"postgres-69fb4594cf-vd7pj\" (UID: \"b57c4af5-cc7f-4636-8ff3-e711a7d5e074\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vd7pj"
Jul 08 21:43:54.076157 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:54.076126    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhtt8\" (UniqueName: \"kubernetes.io/projected/b57c4af5-cc7f-4636-8ff3-e711a7d5e074-kube-api-access-zhtt8\") pod \"postgres-69fb4594cf-vd7pj\" (UID: \"b57c4af5-cc7f-4636-8ff3-e711a7d5e074\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-vd7pj"
Jul 08 21:43:54.107756 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:54.107733    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vd7pj"
Jul 08 21:43:54.231162 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:54.231133    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-vd7pj"]
Jul 08 21:43:54.233054 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:43:54.233023    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb57c4af5_cc7f_4636_8ff3_e711a7d5e074.slice/crio-43011d5fcdb6468074d3ef33355aaf38464e7f95d7fe953c3642c65d290e065d WatchSource:0}: Error finding container 43011d5fcdb6468074d3ef33355aaf38464e7f95d7fe953c3642c65d290e065d: Status 404 returned error can't find the container with id 43011d5fcdb6468074d3ef33355aaf38464e7f95d7fe953c3642c65d290e065d
Jul 08 21:43:55.153105 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:55.153029    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vd7pj" event={"ID":"b57c4af5-cc7f-4636-8ff3-e711a7d5e074","Type":"ContainerStarted","Data":"43011d5fcdb6468074d3ef33355aaf38464e7f95d7fe953c3642c65d290e065d"}
Jul 08 21:43:59.103032 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:59.103011    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 08 21:43:59.176010 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:59.175976    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vd7pj" event={"ID":"b57c4af5-cc7f-4636-8ff3-e711a7d5e074","Type":"ContainerStarted","Data":"ebf7b8154d82cc63e40b94780d6edb8b39b0e5b224947fd7df23194eb35267cb"}
Jul 08 21:43:59.176136 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:59.176121    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vd7pj"
Jul 08 21:43:59.191985 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:43:59.191939    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vd7pj" podStartSLOduration=1.330078294 podStartE2EDuration="6.191922478s" totalImagesPullingTime="4.861844184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:43:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:43:59.190819136 +0000 UTC m=+662.129151558" watchObservedRunningTime="2026-07-08 21:43:59.191922478 +0000 UTC m=+662.130254878"
Jul 08 21:44:05.209803 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:05.209771    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-vd7pj"
Jul 08 21:44:12.360442 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:12.360406    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-647844797c-lhfzw"]
Jul 08 21:44:12.381794 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:12.381769    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-647844797c-lhfzw"]
Jul 08 21:44:12.381937 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:12.381858    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-647844797c-lhfzw"
Jul 08 21:44:12.384808 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:12.384786    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 08 21:44:12.385122 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:12.385102    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-wghkh\""
Jul 08 21:44:12.385247 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:12.385102    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 08 21:44:12.417829 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:12.417808    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xblw4\" (UniqueName: \"kubernetes.io/projected/300f9ae3-2eb0-4110-b542-ba8bbf21ef55-kube-api-access-xblw4\") pod \"maas-controller-647844797c-lhfzw\" (UID: \"300f9ae3-2eb0-4110-b542-ba8bbf21ef55\") " pod="opendatahub/maas-controller-647844797c-lhfzw"
Jul 08 21:44:12.417928 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:12.417846    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/300f9ae3-2eb0-4110-b542-ba8bbf21ef55-webhook-cert\") pod \"maas-controller-647844797c-lhfzw\" (UID: \"300f9ae3-2eb0-4110-b542-ba8bbf21ef55\") " pod="opendatahub/maas-controller-647844797c-lhfzw"
Jul 08 21:44:12.518405 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:12.518380    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/300f9ae3-2eb0-4110-b542-ba8bbf21ef55-webhook-cert\") pod \"maas-controller-647844797c-lhfzw\" (UID: \"300f9ae3-2eb0-4110-b542-ba8bbf21ef55\") " pod="opendatahub/maas-controller-647844797c-lhfzw"
Jul 08 21:44:12.518500 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:12.518485    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xblw4\" (UniqueName: \"kubernetes.io/projected/300f9ae3-2eb0-4110-b542-ba8bbf21ef55-kube-api-access-xblw4\") pod \"maas-controller-647844797c-lhfzw\" (UID: \"300f9ae3-2eb0-4110-b542-ba8bbf21ef55\") " pod="opendatahub/maas-controller-647844797c-lhfzw"
Jul 08 21:44:12.518556 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:44:12.518540    2569 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 08 21:44:12.518647 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:44:12.518637    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/300f9ae3-2eb0-4110-b542-ba8bbf21ef55-webhook-cert podName:300f9ae3-2eb0-4110-b542-ba8bbf21ef55 nodeName:}" failed. No retries permitted until 2026-07-08 21:44:13.018616 +0000 UTC m=+675.956948377 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/300f9ae3-2eb0-4110-b542-ba8bbf21ef55-webhook-cert") pod "maas-controller-647844797c-lhfzw" (UID: "300f9ae3-2eb0-4110-b542-ba8bbf21ef55") : secret "maas-controller-webhook-cert" not found
Jul 08 21:44:12.530936 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:12.530907    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xblw4\" (UniqueName: \"kubernetes.io/projected/300f9ae3-2eb0-4110-b542-ba8bbf21ef55-kube-api-access-xblw4\") pod \"maas-controller-647844797c-lhfzw\" (UID: \"300f9ae3-2eb0-4110-b542-ba8bbf21ef55\") " pod="opendatahub/maas-controller-647844797c-lhfzw"
Jul 08 21:44:12.552381 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:12.552357    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-695b55744f-b6h9n"]
Jul 08 21:44:12.555434 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:12.555416    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-695b55744f-b6h9n"
Jul 08 21:44:12.563753 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:12.563727    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-695b55744f-b6h9n"]
Jul 08 21:44:12.619328 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:12.619233    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj4tv\" (UniqueName: \"kubernetes.io/projected/a47c4c21-a16e-4f70-988e-2767dadff91a-kube-api-access-lj4tv\") pod \"maas-controller-695b55744f-b6h9n\" (UID: \"a47c4c21-a16e-4f70-988e-2767dadff91a\") " pod="opendatahub/maas-controller-695b55744f-b6h9n"
Jul 08 21:44:12.619468 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:12.619369    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a47c4c21-a16e-4f70-988e-2767dadff91a-webhook-cert\") pod \"maas-controller-695b55744f-b6h9n\" (UID: \"a47c4c21-a16e-4f70-988e-2767dadff91a\") " pod="opendatahub/maas-controller-695b55744f-b6h9n"
Jul 08 21:44:12.720373 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:12.720339    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj4tv\" (UniqueName: \"kubernetes.io/projected/a47c4c21-a16e-4f70-988e-2767dadff91a-kube-api-access-lj4tv\") pod \"maas-controller-695b55744f-b6h9n\" (UID: \"a47c4c21-a16e-4f70-988e-2767dadff91a\") " pod="opendatahub/maas-controller-695b55744f-b6h9n"
Jul 08 21:44:12.720510 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:12.720439    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a47c4c21-a16e-4f70-988e-2767dadff91a-webhook-cert\") pod \"maas-controller-695b55744f-b6h9n\" (UID: \"a47c4c21-a16e-4f70-988e-2767dadff91a\") " pod="opendatahub/maas-controller-695b55744f-b6h9n"
Jul 08 21:44:12.722886 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:12.722864    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a47c4c21-a16e-4f70-988e-2767dadff91a-webhook-cert\") pod \"maas-controller-695b55744f-b6h9n\" (UID: \"a47c4c21-a16e-4f70-988e-2767dadff91a\") " pod="opendatahub/maas-controller-695b55744f-b6h9n"
Jul 08 21:44:12.728006 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:12.727984    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj4tv\" (UniqueName: \"kubernetes.io/projected/a47c4c21-a16e-4f70-988e-2767dadff91a-kube-api-access-lj4tv\") pod \"maas-controller-695b55744f-b6h9n\" (UID: \"a47c4c21-a16e-4f70-988e-2767dadff91a\") " pod="opendatahub/maas-controller-695b55744f-b6h9n"
Jul 08 21:44:12.866248 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:12.866216    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-695b55744f-b6h9n"
Jul 08 21:44:12.988725 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:12.988701    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-695b55744f-b6h9n"]
Jul 08 21:44:12.991000 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:44:12.990971    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda47c4c21_a16e_4f70_988e_2767dadff91a.slice/crio-7cb177443f8ca01606e86e830587c0c45d0b258161ae267948b59504d47300cf WatchSource:0}: Error finding container 7cb177443f8ca01606e86e830587c0c45d0b258161ae267948b59504d47300cf: Status 404 returned error can't find the container with id 7cb177443f8ca01606e86e830587c0c45d0b258161ae267948b59504d47300cf
Jul 08 21:44:13.022826 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:13.022797    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/300f9ae3-2eb0-4110-b542-ba8bbf21ef55-webhook-cert\") pod \"maas-controller-647844797c-lhfzw\" (UID: \"300f9ae3-2eb0-4110-b542-ba8bbf21ef55\") " pod="opendatahub/maas-controller-647844797c-lhfzw"
Jul 08 21:44:13.025150 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:13.025129    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/300f9ae3-2eb0-4110-b542-ba8bbf21ef55-webhook-cert\") pod \"maas-controller-647844797c-lhfzw\" (UID: \"300f9ae3-2eb0-4110-b542-ba8bbf21ef55\") " pod="opendatahub/maas-controller-647844797c-lhfzw"
Jul 08 21:44:13.226911 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:13.226877    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-695b55744f-b6h9n" event={"ID":"a47c4c21-a16e-4f70-988e-2767dadff91a","Type":"ContainerStarted","Data":"7cb177443f8ca01606e86e830587c0c45d0b258161ae267948b59504d47300cf"}
Jul 08 21:44:13.291758 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:13.291721    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-647844797c-lhfzw"
Jul 08 21:44:13.417424 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:13.417394    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-647844797c-lhfzw"]
Jul 08 21:44:13.420244 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:44:13.420219    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod300f9ae3_2eb0_4110_b542_ba8bbf21ef55.slice/crio-12d7348535cc4f1be3b79abefe166c73923719d060c9c0c407a41835f665671e WatchSource:0}: Error finding container 12d7348535cc4f1be3b79abefe166c73923719d060c9c0c407a41835f665671e: Status 404 returned error can't find the container with id 12d7348535cc4f1be3b79abefe166c73923719d060c9c0c407a41835f665671e
Jul 08 21:44:14.233575 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:14.233536    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-647844797c-lhfzw" event={"ID":"300f9ae3-2eb0-4110-b542-ba8bbf21ef55","Type":"ContainerStarted","Data":"12d7348535cc4f1be3b79abefe166c73923719d060c9c0c407a41835f665671e"}
Jul 08 21:44:16.242168 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:16.242133    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-695b55744f-b6h9n" event={"ID":"a47c4c21-a16e-4f70-988e-2767dadff91a","Type":"ContainerStarted","Data":"81a5ce54b23e3438e162cbf43d8d3d3b9e1ca25e723b63614500f47e87cad9d6"}
Jul 08 21:44:16.242652 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:16.242209    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-695b55744f-b6h9n"
Jul 08 21:44:16.243689 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:16.243663    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-647844797c-lhfzw" event={"ID":"300f9ae3-2eb0-4110-b542-ba8bbf21ef55","Type":"ContainerStarted","Data":"f4f58da7049816ae8ca49ad3a722d5c5f376e87cccbb052ea277464af15ade1f"}
Jul 08 21:44:16.243792 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:16.243780    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-647844797c-lhfzw"
Jul 08 21:44:16.266492 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:16.266441    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-695b55744f-b6h9n" podStartSLOduration=1.6698020470000001 podStartE2EDuration="4.266425988s" totalImagesPullingTime="2.596623941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:44:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:44:16.264232428 +0000 UTC m=+679.202564828" watchObservedRunningTime="2026-07-08 21:44:16.266425988 +0000 UTC m=+679.204758388"
Jul 08 21:44:16.285952 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:16.285911    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-647844797c-lhfzw" podStartSLOduration=2.127200255 podStartE2EDuration="4.285898157s" totalImagesPullingTime="2.158697902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:44:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:44:16.285387615 +0000 UTC m=+679.223720035" watchObservedRunningTime="2026-07-08 21:44:16.285898157 +0000 UTC m=+679.224230556"
Jul 08 21:44:27.252802 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:27.252764    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-647844797c-lhfzw"
Jul 08 21:44:27.253221 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:27.252839    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-695b55744f-b6h9n"
Jul 08 21:44:27.314455 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:27.314421    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-647844797c-lhfzw"]
Jul 08 21:44:27.314661 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:27.314638    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-647844797c-lhfzw" podUID="300f9ae3-2eb0-4110-b542-ba8bbf21ef55" containerName="manager" containerID="cri-o://f4f58da7049816ae8ca49ad3a722d5c5f376e87cccbb052ea277464af15ade1f" gracePeriod=30
Jul 08 21:44:27.557552 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:27.557527    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-647844797c-lhfzw"
Jul 08 21:44:27.647381 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:27.647317    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xblw4\" (UniqueName: \"kubernetes.io/projected/300f9ae3-2eb0-4110-b542-ba8bbf21ef55-kube-api-access-xblw4\") pod \"300f9ae3-2eb0-4110-b542-ba8bbf21ef55\" (UID: \"300f9ae3-2eb0-4110-b542-ba8bbf21ef55\") "
Jul 08 21:44:27.647571 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:27.647411    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/300f9ae3-2eb0-4110-b542-ba8bbf21ef55-webhook-cert\") pod \"300f9ae3-2eb0-4110-b542-ba8bbf21ef55\" (UID: \"300f9ae3-2eb0-4110-b542-ba8bbf21ef55\") "
Jul 08 21:44:27.649700 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:27.649674    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/300f9ae3-2eb0-4110-b542-ba8bbf21ef55-kube-api-access-xblw4" (OuterVolumeSpecName: "kube-api-access-xblw4") pod "300f9ae3-2eb0-4110-b542-ba8bbf21ef55" (UID: "300f9ae3-2eb0-4110-b542-ba8bbf21ef55"). InnerVolumeSpecName "kube-api-access-xblw4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:44:27.649803 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:27.649775    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/300f9ae3-2eb0-4110-b542-ba8bbf21ef55-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "300f9ae3-2eb0-4110-b542-ba8bbf21ef55" (UID: "300f9ae3-2eb0-4110-b542-ba8bbf21ef55"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:44:27.748861 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:27.748810    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xblw4\" (UniqueName: \"kubernetes.io/projected/300f9ae3-2eb0-4110-b542-ba8bbf21ef55-kube-api-access-xblw4\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 21:44:27.748861 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:27.748851    2569 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/300f9ae3-2eb0-4110-b542-ba8bbf21ef55-webhook-cert\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 21:44:28.295995 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:28.295955    2569 generic.go:356] "Generic (PLEG): container finished" podID="300f9ae3-2eb0-4110-b542-ba8bbf21ef55" containerID="f4f58da7049816ae8ca49ad3a722d5c5f376e87cccbb052ea277464af15ade1f" exitCode=0
Jul 08 21:44:28.295995 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:28.295998    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-647844797c-lhfzw"
Jul 08 21:44:28.296545 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:28.296043    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-647844797c-lhfzw" event={"ID":"300f9ae3-2eb0-4110-b542-ba8bbf21ef55","Type":"ContainerDied","Data":"f4f58da7049816ae8ca49ad3a722d5c5f376e87cccbb052ea277464af15ade1f"}
Jul 08 21:44:28.296545 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:28.296111    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-647844797c-lhfzw" event={"ID":"300f9ae3-2eb0-4110-b542-ba8bbf21ef55","Type":"ContainerDied","Data":"12d7348535cc4f1be3b79abefe166c73923719d060c9c0c407a41835f665671e"}
Jul 08 21:44:28.296545 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:28.296145    2569 scope.go:117] "RemoveContainer" containerID="f4f58da7049816ae8ca49ad3a722d5c5f376e87cccbb052ea277464af15ade1f"
Jul 08 21:44:28.304939 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:28.304921    2569 scope.go:117] "RemoveContainer" containerID="f4f58da7049816ae8ca49ad3a722d5c5f376e87cccbb052ea277464af15ade1f"
Jul 08 21:44:28.305209 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:44:28.305191    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4f58da7049816ae8ca49ad3a722d5c5f376e87cccbb052ea277464af15ade1f\": container with ID starting with f4f58da7049816ae8ca49ad3a722d5c5f376e87cccbb052ea277464af15ade1f not found: ID does not exist" containerID="f4f58da7049816ae8ca49ad3a722d5c5f376e87cccbb052ea277464af15ade1f"
Jul 08 21:44:28.305269 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:28.305221    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4f58da7049816ae8ca49ad3a722d5c5f376e87cccbb052ea277464af15ade1f"} err="failed to get container status \"f4f58da7049816ae8ca49ad3a722d5c5f376e87cccbb052ea277464af15ade1f\": rpc error: code = NotFound desc = could not find container \"f4f58da7049816ae8ca49ad3a722d5c5f376e87cccbb052ea277464af15ade1f\": container with ID starting with f4f58da7049816ae8ca49ad3a722d5c5f376e87cccbb052ea277464af15ade1f not found: ID does not exist"
Jul 08 21:44:28.316042 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:28.316013    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-647844797c-lhfzw"]
Jul 08 21:44:28.319867 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:28.319847    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-647844797c-lhfzw"]
Jul 08 21:44:29.611812 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:29.611776    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="300f9ae3-2eb0-4110-b542-ba8bbf21ef55" path="/var/lib/kubelet/pods/300f9ae3-2eb0-4110-b542-ba8bbf21ef55/volumes"
Jul 08 21:44:47.943658 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:47.943578    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-f4d6cdb9-rvfsq"]
Jul 08 21:44:47.944098 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:47.943925    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="300f9ae3-2eb0-4110-b542-ba8bbf21ef55" containerName="manager"
Jul 08 21:44:47.944098 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:47.943938    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="300f9ae3-2eb0-4110-b542-ba8bbf21ef55" containerName="manager"
Jul 08 21:44:47.944098 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:47.944002    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="300f9ae3-2eb0-4110-b542-ba8bbf21ef55" containerName="manager"
Jul 08 21:44:47.947112 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:47.947096    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f4d6cdb9-rvfsq"
Jul 08 21:44:47.949504 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:47.949482    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 08 21:44:47.949604 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:47.949585    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-n9zrt\""
Jul 08 21:44:47.961964 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:47.961941    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-f4d6cdb9-rvfsq"]
Jul 08 21:44:48.126835 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:48.126801    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pkkl\" (UniqueName: \"kubernetes.io/projected/9b92edda-e637-49f8-b14e-ae58c4904200-kube-api-access-6pkkl\") pod \"maas-api-f4d6cdb9-rvfsq\" (UID: \"9b92edda-e637-49f8-b14e-ae58c4904200\") " pod="odh-ai-gateway-infra/maas-api-f4d6cdb9-rvfsq"
Jul 08 21:44:48.126835 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:48.126839    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b92edda-e637-49f8-b14e-ae58c4904200-maas-api-tls\") pod \"maas-api-f4d6cdb9-rvfsq\" (UID: \"9b92edda-e637-49f8-b14e-ae58c4904200\") " pod="odh-ai-gateway-infra/maas-api-f4d6cdb9-rvfsq"
Jul 08 21:44:48.127062 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:48.126859    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b92edda-e637-49f8-b14e-ae58c4904200-openshift-service-ca\") pod \"maas-api-f4d6cdb9-rvfsq\" (UID: \"9b92edda-e637-49f8-b14e-ae58c4904200\") " pod="odh-ai-gateway-infra/maas-api-f4d6cdb9-rvfsq"
Jul 08 21:44:48.227939 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:48.227843    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b92edda-e637-49f8-b14e-ae58c4904200-openshift-service-ca\") pod \"maas-api-f4d6cdb9-rvfsq\" (UID: \"9b92edda-e637-49f8-b14e-ae58c4904200\") " pod="odh-ai-gateway-infra/maas-api-f4d6cdb9-rvfsq"
Jul 08 21:44:48.228113 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:48.227942    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pkkl\" (UniqueName: \"kubernetes.io/projected/9b92edda-e637-49f8-b14e-ae58c4904200-kube-api-access-6pkkl\") pod \"maas-api-f4d6cdb9-rvfsq\" (UID: \"9b92edda-e637-49f8-b14e-ae58c4904200\") " pod="odh-ai-gateway-infra/maas-api-f4d6cdb9-rvfsq"
Jul 08 21:44:48.228113 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:48.227971    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b92edda-e637-49f8-b14e-ae58c4904200-maas-api-tls\") pod \"maas-api-f4d6cdb9-rvfsq\" (UID: \"9b92edda-e637-49f8-b14e-ae58c4904200\") " pod="odh-ai-gateway-infra/maas-api-f4d6cdb9-rvfsq"
Jul 08 21:44:48.228113 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:44:48.228085    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 08 21:44:48.228355 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:44:48.228142    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b92edda-e637-49f8-b14e-ae58c4904200-maas-api-tls podName:9b92edda-e637-49f8-b14e-ae58c4904200 nodeName:}" failed. No retries permitted until 2026-07-08 21:44:48.728126692 +0000 UTC m=+711.666459071 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9b92edda-e637-49f8-b14e-ae58c4904200-maas-api-tls") pod "maas-api-f4d6cdb9-rvfsq" (UID: "9b92edda-e637-49f8-b14e-ae58c4904200") : secret "maas-api-serving-cert" not found
Jul 08 21:44:48.228674 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:48.228649    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b92edda-e637-49f8-b14e-ae58c4904200-openshift-service-ca\") pod \"maas-api-f4d6cdb9-rvfsq\" (UID: \"9b92edda-e637-49f8-b14e-ae58c4904200\") " pod="odh-ai-gateway-infra/maas-api-f4d6cdb9-rvfsq"
Jul 08 21:44:48.238645 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:48.238621    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pkkl\" (UniqueName: \"kubernetes.io/projected/9b92edda-e637-49f8-b14e-ae58c4904200-kube-api-access-6pkkl\") pod \"maas-api-f4d6cdb9-rvfsq\" (UID: \"9b92edda-e637-49f8-b14e-ae58c4904200\") " pod="odh-ai-gateway-infra/maas-api-f4d6cdb9-rvfsq"
Jul 08 21:44:48.651202 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:48.651167    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-8r7ss"]
Jul 08 21:44:48.654261 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:48.654246    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-8r7ss"
Jul 08 21:44:48.656531 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:48.656510    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 08 21:44:48.656664 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:48.656550    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-nmzxw\""
Jul 08 21:44:48.665174 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:48.665142    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-8r7ss"]
Jul 08 21:44:48.732612 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:48.732580    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b92edda-e637-49f8-b14e-ae58c4904200-maas-api-tls\") pod \"maas-api-f4d6cdb9-rvfsq\" (UID: \"9b92edda-e637-49f8-b14e-ae58c4904200\") " pod="odh-ai-gateway-infra/maas-api-f4d6cdb9-rvfsq"
Jul 08 21:44:48.735365 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:48.735333    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b92edda-e637-49f8-b14e-ae58c4904200-maas-api-tls\") pod \"maas-api-f4d6cdb9-rvfsq\" (UID: \"9b92edda-e637-49f8-b14e-ae58c4904200\") " pod="odh-ai-gateway-infra/maas-api-f4d6cdb9-rvfsq"
Jul 08 21:44:48.737796 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:48.737775    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-zh7w7"]
Jul 08 21:44:48.740878 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:48.740861    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-zh7w7"
Jul 08 21:44:48.751807 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:48.751784    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-zh7w7"]
Jul 08 21:44:48.832986 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:48.832954    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq77g\" (UniqueName: \"kubernetes.io/projected/806002e7-9884-45f8-86b0-fc291ae52159-kube-api-access-qq77g\") pod \"payload-processing-58f86c7798-zh7w7\" (UID: \"806002e7-9884-45f8-86b0-fc291ae52159\") " pod="openshift-ingress/payload-processing-58f86c7798-zh7w7"
Jul 08 21:44:48.833165 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:48.833002    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a22bc284-b6bc-4dfe-b2fc-a2e6838441ac-plugins-config-volume\") pod \"payload-pre-processing-7964457696-8r7ss\" (UID: \"a22bc284-b6bc-4dfe-b2fc-a2e6838441ac\") " pod="openshift-ingress/payload-pre-processing-7964457696-8r7ss"
Jul 08 21:44:48.833165 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:48.833048    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv4cq\" (UniqueName: \"kubernetes.io/projected/a22bc284-b6bc-4dfe-b2fc-a2e6838441ac-kube-api-access-wv4cq\") pod \"payload-pre-processing-7964457696-8r7ss\" (UID: \"a22bc284-b6bc-4dfe-b2fc-a2e6838441ac\") " pod="openshift-ingress/payload-pre-processing-7964457696-8r7ss"
Jul 08 21:44:48.833165 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:48.833076    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/806002e7-9884-45f8-86b0-fc291ae52159-plugins-config-volume\") pod \"payload-processing-58f86c7798-zh7w7\" (UID: \"806002e7-9884-45f8-86b0-fc291ae52159\") " pod="openshift-ingress/payload-processing-58f86c7798-zh7w7"
Jul 08 21:44:48.856728 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:48.856696    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f4d6cdb9-rvfsq"
Jul 08 21:44:48.933634 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:48.933584    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq77g\" (UniqueName: \"kubernetes.io/projected/806002e7-9884-45f8-86b0-fc291ae52159-kube-api-access-qq77g\") pod \"payload-processing-58f86c7798-zh7w7\" (UID: \"806002e7-9884-45f8-86b0-fc291ae52159\") " pod="openshift-ingress/payload-processing-58f86c7798-zh7w7"
Jul 08 21:44:48.933818 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:48.933643    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a22bc284-b6bc-4dfe-b2fc-a2e6838441ac-plugins-config-volume\") pod \"payload-pre-processing-7964457696-8r7ss\" (UID: \"a22bc284-b6bc-4dfe-b2fc-a2e6838441ac\") " pod="openshift-ingress/payload-pre-processing-7964457696-8r7ss"
Jul 08 21:44:48.933818 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:48.933669    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv4cq\" (UniqueName: \"kubernetes.io/projected/a22bc284-b6bc-4dfe-b2fc-a2e6838441ac-kube-api-access-wv4cq\") pod \"payload-pre-processing-7964457696-8r7ss\" (UID: \"a22bc284-b6bc-4dfe-b2fc-a2e6838441ac\") " pod="openshift-ingress/payload-pre-processing-7964457696-8r7ss"
Jul 08 21:44:48.933818 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:48.933696    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/806002e7-9884-45f8-86b0-fc291ae52159-plugins-config-volume\") pod \"payload-processing-58f86c7798-zh7w7\" (UID: \"806002e7-9884-45f8-86b0-fc291ae52159\") " pod="openshift-ingress/payload-processing-58f86c7798-zh7w7"
Jul 08 21:44:48.934441 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:48.934415    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/806002e7-9884-45f8-86b0-fc291ae52159-plugins-config-volume\") pod \"payload-processing-58f86c7798-zh7w7\" (UID: \"806002e7-9884-45f8-86b0-fc291ae52159\") " pod="openshift-ingress/payload-processing-58f86c7798-zh7w7"
Jul 08 21:44:48.934586 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:48.934564    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a22bc284-b6bc-4dfe-b2fc-a2e6838441ac-plugins-config-volume\") pod \"payload-pre-processing-7964457696-8r7ss\" (UID: \"a22bc284-b6bc-4dfe-b2fc-a2e6838441ac\") " pod="openshift-ingress/payload-pre-processing-7964457696-8r7ss"
Jul 08 21:44:48.947758 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:48.947733    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv4cq\" (UniqueName: \"kubernetes.io/projected/a22bc284-b6bc-4dfe-b2fc-a2e6838441ac-kube-api-access-wv4cq\") pod \"payload-pre-processing-7964457696-8r7ss\" (UID: \"a22bc284-b6bc-4dfe-b2fc-a2e6838441ac\") " pod="openshift-ingress/payload-pre-processing-7964457696-8r7ss"
Jul 08 21:44:48.948240 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:48.948219    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq77g\" (UniqueName: \"kubernetes.io/projected/806002e7-9884-45f8-86b0-fc291ae52159-kube-api-access-qq77g\") pod \"payload-processing-58f86c7798-zh7w7\" (UID: \"806002e7-9884-45f8-86b0-fc291ae52159\") " pod="openshift-ingress/payload-processing-58f86c7798-zh7w7"
Jul 08 21:44:48.965332 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:48.965299    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-8r7ss"
Jul 08 21:44:48.990720 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:48.990678    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-f4d6cdb9-rvfsq"]
Jul 08 21:44:48.994835 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:44:48.994806    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b92edda_e637_49f8_b14e_ae58c4904200.slice/crio-6c8776148d3e18cf021fb863d0f8b0082b3d9993543f1c37b5a8e038829377ec WatchSource:0}: Error finding container 6c8776148d3e18cf021fb863d0f8b0082b3d9993543f1c37b5a8e038829377ec: Status 404 returned error can't find the container with id 6c8776148d3e18cf021fb863d0f8b0082b3d9993543f1c37b5a8e038829377ec
Jul 08 21:44:49.052813 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:49.052585    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-zh7w7"
Jul 08 21:44:49.108864 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:49.108837    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-8r7ss"]
Jul 08 21:44:49.113276 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:44:49.113242    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda22bc284_b6bc_4dfe_b2fc_a2e6838441ac.slice/crio-9a2155bbbe933896530e0487af4e06cad8e74e560ac7f7b430d0950792e467db WatchSource:0}: Error finding container 9a2155bbbe933896530e0487af4e06cad8e74e560ac7f7b430d0950792e467db: Status 404 returned error can't find the container with id 9a2155bbbe933896530e0487af4e06cad8e74e560ac7f7b430d0950792e467db
Jul 08 21:44:49.194643 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:49.194615    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-zh7w7"]
Jul 08 21:44:49.197086 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:44:49.197061    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod806002e7_9884_45f8_86b0_fc291ae52159.slice/crio-7549b9c23c70c3489f3ad46fbe0be75ca4b5df834c0d2770d98e22ef525b778c WatchSource:0}: Error finding container 7549b9c23c70c3489f3ad46fbe0be75ca4b5df834c0d2770d98e22ef525b778c: Status 404 returned error can't find the container with id 7549b9c23c70c3489f3ad46fbe0be75ca4b5df834c0d2770d98e22ef525b778c
Jul 08 21:44:49.377759 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:49.377708    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-8r7ss" event={"ID":"a22bc284-b6bc-4dfe-b2fc-a2e6838441ac","Type":"ContainerStarted","Data":"9a2155bbbe933896530e0487af4e06cad8e74e560ac7f7b430d0950792e467db"}
Jul 08 21:44:49.378852 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:49.378820    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-zh7w7" event={"ID":"806002e7-9884-45f8-86b0-fc291ae52159","Type":"ContainerStarted","Data":"7549b9c23c70c3489f3ad46fbe0be75ca4b5df834c0d2770d98e22ef525b778c"}
Jul 08 21:44:49.379953 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:49.379932    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f4d6cdb9-rvfsq" event={"ID":"9b92edda-e637-49f8-b14e-ae58c4904200","Type":"ContainerStarted","Data":"6c8776148d3e18cf021fb863d0f8b0082b3d9993543f1c37b5a8e038829377ec"}
Jul 08 21:44:51.391067 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:51.391032    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-zh7w7" event={"ID":"806002e7-9884-45f8-86b0-fc291ae52159","Type":"ContainerStarted","Data":"977fac36056c3788f53d27e69f1df94fcbd0d55ec67153145fe5ce180413b67b"}
Jul 08 21:44:51.391568 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:51.391142    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-zh7w7"
Jul 08 21:44:51.392799 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:51.392769    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f4d6cdb9-rvfsq" event={"ID":"9b92edda-e637-49f8-b14e-ae58c4904200","Type":"ContainerStarted","Data":"8d3759ab9a0029366bc14498a3836d5e511f775b0d02b878b554878eb1ea2ba0"}
Jul 08 21:44:51.393060 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:51.392835    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-f4d6cdb9-rvfsq"
Jul 08 21:44:51.394244 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:51.394222    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-8r7ss" event={"ID":"a22bc284-b6bc-4dfe-b2fc-a2e6838441ac","Type":"ContainerStarted","Data":"ac25499c9e5acb0d57ce54474f6b80670184e22209596b942bb85ed369e90447"}
Jul 08 21:44:51.394370 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:51.394326    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-8r7ss"
Jul 08 21:44:51.409964 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:51.409583    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-zh7w7" podStartSLOduration=1.738778001 podStartE2EDuration="3.409566598s" totalImagesPullingTime="1.670788597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:44:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:44:51.40937526 +0000 UTC m=+714.347707678" watchObservedRunningTime="2026-07-08 21:44:51.409566598 +0000 UTC m=+714.347898998"
Jul 08 21:44:51.426253 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:51.426200    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-f4d6cdb9-rvfsq" podStartSLOduration=2.553112426 podStartE2EDuration="4.426181183s" totalImagesPullingTime="1.873068757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:44:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:44:51.42588206 +0000 UTC m=+714.364214487" watchObservedRunningTime="2026-07-08 21:44:51.426181183 +0000 UTC m=+714.364513583"
Jul 08 21:44:51.439789 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:51.439737    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-8r7ss" podStartSLOduration=1.683495642 podStartE2EDuration="3.439722576s" totalImagesPullingTime="1.756226934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:44:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:44:51.439485522 +0000 UTC m=+714.377817949" watchObservedRunningTime="2026-07-08 21:44:51.439722576 +0000 UTC m=+714.378054975"
Jul 08 21:44:57.404540 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:44:57.404512    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-f4d6cdb9-rvfsq"
Jul 08 21:45:00.139778 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:00.139741    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725785-m8zdp"]
Jul 08 21:45:00.144506 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:00.144489    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725785-m8zdp"
Jul 08 21:45:00.154046 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:00.154027    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725785-m8zdp"]
Jul 08 21:45:00.227536 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:00.227496    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzftd\" (UniqueName: \"kubernetes.io/projected/53762b2f-b2c7-40cd-88ab-34b112cca85c-kube-api-access-dzftd\") pod \"maas-api-key-cleanup-29725785-m8zdp\" (UID: \"53762b2f-b2c7-40cd-88ab-34b112cca85c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725785-m8zdp"
Jul 08 21:45:00.328635 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:00.328594    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzftd\" (UniqueName: \"kubernetes.io/projected/53762b2f-b2c7-40cd-88ab-34b112cca85c-kube-api-access-dzftd\") pod \"maas-api-key-cleanup-29725785-m8zdp\" (UID: \"53762b2f-b2c7-40cd-88ab-34b112cca85c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725785-m8zdp"
Jul 08 21:45:00.337274 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:00.337240    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzftd\" (UniqueName: \"kubernetes.io/projected/53762b2f-b2c7-40cd-88ab-34b112cca85c-kube-api-access-dzftd\") pod \"maas-api-key-cleanup-29725785-m8zdp\" (UID: \"53762b2f-b2c7-40cd-88ab-34b112cca85c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725785-m8zdp"
Jul 08 21:45:00.455043 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:00.454953    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725785-m8zdp"
Jul 08 21:45:00.580190 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:00.580160    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725785-m8zdp"]
Jul 08 21:45:00.582818 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:45:00.582786    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53762b2f_b2c7_40cd_88ab_34b112cca85c.slice/crio-bc72b944192d2c2ae901748df255983c589ab79889bd33029e23c82b3f3f2719 WatchSource:0}: Error finding container bc72b944192d2c2ae901748df255983c589ab79889bd33029e23c82b3f3f2719: Status 404 returned error can't find the container with id bc72b944192d2c2ae901748df255983c589ab79889bd33029e23c82b3f3f2719
Jul 08 21:45:01.434333 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:01.434278    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725785-m8zdp" event={"ID":"53762b2f-b2c7-40cd-88ab-34b112cca85c","Type":"ContainerStarted","Data":"bc72b944192d2c2ae901748df255983c589ab79889bd33029e23c82b3f3f2719"}
Jul 08 21:45:02.400880 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:02.400835    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-zh7w7"
Jul 08 21:45:02.401501 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:02.401317    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-8r7ss"
Jul 08 21:45:03.445781 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:03.445743    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725785-m8zdp" event={"ID":"53762b2f-b2c7-40cd-88ab-34b112cca85c","Type":"ContainerStarted","Data":"af46a92b329c5ee3a3e7e0c01c502d48dec2f65a2b140d66da5287f24e30b80a"}
Jul 08 21:45:03.462211 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:03.462101    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725785-m8zdp" podStartSLOduration=1.230730892 podStartE2EDuration="3.462081241s" totalImagesPullingTime="2.231350349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:45:03.461824114 +0000 UTC m=+726.400156534" watchObservedRunningTime="2026-07-08 21:45:03.462081241 +0000 UTC m=+726.400413643"
Jul 08 21:45:06.555124 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:06.555081    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx"]
Jul 08 21:45:06.558700 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:06.558679    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx"
Jul 08 21:45:06.561057 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:06.561035    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 08 21:45:06.562099 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:06.562084    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 08 21:45:06.562216 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:06.562191    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tr7vh\""
Jul 08 21:45:06.562216 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:06.562197    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 08 21:45:06.571029 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:06.571006    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx"]
Jul 08 21:45:06.576611 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:06.576583    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70bed7d3-110f-4207-8870-ee2bed023b26-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx\" (UID: \"70bed7d3-110f-4207-8870-ee2bed023b26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx"
Jul 08 21:45:06.576737 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:06.576613    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70bed7d3-110f-4207-8870-ee2bed023b26-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx\" (UID: \"70bed7d3-110f-4207-8870-ee2bed023b26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx"
Jul 08 21:45:06.576737 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:06.576640    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70bed7d3-110f-4207-8870-ee2bed023b26-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx\" (UID: \"70bed7d3-110f-4207-8870-ee2bed023b26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx"
Jul 08 21:45:06.576737 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:06.576661    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70bed7d3-110f-4207-8870-ee2bed023b26-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx\" (UID: \"70bed7d3-110f-4207-8870-ee2bed023b26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx"
Jul 08 21:45:06.576737 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:06.576719    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqmpw\" (UniqueName: \"kubernetes.io/projected/70bed7d3-110f-4207-8870-ee2bed023b26-kube-api-access-pqmpw\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx\" (UID: \"70bed7d3-110f-4207-8870-ee2bed023b26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx"
Jul 08 21:45:06.576954 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:06.576780    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70bed7d3-110f-4207-8870-ee2bed023b26-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx\" (UID: \"70bed7d3-110f-4207-8870-ee2bed023b26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx"
Jul 08 21:45:06.677607 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:06.677569    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70bed7d3-110f-4207-8870-ee2bed023b26-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx\" (UID: \"70bed7d3-110f-4207-8870-ee2bed023b26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx"
Jul 08 21:45:06.677812 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:06.677641    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70bed7d3-110f-4207-8870-ee2bed023b26-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx\" (UID: \"70bed7d3-110f-4207-8870-ee2bed023b26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx"
Jul 08 21:45:06.677812 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:06.677661    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70bed7d3-110f-4207-8870-ee2bed023b26-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx\" (UID: \"70bed7d3-110f-4207-8870-ee2bed023b26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx"
Jul 08 21:45:06.677812 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:06.677684    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70bed7d3-110f-4207-8870-ee2bed023b26-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx\" (UID: \"70bed7d3-110f-4207-8870-ee2bed023b26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx"
Jul 08 21:45:06.677812 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:06.677706    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70bed7d3-110f-4207-8870-ee2bed023b26-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx\" (UID: \"70bed7d3-110f-4207-8870-ee2bed023b26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx"
Jul 08 21:45:06.677812 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:06.677730    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqmpw\" (UniqueName: \"kubernetes.io/projected/70bed7d3-110f-4207-8870-ee2bed023b26-kube-api-access-pqmpw\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx\" (UID: \"70bed7d3-110f-4207-8870-ee2bed023b26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx"
Jul 08 21:45:06.678116 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:06.678092    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70bed7d3-110f-4207-8870-ee2bed023b26-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx\" (UID: \"70bed7d3-110f-4207-8870-ee2bed023b26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx"
Jul 08 21:45:06.678234 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:06.678210    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70bed7d3-110f-4207-8870-ee2bed023b26-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx\" (UID: \"70bed7d3-110f-4207-8870-ee2bed023b26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx"
Jul 08 21:45:06.678316 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:06.678246    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70bed7d3-110f-4207-8870-ee2bed023b26-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx\" (UID: \"70bed7d3-110f-4207-8870-ee2bed023b26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx"
Jul 08 21:45:06.680138 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:06.680113    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70bed7d3-110f-4207-8870-ee2bed023b26-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx\" (UID: \"70bed7d3-110f-4207-8870-ee2bed023b26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx"
Jul 08 21:45:06.680338 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:06.680320    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70bed7d3-110f-4207-8870-ee2bed023b26-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx\" (UID: \"70bed7d3-110f-4207-8870-ee2bed023b26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx"
Jul 08 21:45:06.685803 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:06.685783    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqmpw\" (UniqueName: \"kubernetes.io/projected/70bed7d3-110f-4207-8870-ee2bed023b26-kube-api-access-pqmpw\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx\" (UID: \"70bed7d3-110f-4207-8870-ee2bed023b26\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx"
Jul 08 21:45:06.868936 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:06.868839    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx"
Jul 08 21:45:07.008537 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:07.008497    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx"]
Jul 08 21:45:07.011478 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:45:07.011448    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70bed7d3_110f_4207_8870_ee2bed023b26.slice/crio-f2285188985555a2b43b5079b090bb3075a238b443caf004472f577ec527d58f WatchSource:0}: Error finding container f2285188985555a2b43b5079b090bb3075a238b443caf004472f577ec527d58f: Status 404 returned error can't find the container with id f2285188985555a2b43b5079b090bb3075a238b443caf004472f577ec527d58f
Jul 08 21:45:07.464770 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:07.464732    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx" event={"ID":"70bed7d3-110f-4207-8870-ee2bed023b26","Type":"ContainerStarted","Data":"f2285188985555a2b43b5079b090bb3075a238b443caf004472f577ec527d58f"}
Jul 08 21:45:08.471035 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:08.470944    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx" event={"ID":"70bed7d3-110f-4207-8870-ee2bed023b26","Type":"ContainerStarted","Data":"8cf7989834e5f5af8ac5992b9e6264d316c0a040e2a1faf6ea48c3ee714577a2"}
Jul 08 21:45:08.488704 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:08.488655    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx" podStartSLOduration=1.324752097 podStartE2EDuration="2.488638823s" totalImagesPullingTime="1.163886726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:45:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:45:08.487679334 +0000 UTC m=+731.426011783" watchObservedRunningTime="2026-07-08 21:45:08.488638823 +0000 UTC m=+731.426971223"
Jul 08 21:45:16.869194 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:16.869153    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx"
Jul 08 21:45:16.869620 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:16.869220    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx"
Jul 08 21:45:16.881965 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:16.881938    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx"
Jul 08 21:45:17.520640 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:17.520613    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx"
Jul 08 21:45:32.145304 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:32.145252    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-f4mpl"]
Jul 08 21:45:32.150209 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:32.150186    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f4mpl"
Jul 08 21:45:32.153936 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:32.153910    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 08 21:45:32.158859 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:32.158835    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-f4mpl"]
Jul 08 21:45:32.296490 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:32.296457    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee0021cd-5293-482b-9a8d-4a65fc6154b5-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f4mpl\" (UID: \"ee0021cd-5293-482b-9a8d-4a65fc6154b5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f4mpl"
Jul 08 21:45:32.296682 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:32.296526    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee0021cd-5293-482b-9a8d-4a65fc6154b5-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f4mpl\" (UID: \"ee0021cd-5293-482b-9a8d-4a65fc6154b5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f4mpl"
Jul 08 21:45:32.296682 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:32.296604    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee0021cd-5293-482b-9a8d-4a65fc6154b5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f4mpl\" (UID: \"ee0021cd-5293-482b-9a8d-4a65fc6154b5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f4mpl"
Jul 08 21:45:32.296682 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:32.296630    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee0021cd-5293-482b-9a8d-4a65fc6154b5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f4mpl\" (UID: \"ee0021cd-5293-482b-9a8d-4a65fc6154b5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f4mpl"
Jul 08 21:45:32.296682 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:32.296648    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee0021cd-5293-482b-9a8d-4a65fc6154b5-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f4mpl\" (UID: \"ee0021cd-5293-482b-9a8d-4a65fc6154b5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f4mpl"
Jul 08 21:45:32.296831 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:32.296685    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spnps\" (UniqueName: \"kubernetes.io/projected/ee0021cd-5293-482b-9a8d-4a65fc6154b5-kube-api-access-spnps\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f4mpl\" (UID: \"ee0021cd-5293-482b-9a8d-4a65fc6154b5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f4mpl"
Jul 08 21:45:32.398063 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:32.397974    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee0021cd-5293-482b-9a8d-4a65fc6154b5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f4mpl\" (UID: \"ee0021cd-5293-482b-9a8d-4a65fc6154b5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f4mpl"
Jul 08 21:45:32.398063 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:32.398040    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee0021cd-5293-482b-9a8d-4a65fc6154b5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f4mpl\" (UID: \"ee0021cd-5293-482b-9a8d-4a65fc6154b5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f4mpl"
Jul 08 21:45:32.398311 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:32.398067    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee0021cd-5293-482b-9a8d-4a65fc6154b5-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f4mpl\" (UID: \"ee0021cd-5293-482b-9a8d-4a65fc6154b5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f4mpl"
Jul 08 21:45:32.398311 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:32.398106    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spnps\" (UniqueName: \"kubernetes.io/projected/ee0021cd-5293-482b-9a8d-4a65fc6154b5-kube-api-access-spnps\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f4mpl\" (UID: \"ee0021cd-5293-482b-9a8d-4a65fc6154b5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f4mpl"
Jul 08 21:45:32.398311 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:32.398136    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee0021cd-5293-482b-9a8d-4a65fc6154b5-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f4mpl\" (UID: \"ee0021cd-5293-482b-9a8d-4a65fc6154b5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f4mpl"
Jul 08 21:45:32.398311 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:32.398217    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee0021cd-5293-482b-9a8d-4a65fc6154b5-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f4mpl\" (UID: \"ee0021cd-5293-482b-9a8d-4a65fc6154b5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f4mpl"
Jul 08 21:45:32.398543 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:32.398517    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee0021cd-5293-482b-9a8d-4a65fc6154b5-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f4mpl\" (UID: \"ee0021cd-5293-482b-9a8d-4a65fc6154b5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f4mpl"
Jul 08 21:45:32.398585 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:32.398573    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee0021cd-5293-482b-9a8d-4a65fc6154b5-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f4mpl\" (UID: \"ee0021cd-5293-482b-9a8d-4a65fc6154b5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f4mpl"
Jul 08 21:45:32.398623 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:32.398588    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee0021cd-5293-482b-9a8d-4a65fc6154b5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f4mpl\" (UID: \"ee0021cd-5293-482b-9a8d-4a65fc6154b5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f4mpl"
Jul 08 21:45:32.400641 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:32.400614    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee0021cd-5293-482b-9a8d-4a65fc6154b5-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f4mpl\" (UID: \"ee0021cd-5293-482b-9a8d-4a65fc6154b5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f4mpl"
Jul 08 21:45:32.400780 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:32.400764    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee0021cd-5293-482b-9a8d-4a65fc6154b5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f4mpl\" (UID: \"ee0021cd-5293-482b-9a8d-4a65fc6154b5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f4mpl"
Jul 08 21:45:32.408479 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:32.408460    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spnps\" (UniqueName: \"kubernetes.io/projected/ee0021cd-5293-482b-9a8d-4a65fc6154b5-kube-api-access-spnps\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f4mpl\" (UID: \"ee0021cd-5293-482b-9a8d-4a65fc6154b5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f4mpl"
Jul 08 21:45:32.463365 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:32.463332    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f4mpl"
Jul 08 21:45:32.596631 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:32.596603    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-f4mpl"]
Jul 08 21:45:32.598682 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:45:32.598656    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee0021cd_5293_482b_9a8d_4a65fc6154b5.slice/crio-383a83486a7d2a687a231aa53d36ff1dec912e5f5dce5e2fddc47d92d370d2e5 WatchSource:0}: Error finding container 383a83486a7d2a687a231aa53d36ff1dec912e5f5dce5e2fddc47d92d370d2e5: Status 404 returned error can't find the container with id 383a83486a7d2a687a231aa53d36ff1dec912e5f5dce5e2fddc47d92d370d2e5
Jul 08 21:45:33.580139 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:33.580106    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f4mpl" event={"ID":"ee0021cd-5293-482b-9a8d-4a65fc6154b5","Type":"ContainerStarted","Data":"47d2f78809193a7c12ee156d288dd31740e55d002fdf0e3fae9d2e5e707d2bfc"}
Jul 08 21:45:33.580561 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:33.580158    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f4mpl" event={"ID":"ee0021cd-5293-482b-9a8d-4a65fc6154b5","Type":"ContainerStarted","Data":"383a83486a7d2a687a231aa53d36ff1dec912e5f5dce5e2fddc47d92d370d2e5"}
Jul 08 21:45:33.612636 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:33.612572    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f4mpl" podStartSLOduration=1.3965564719999999 podStartE2EDuration="1.61255504s" totalImagesPullingTime="215.998568ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:45:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:45:33.610762439 +0000 UTC m=+756.549094841" watchObservedRunningTime="2026-07-08 21:45:33.61255504 +0000 UTC m=+756.550887453"
Jul 08 21:45:42.464171 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:42.464131    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f4mpl"
Jul 08 21:45:42.464704 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:42.464196    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f4mpl"
Jul 08 21:45:42.476596 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:42.476572    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f4mpl"
Jul 08 21:45:42.628043 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:45:42.628016    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f4mpl"
Jul 08 21:46:00.010142 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:46:00.010109    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725785-m8zdp"]
Jul 08 21:46:00.010564 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:46:00.010333    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725785-m8zdp" podUID="53762b2f-b2c7-40cd-88ab-34b112cca85c" containerName="cleanup" containerID="cri-o://af46a92b329c5ee3a3e7e0c01c502d48dec2f65a2b140d66da5287f24e30b80a" gracePeriod=30
Jul 08 21:46:30.196445 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:46:30.196420    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725785-m8zdp"
Jul 08 21:46:30.294612 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:46:30.294537    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzftd\" (UniqueName: \"kubernetes.io/projected/53762b2f-b2c7-40cd-88ab-34b112cca85c-kube-api-access-dzftd\") pod \"53762b2f-b2c7-40cd-88ab-34b112cca85c\" (UID: \"53762b2f-b2c7-40cd-88ab-34b112cca85c\") "
Jul 08 21:46:30.296828 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:46:30.296804    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53762b2f-b2c7-40cd-88ab-34b112cca85c-kube-api-access-dzftd" (OuterVolumeSpecName: "kube-api-access-dzftd") pod "53762b2f-b2c7-40cd-88ab-34b112cca85c" (UID: "53762b2f-b2c7-40cd-88ab-34b112cca85c"). InnerVolumeSpecName "kube-api-access-dzftd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:46:30.395473 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:46:30.395443    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzftd\" (UniqueName: \"kubernetes.io/projected/53762b2f-b2c7-40cd-88ab-34b112cca85c-kube-api-access-dzftd\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 21:46:30.809159 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:46:30.809121    2569 generic.go:356] "Generic (PLEG): container finished" podID="53762b2f-b2c7-40cd-88ab-34b112cca85c" containerID="af46a92b329c5ee3a3e7e0c01c502d48dec2f65a2b140d66da5287f24e30b80a" exitCode=137
Jul 08 21:46:30.809359 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:46:30.809166    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725785-m8zdp"
Jul 08 21:46:30.809359 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:46:30.809207    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725785-m8zdp" event={"ID":"53762b2f-b2c7-40cd-88ab-34b112cca85c","Type":"ContainerDied","Data":"af46a92b329c5ee3a3e7e0c01c502d48dec2f65a2b140d66da5287f24e30b80a"}
Jul 08 21:46:30.809359 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:46:30.809264    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725785-m8zdp" event={"ID":"53762b2f-b2c7-40cd-88ab-34b112cca85c","Type":"ContainerDied","Data":"bc72b944192d2c2ae901748df255983c589ab79889bd33029e23c82b3f3f2719"}
Jul 08 21:46:30.809359 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:46:30.809322    2569 scope.go:117] "RemoveContainer" containerID="af46a92b329c5ee3a3e7e0c01c502d48dec2f65a2b140d66da5287f24e30b80a"
Jul 08 21:46:30.818077 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:46:30.818056    2569 scope.go:117] "RemoveContainer" containerID="af46a92b329c5ee3a3e7e0c01c502d48dec2f65a2b140d66da5287f24e30b80a"
Jul 08 21:46:30.818383 ip-10-0-131-83 kubenswrapper[2569]: E0708 21:46:30.818359    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af46a92b329c5ee3a3e7e0c01c502d48dec2f65a2b140d66da5287f24e30b80a\": container with ID starting with af46a92b329c5ee3a3e7e0c01c502d48dec2f65a2b140d66da5287f24e30b80a not found: ID does not exist" containerID="af46a92b329c5ee3a3e7e0c01c502d48dec2f65a2b140d66da5287f24e30b80a"
Jul 08 21:46:30.818479 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:46:30.818388    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af46a92b329c5ee3a3e7e0c01c502d48dec2f65a2b140d66da5287f24e30b80a"} err="failed to get container status \"af46a92b329c5ee3a3e7e0c01c502d48dec2f65a2b140d66da5287f24e30b80a\": rpc error: code = NotFound desc = could not find container \"af46a92b329c5ee3a3e7e0c01c502d48dec2f65a2b140d66da5287f24e30b80a\": container with ID starting with af46a92b329c5ee3a3e7e0c01c502d48dec2f65a2b140d66da5287f24e30b80a not found: ID does not exist"
Jul 08 21:46:30.829840 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:46:30.829815    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725785-m8zdp"]
Jul 08 21:46:30.834060 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:46:30.834039    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725785-m8zdp"]
Jul 08 21:46:31.611886 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:46:31.611854    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53762b2f-b2c7-40cd-88ab-34b112cca85c" path="/var/lib/kubelet/pods/53762b2f-b2c7-40cd-88ab-34b112cca85c/volumes"
Jul 08 21:47:57.526535 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:47:57.526504    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6cs4g_a022d640-79f0-4d35-be9a-9c6ac708d10b/ovn-acl-logging/0.log"
Jul 08 21:47:57.532038 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:47:57.532017    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6cs4g_a022d640-79f0-4d35-be9a-9c6ac708d10b/ovn-acl-logging/0.log"
Jul 08 21:49:01.239727 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:01.239689    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-695b55744f-b6h9n"]
Jul 08 21:49:01.242074 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:01.239884    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-695b55744f-b6h9n" podUID="a47c4c21-a16e-4f70-988e-2767dadff91a" containerName="manager" containerID="cri-o://81a5ce54b23e3438e162cbf43d8d3d3b9e1ca25e723b63614500f47e87cad9d6" gracePeriod=30
Jul 08 21:49:01.455264 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:01.455230    2569 generic.go:356] "Generic (PLEG): container finished" podID="a47c4c21-a16e-4f70-988e-2767dadff91a" containerID="81a5ce54b23e3438e162cbf43d8d3d3b9e1ca25e723b63614500f47e87cad9d6" exitCode=0
Jul 08 21:49:01.455474 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:01.455318    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-695b55744f-b6h9n" event={"ID":"a47c4c21-a16e-4f70-988e-2767dadff91a","Type":"ContainerDied","Data":"81a5ce54b23e3438e162cbf43d8d3d3b9e1ca25e723b63614500f47e87cad9d6"}
Jul 08 21:49:01.495559 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:01.495488    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-695b55744f-b6h9n"
Jul 08 21:49:01.605003 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:01.604967    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a47c4c21-a16e-4f70-988e-2767dadff91a-webhook-cert\") pod \"a47c4c21-a16e-4f70-988e-2767dadff91a\" (UID: \"a47c4c21-a16e-4f70-988e-2767dadff91a\") "
Jul 08 21:49:01.605217 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:01.605048    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lj4tv\" (UniqueName: \"kubernetes.io/projected/a47c4c21-a16e-4f70-988e-2767dadff91a-kube-api-access-lj4tv\") pod \"a47c4c21-a16e-4f70-988e-2767dadff91a\" (UID: \"a47c4c21-a16e-4f70-988e-2767dadff91a\") "
Jul 08 21:49:01.607307 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:01.607254    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a47c4c21-a16e-4f70-988e-2767dadff91a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a47c4c21-a16e-4f70-988e-2767dadff91a" (UID: "a47c4c21-a16e-4f70-988e-2767dadff91a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:49:01.607449 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:01.607353    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a47c4c21-a16e-4f70-988e-2767dadff91a-kube-api-access-lj4tv" (OuterVolumeSpecName: "kube-api-access-lj4tv") pod "a47c4c21-a16e-4f70-988e-2767dadff91a" (UID: "a47c4c21-a16e-4f70-988e-2767dadff91a"). InnerVolumeSpecName "kube-api-access-lj4tv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:49:01.705932 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:01.705888    2569 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a47c4c21-a16e-4f70-988e-2767dadff91a-webhook-cert\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 21:49:01.705932 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:01.705923    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lj4tv\" (UniqueName: \"kubernetes.io/projected/a47c4c21-a16e-4f70-988e-2767dadff91a-kube-api-access-lj4tv\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 21:49:02.466205 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:02.466177    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-695b55744f-b6h9n"
Jul 08 21:49:02.466660 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:02.466169    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-695b55744f-b6h9n" event={"ID":"a47c4c21-a16e-4f70-988e-2767dadff91a","Type":"ContainerDied","Data":"7cb177443f8ca01606e86e830587c0c45d0b258161ae267948b59504d47300cf"}
Jul 08 21:49:02.466660 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:02.466356    2569 scope.go:117] "RemoveContainer" containerID="81a5ce54b23e3438e162cbf43d8d3d3b9e1ca25e723b63614500f47e87cad9d6"
Jul 08 21:49:02.481765 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:02.481734    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-695b55744f-b6h9n"]
Jul 08 21:49:02.485200 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:02.485173    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-695b55744f-b6h9n"]
Jul 08 21:49:03.241337 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:03.241277    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-695b55744f-9mdpv"]
Jul 08 21:49:03.241625 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:03.241613    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53762b2f-b2c7-40cd-88ab-34b112cca85c" containerName="cleanup"
Jul 08 21:49:03.241669 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:03.241627    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="53762b2f-b2c7-40cd-88ab-34b112cca85c" containerName="cleanup"
Jul 08 21:49:03.241669 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:03.241648    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a47c4c21-a16e-4f70-988e-2767dadff91a" containerName="manager"
Jul 08 21:49:03.241669 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:03.241653    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a47c4c21-a16e-4f70-988e-2767dadff91a" containerName="manager"
Jul 08 21:49:03.241762 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:03.241696    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a47c4c21-a16e-4f70-988e-2767dadff91a" containerName="manager"
Jul 08 21:49:03.241762 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:03.241707    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="53762b2f-b2c7-40cd-88ab-34b112cca85c" containerName="cleanup"
Jul 08 21:49:03.245811 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:03.245794    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-695b55744f-9mdpv"
Jul 08 21:49:03.247892 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:03.247859    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 08 21:49:03.248804 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:03.248787    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-wghkh\""
Jul 08 21:49:03.248877 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:03.248851    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 08 21:49:03.252211 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:03.252182    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-695b55744f-9mdpv"]
Jul 08 21:49:03.421378 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:03.421339    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftlck\" (UniqueName: \"kubernetes.io/projected/4f8d0932-ecb8-48a8-88f9-93404d35e422-kube-api-access-ftlck\") pod \"maas-controller-695b55744f-9mdpv\" (UID: \"4f8d0932-ecb8-48a8-88f9-93404d35e422\") " pod="opendatahub/maas-controller-695b55744f-9mdpv"
Jul 08 21:49:03.421576 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:03.421469    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f8d0932-ecb8-48a8-88f9-93404d35e422-webhook-cert\") pod \"maas-controller-695b55744f-9mdpv\" (UID: \"4f8d0932-ecb8-48a8-88f9-93404d35e422\") " pod="opendatahub/maas-controller-695b55744f-9mdpv"
Jul 08 21:49:03.522434 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:03.522342    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f8d0932-ecb8-48a8-88f9-93404d35e422-webhook-cert\") pod \"maas-controller-695b55744f-9mdpv\" (UID: \"4f8d0932-ecb8-48a8-88f9-93404d35e422\") " pod="opendatahub/maas-controller-695b55744f-9mdpv"
Jul 08 21:49:03.522434 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:03.522405    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftlck\" (UniqueName: \"kubernetes.io/projected/4f8d0932-ecb8-48a8-88f9-93404d35e422-kube-api-access-ftlck\") pod \"maas-controller-695b55744f-9mdpv\" (UID: \"4f8d0932-ecb8-48a8-88f9-93404d35e422\") " pod="opendatahub/maas-controller-695b55744f-9mdpv"
Jul 08 21:49:03.524998 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:03.524972    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f8d0932-ecb8-48a8-88f9-93404d35e422-webhook-cert\") pod \"maas-controller-695b55744f-9mdpv\" (UID: \"4f8d0932-ecb8-48a8-88f9-93404d35e422\") " pod="opendatahub/maas-controller-695b55744f-9mdpv"
Jul 08 21:49:03.530318 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:03.530275    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftlck\" (UniqueName: \"kubernetes.io/projected/4f8d0932-ecb8-48a8-88f9-93404d35e422-kube-api-access-ftlck\") pod \"maas-controller-695b55744f-9mdpv\" (UID: \"4f8d0932-ecb8-48a8-88f9-93404d35e422\") " pod="opendatahub/maas-controller-695b55744f-9mdpv"
Jul 08 21:49:03.557205 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:03.557168    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-695b55744f-9mdpv"
Jul 08 21:49:03.615796 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:03.615757    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a47c4c21-a16e-4f70-988e-2767dadff91a" path="/var/lib/kubelet/pods/a47c4c21-a16e-4f70-988e-2767dadff91a/volumes"
Jul 08 21:49:03.696146 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:03.696114    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-695b55744f-9mdpv"]
Jul 08 21:49:03.698151 ip-10-0-131-83 kubenswrapper[2569]: W0708 21:49:03.698123    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f8d0932_ecb8_48a8_88f9_93404d35e422.slice/crio-fea2a611e0fd678fa6c213dc6916ed688e469850bd52457c953008b3c69887c7 WatchSource:0}: Error finding container fea2a611e0fd678fa6c213dc6916ed688e469850bd52457c953008b3c69887c7: Status 404 returned error can't find the container with id fea2a611e0fd678fa6c213dc6916ed688e469850bd52457c953008b3c69887c7
Jul 08 21:49:03.699539 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:03.699522    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 21:49:04.477458 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:04.477318    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-695b55744f-9mdpv" event={"ID":"4f8d0932-ecb8-48a8-88f9-93404d35e422","Type":"ContainerStarted","Data":"54f3c2bc693d9bbaebea4829c02c25bd9fdf96058d2cf675096ab06036467570"}
Jul 08 21:49:04.477458 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:04.477372    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-695b55744f-9mdpv" event={"ID":"4f8d0932-ecb8-48a8-88f9-93404d35e422","Type":"ContainerStarted","Data":"fea2a611e0fd678fa6c213dc6916ed688e469850bd52457c953008b3c69887c7"}
Jul 08 21:49:04.477458 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:04.477413    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-695b55744f-9mdpv"
Jul 08 21:49:04.494238 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:04.494180    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-695b55744f-9mdpv" podStartSLOduration=1.020648324 podStartE2EDuration="1.494163557s" totalImagesPullingTime="473.515233ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:49:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:49:04.492317108 +0000 UTC m=+967.430649525" watchObservedRunningTime="2026-07-08 21:49:04.494163557 +0000 UTC m=+967.432495956"
Jul 08 21:49:15.487740 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:49:15.487711    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-695b55744f-9mdpv"
Jul 08 21:52:57.552198 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:52:57.552161    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6cs4g_a022d640-79f0-4d35-be9a-9c6ac708d10b/ovn-acl-logging/0.log"
Jul 08 21:52:57.555779 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:52:57.555759    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6cs4g_a022d640-79f0-4d35-be9a-9c6ac708d10b/ovn-acl-logging/0.log"
Jul 08 21:57:57.578888 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:57:57.578858    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6cs4g_a022d640-79f0-4d35-be9a-9c6ac708d10b/ovn-acl-logging/0.log"
Jul 08 21:57:57.580354 ip-10-0-131-83 kubenswrapper[2569]: I0708 21:57:57.580333    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6cs4g_a022d640-79f0-4d35-be9a-9c6ac708d10b/ovn-acl-logging/0.log"
Jul 08 22:00:00.136843 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:00:00.136807    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725800-pb9zd"]
Jul 08 22:00:00.142368 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:00:00.140836    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725800-pb9zd"
Jul 08 22:00:00.158494 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:00:00.158470    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725800-pb9zd"]
Jul 08 22:00:00.299445 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:00:00.299398    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfjrq\" (UniqueName: \"kubernetes.io/projected/b0ff16f8-0907-4ca6-a216-3de981a09da7-kube-api-access-zfjrq\") pod \"maas-api-key-cleanup-29725800-pb9zd\" (UID: \"b0ff16f8-0907-4ca6-a216-3de981a09da7\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725800-pb9zd"
Jul 08 22:00:00.399885 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:00:00.399855    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfjrq\" (UniqueName: \"kubernetes.io/projected/b0ff16f8-0907-4ca6-a216-3de981a09da7-kube-api-access-zfjrq\") pod \"maas-api-key-cleanup-29725800-pb9zd\" (UID: \"b0ff16f8-0907-4ca6-a216-3de981a09da7\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725800-pb9zd"
Jul 08 22:00:00.408799 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:00:00.408778    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfjrq\" (UniqueName: \"kubernetes.io/projected/b0ff16f8-0907-4ca6-a216-3de981a09da7-kube-api-access-zfjrq\") pod \"maas-api-key-cleanup-29725800-pb9zd\" (UID: \"b0ff16f8-0907-4ca6-a216-3de981a09da7\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725800-pb9zd"
Jul 08 22:00:00.452388 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:00:00.452358    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725800-pb9zd"
Jul 08 22:00:00.579791 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:00:00.579768    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725800-pb9zd"]
Jul 08 22:00:00.581485 ip-10-0-131-83 kubenswrapper[2569]: W0708 22:00:00.581461    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0ff16f8_0907_4ca6_a216_3de981a09da7.slice/crio-0efdb40caebffb3f3f4a108c98490fd8fe900e78831773f29897d6c4b972e1fc WatchSource:0}: Error finding container 0efdb40caebffb3f3f4a108c98490fd8fe900e78831773f29897d6c4b972e1fc: Status 404 returned error can't find the container with id 0efdb40caebffb3f3f4a108c98490fd8fe900e78831773f29897d6c4b972e1fc
Jul 08 22:00:01.218335 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:00:01.218301    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725800-pb9zd" event={"ID":"b0ff16f8-0907-4ca6-a216-3de981a09da7","Type":"ContainerStarted","Data":"b5e02fd2a602e46bbf716939b5d41dcc6d4022a2622eee10d182527780f99939"}
Jul 08 22:00:01.218712 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:00:01.218357    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725800-pb9zd" event={"ID":"b0ff16f8-0907-4ca6-a216-3de981a09da7","Type":"ContainerStarted","Data":"0efdb40caebffb3f3f4a108c98490fd8fe900e78831773f29897d6c4b972e1fc"}
Jul 08 22:01:00.008494 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:00.008438    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725800-pb9zd" podStartSLOduration=60.008418969 podStartE2EDuration="1m0.008418969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:00:01.254075086 +0000 UTC m=+1624.192407513" watchObservedRunningTime="2026-07-08 22:01:00.008418969 +0000 UTC m=+1682.946751369"
Jul 08 22:01:00.009638 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:00.009617    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725800-pb9zd"]
Jul 08 22:01:00.009835 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:00.009815    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725800-pb9zd" podUID="b0ff16f8-0907-4ca6-a216-3de981a09da7" containerName="cleanup" containerID="cri-o://b5e02fd2a602e46bbf716939b5d41dcc6d4022a2622eee10d182527780f99939" gracePeriod=30
Jul 08 22:01:11.856902 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:11.856866    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8e25db08-7fd998fdcb-gswfg"]
Jul 08 22:01:11.860703 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:11.860681    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e25db08-7fd998fdcb-gswfg"
Jul 08 22:01:11.863010 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:11.862986    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-8e25db08-serving-cert\""
Jul 08 22:01:11.871630 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:11.871602    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8e25db08-7fd998fdcb-gswfg"]
Jul 08 22:01:11.912069 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:11.912027    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8cdf5c14-240b-4121-98a1-9093b05cc165-maas-api-tls\") pod \"maas-api-e2e-ait-8e25db08-7fd998fdcb-gswfg\" (UID: \"8cdf5c14-240b-4121-98a1-9093b05cc165\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e25db08-7fd998fdcb-gswfg"
Jul 08 22:01:11.912258 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:11.912080    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cdf5c14-240b-4121-98a1-9093b05cc165-openshift-service-ca\") pod \"maas-api-e2e-ait-8e25db08-7fd998fdcb-gswfg\" (UID: \"8cdf5c14-240b-4121-98a1-9093b05cc165\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e25db08-7fd998fdcb-gswfg"
Jul 08 22:01:11.912258 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:11.912102    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89f8x\" (UniqueName: \"kubernetes.io/projected/8cdf5c14-240b-4121-98a1-9093b05cc165-kube-api-access-89f8x\") pod \"maas-api-e2e-ait-8e25db08-7fd998fdcb-gswfg\" (UID: \"8cdf5c14-240b-4121-98a1-9093b05cc165\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e25db08-7fd998fdcb-gswfg"
Jul 08 22:01:12.013422 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:12.013383    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8cdf5c14-240b-4121-98a1-9093b05cc165-maas-api-tls\") pod \"maas-api-e2e-ait-8e25db08-7fd998fdcb-gswfg\" (UID: \"8cdf5c14-240b-4121-98a1-9093b05cc165\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e25db08-7fd998fdcb-gswfg"
Jul 08 22:01:12.013611 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:12.013444    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cdf5c14-240b-4121-98a1-9093b05cc165-openshift-service-ca\") pod \"maas-api-e2e-ait-8e25db08-7fd998fdcb-gswfg\" (UID: \"8cdf5c14-240b-4121-98a1-9093b05cc165\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e25db08-7fd998fdcb-gswfg"
Jul 08 22:01:12.013611 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:12.013482    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89f8x\" (UniqueName: \"kubernetes.io/projected/8cdf5c14-240b-4121-98a1-9093b05cc165-kube-api-access-89f8x\") pod \"maas-api-e2e-ait-8e25db08-7fd998fdcb-gswfg\" (UID: \"8cdf5c14-240b-4121-98a1-9093b05cc165\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e25db08-7fd998fdcb-gswfg"
Jul 08 22:01:12.014195 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:12.014173    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cdf5c14-240b-4121-98a1-9093b05cc165-openshift-service-ca\") pod \"maas-api-e2e-ait-8e25db08-7fd998fdcb-gswfg\" (UID: \"8cdf5c14-240b-4121-98a1-9093b05cc165\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e25db08-7fd998fdcb-gswfg"
Jul 08 22:01:12.016043 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:12.016019    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8cdf5c14-240b-4121-98a1-9093b05cc165-maas-api-tls\") pod \"maas-api-e2e-ait-8e25db08-7fd998fdcb-gswfg\" (UID: \"8cdf5c14-240b-4121-98a1-9093b05cc165\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e25db08-7fd998fdcb-gswfg"
Jul 08 22:01:12.021440 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:12.021419    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89f8x\" (UniqueName: \"kubernetes.io/projected/8cdf5c14-240b-4121-98a1-9093b05cc165-kube-api-access-89f8x\") pod \"maas-api-e2e-ait-8e25db08-7fd998fdcb-gswfg\" (UID: \"8cdf5c14-240b-4121-98a1-9093b05cc165\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e25db08-7fd998fdcb-gswfg"
Jul 08 22:01:12.171349 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:12.171315    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e25db08-7fd998fdcb-gswfg"
Jul 08 22:01:12.308674 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:12.308633    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8e25db08-7fd998fdcb-gswfg"]
Jul 08 22:01:12.311410 ip-10-0-131-83 kubenswrapper[2569]: W0708 22:01:12.311379    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cdf5c14_240b_4121_98a1_9093b05cc165.slice/crio-a407a84950e7206b4e1299328386d05326a178535dc418b6fd0f2493f4bf7d02 WatchSource:0}: Error finding container a407a84950e7206b4e1299328386d05326a178535dc418b6fd0f2493f4bf7d02: Status 404 returned error can't find the container with id a407a84950e7206b4e1299328386d05326a178535dc418b6fd0f2493f4bf7d02
Jul 08 22:01:12.312715 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:12.312694    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 22:01:12.519233 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:12.519147    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e25db08-7fd998fdcb-gswfg" event={"ID":"8cdf5c14-240b-4121-98a1-9093b05cc165","Type":"ContainerStarted","Data":"a407a84950e7206b4e1299328386d05326a178535dc418b6fd0f2493f4bf7d02"}
Jul 08 22:01:13.525606 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:13.525567    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e25db08-7fd998fdcb-gswfg" event={"ID":"8cdf5c14-240b-4121-98a1-9093b05cc165","Type":"ContainerStarted","Data":"7ee93f72c8e6dde647b5fa1c3be451c047fa71985d15356f9f5852849605245e"}
Jul 08 22:01:13.526078 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:13.525684    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e25db08-7fd998fdcb-gswfg"
Jul 08 22:01:13.543222 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:13.543163    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e25db08-7fd998fdcb-gswfg" podStartSLOduration=1.889097773 podStartE2EDuration="2.543143236s" totalImagesPullingTime="654.045463ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:01:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:01:13.542095278 +0000 UTC m=+1696.480427679" watchObservedRunningTime="2026-07-08 22:01:13.543143236 +0000 UTC m=+1696.481475638"
Jul 08 22:01:17.171776 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:17.171735    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8e25db08-7fd998fdcb-gswfg"]
Jul 08 22:01:17.172231 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:17.172009    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e25db08-7fd998fdcb-gswfg" podUID="8cdf5c14-240b-4121-98a1-9093b05cc165" containerName="maas-api" containerID="cri-o://7ee93f72c8e6dde647b5fa1c3be451c047fa71985d15356f9f5852849605245e" gracePeriod=30
Jul 08 22:01:17.416937 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:17.416907    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e25db08-7fd998fdcb-gswfg"
Jul 08 22:01:17.458693 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:17.458592    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cdf5c14-240b-4121-98a1-9093b05cc165-openshift-service-ca\") pod \"8cdf5c14-240b-4121-98a1-9093b05cc165\" (UID: \"8cdf5c14-240b-4121-98a1-9093b05cc165\") "
Jul 08 22:01:17.458693 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:17.458676    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8cdf5c14-240b-4121-98a1-9093b05cc165-maas-api-tls\") pod \"8cdf5c14-240b-4121-98a1-9093b05cc165\" (UID: \"8cdf5c14-240b-4121-98a1-9093b05cc165\") "
Jul 08 22:01:17.458911 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:17.458746    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89f8x\" (UniqueName: \"kubernetes.io/projected/8cdf5c14-240b-4121-98a1-9093b05cc165-kube-api-access-89f8x\") pod \"8cdf5c14-240b-4121-98a1-9093b05cc165\" (UID: \"8cdf5c14-240b-4121-98a1-9093b05cc165\") "
Jul 08 22:01:17.459026 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:17.459006    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cdf5c14-240b-4121-98a1-9093b05cc165-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8cdf5c14-240b-4121-98a1-9093b05cc165" (UID: "8cdf5c14-240b-4121-98a1-9093b05cc165"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:01:17.460861 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:17.460835    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cdf5c14-240b-4121-98a1-9093b05cc165-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8cdf5c14-240b-4121-98a1-9093b05cc165" (UID: "8cdf5c14-240b-4121-98a1-9093b05cc165"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 22:01:17.460987 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:17.460957    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cdf5c14-240b-4121-98a1-9093b05cc165-kube-api-access-89f8x" (OuterVolumeSpecName: "kube-api-access-89f8x") pod "8cdf5c14-240b-4121-98a1-9093b05cc165" (UID: "8cdf5c14-240b-4121-98a1-9093b05cc165"). InnerVolumeSpecName "kube-api-access-89f8x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:01:17.544888 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:17.544854    2569 generic.go:356] "Generic (PLEG): container finished" podID="8cdf5c14-240b-4121-98a1-9093b05cc165" containerID="7ee93f72c8e6dde647b5fa1c3be451c047fa71985d15356f9f5852849605245e" exitCode=0
Jul 08 22:01:17.545065 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:17.544902    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e25db08-7fd998fdcb-gswfg"
Jul 08 22:01:17.545065 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:17.544939    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e25db08-7fd998fdcb-gswfg" event={"ID":"8cdf5c14-240b-4121-98a1-9093b05cc165","Type":"ContainerDied","Data":"7ee93f72c8e6dde647b5fa1c3be451c047fa71985d15356f9f5852849605245e"}
Jul 08 22:01:17.545065 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:17.544986    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8e25db08-7fd998fdcb-gswfg" event={"ID":"8cdf5c14-240b-4121-98a1-9093b05cc165","Type":"ContainerDied","Data":"a407a84950e7206b4e1299328386d05326a178535dc418b6fd0f2493f4bf7d02"}
Jul 08 22:01:17.545065 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:17.545009    2569 scope.go:117] "RemoveContainer" containerID="7ee93f72c8e6dde647b5fa1c3be451c047fa71985d15356f9f5852849605245e"
Jul 08 22:01:17.553859 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:17.553840    2569 scope.go:117] "RemoveContainer" containerID="7ee93f72c8e6dde647b5fa1c3be451c047fa71985d15356f9f5852849605245e"
Jul 08 22:01:17.554153 ip-10-0-131-83 kubenswrapper[2569]: E0708 22:01:17.554129    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ee93f72c8e6dde647b5fa1c3be451c047fa71985d15356f9f5852849605245e\": container with ID starting with 7ee93f72c8e6dde647b5fa1c3be451c047fa71985d15356f9f5852849605245e not found: ID does not exist" containerID="7ee93f72c8e6dde647b5fa1c3be451c047fa71985d15356f9f5852849605245e"
Jul 08 22:01:17.554250 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:17.554161    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ee93f72c8e6dde647b5fa1c3be451c047fa71985d15356f9f5852849605245e"} err="failed to get container status \"7ee93f72c8e6dde647b5fa1c3be451c047fa71985d15356f9f5852849605245e\": rpc error: code = NotFound desc = could not find container \"7ee93f72c8e6dde647b5fa1c3be451c047fa71985d15356f9f5852849605245e\": container with ID starting with 7ee93f72c8e6dde647b5fa1c3be451c047fa71985d15356f9f5852849605245e not found: ID does not exist"
Jul 08 22:01:17.559547 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:17.559523    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8cdf5c14-240b-4121-98a1-9093b05cc165-maas-api-tls\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:01:17.559547 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:17.559546    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89f8x\" (UniqueName: \"kubernetes.io/projected/8cdf5c14-240b-4121-98a1-9093b05cc165-kube-api-access-89f8x\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:01:17.559715 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:17.559555    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cdf5c14-240b-4121-98a1-9093b05cc165-openshift-service-ca\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:01:17.565570 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:17.565538    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8e25db08-7fd998fdcb-gswfg"]
Jul 08 22:01:17.569376 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:17.569352    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8e25db08-7fd998fdcb-gswfg"]
Jul 08 22:01:17.613271 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:17.613183    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cdf5c14-240b-4121-98a1-9093b05cc165" path="/var/lib/kubelet/pods/8cdf5c14-240b-4121-98a1-9093b05cc165/volumes"
Jul 08 22:01:23.051947 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:23.051915    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h"]
Jul 08 22:01:23.052483 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:23.052465    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cdf5c14-240b-4121-98a1-9093b05cc165" containerName="maas-api"
Jul 08 22:01:23.052588 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:23.052487    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cdf5c14-240b-4121-98a1-9093b05cc165" containerName="maas-api"
Jul 08 22:01:23.052647 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:23.052587    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cdf5c14-240b-4121-98a1-9093b05cc165" containerName="maas-api"
Jul 08 22:01:23.057218 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:23.057194    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h"
Jul 08 22:01:23.059558 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:23.059533    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-96fe6628-openshift-default-dockercfg-g86tf\""
Jul 08 22:01:23.068096 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:23.068071    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h"]
Jul 08 22:01:23.107256 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:23.107227    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jqzj\" (UniqueName: \"kubernetes.io/projected/634c593c-f689-41ca-8762-474d74a6ea9a-kube-api-access-8jqzj\") pod \"e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h\" (UID: \"634c593c-f689-41ca-8762-474d74a6ea9a\") " pod="openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h"
Jul 08 22:01:23.107402 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:23.107271    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/634c593c-f689-41ca-8762-474d74a6ea9a-istio-data\") pod \"e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h\" (UID: \"634c593c-f689-41ca-8762-474d74a6ea9a\") " pod="openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h"
Jul 08 22:01:23.107402 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:23.107304    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/634c593c-f689-41ca-8762-474d74a6ea9a-istio-token\") pod \"e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h\" (UID: \"634c593c-f689-41ca-8762-474d74a6ea9a\") " pod="openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h"
Jul 08 22:01:23.107495 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:23.107408    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/634c593c-f689-41ca-8762-474d74a6ea9a-istiod-ca-cert\") pod \"e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h\" (UID: \"634c593c-f689-41ca-8762-474d74a6ea9a\") " pod="openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h"
Jul 08 22:01:23.107495 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:23.107455    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/634c593c-f689-41ca-8762-474d74a6ea9a-istio-envoy\") pod \"e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h\" (UID: \"634c593c-f689-41ca-8762-474d74a6ea9a\") " pod="openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h"
Jul 08 22:01:23.107602 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:23.107494    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/634c593c-f689-41ca-8762-474d74a6ea9a-istio-podinfo\") pod \"e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h\" (UID: \"634c593c-f689-41ca-8762-474d74a6ea9a\") " pod="openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h"
Jul 08 22:01:23.107602 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:23.107557    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/634c593c-f689-41ca-8762-474d74a6ea9a-workload-certs\") pod \"e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h\" (UID: \"634c593c-f689-41ca-8762-474d74a6ea9a\") " pod="openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h"
Jul 08 22:01:23.107602 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:23.107584    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/634c593c-f689-41ca-8762-474d74a6ea9a-credential-socket\") pod \"e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h\" (UID: \"634c593c-f689-41ca-8762-474d74a6ea9a\") " pod="openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h"
Jul 08 22:01:23.107711 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:23.107632    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/634c593c-f689-41ca-8762-474d74a6ea9a-workload-socket\") pod \"e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h\" (UID: \"634c593c-f689-41ca-8762-474d74a6ea9a\") " pod="openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h"
Jul 08 22:01:23.208271 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:23.208235    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/634c593c-f689-41ca-8762-474d74a6ea9a-workload-certs\") pod \"e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h\" (UID: \"634c593c-f689-41ca-8762-474d74a6ea9a\") " pod="openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h"
Jul 08 22:01:23.208271 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:23.208273    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/634c593c-f689-41ca-8762-474d74a6ea9a-credential-socket\") pod \"e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h\" (UID: \"634c593c-f689-41ca-8762-474d74a6ea9a\") " pod="openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h"
Jul 08 22:01:23.208513 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:23.208330    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/634c593c-f689-41ca-8762-474d74a6ea9a-workload-socket\") pod \"e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h\" (UID: \"634c593c-f689-41ca-8762-474d74a6ea9a\") " pod="openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h"
Jul 08 22:01:23.208513 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:23.208352    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jqzj\" (UniqueName: \"kubernetes.io/projected/634c593c-f689-41ca-8762-474d74a6ea9a-kube-api-access-8jqzj\") pod \"e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h\" (UID: \"634c593c-f689-41ca-8762-474d74a6ea9a\") " pod="openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h"
Jul 08 22:01:23.208513 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:23.208384    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/634c593c-f689-41ca-8762-474d74a6ea9a-istio-data\") pod \"e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h\" (UID: \"634c593c-f689-41ca-8762-474d74a6ea9a\") " pod="openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h"
Jul 08 22:01:23.208513 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:23.208401    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/634c593c-f689-41ca-8762-474d74a6ea9a-istio-token\") pod \"e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h\" (UID: \"634c593c-f689-41ca-8762-474d74a6ea9a\") " pod="openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h"
Jul 08 22:01:23.208513 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:23.208442    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/634c593c-f689-41ca-8762-474d74a6ea9a-istiod-ca-cert\") pod \"e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h\" (UID: \"634c593c-f689-41ca-8762-474d74a6ea9a\") " pod="openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h"
Jul 08 22:01:23.208513 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:23.208474    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/634c593c-f689-41ca-8762-474d74a6ea9a-istio-envoy\") pod \"e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h\" (UID: \"634c593c-f689-41ca-8762-474d74a6ea9a\") " pod="openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h"
Jul 08 22:01:23.208513 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:23.208501    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/634c593c-f689-41ca-8762-474d74a6ea9a-istio-podinfo\") pod \"e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h\" (UID: \"634c593c-f689-41ca-8762-474d74a6ea9a\") " pod="openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h"
Jul 08 22:01:23.208901 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:23.208683    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/634c593c-f689-41ca-8762-474d74a6ea9a-workload-certs\") pod \"e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h\" (UID: \"634c593c-f689-41ca-8762-474d74a6ea9a\") " pod="openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h"
Jul 08 22:01:23.208901 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:23.208741    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/634c593c-f689-41ca-8762-474d74a6ea9a-credential-socket\") pod \"e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h\" (UID: \"634c593c-f689-41ca-8762-474d74a6ea9a\") " pod="openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h"
Jul 08 22:01:23.208901 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:23.208772    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/634c593c-f689-41ca-8762-474d74a6ea9a-workload-socket\") pod \"e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h\" (UID: \"634c593c-f689-41ca-8762-474d74a6ea9a\") " pod="openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h"
Jul 08 22:01:23.209266 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:23.209229    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/634c593c-f689-41ca-8762-474d74a6ea9a-istiod-ca-cert\") pod \"e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h\" (UID: \"634c593c-f689-41ca-8762-474d74a6ea9a\") " pod="openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h"
Jul 08 22:01:23.209266 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:23.209245    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/634c593c-f689-41ca-8762-474d74a6ea9a-istio-data\") pod \"e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h\" (UID: \"634c593c-f689-41ca-8762-474d74a6ea9a\") " pod="openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h"
Jul 08 22:01:23.211053 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:23.211021    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/634c593c-f689-41ca-8762-474d74a6ea9a-istio-envoy\") pod \"e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h\" (UID: \"634c593c-f689-41ca-8762-474d74a6ea9a\") " pod="openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h"
Jul 08 22:01:23.211144 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:23.211128    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/634c593c-f689-41ca-8762-474d74a6ea9a-istio-podinfo\") pod \"e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h\" (UID: \"634c593c-f689-41ca-8762-474d74a6ea9a\") " pod="openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h"
Jul 08 22:01:23.226863 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:23.226835    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/634c593c-f689-41ca-8762-474d74a6ea9a-istio-token\") pod \"e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h\" (UID: \"634c593c-f689-41ca-8762-474d74a6ea9a\") " pod="openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h"
Jul 08 22:01:23.232452 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:23.232418    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jqzj\" (UniqueName: \"kubernetes.io/projected/634c593c-f689-41ca-8762-474d74a6ea9a-kube-api-access-8jqzj\") pod \"e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h\" (UID: \"634c593c-f689-41ca-8762-474d74a6ea9a\") " pod="openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h"
Jul 08 22:01:23.369693 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:23.369612    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h"
Jul 08 22:01:23.505549 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:23.505523    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h"]
Jul 08 22:01:23.507532 ip-10-0-131-83 kubenswrapper[2569]: W0708 22:01:23.507503    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod634c593c_f689_41ca_8762_474d74a6ea9a.slice/crio-0642ca3c68eadb832e97021dac59498b00852bd13ac49b63949542fd26fc24fa WatchSource:0}: Error finding container 0642ca3c68eadb832e97021dac59498b00852bd13ac49b63949542fd26fc24fa: Status 404 returned error can't find the container with id 0642ca3c68eadb832e97021dac59498b00852bd13ac49b63949542fd26fc24fa
Jul 08 22:01:23.571662 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:23.571627    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h" event={"ID":"634c593c-f689-41ca-8762-474d74a6ea9a","Type":"ContainerStarted","Data":"0642ca3c68eadb832e97021dac59498b00852bd13ac49b63949542fd26fc24fa"}
Jul 08 22:01:24.345790 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:24.345758    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-96fe6628-599d67b46d-wjjq2"]
Jul 08 22:01:24.349863 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:24.349837    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-96fe6628-599d67b46d-wjjq2"
Jul 08 22:01:24.353833 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:24.353808    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-96fe6628-serving-cert\""
Jul 08 22:01:24.363032 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:24.362997    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-96fe6628-599d67b46d-wjjq2"]
Jul 08 22:01:24.419798 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:24.419759    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bb2b533-08c5-490f-99ce-aed058959f8c-openshift-service-ca\") pod \"maas-api-e2e-ait-96fe6628-599d67b46d-wjjq2\" (UID: \"5bb2b533-08c5-490f-99ce-aed058959f8c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-96fe6628-599d67b46d-wjjq2"
Jul 08 22:01:24.419960 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:24.419834    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqv55\" (UniqueName: \"kubernetes.io/projected/5bb2b533-08c5-490f-99ce-aed058959f8c-kube-api-access-hqv55\") pod \"maas-api-e2e-ait-96fe6628-599d67b46d-wjjq2\" (UID: \"5bb2b533-08c5-490f-99ce-aed058959f8c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-96fe6628-599d67b46d-wjjq2"
Jul 08 22:01:24.419960 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:24.419933    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5bb2b533-08c5-490f-99ce-aed058959f8c-maas-api-tls\") pod \"maas-api-e2e-ait-96fe6628-599d67b46d-wjjq2\" (UID: \"5bb2b533-08c5-490f-99ce-aed058959f8c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-96fe6628-599d67b46d-wjjq2"
Jul 08 22:01:24.521218 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:24.521175    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqv55\" (UniqueName: \"kubernetes.io/projected/5bb2b533-08c5-490f-99ce-aed058959f8c-kube-api-access-hqv55\") pod \"maas-api-e2e-ait-96fe6628-599d67b46d-wjjq2\" (UID: \"5bb2b533-08c5-490f-99ce-aed058959f8c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-96fe6628-599d67b46d-wjjq2"
Jul 08 22:01:24.521416 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:24.521276    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5bb2b533-08c5-490f-99ce-aed058959f8c-maas-api-tls\") pod \"maas-api-e2e-ait-96fe6628-599d67b46d-wjjq2\" (UID: \"5bb2b533-08c5-490f-99ce-aed058959f8c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-96fe6628-599d67b46d-wjjq2"
Jul 08 22:01:24.521482 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:24.521458    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bb2b533-08c5-490f-99ce-aed058959f8c-openshift-service-ca\") pod \"maas-api-e2e-ait-96fe6628-599d67b46d-wjjq2\" (UID: \"5bb2b533-08c5-490f-99ce-aed058959f8c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-96fe6628-599d67b46d-wjjq2"
Jul 08 22:01:24.521537 ip-10-0-131-83 kubenswrapper[2569]: E0708 22:01:24.521507    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-96fe6628-serving-cert: secret "maas-api-e2e-ait-96fe6628-serving-cert" not found
Jul 08 22:01:24.521603 ip-10-0-131-83 kubenswrapper[2569]: E0708 22:01:24.521585    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bb2b533-08c5-490f-99ce-aed058959f8c-maas-api-tls podName:5bb2b533-08c5-490f-99ce-aed058959f8c nodeName:}" failed. No retries permitted until 2026-07-08 22:01:25.021563335 +0000 UTC m=+1707.959895730 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5bb2b533-08c5-490f-99ce-aed058959f8c-maas-api-tls") pod "maas-api-e2e-ait-96fe6628-599d67b46d-wjjq2" (UID: "5bb2b533-08c5-490f-99ce-aed058959f8c") : secret "maas-api-e2e-ait-96fe6628-serving-cert" not found
Jul 08 22:01:24.522247 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:24.522217    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bb2b533-08c5-490f-99ce-aed058959f8c-openshift-service-ca\") pod \"maas-api-e2e-ait-96fe6628-599d67b46d-wjjq2\" (UID: \"5bb2b533-08c5-490f-99ce-aed058959f8c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-96fe6628-599d67b46d-wjjq2"
Jul 08 22:01:24.530528 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:24.530504    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqv55\" (UniqueName: \"kubernetes.io/projected/5bb2b533-08c5-490f-99ce-aed058959f8c-kube-api-access-hqv55\") pod \"maas-api-e2e-ait-96fe6628-599d67b46d-wjjq2\" (UID: \"5bb2b533-08c5-490f-99ce-aed058959f8c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-96fe6628-599d67b46d-wjjq2"
Jul 08 22:01:25.026232 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:25.026189    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5bb2b533-08c5-490f-99ce-aed058959f8c-maas-api-tls\") pod \"maas-api-e2e-ait-96fe6628-599d67b46d-wjjq2\" (UID: \"5bb2b533-08c5-490f-99ce-aed058959f8c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-96fe6628-599d67b46d-wjjq2"
Jul 08 22:01:25.029237 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:25.029209    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5bb2b533-08c5-490f-99ce-aed058959f8c-maas-api-tls\") pod \"maas-api-e2e-ait-96fe6628-599d67b46d-wjjq2\" (UID: \"5bb2b533-08c5-490f-99ce-aed058959f8c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-96fe6628-599d67b46d-wjjq2"
Jul 08 22:01:25.263030 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:25.262990    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-96fe6628-599d67b46d-wjjq2"
Jul 08 22:01:26.167811 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:26.167307    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 08 22:01:26.167811 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:26.167405    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 08 22:01:26.167811 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:26.167504    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 08 22:01:26.229726 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:26.229705    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-96fe6628-599d67b46d-wjjq2"]
Jul 08 22:01:26.232408 ip-10-0-131-83 kubenswrapper[2569]: W0708 22:01:26.232381    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bb2b533_08c5_490f_99ce_aed058959f8c.slice/crio-d3d9567dcb35cd4964b0672f8fef6cca3182ab9aaef61b75a9ba8c0f7b24f162 WatchSource:0}: Error finding container d3d9567dcb35cd4964b0672f8fef6cca3182ab9aaef61b75a9ba8c0f7b24f162: Status 404 returned error can't find the container with id d3d9567dcb35cd4964b0672f8fef6cca3182ab9aaef61b75a9ba8c0f7b24f162
Jul 08 22:01:26.588021 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:26.587977    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h" event={"ID":"634c593c-f689-41ca-8762-474d74a6ea9a","Type":"ContainerStarted","Data":"8e6c8931bf4a1ce14e9e57064cefce6e5b105367c6ca3504e26861e479212a15"}
Jul 08 22:01:26.589191 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:26.589161    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-96fe6628-599d67b46d-wjjq2" event={"ID":"5bb2b533-08c5-490f-99ce-aed058959f8c","Type":"ContainerStarted","Data":"d3d9567dcb35cd4964b0672f8fef6cca3182ab9aaef61b75a9ba8c0f7b24f162"}
Jul 08 22:01:26.608791 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:26.608727    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h" podStartSLOduration=0.951274325 podStartE2EDuration="3.608707751s" totalImagesPullingTime="2.657433426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:01:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:01:26.606179438 +0000 UTC m=+1709.544511849" watchObservedRunningTime="2026-07-08 22:01:26.608707751 +0000 UTC m=+1709.547040151"
Jul 08 22:01:27.370792 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:27.370760    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h"
Jul 08 22:01:27.375117 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:27.375091    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h"
Jul 08 22:01:27.595807 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:27.595770    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-96fe6628-599d67b46d-wjjq2" event={"ID":"5bb2b533-08c5-490f-99ce-aed058959f8c","Type":"ContainerStarted","Data":"96a2d483e8a283cffcb5e29d2b2556e8372ebf4c40f1153eda036fe69a61b09c"}
Jul 08 22:01:27.596059 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:27.596041    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h"
Jul 08 22:01:27.596949 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:27.596929    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h"
Jul 08 22:01:27.613419 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:27.613377    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-96fe6628-599d67b46d-wjjq2" podStartSLOduration=3.075125609 podStartE2EDuration="3.613362631s" totalImagesPullingTime="538.237022ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:01:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:01:27.61166509 +0000 UTC m=+1710.549997512" watchObservedRunningTime="2026-07-08 22:01:27.613362631 +0000 UTC m=+1710.551695031"
Jul 08 22:01:28.603989 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:28.603960    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-96fe6628-599d67b46d-wjjq2"
Jul 08 22:01:29.659013 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:29.658981    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-96fe6628-599d67b46d-wjjq2"]
Jul 08 22:01:29.667032 ip-10-0-131-83 kubenswrapper[2569]: E0708 22:01:29.667009    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-96fe6628-serving-cert: secret "maas-api-e2e-ait-96fe6628-serving-cert" not found
Jul 08 22:01:29.667153 ip-10-0-131-83 kubenswrapper[2569]: E0708 22:01:29.667091    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bb2b533-08c5-490f-99ce-aed058959f8c-maas-api-tls podName:5bb2b533-08c5-490f-99ce-aed058959f8c nodeName:}" failed. No retries permitted until 2026-07-08 22:01:30.167070594 +0000 UTC m=+1713.105402976 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5bb2b533-08c5-490f-99ce-aed058959f8c-maas-api-tls") pod "maas-api-e2e-ait-96fe6628-599d67b46d-wjjq2" (UID: "5bb2b533-08c5-490f-99ce-aed058959f8c") : secret "maas-api-e2e-ait-96fe6628-serving-cert" not found
Jul 08 22:01:30.171018 ip-10-0-131-83 kubenswrapper[2569]: E0708 22:01:30.170987    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-96fe6628-serving-cert: secret "maas-api-e2e-ait-96fe6628-serving-cert" not found
Jul 08 22:01:30.171180 ip-10-0-131-83 kubenswrapper[2569]: E0708 22:01:30.171072    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bb2b533-08c5-490f-99ce-aed058959f8c-maas-api-tls podName:5bb2b533-08c5-490f-99ce-aed058959f8c nodeName:}" failed. No retries permitted until 2026-07-08 22:01:31.171052855 +0000 UTC m=+1714.109385233 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5bb2b533-08c5-490f-99ce-aed058959f8c-maas-api-tls") pod "maas-api-e2e-ait-96fe6628-599d67b46d-wjjq2" (UID: "5bb2b533-08c5-490f-99ce-aed058959f8c") : secret "maas-api-e2e-ait-96fe6628-serving-cert" not found
Jul 08 22:01:30.220584 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:30.220559    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725800-pb9zd"
Jul 08 22:01:30.372651 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:30.372572    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zfjrq\" (UniqueName: \"kubernetes.io/projected/b0ff16f8-0907-4ca6-a216-3de981a09da7-kube-api-access-zfjrq\") pod \"b0ff16f8-0907-4ca6-a216-3de981a09da7\" (UID: \"b0ff16f8-0907-4ca6-a216-3de981a09da7\") "
Jul 08 22:01:30.374700 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:30.374667    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0ff16f8-0907-4ca6-a216-3de981a09da7-kube-api-access-zfjrq" (OuterVolumeSpecName: "kube-api-access-zfjrq") pod "b0ff16f8-0907-4ca6-a216-3de981a09da7" (UID: "b0ff16f8-0907-4ca6-a216-3de981a09da7"). InnerVolumeSpecName "kube-api-access-zfjrq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:01:30.473557 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:30.473519    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zfjrq\" (UniqueName: \"kubernetes.io/projected/b0ff16f8-0907-4ca6-a216-3de981a09da7-kube-api-access-zfjrq\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:01:30.615001 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:30.614967    2569 generic.go:356] "Generic (PLEG): container finished" podID="b0ff16f8-0907-4ca6-a216-3de981a09da7" containerID="b5e02fd2a602e46bbf716939b5d41dcc6d4022a2622eee10d182527780f99939" exitCode=137
Jul 08 22:01:30.615148 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:30.615006    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725800-pb9zd"
Jul 08 22:01:30.615148 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:30.615037    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725800-pb9zd" event={"ID":"b0ff16f8-0907-4ca6-a216-3de981a09da7","Type":"ContainerDied","Data":"b5e02fd2a602e46bbf716939b5d41dcc6d4022a2622eee10d182527780f99939"}
Jul 08 22:01:30.615148 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:30.615077    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725800-pb9zd" event={"ID":"b0ff16f8-0907-4ca6-a216-3de981a09da7","Type":"ContainerDied","Data":"0efdb40caebffb3f3f4a108c98490fd8fe900e78831773f29897d6c4b972e1fc"}
Jul 08 22:01:30.615148 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:30.615099    2569 scope.go:117] "RemoveContainer" containerID="b5e02fd2a602e46bbf716939b5d41dcc6d4022a2622eee10d182527780f99939"
Jul 08 22:01:30.615418 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:30.615397    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-96fe6628-599d67b46d-wjjq2" podUID="5bb2b533-08c5-490f-99ce-aed058959f8c" containerName="maas-api" containerID="cri-o://96a2d483e8a283cffcb5e29d2b2556e8372ebf4c40f1153eda036fe69a61b09c" gracePeriod=30
Jul 08 22:01:30.624486 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:30.624336    2569 scope.go:117] "RemoveContainer" containerID="b5e02fd2a602e46bbf716939b5d41dcc6d4022a2622eee10d182527780f99939"
Jul 08 22:01:30.624713 ip-10-0-131-83 kubenswrapper[2569]: E0708 22:01:30.624693    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5e02fd2a602e46bbf716939b5d41dcc6d4022a2622eee10d182527780f99939\": container with ID starting with b5e02fd2a602e46bbf716939b5d41dcc6d4022a2622eee10d182527780f99939 not found: ID does not exist" containerID="b5e02fd2a602e46bbf716939b5d41dcc6d4022a2622eee10d182527780f99939"
Jul 08 22:01:30.624798 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:30.624731    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5e02fd2a602e46bbf716939b5d41dcc6d4022a2622eee10d182527780f99939"} err="failed to get container status \"b5e02fd2a602e46bbf716939b5d41dcc6d4022a2622eee10d182527780f99939\": rpc error: code = NotFound desc = could not find container \"b5e02fd2a602e46bbf716939b5d41dcc6d4022a2622eee10d182527780f99939\": container with ID starting with b5e02fd2a602e46bbf716939b5d41dcc6d4022a2622eee10d182527780f99939 not found: ID does not exist"
Jul 08 22:01:30.703009 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:30.702966    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725800-pb9zd"]
Jul 08 22:01:30.709514 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:30.709482    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725800-pb9zd"]
Jul 08 22:01:30.861874 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:30.861849    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-96fe6628-599d67b46d-wjjq2"
Jul 08 22:01:30.978886 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:30.978854    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5bb2b533-08c5-490f-99ce-aed058959f8c-maas-api-tls\") pod \"5bb2b533-08c5-490f-99ce-aed058959f8c\" (UID: \"5bb2b533-08c5-490f-99ce-aed058959f8c\") "
Jul 08 22:01:30.979095 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:30.978899    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bb2b533-08c5-490f-99ce-aed058959f8c-openshift-service-ca\") pod \"5bb2b533-08c5-490f-99ce-aed058959f8c\" (UID: \"5bb2b533-08c5-490f-99ce-aed058959f8c\") "
Jul 08 22:01:30.979095 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:30.978925    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqv55\" (UniqueName: \"kubernetes.io/projected/5bb2b533-08c5-490f-99ce-aed058959f8c-kube-api-access-hqv55\") pod \"5bb2b533-08c5-490f-99ce-aed058959f8c\" (UID: \"5bb2b533-08c5-490f-99ce-aed058959f8c\") "
Jul 08 22:01:30.979225 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:30.979203    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bb2b533-08c5-490f-99ce-aed058959f8c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5bb2b533-08c5-490f-99ce-aed058959f8c" (UID: "5bb2b533-08c5-490f-99ce-aed058959f8c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:01:30.981054 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:30.981034    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bb2b533-08c5-490f-99ce-aed058959f8c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5bb2b533-08c5-490f-99ce-aed058959f8c" (UID: "5bb2b533-08c5-490f-99ce-aed058959f8c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 22:01:30.981122 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:30.981103    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bb2b533-08c5-490f-99ce-aed058959f8c-kube-api-access-hqv55" (OuterVolumeSpecName: "kube-api-access-hqv55") pod "5bb2b533-08c5-490f-99ce-aed058959f8c" (UID: "5bb2b533-08c5-490f-99ce-aed058959f8c"). InnerVolumeSpecName "kube-api-access-hqv55". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:01:31.079875 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:31.079841    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5bb2b533-08c5-490f-99ce-aed058959f8c-maas-api-tls\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:01:31.079875 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:31.079868    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bb2b533-08c5-490f-99ce-aed058959f8c-openshift-service-ca\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:01:31.079875 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:31.079878    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqv55\" (UniqueName: \"kubernetes.io/projected/5bb2b533-08c5-490f-99ce-aed058959f8c-kube-api-access-hqv55\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:01:31.614869 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:31.614819    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0ff16f8-0907-4ca6-a216-3de981a09da7" path="/var/lib/kubelet/pods/b0ff16f8-0907-4ca6-a216-3de981a09da7/volumes"
Jul 08 22:01:31.622309 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:31.622247    2569 generic.go:356] "Generic (PLEG): container finished" podID="5bb2b533-08c5-490f-99ce-aed058959f8c" containerID="96a2d483e8a283cffcb5e29d2b2556e8372ebf4c40f1153eda036fe69a61b09c" exitCode=0
Jul 08 22:01:31.622488 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:31.622339    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-96fe6628-599d67b46d-wjjq2"
Jul 08 22:01:31.622488 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:31.622351    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-96fe6628-599d67b46d-wjjq2" event={"ID":"5bb2b533-08c5-490f-99ce-aed058959f8c","Type":"ContainerDied","Data":"96a2d483e8a283cffcb5e29d2b2556e8372ebf4c40f1153eda036fe69a61b09c"}
Jul 08 22:01:31.622488 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:31.622415    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-96fe6628-599d67b46d-wjjq2" event={"ID":"5bb2b533-08c5-490f-99ce-aed058959f8c","Type":"ContainerDied","Data":"d3d9567dcb35cd4964b0672f8fef6cca3182ab9aaef61b75a9ba8c0f7b24f162"}
Jul 08 22:01:31.622488 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:31.622446    2569 scope.go:117] "RemoveContainer" containerID="96a2d483e8a283cffcb5e29d2b2556e8372ebf4c40f1153eda036fe69a61b09c"
Jul 08 22:01:31.631882 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:31.631865    2569 scope.go:117] "RemoveContainer" containerID="96a2d483e8a283cffcb5e29d2b2556e8372ebf4c40f1153eda036fe69a61b09c"
Jul 08 22:01:31.632130 ip-10-0-131-83 kubenswrapper[2569]: E0708 22:01:31.632108    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96a2d483e8a283cffcb5e29d2b2556e8372ebf4c40f1153eda036fe69a61b09c\": container with ID starting with 96a2d483e8a283cffcb5e29d2b2556e8372ebf4c40f1153eda036fe69a61b09c not found: ID does not exist" containerID="96a2d483e8a283cffcb5e29d2b2556e8372ebf4c40f1153eda036fe69a61b09c"
Jul 08 22:01:31.632197 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:31.632141    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96a2d483e8a283cffcb5e29d2b2556e8372ebf4c40f1153eda036fe69a61b09c"} err="failed to get container status \"96a2d483e8a283cffcb5e29d2b2556e8372ebf4c40f1153eda036fe69a61b09c\": rpc error: code = NotFound desc = could not find container \"96a2d483e8a283cffcb5e29d2b2556e8372ebf4c40f1153eda036fe69a61b09c\": container with ID starting with 96a2d483e8a283cffcb5e29d2b2556e8372ebf4c40f1153eda036fe69a61b09c not found: ID does not exist"
Jul 08 22:01:31.641392 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:31.641365    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-96fe6628-599d67b46d-wjjq2"]
Jul 08 22:01:31.645616 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:31.645591    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-96fe6628-599d67b46d-wjjq2"]
Jul 08 22:01:33.613575 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:33.613535    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bb2b533-08c5-490f-99ce-aed058959f8c" path="/var/lib/kubelet/pods/5bb2b533-08c5-490f-99ce-aed058959f8c/volumes"
Jul 08 22:01:35.332098 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:35.332062    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h"]
Jul 08 22:01:35.332582 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:35.332255    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h" podUID="634c593c-f689-41ca-8762-474d74a6ea9a" containerName="istio-proxy" containerID="cri-o://8e6c8931bf4a1ce14e9e57064cefce6e5b105367c6ca3504e26861e479212a15" gracePeriod=30
Jul 08 22:01:35.474712 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:35.474687    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h"
Jul 08 22:01:35.638698 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:35.638677    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/634c593c-f689-41ca-8762-474d74a6ea9a-istio-data\") pod \"634c593c-f689-41ca-8762-474d74a6ea9a\" (UID: \"634c593c-f689-41ca-8762-474d74a6ea9a\") "
Jul 08 22:01:35.638843 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:35.638716    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/634c593c-f689-41ca-8762-474d74a6ea9a-workload-certs\") pod \"634c593c-f689-41ca-8762-474d74a6ea9a\" (UID: \"634c593c-f689-41ca-8762-474d74a6ea9a\") "
Jul 08 22:01:35.638843 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:35.638738    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jqzj\" (UniqueName: \"kubernetes.io/projected/634c593c-f689-41ca-8762-474d74a6ea9a-kube-api-access-8jqzj\") pod \"634c593c-f689-41ca-8762-474d74a6ea9a\" (UID: \"634c593c-f689-41ca-8762-474d74a6ea9a\") "
Jul 08 22:01:35.638843 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:35.638788    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/634c593c-f689-41ca-8762-474d74a6ea9a-istio-envoy\") pod \"634c593c-f689-41ca-8762-474d74a6ea9a\" (UID: \"634c593c-f689-41ca-8762-474d74a6ea9a\") "
Jul 08 22:01:35.638843 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:35.638815    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/634c593c-f689-41ca-8762-474d74a6ea9a-istio-podinfo\") pod \"634c593c-f689-41ca-8762-474d74a6ea9a\" (UID: \"634c593c-f689-41ca-8762-474d74a6ea9a\") "
Jul 08 22:01:35.639035 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:35.638853    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/634c593c-f689-41ca-8762-474d74a6ea9a-istio-token\") pod \"634c593c-f689-41ca-8762-474d74a6ea9a\" (UID: \"634c593c-f689-41ca-8762-474d74a6ea9a\") "
Jul 08 22:01:35.639035 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:35.638888    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/634c593c-f689-41ca-8762-474d74a6ea9a-workload-socket\") pod \"634c593c-f689-41ca-8762-474d74a6ea9a\" (UID: \"634c593c-f689-41ca-8762-474d74a6ea9a\") "
Jul 08 22:01:35.639035 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:35.638931    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/634c593c-f689-41ca-8762-474d74a6ea9a-istiod-ca-cert\") pod \"634c593c-f689-41ca-8762-474d74a6ea9a\" (UID: \"634c593c-f689-41ca-8762-474d74a6ea9a\") "
Jul 08 22:01:35.639035 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:35.638954    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/634c593c-f689-41ca-8762-474d74a6ea9a-credential-socket\") pod \"634c593c-f689-41ca-8762-474d74a6ea9a\" (UID: \"634c593c-f689-41ca-8762-474d74a6ea9a\") "
Jul 08 22:01:35.639035 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:35.638977    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/634c593c-f689-41ca-8762-474d74a6ea9a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "634c593c-f689-41ca-8762-474d74a6ea9a" (UID: "634c593c-f689-41ca-8762-474d74a6ea9a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:01:35.639315 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:35.639208    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/634c593c-f689-41ca-8762-474d74a6ea9a-workload-certs\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:01:35.639315 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:35.639209    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/634c593c-f689-41ca-8762-474d74a6ea9a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "634c593c-f689-41ca-8762-474d74a6ea9a" (UID: "634c593c-f689-41ca-8762-474d74a6ea9a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:01:35.639465 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:35.639442    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/634c593c-f689-41ca-8762-474d74a6ea9a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "634c593c-f689-41ca-8762-474d74a6ea9a" (UID: "634c593c-f689-41ca-8762-474d74a6ea9a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:01:35.639546 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:35.639523    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/634c593c-f689-41ca-8762-474d74a6ea9a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "634c593c-f689-41ca-8762-474d74a6ea9a" (UID: "634c593c-f689-41ca-8762-474d74a6ea9a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:01:35.639936 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:35.639906    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/634c593c-f689-41ca-8762-474d74a6ea9a-istio-data" (OuterVolumeSpecName: "istio-data") pod "634c593c-f689-41ca-8762-474d74a6ea9a" (UID: "634c593c-f689-41ca-8762-474d74a6ea9a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:01:35.641318 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:35.641259    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/634c593c-f689-41ca-8762-474d74a6ea9a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "634c593c-f689-41ca-8762-474d74a6ea9a" (UID: "634c593c-f689-41ca-8762-474d74a6ea9a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 22:01:35.641429 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:35.641387    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/634c593c-f689-41ca-8762-474d74a6ea9a-kube-api-access-8jqzj" (OuterVolumeSpecName: "kube-api-access-8jqzj") pod "634c593c-f689-41ca-8762-474d74a6ea9a" (UID: "634c593c-f689-41ca-8762-474d74a6ea9a"). InnerVolumeSpecName "kube-api-access-8jqzj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:01:35.641429 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:35.641415    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/634c593c-f689-41ca-8762-474d74a6ea9a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "634c593c-f689-41ca-8762-474d74a6ea9a" (UID: "634c593c-f689-41ca-8762-474d74a6ea9a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:01:35.641532 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:35.641461    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/634c593c-f689-41ca-8762-474d74a6ea9a-istio-token" (OuterVolumeSpecName: "istio-token") pod "634c593c-f689-41ca-8762-474d74a6ea9a" (UID: "634c593c-f689-41ca-8762-474d74a6ea9a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:01:35.646440 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:35.646414    2569 generic.go:356] "Generic (PLEG): container finished" podID="634c593c-f689-41ca-8762-474d74a6ea9a" containerID="8e6c8931bf4a1ce14e9e57064cefce6e5b105367c6ca3504e26861e479212a15" exitCode=0
Jul 08 22:01:35.646558 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:35.646468    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h"
Jul 08 22:01:35.646558 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:35.646493    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h" event={"ID":"634c593c-f689-41ca-8762-474d74a6ea9a","Type":"ContainerDied","Data":"8e6c8931bf4a1ce14e9e57064cefce6e5b105367c6ca3504e26861e479212a15"}
Jul 08 22:01:35.646558 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:35.646551    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h" event={"ID":"634c593c-f689-41ca-8762-474d74a6ea9a","Type":"ContainerDied","Data":"0642ca3c68eadb832e97021dac59498b00852bd13ac49b63949542fd26fc24fa"}
Jul 08 22:01:35.646827 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:35.646582    2569 scope.go:117] "RemoveContainer" containerID="8e6c8931bf4a1ce14e9e57064cefce6e5b105367c6ca3504e26861e479212a15"
Jul 08 22:01:35.659193 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:35.659174    2569 scope.go:117] "RemoveContainer" containerID="8e6c8931bf4a1ce14e9e57064cefce6e5b105367c6ca3504e26861e479212a15"
Jul 08 22:01:35.659514 ip-10-0-131-83 kubenswrapper[2569]: E0708 22:01:35.659493    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e6c8931bf4a1ce14e9e57064cefce6e5b105367c6ca3504e26861e479212a15\": container with ID starting with 8e6c8931bf4a1ce14e9e57064cefce6e5b105367c6ca3504e26861e479212a15 not found: ID does not exist" containerID="8e6c8931bf4a1ce14e9e57064cefce6e5b105367c6ca3504e26861e479212a15"
Jul 08 22:01:35.659574 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:35.659523    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e6c8931bf4a1ce14e9e57064cefce6e5b105367c6ca3504e26861e479212a15"} err="failed to get container status \"8e6c8931bf4a1ce14e9e57064cefce6e5b105367c6ca3504e26861e479212a15\": rpc error: code = NotFound desc = could not find container \"8e6c8931bf4a1ce14e9e57064cefce6e5b105367c6ca3504e26861e479212a15\": container with ID starting with 8e6c8931bf4a1ce14e9e57064cefce6e5b105367c6ca3504e26861e479212a15 not found: ID does not exist"
Jul 08 22:01:35.669534 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:35.669510    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h"]
Jul 08 22:01:35.679883 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:35.679850    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-96fe6628-openshift-default-847ffcdfd7-s686h"]
Jul 08 22:01:35.740047 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:35.740006    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/634c593c-f689-41ca-8762-474d74a6ea9a-workload-socket\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:01:35.740047 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:35.740039    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/634c593c-f689-41ca-8762-474d74a6ea9a-istiod-ca-cert\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:01:35.740047 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:35.740048    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/634c593c-f689-41ca-8762-474d74a6ea9a-credential-socket\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:01:35.740270 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:35.740058    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/634c593c-f689-41ca-8762-474d74a6ea9a-istio-data\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:01:35.740270 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:35.740068    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jqzj\" (UniqueName: \"kubernetes.io/projected/634c593c-f689-41ca-8762-474d74a6ea9a-kube-api-access-8jqzj\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:01:35.740270 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:35.740076    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/634c593c-f689-41ca-8762-474d74a6ea9a-istio-envoy\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:01:35.740270 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:35.740084    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/634c593c-f689-41ca-8762-474d74a6ea9a-istio-podinfo\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:01:35.740270 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:35.740091    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/634c593c-f689-41ca-8762-474d74a6ea9a-istio-token\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:01:37.613504 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:37.613473    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="634c593c-f689-41ca-8762-474d74a6ea9a" path="/var/lib/kubelet/pods/634c593c-f689-41ca-8762-474d74a6ea9a/volumes"
Jul 08 22:01:41.483865 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.483827    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r"]
Jul 08 22:01:41.484398 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.484366    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0ff16f8-0907-4ca6-a216-3de981a09da7" containerName="cleanup"
Jul 08 22:01:41.484398 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.484391    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0ff16f8-0907-4ca6-a216-3de981a09da7" containerName="cleanup"
Jul 08 22:01:41.484540 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.484412    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bb2b533-08c5-490f-99ce-aed058959f8c" containerName="maas-api"
Jul 08 22:01:41.484540 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.484421    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bb2b533-08c5-490f-99ce-aed058959f8c" containerName="maas-api"
Jul 08 22:01:41.484540 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.484432    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="634c593c-f689-41ca-8762-474d74a6ea9a" containerName="istio-proxy"
Jul 08 22:01:41.484540 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.484442    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="634c593c-f689-41ca-8762-474d74a6ea9a" containerName="istio-proxy"
Jul 08 22:01:41.484663 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.484547    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0ff16f8-0907-4ca6-a216-3de981a09da7" containerName="cleanup"
Jul 08 22:01:41.484663 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.484559    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bb2b533-08c5-490f-99ce-aed058959f8c" containerName="maas-api"
Jul 08 22:01:41.484663 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.484569    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="634c593c-f689-41ca-8762-474d74a6ea9a" containerName="istio-proxy"
Jul 08 22:01:41.488183 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.488161    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r"
Jul 08 22:01:41.490461 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.490442    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-bed7d68f-openshift-default-dockercfg-j2tmq\""
Jul 08 22:01:41.498096 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.498076    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r"]
Jul 08 22:01:41.588339 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.588269    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7012ab8b-5947-4c80-87db-e1e6621ce63a-istio-podinfo\") pod \"e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r\" (UID: \"7012ab8b-5947-4c80-87db-e1e6621ce63a\") " pod="openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r"
Jul 08 22:01:41.588535 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.588367    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7012ab8b-5947-4c80-87db-e1e6621ce63a-istiod-ca-cert\") pod \"e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r\" (UID: \"7012ab8b-5947-4c80-87db-e1e6621ce63a\") " pod="openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r"
Jul 08 22:01:41.588535 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.588401    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7012ab8b-5947-4c80-87db-e1e6621ce63a-workload-socket\") pod \"e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r\" (UID: \"7012ab8b-5947-4c80-87db-e1e6621ce63a\") " pod="openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r"
Jul 08 22:01:41.588535 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.588434    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7012ab8b-5947-4c80-87db-e1e6621ce63a-istio-envoy\") pod \"e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r\" (UID: \"7012ab8b-5947-4c80-87db-e1e6621ce63a\") " pod="openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r"
Jul 08 22:01:41.588535 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.588461    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7012ab8b-5947-4c80-87db-e1e6621ce63a-istio-token\") pod \"e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r\" (UID: \"7012ab8b-5947-4c80-87db-e1e6621ce63a\") " pod="openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r"
Jul 08 22:01:41.588535 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.588532    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7012ab8b-5947-4c80-87db-e1e6621ce63a-credential-socket\") pod \"e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r\" (UID: \"7012ab8b-5947-4c80-87db-e1e6621ce63a\") " pod="openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r"
Jul 08 22:01:41.588840 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.588583    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7012ab8b-5947-4c80-87db-e1e6621ce63a-workload-certs\") pod \"e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r\" (UID: \"7012ab8b-5947-4c80-87db-e1e6621ce63a\") " pod="openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r"
Jul 08 22:01:41.588840 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.588612    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d85k4\" (UniqueName: \"kubernetes.io/projected/7012ab8b-5947-4c80-87db-e1e6621ce63a-kube-api-access-d85k4\") pod \"e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r\" (UID: \"7012ab8b-5947-4c80-87db-e1e6621ce63a\") " pod="openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r"
Jul 08 22:01:41.588840 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.588646    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7012ab8b-5947-4c80-87db-e1e6621ce63a-istio-data\") pod \"e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r\" (UID: \"7012ab8b-5947-4c80-87db-e1e6621ce63a\") " pod="openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r"
Jul 08 22:01:41.689000 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.688967    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7012ab8b-5947-4c80-87db-e1e6621ce63a-workload-certs\") pod \"e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r\" (UID: \"7012ab8b-5947-4c80-87db-e1e6621ce63a\") " pod="openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r"
Jul 08 22:01:41.689000 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.688997    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d85k4\" (UniqueName: \"kubernetes.io/projected/7012ab8b-5947-4c80-87db-e1e6621ce63a-kube-api-access-d85k4\") pod \"e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r\" (UID: \"7012ab8b-5947-4c80-87db-e1e6621ce63a\") " pod="openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r"
Jul 08 22:01:41.689255 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.689171    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7012ab8b-5947-4c80-87db-e1e6621ce63a-istio-data\") pod \"e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r\" (UID: \"7012ab8b-5947-4c80-87db-e1e6621ce63a\") " pod="openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r"
Jul 08 22:01:41.689255 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.689235    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7012ab8b-5947-4c80-87db-e1e6621ce63a-istio-podinfo\") pod \"e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r\" (UID: \"7012ab8b-5947-4c80-87db-e1e6621ce63a\") " pod="openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r"
Jul 08 22:01:41.689391 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.689300    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7012ab8b-5947-4c80-87db-e1e6621ce63a-istiod-ca-cert\") pod \"e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r\" (UID: \"7012ab8b-5947-4c80-87db-e1e6621ce63a\") " pod="openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r"
Jul 08 22:01:41.689391 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.689336    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7012ab8b-5947-4c80-87db-e1e6621ce63a-workload-socket\") pod \"e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r\" (UID: \"7012ab8b-5947-4c80-87db-e1e6621ce63a\") " pod="openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r"
Jul 08 22:01:41.689391 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.689367    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7012ab8b-5947-4c80-87db-e1e6621ce63a-workload-certs\") pod \"e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r\" (UID: \"7012ab8b-5947-4c80-87db-e1e6621ce63a\") " pod="openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r"
Jul 08 22:01:41.689551 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.689401    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7012ab8b-5947-4c80-87db-e1e6621ce63a-istio-envoy\") pod \"e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r\" (UID: \"7012ab8b-5947-4c80-87db-e1e6621ce63a\") " pod="openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r"
Jul 08 22:01:41.689551 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.689429    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7012ab8b-5947-4c80-87db-e1e6621ce63a-istio-token\") pod \"e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r\" (UID: \"7012ab8b-5947-4c80-87db-e1e6621ce63a\") " pod="openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r"
Jul 08 22:01:41.689551 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.689524    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7012ab8b-5947-4c80-87db-e1e6621ce63a-credential-socket\") pod \"e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r\" (UID: \"7012ab8b-5947-4c80-87db-e1e6621ce63a\") " pod="openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r"
Jul 08 22:01:41.689744 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.689615    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7012ab8b-5947-4c80-87db-e1e6621ce63a-istio-data\") pod \"e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r\" (UID: \"7012ab8b-5947-4c80-87db-e1e6621ce63a\") " pod="openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r"
Jul 08 22:01:41.689878 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.689853    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7012ab8b-5947-4c80-87db-e1e6621ce63a-credential-socket\") pod \"e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r\" (UID: \"7012ab8b-5947-4c80-87db-e1e6621ce63a\") " pod="openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r"
Jul 08 22:01:41.689937 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.689878    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7012ab8b-5947-4c80-87db-e1e6621ce63a-workload-socket\") pod \"e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r\" (UID: \"7012ab8b-5947-4c80-87db-e1e6621ce63a\") " pod="openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r"
Jul 08 22:01:41.690113 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.690087    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7012ab8b-5947-4c80-87db-e1e6621ce63a-istiod-ca-cert\") pod \"e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r\" (UID: \"7012ab8b-5947-4c80-87db-e1e6621ce63a\") " pod="openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r"
Jul 08 22:01:41.691902 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.691881    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7012ab8b-5947-4c80-87db-e1e6621ce63a-istio-envoy\") pod \"e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r\" (UID: \"7012ab8b-5947-4c80-87db-e1e6621ce63a\") " pod="openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r"
Jul 08 22:01:41.692268 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.692248    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7012ab8b-5947-4c80-87db-e1e6621ce63a-istio-podinfo\") pod \"e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r\" (UID: \"7012ab8b-5947-4c80-87db-e1e6621ce63a\") " pod="openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r"
Jul 08 22:01:41.696845 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.696817    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7012ab8b-5947-4c80-87db-e1e6621ce63a-istio-token\") pod \"e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r\" (UID: \"7012ab8b-5947-4c80-87db-e1e6621ce63a\") " pod="openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r"
Jul 08 22:01:41.697319 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.697263    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d85k4\" (UniqueName: \"kubernetes.io/projected/7012ab8b-5947-4c80-87db-e1e6621ce63a-kube-api-access-d85k4\") pod \"e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r\" (UID: \"7012ab8b-5947-4c80-87db-e1e6621ce63a\") " pod="openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r"
Jul 08 22:01:41.800881 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.800788    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r"
Jul 08 22:01:41.936401 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.936370    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r"]
Jul 08 22:01:41.939103 ip-10-0-131-83 kubenswrapper[2569]: W0708 22:01:41.939076    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7012ab8b_5947_4c80_87db_e1e6621ce63a.slice/crio-419d28b2b11490b54dd39890c0e15c709d6bf6e0c31de078773cf8338187947a WatchSource:0}: Error finding container 419d28b2b11490b54dd39890c0e15c709d6bf6e0c31de078773cf8338187947a: Status 404 returned error can't find the container with id 419d28b2b11490b54dd39890c0e15c709d6bf6e0c31de078773cf8338187947a
Jul 08 22:01:41.941554 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.941516    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 08 22:01:41.941651 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.941592    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 08 22:01:41.941651 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:41.941620    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 08 22:01:42.678232 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:42.678191    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r" event={"ID":"7012ab8b-5947-4c80-87db-e1e6621ce63a","Type":"ContainerStarted","Data":"f0f275510c3871c49a427693e08fcff89d911d7a11e8c190085e50369fbbf71f"}
Jul 08 22:01:42.678653 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:42.678249    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r" event={"ID":"7012ab8b-5947-4c80-87db-e1e6621ce63a","Type":"ContainerStarted","Data":"419d28b2b11490b54dd39890c0e15c709d6bf6e0c31de078773cf8338187947a"}
Jul 08 22:01:42.694928 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:42.694888    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-bed7d68f-7867547d5f-qnrp9"]
Jul 08 22:01:42.697824 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:42.697800    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bed7d68f-7867547d5f-qnrp9"
Jul 08 22:01:42.700136 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:42.700110    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-bed7d68f-serving-cert\""
Jul 08 22:01:42.709118 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:42.709066    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r" podStartSLOduration=1.709018325 podStartE2EDuration="1.709018325s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:01:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:01:42.707081176 +0000 UTC m=+1725.645413603" watchObservedRunningTime="2026-07-08 22:01:42.709018325 +0000 UTC m=+1725.647350729"
Jul 08 22:01:42.711982 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:42.711956    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-bed7d68f-7867547d5f-qnrp9"]
Jul 08 22:01:42.798532 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:42.798502    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hklk\" (UniqueName: \"kubernetes.io/projected/a46ec873-57f5-433c-b49d-2d6a44689fb7-kube-api-access-9hklk\") pod \"maas-api-e2e-derive-bed7d68f-7867547d5f-qnrp9\" (UID: \"a46ec873-57f5-433c-b49d-2d6a44689fb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bed7d68f-7867547d5f-qnrp9"
Jul 08 22:01:42.798677 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:42.798550    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a46ec873-57f5-433c-b49d-2d6a44689fb7-maas-api-tls\") pod \"maas-api-e2e-derive-bed7d68f-7867547d5f-qnrp9\" (UID: \"a46ec873-57f5-433c-b49d-2d6a44689fb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bed7d68f-7867547d5f-qnrp9"
Jul 08 22:01:42.798677 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:42.798573    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a46ec873-57f5-433c-b49d-2d6a44689fb7-openshift-service-ca\") pod \"maas-api-e2e-derive-bed7d68f-7867547d5f-qnrp9\" (UID: \"a46ec873-57f5-433c-b49d-2d6a44689fb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bed7d68f-7867547d5f-qnrp9"
Jul 08 22:01:42.801458 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:42.801435    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r"
Jul 08 22:01:42.806034 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:42.806011    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r"
Jul 08 22:01:42.899618 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:42.899580    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hklk\" (UniqueName: \"kubernetes.io/projected/a46ec873-57f5-433c-b49d-2d6a44689fb7-kube-api-access-9hklk\") pod \"maas-api-e2e-derive-bed7d68f-7867547d5f-qnrp9\" (UID: \"a46ec873-57f5-433c-b49d-2d6a44689fb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bed7d68f-7867547d5f-qnrp9"
Jul 08 22:01:42.899782 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:42.899644    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a46ec873-57f5-433c-b49d-2d6a44689fb7-maas-api-tls\") pod \"maas-api-e2e-derive-bed7d68f-7867547d5f-qnrp9\" (UID: \"a46ec873-57f5-433c-b49d-2d6a44689fb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bed7d68f-7867547d5f-qnrp9"
Jul 08 22:01:42.899782 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:42.899674    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a46ec873-57f5-433c-b49d-2d6a44689fb7-openshift-service-ca\") pod \"maas-api-e2e-derive-bed7d68f-7867547d5f-qnrp9\" (UID: \"a46ec873-57f5-433c-b49d-2d6a44689fb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bed7d68f-7867547d5f-qnrp9"
Jul 08 22:01:42.899857 ip-10-0-131-83 kubenswrapper[2569]: E0708 22:01:42.899803    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-bed7d68f-serving-cert: secret "maas-api-e2e-derive-bed7d68f-serving-cert" not found
Jul 08 22:01:42.899898 ip-10-0-131-83 kubenswrapper[2569]: E0708 22:01:42.899860    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a46ec873-57f5-433c-b49d-2d6a44689fb7-maas-api-tls podName:a46ec873-57f5-433c-b49d-2d6a44689fb7 nodeName:}" failed. No retries permitted until 2026-07-08 22:01:43.399845106 +0000 UTC m=+1726.338177484 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a46ec873-57f5-433c-b49d-2d6a44689fb7-maas-api-tls") pod "maas-api-e2e-derive-bed7d68f-7867547d5f-qnrp9" (UID: "a46ec873-57f5-433c-b49d-2d6a44689fb7") : secret "maas-api-e2e-derive-bed7d68f-serving-cert" not found
Jul 08 22:01:42.900329 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:42.900310    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a46ec873-57f5-433c-b49d-2d6a44689fb7-openshift-service-ca\") pod \"maas-api-e2e-derive-bed7d68f-7867547d5f-qnrp9\" (UID: \"a46ec873-57f5-433c-b49d-2d6a44689fb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bed7d68f-7867547d5f-qnrp9"
Jul 08 22:01:42.908640 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:42.908614    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hklk\" (UniqueName: \"kubernetes.io/projected/a46ec873-57f5-433c-b49d-2d6a44689fb7-kube-api-access-9hklk\") pod \"maas-api-e2e-derive-bed7d68f-7867547d5f-qnrp9\" (UID: \"a46ec873-57f5-433c-b49d-2d6a44689fb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bed7d68f-7867547d5f-qnrp9"
Jul 08 22:01:43.405481 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:43.405440    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a46ec873-57f5-433c-b49d-2d6a44689fb7-maas-api-tls\") pod \"maas-api-e2e-derive-bed7d68f-7867547d5f-qnrp9\" (UID: \"a46ec873-57f5-433c-b49d-2d6a44689fb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bed7d68f-7867547d5f-qnrp9"
Jul 08 22:01:43.407988 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:43.407961    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a46ec873-57f5-433c-b49d-2d6a44689fb7-maas-api-tls\") pod \"maas-api-e2e-derive-bed7d68f-7867547d5f-qnrp9\" (UID: \"a46ec873-57f5-433c-b49d-2d6a44689fb7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bed7d68f-7867547d5f-qnrp9"
Jul 08 22:01:43.612962 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:43.612928    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bed7d68f-7867547d5f-qnrp9"
Jul 08 22:01:43.683837 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:43.683811    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r"
Jul 08 22:01:43.684982 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:43.684959    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r"
Jul 08 22:01:43.753984 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:43.753950    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-bed7d68f-7867547d5f-qnrp9"]
Jul 08 22:01:43.758503 ip-10-0-131-83 kubenswrapper[2569]: W0708 22:01:43.758475    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda46ec873_57f5_433c_b49d_2d6a44689fb7.slice/crio-12e2dcb9caa3f5e84439367ed87593fc5e04382d63cefb518ee45764bf1657ff WatchSource:0}: Error finding container 12e2dcb9caa3f5e84439367ed87593fc5e04382d63cefb518ee45764bf1657ff: Status 404 returned error can't find the container with id 12e2dcb9caa3f5e84439367ed87593fc5e04382d63cefb518ee45764bf1657ff
Jul 08 22:01:44.689498 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:44.689454    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bed7d68f-7867547d5f-qnrp9" event={"ID":"a46ec873-57f5-433c-b49d-2d6a44689fb7","Type":"ContainerStarted","Data":"f51fa9ac1f35671abb7087a832ff33ea6f0c06a8f08e8ae1f9000e02280ba3ae"}
Jul 08 22:01:44.689857 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:44.689536    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bed7d68f-7867547d5f-qnrp9" event={"ID":"a46ec873-57f5-433c-b49d-2d6a44689fb7","Type":"ContainerStarted","Data":"12e2dcb9caa3f5e84439367ed87593fc5e04382d63cefb518ee45764bf1657ff"}
Jul 08 22:01:45.712599 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:45.712539    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bed7d68f-7867547d5f-qnrp9" podStartSLOduration=2.936314399 podStartE2EDuration="3.712519109s" totalImagesPullingTime="776.20471ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:01:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:01:45.711909822 +0000 UTC m=+1728.650242225" watchObservedRunningTime="2026-07-08 22:01:45.712519109 +0000 UTC m=+1728.650851510"
Jul 08 22:01:47.232468 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:47.232429    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r"]
Jul 08 22:01:47.232872 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:47.232682    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r" podUID="7012ab8b-5947-4c80-87db-e1e6621ce63a" containerName="istio-proxy" containerID="cri-o://f0f275510c3871c49a427693e08fcff89d911d7a11e8c190085e50369fbbf71f" gracePeriod=30
Jul 08 22:01:47.508892 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:47.508794    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-bed7d68f-7867547d5f-qnrp9"]
Jul 08 22:01:47.509118 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:47.509064    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bed7d68f-7867547d5f-qnrp9" podUID="a46ec873-57f5-433c-b49d-2d6a44689fb7" containerName="maas-api" containerID="cri-o://f51fa9ac1f35671abb7087a832ff33ea6f0c06a8f08e8ae1f9000e02280ba3ae" gracePeriod=30
Jul 08 22:01:47.509305 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:47.509268    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bed7d68f-7867547d5f-qnrp9"
Jul 08 22:01:47.719860 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:47.719657    2569 generic.go:356] "Generic (PLEG): container finished" podID="a46ec873-57f5-433c-b49d-2d6a44689fb7" containerID="f51fa9ac1f35671abb7087a832ff33ea6f0c06a8f08e8ae1f9000e02280ba3ae" exitCode=0
Jul 08 22:01:47.719860 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:47.719789    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bed7d68f-7867547d5f-qnrp9" event={"ID":"a46ec873-57f5-433c-b49d-2d6a44689fb7","Type":"ContainerDied","Data":"f51fa9ac1f35671abb7087a832ff33ea6f0c06a8f08e8ae1f9000e02280ba3ae"}
Jul 08 22:01:47.771591 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:47.771533    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bed7d68f-7867547d5f-qnrp9"
Jul 08 22:01:47.842672 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:47.842641    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a46ec873-57f5-433c-b49d-2d6a44689fb7-maas-api-tls\") pod \"a46ec873-57f5-433c-b49d-2d6a44689fb7\" (UID: \"a46ec873-57f5-433c-b49d-2d6a44689fb7\") "
Jul 08 22:01:47.842885 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:47.842750    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hklk\" (UniqueName: \"kubernetes.io/projected/a46ec873-57f5-433c-b49d-2d6a44689fb7-kube-api-access-9hklk\") pod \"a46ec873-57f5-433c-b49d-2d6a44689fb7\" (UID: \"a46ec873-57f5-433c-b49d-2d6a44689fb7\") "
Jul 08 22:01:47.842975 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:47.842958    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a46ec873-57f5-433c-b49d-2d6a44689fb7-openshift-service-ca\") pod \"a46ec873-57f5-433c-b49d-2d6a44689fb7\" (UID: \"a46ec873-57f5-433c-b49d-2d6a44689fb7\") "
Jul 08 22:01:47.843452 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:47.843373    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a46ec873-57f5-433c-b49d-2d6a44689fb7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a46ec873-57f5-433c-b49d-2d6a44689fb7" (UID: "a46ec873-57f5-433c-b49d-2d6a44689fb7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:01:47.845042 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:47.845005    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a46ec873-57f5-433c-b49d-2d6a44689fb7-kube-api-access-9hklk" (OuterVolumeSpecName: "kube-api-access-9hklk") pod "a46ec873-57f5-433c-b49d-2d6a44689fb7" (UID: "a46ec873-57f5-433c-b49d-2d6a44689fb7"). InnerVolumeSpecName "kube-api-access-9hklk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:01:47.845123 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:47.845055    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a46ec873-57f5-433c-b49d-2d6a44689fb7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a46ec873-57f5-433c-b49d-2d6a44689fb7" (UID: "a46ec873-57f5-433c-b49d-2d6a44689fb7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 22:01:47.943715 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:47.943688    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a46ec873-57f5-433c-b49d-2d6a44689fb7-maas-api-tls\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:01:47.943715 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:47.943714    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hklk\" (UniqueName: \"kubernetes.io/projected/a46ec873-57f5-433c-b49d-2d6a44689fb7-kube-api-access-9hklk\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:01:47.943926 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:47.943728    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a46ec873-57f5-433c-b49d-2d6a44689fb7-openshift-service-ca\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:01:48.727516 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:48.727483    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bed7d68f-7867547d5f-qnrp9"
Jul 08 22:01:48.727942 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:48.727486    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bed7d68f-7867547d5f-qnrp9" event={"ID":"a46ec873-57f5-433c-b49d-2d6a44689fb7","Type":"ContainerDied","Data":"12e2dcb9caa3f5e84439367ed87593fc5e04382d63cefb518ee45764bf1657ff"}
Jul 08 22:01:48.727942 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:48.727629    2569 scope.go:117] "RemoveContainer" containerID="f51fa9ac1f35671abb7087a832ff33ea6f0c06a8f08e8ae1f9000e02280ba3ae"
Jul 08 22:01:48.752053 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:48.751961    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-bed7d68f-7867547d5f-qnrp9"]
Jul 08 22:01:48.757858 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:48.757830    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-bed7d68f-7867547d5f-qnrp9"]
Jul 08 22:01:49.616104 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:49.616072    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a46ec873-57f5-433c-b49d-2d6a44689fb7" path="/var/lib/kubelet/pods/a46ec873-57f5-433c-b49d-2d6a44689fb7/volumes"
Jul 08 22:01:53.981887 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:53.981861    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r"
Jul 08 22:01:54.094885 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:54.094802    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7012ab8b-5947-4c80-87db-e1e6621ce63a-credential-socket\") pod \"7012ab8b-5947-4c80-87db-e1e6621ce63a\" (UID: \"7012ab8b-5947-4c80-87db-e1e6621ce63a\") "
Jul 08 22:01:54.094885 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:54.094861    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7012ab8b-5947-4c80-87db-e1e6621ce63a-istio-envoy\") pod \"7012ab8b-5947-4c80-87db-e1e6621ce63a\" (UID: \"7012ab8b-5947-4c80-87db-e1e6621ce63a\") "
Jul 08 22:01:54.095080 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:54.094891    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7012ab8b-5947-4c80-87db-e1e6621ce63a-workload-certs\") pod \"7012ab8b-5947-4c80-87db-e1e6621ce63a\" (UID: \"7012ab8b-5947-4c80-87db-e1e6621ce63a\") "
Jul 08 22:01:54.095080 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:54.094937    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7012ab8b-5947-4c80-87db-e1e6621ce63a-istio-data\") pod \"7012ab8b-5947-4c80-87db-e1e6621ce63a\" (UID: \"7012ab8b-5947-4c80-87db-e1e6621ce63a\") "
Jul 08 22:01:54.095080 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:54.094967    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7012ab8b-5947-4c80-87db-e1e6621ce63a-istio-podinfo\") pod \"7012ab8b-5947-4c80-87db-e1e6621ce63a\" (UID: \"7012ab8b-5947-4c80-87db-e1e6621ce63a\") "
Jul 08 22:01:54.095080 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:54.095022    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7012ab8b-5947-4c80-87db-e1e6621ce63a-istiod-ca-cert\") pod \"7012ab8b-5947-4c80-87db-e1e6621ce63a\" (UID: \"7012ab8b-5947-4c80-87db-e1e6621ce63a\") "
Jul 08 22:01:54.095080 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:54.095048    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7012ab8b-5947-4c80-87db-e1e6621ce63a-workload-socket\") pod \"7012ab8b-5947-4c80-87db-e1e6621ce63a\" (UID: \"7012ab8b-5947-4c80-87db-e1e6621ce63a\") "
Jul 08 22:01:54.095080 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:54.095061    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7012ab8b-5947-4c80-87db-e1e6621ce63a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7012ab8b-5947-4c80-87db-e1e6621ce63a" (UID: "7012ab8b-5947-4c80-87db-e1e6621ce63a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:01:54.095402 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:54.095071    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d85k4\" (UniqueName: \"kubernetes.io/projected/7012ab8b-5947-4c80-87db-e1e6621ce63a-kube-api-access-d85k4\") pod \"7012ab8b-5947-4c80-87db-e1e6621ce63a\" (UID: \"7012ab8b-5947-4c80-87db-e1e6621ce63a\") "
Jul 08 22:01:54.095402 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:54.095134    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7012ab8b-5947-4c80-87db-e1e6621ce63a-istio-token\") pod \"7012ab8b-5947-4c80-87db-e1e6621ce63a\" (UID: \"7012ab8b-5947-4c80-87db-e1e6621ce63a\") "
Jul 08 22:01:54.095402 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:54.095241    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7012ab8b-5947-4c80-87db-e1e6621ce63a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7012ab8b-5947-4c80-87db-e1e6621ce63a" (UID: "7012ab8b-5947-4c80-87db-e1e6621ce63a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:01:54.095402 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:54.095343    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7012ab8b-5947-4c80-87db-e1e6621ce63a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7012ab8b-5947-4c80-87db-e1e6621ce63a" (UID: "7012ab8b-5947-4c80-87db-e1e6621ce63a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:01:54.095621 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:54.095498    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7012ab8b-5947-4c80-87db-e1e6621ce63a-credential-socket\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:01:54.095621 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:54.095517    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7012ab8b-5947-4c80-87db-e1e6621ce63a-workload-certs\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:01:54.095621 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:54.095531    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7012ab8b-5947-4c80-87db-e1e6621ce63a-workload-socket\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:01:54.095621 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:54.095581    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7012ab8b-5947-4c80-87db-e1e6621ce63a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7012ab8b-5947-4c80-87db-e1e6621ce63a" (UID: "7012ab8b-5947-4c80-87db-e1e6621ce63a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:01:54.096045 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:54.096018    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7012ab8b-5947-4c80-87db-e1e6621ce63a-istio-data" (OuterVolumeSpecName: "istio-data") pod "7012ab8b-5947-4c80-87db-e1e6621ce63a" (UID: "7012ab8b-5947-4c80-87db-e1e6621ce63a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:01:54.097326 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:54.097303    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7012ab8b-5947-4c80-87db-e1e6621ce63a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7012ab8b-5947-4c80-87db-e1e6621ce63a" (UID: "7012ab8b-5947-4c80-87db-e1e6621ce63a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:01:54.097419 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:54.097373    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7012ab8b-5947-4c80-87db-e1e6621ce63a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7012ab8b-5947-4c80-87db-e1e6621ce63a" (UID: "7012ab8b-5947-4c80-87db-e1e6621ce63a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 22:01:54.097841 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:54.097823    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7012ab8b-5947-4c80-87db-e1e6621ce63a-istio-token" (OuterVolumeSpecName: "istio-token") pod "7012ab8b-5947-4c80-87db-e1e6621ce63a" (UID: "7012ab8b-5947-4c80-87db-e1e6621ce63a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:01:54.097900 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:54.097846    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7012ab8b-5947-4c80-87db-e1e6621ce63a-kube-api-access-d85k4" (OuterVolumeSpecName: "kube-api-access-d85k4") pod "7012ab8b-5947-4c80-87db-e1e6621ce63a" (UID: "7012ab8b-5947-4c80-87db-e1e6621ce63a"). InnerVolumeSpecName "kube-api-access-d85k4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:01:54.196511 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:54.196463    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7012ab8b-5947-4c80-87db-e1e6621ce63a-istio-data\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:01:54.196511 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:54.196507    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7012ab8b-5947-4c80-87db-e1e6621ce63a-istio-podinfo\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:01:54.196511 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:54.196519    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7012ab8b-5947-4c80-87db-e1e6621ce63a-istiod-ca-cert\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:01:54.196765 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:54.196533    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d85k4\" (UniqueName: \"kubernetes.io/projected/7012ab8b-5947-4c80-87db-e1e6621ce63a-kube-api-access-d85k4\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:01:54.196765 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:54.196547    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7012ab8b-5947-4c80-87db-e1e6621ce63a-istio-token\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:01:54.196765 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:54.196559    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7012ab8b-5947-4c80-87db-e1e6621ce63a-istio-envoy\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:01:54.757454 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:54.757417    2569 generic.go:356] "Generic (PLEG): container finished" podID="7012ab8b-5947-4c80-87db-e1e6621ce63a" containerID="f0f275510c3871c49a427693e08fcff89d911d7a11e8c190085e50369fbbf71f" exitCode=0
Jul 08 22:01:54.757631 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:54.757464    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r"
Jul 08 22:01:54.757631 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:54.757476    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r" event={"ID":"7012ab8b-5947-4c80-87db-e1e6621ce63a","Type":"ContainerDied","Data":"f0f275510c3871c49a427693e08fcff89d911d7a11e8c190085e50369fbbf71f"}
Jul 08 22:01:54.757631 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:54.757520    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r" event={"ID":"7012ab8b-5947-4c80-87db-e1e6621ce63a","Type":"ContainerDied","Data":"419d28b2b11490b54dd39890c0e15c709d6bf6e0c31de078773cf8338187947a"}
Jul 08 22:01:54.757631 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:54.757540    2569 scope.go:117] "RemoveContainer" containerID="f0f275510c3871c49a427693e08fcff89d911d7a11e8c190085e50369fbbf71f"
Jul 08 22:01:54.766454 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:54.766436    2569 scope.go:117] "RemoveContainer" containerID="f0f275510c3871c49a427693e08fcff89d911d7a11e8c190085e50369fbbf71f"
Jul 08 22:01:54.766710 ip-10-0-131-83 kubenswrapper[2569]: E0708 22:01:54.766691    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0f275510c3871c49a427693e08fcff89d911d7a11e8c190085e50369fbbf71f\": container with ID starting with f0f275510c3871c49a427693e08fcff89d911d7a11e8c190085e50369fbbf71f not found: ID does not exist" containerID="f0f275510c3871c49a427693e08fcff89d911d7a11e8c190085e50369fbbf71f"
Jul 08 22:01:54.766753 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:54.766720    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0f275510c3871c49a427693e08fcff89d911d7a11e8c190085e50369fbbf71f"} err="failed to get container status \"f0f275510c3871c49a427693e08fcff89d911d7a11e8c190085e50369fbbf71f\": rpc error: code = NotFound desc = could not find container \"f0f275510c3871c49a427693e08fcff89d911d7a11e8c190085e50369fbbf71f\": container with ID starting with f0f275510c3871c49a427693e08fcff89d911d7a11e8c190085e50369fbbf71f not found: ID does not exist"
Jul 08 22:01:54.791269 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:54.791236    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r"]
Jul 08 22:01:54.802062 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:54.802035    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-bed7d68f-openshift-default-6d9cc66699-tsq8r"]
Jul 08 22:01:55.612232 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:01:55.612199    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7012ab8b-5947-4c80-87db-e1e6621ce63a" path="/var/lib/kubelet/pods/7012ab8b-5947-4c80-87db-e1e6621ce63a/volumes"
Jul 08 22:02:57.604852 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:02:57.604822    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6cs4g_a022d640-79f0-4d35-be9a-9c6ac708d10b/ovn-acl-logging/0.log"
Jul 08 22:02:57.605341 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:02:57.604965    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6cs4g_a022d640-79f0-4d35-be9a-9c6ac708d10b/ovn-acl-logging/0.log"
Jul 08 22:03:28.413330 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:28.413267    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"]
Jul 08 22:03:28.413812 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:28.413617    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a46ec873-57f5-433c-b49d-2d6a44689fb7" containerName="maas-api"
Jul 08 22:03:28.413812 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:28.413629    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a46ec873-57f5-433c-b49d-2d6a44689fb7" containerName="maas-api"
Jul 08 22:03:28.413812 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:28.413645    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7012ab8b-5947-4c80-87db-e1e6621ce63a" containerName="istio-proxy"
Jul 08 22:03:28.413812 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:28.413650    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7012ab8b-5947-4c80-87db-e1e6621ce63a" containerName="istio-proxy"
Jul 08 22:03:28.413812 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:28.413702    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a46ec873-57f5-433c-b49d-2d6a44689fb7" containerName="maas-api"
Jul 08 22:03:28.413812 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:28.413713    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="7012ab8b-5947-4c80-87db-e1e6621ce63a" containerName="istio-proxy"
Jul 08 22:03:28.415593 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:28.415576    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"
Jul 08 22:03:28.417973 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:28.417954    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-33669def-openshift-default-dockercfg-b8vp4\""
Jul 08 22:03:28.436586 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:28.436556    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"]
Jul 08 22:03:28.524064 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:28.524025    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-istio-token\") pod \"e2e-mt-33669def-openshift-default-7846d94987-6b86p\" (UID: \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\") " pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"
Jul 08 22:03:28.524276 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:28.524069    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-workload-socket\") pod \"e2e-mt-33669def-openshift-default-7846d94987-6b86p\" (UID: \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\") " pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"
Jul 08 22:03:28.524276 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:28.524107    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcm7j\" (UniqueName: \"kubernetes.io/projected/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-kube-api-access-rcm7j\") pod \"e2e-mt-33669def-openshift-default-7846d94987-6b86p\" (UID: \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\") " pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"
Jul 08 22:03:28.524276 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:28.524130    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-workload-certs\") pod \"e2e-mt-33669def-openshift-default-7846d94987-6b86p\" (UID: \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\") " pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"
Jul 08 22:03:28.524276 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:28.524165    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-istio-podinfo\") pod \"e2e-mt-33669def-openshift-default-7846d94987-6b86p\" (UID: \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\") " pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"
Jul 08 22:03:28.524276 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:28.524182    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-istiod-ca-cert\") pod \"e2e-mt-33669def-openshift-default-7846d94987-6b86p\" (UID: \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\") " pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"
Jul 08 22:03:28.524276 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:28.524220    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-istio-envoy\") pod \"e2e-mt-33669def-openshift-default-7846d94987-6b86p\" (UID: \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\") " pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"
Jul 08 22:03:28.524276 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:28.524251    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-credential-socket\") pod \"e2e-mt-33669def-openshift-default-7846d94987-6b86p\" (UID: \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\") " pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"
Jul 08 22:03:28.524276 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:28.524272    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-istio-data\") pod \"e2e-mt-33669def-openshift-default-7846d94987-6b86p\" (UID: \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\") " pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"
Jul 08 22:03:28.625697 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:28.625665    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-istio-envoy\") pod \"e2e-mt-33669def-openshift-default-7846d94987-6b86p\" (UID: \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\") " pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"
Jul 08 22:03:28.625883 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:28.625719    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-credential-socket\") pod \"e2e-mt-33669def-openshift-default-7846d94987-6b86p\" (UID: \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\") " pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"
Jul 08 22:03:28.625883 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:28.625835    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-istio-data\") pod \"e2e-mt-33669def-openshift-default-7846d94987-6b86p\" (UID: \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\") " pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"
Jul 08 22:03:28.626005 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:28.625900    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-istio-token\") pod \"e2e-mt-33669def-openshift-default-7846d94987-6b86p\" (UID: \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\") " pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"
Jul 08 22:03:28.626005 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:28.625925    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-workload-socket\") pod \"e2e-mt-33669def-openshift-default-7846d94987-6b86p\" (UID: \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\") " pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"
Jul 08 22:03:28.626005 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:28.625941    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcm7j\" (UniqueName: \"kubernetes.io/projected/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-kube-api-access-rcm7j\") pod \"e2e-mt-33669def-openshift-default-7846d94987-6b86p\" (UID: \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\") " pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"
Jul 08 22:03:28.626005 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:28.625962    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-workload-certs\") pod \"e2e-mt-33669def-openshift-default-7846d94987-6b86p\" (UID: \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\") " pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"
Jul 08 22:03:28.626210 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:28.626016    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-istio-podinfo\") pod \"e2e-mt-33669def-openshift-default-7846d94987-6b86p\" (UID: \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\") " pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"
Jul 08 22:03:28.626210 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:28.626034    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-istiod-ca-cert\") pod \"e2e-mt-33669def-openshift-default-7846d94987-6b86p\" (UID: \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\") " pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"
Jul 08 22:03:28.626210 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:28.626106    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-credential-socket\") pod \"e2e-mt-33669def-openshift-default-7846d94987-6b86p\" (UID: \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\") " pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"
Jul 08 22:03:28.626210 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:28.626201    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-istio-data\") pod \"e2e-mt-33669def-openshift-default-7846d94987-6b86p\" (UID: \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\") " pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"
Jul 08 22:03:28.626446 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:28.626273    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-workload-socket\") pod \"e2e-mt-33669def-openshift-default-7846d94987-6b86p\" (UID: \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\") " pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"
Jul 08 22:03:28.626525 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:28.626496    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-workload-certs\") pod \"e2e-mt-33669def-openshift-default-7846d94987-6b86p\" (UID: \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\") " pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"
Jul 08 22:03:28.626781 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:28.626755    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-istiod-ca-cert\") pod \"e2e-mt-33669def-openshift-default-7846d94987-6b86p\" (UID: \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\") " pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"
Jul 08 22:03:28.628843 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:28.628817    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-istio-envoy\") pod \"e2e-mt-33669def-openshift-default-7846d94987-6b86p\" (UID: \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\") " pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"
Jul 08 22:03:28.628979 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:28.628860    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-istio-podinfo\") pod \"e2e-mt-33669def-openshift-default-7846d94987-6b86p\" (UID: \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\") " pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"
Jul 08 22:03:28.634390 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:28.634365    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-istio-token\") pod \"e2e-mt-33669def-openshift-default-7846d94987-6b86p\" (UID: \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\") " pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"
Jul 08 22:03:28.634889 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:28.634869    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcm7j\" (UniqueName: \"kubernetes.io/projected/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-kube-api-access-rcm7j\") pod \"e2e-mt-33669def-openshift-default-7846d94987-6b86p\" (UID: \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\") " pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"
Jul 08 22:03:28.725340 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:28.725228    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"
Jul 08 22:03:28.864155 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:28.864126    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"]
Jul 08 22:03:28.866251 ip-10-0-131-83 kubenswrapper[2569]: W0708 22:03:28.866217    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a28b467_ac09_4e09_9a0a_1d2d54954dcd.slice/crio-7493aec3c80f49cae6edeabf2bc9242b1a1452018fbbc3dbcba0db5389dc6dfd WatchSource:0}: Error finding container 7493aec3c80f49cae6edeabf2bc9242b1a1452018fbbc3dbcba0db5389dc6dfd: Status 404 returned error can't find the container with id 7493aec3c80f49cae6edeabf2bc9242b1a1452018fbbc3dbcba0db5389dc6dfd
Jul 08 22:03:28.868624 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:28.868593    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 08 22:03:28.868699 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:28.868659    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 08 22:03:28.868699 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:28.868686    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 08 22:03:29.165702 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:29.165656    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p" event={"ID":"1a28b467-ac09-4e09-9a0a-1d2d54954dcd","Type":"ContainerStarted","Data":"0745ff9af04b2e3a6a16719915c9fa78fbb75741f12a3bacaf9ad33e92d8fbc3"}
Jul 08 22:03:29.165904 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:29.165716    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p" event={"ID":"1a28b467-ac09-4e09-9a0a-1d2d54954dcd","Type":"ContainerStarted","Data":"7493aec3c80f49cae6edeabf2bc9242b1a1452018fbbc3dbcba0db5389dc6dfd"}
Jul 08 22:03:29.185579 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:29.185527    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p" podStartSLOduration=1.185511464 podStartE2EDuration="1.185511464s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:03:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:03:29.18419561 +0000 UTC m=+1832.122528037" watchObservedRunningTime="2026-07-08 22:03:29.185511464 +0000 UTC m=+1832.123843864"
Jul 08 22:03:29.726476 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:29.726438    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"
Jul 08 22:03:29.731329 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:29.731305    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"
Jul 08 22:03:30.171095 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:30.171066    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"
Jul 08 22:03:30.172115 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:30.172095    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"
Jul 08 22:03:31.354619 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:31.354589    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-33669def-84cf788bd5-sfbhw"]
Jul 08 22:03:31.361342 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:31.360324    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-33669def-84cf788bd5-sfbhw"
Jul 08 22:03:31.363503 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:31.363470    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-33669def-serving-cert\""
Jul 08 22:03:31.369638 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:31.369600    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-33669def-84cf788bd5-sfbhw"]
Jul 08 22:03:31.449877 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:31.449841    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b0f0817-559e-4a99-8d95-c1193c01a376-openshift-service-ca\") pod \"maas-api-e2e-mt-33669def-84cf788bd5-sfbhw\" (UID: \"0b0f0817-559e-4a99-8d95-c1193c01a376\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-33669def-84cf788bd5-sfbhw"
Jul 08 22:03:31.450048 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:31.449887    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b0f0817-559e-4a99-8d95-c1193c01a376-maas-api-tls\") pod \"maas-api-e2e-mt-33669def-84cf788bd5-sfbhw\" (UID: \"0b0f0817-559e-4a99-8d95-c1193c01a376\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-33669def-84cf788bd5-sfbhw"
Jul 08 22:03:31.450048 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:31.449921    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssq95\" (UniqueName: \"kubernetes.io/projected/0b0f0817-559e-4a99-8d95-c1193c01a376-kube-api-access-ssq95\") pod \"maas-api-e2e-mt-33669def-84cf788bd5-sfbhw\" (UID: \"0b0f0817-559e-4a99-8d95-c1193c01a376\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-33669def-84cf788bd5-sfbhw"
Jul 08 22:03:31.551179 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:31.551137    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b0f0817-559e-4a99-8d95-c1193c01a376-openshift-service-ca\") pod \"maas-api-e2e-mt-33669def-84cf788bd5-sfbhw\" (UID: \"0b0f0817-559e-4a99-8d95-c1193c01a376\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-33669def-84cf788bd5-sfbhw"
Jul 08 22:03:31.551179 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:31.551183    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b0f0817-559e-4a99-8d95-c1193c01a376-maas-api-tls\") pod \"maas-api-e2e-mt-33669def-84cf788bd5-sfbhw\" (UID: \"0b0f0817-559e-4a99-8d95-c1193c01a376\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-33669def-84cf788bd5-sfbhw"
Jul 08 22:03:31.551432 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:31.551211    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssq95\" (UniqueName: \"kubernetes.io/projected/0b0f0817-559e-4a99-8d95-c1193c01a376-kube-api-access-ssq95\") pod \"maas-api-e2e-mt-33669def-84cf788bd5-sfbhw\" (UID: \"0b0f0817-559e-4a99-8d95-c1193c01a376\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-33669def-84cf788bd5-sfbhw"
Jul 08 22:03:31.551850 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:31.551824    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b0f0817-559e-4a99-8d95-c1193c01a376-openshift-service-ca\") pod \"maas-api-e2e-mt-33669def-84cf788bd5-sfbhw\" (UID: \"0b0f0817-559e-4a99-8d95-c1193c01a376\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-33669def-84cf788bd5-sfbhw"
Jul 08 22:03:31.553854 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:31.553825    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b0f0817-559e-4a99-8d95-c1193c01a376-maas-api-tls\") pod \"maas-api-e2e-mt-33669def-84cf788bd5-sfbhw\" (UID: \"0b0f0817-559e-4a99-8d95-c1193c01a376\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-33669def-84cf788bd5-sfbhw"
Jul 08 22:03:31.559442 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:31.559419    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssq95\" (UniqueName: \"kubernetes.io/projected/0b0f0817-559e-4a99-8d95-c1193c01a376-kube-api-access-ssq95\") pod \"maas-api-e2e-mt-33669def-84cf788bd5-sfbhw\" (UID: \"0b0f0817-559e-4a99-8d95-c1193c01a376\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-33669def-84cf788bd5-sfbhw"
Jul 08 22:03:31.673409 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:31.673372    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-33669def-84cf788bd5-sfbhw"
Jul 08 22:03:31.809415 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:31.809371    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-33669def-84cf788bd5-sfbhw"]
Jul 08 22:03:31.811381 ip-10-0-131-83 kubenswrapper[2569]: W0708 22:03:31.811354    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b0f0817_559e_4a99_8d95_c1193c01a376.slice/crio-fa5b66bc36320710f15a58710771d48ad129c1e94000213d84d08e33192ddd51 WatchSource:0}: Error finding container fa5b66bc36320710f15a58710771d48ad129c1e94000213d84d08e33192ddd51: Status 404 returned error can't find the container with id fa5b66bc36320710f15a58710771d48ad129c1e94000213d84d08e33192ddd51
Jul 08 22:03:32.181774 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:32.181736    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-33669def-84cf788bd5-sfbhw" event={"ID":"0b0f0817-559e-4a99-8d95-c1193c01a376","Type":"ContainerStarted","Data":"fa5b66bc36320710f15a58710771d48ad129c1e94000213d84d08e33192ddd51"}
Jul 08 22:03:33.188056 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:33.188020    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-33669def-84cf788bd5-sfbhw" event={"ID":"0b0f0817-559e-4a99-8d95-c1193c01a376","Type":"ContainerStarted","Data":"dbc53ab80366613f068ca588076d8be50841457f2854ac3682e04a6c6d009f84"}
Jul 08 22:03:33.188520 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:33.188152    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-33669def-84cf788bd5-sfbhw"
Jul 08 22:03:33.205643 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:33.205587    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-33669def-84cf788bd5-sfbhw" podStartSLOduration=1.76423622 podStartE2EDuration="2.205571084s" totalImagesPullingTime="441.334864ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:03:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:03:33.203512951 +0000 UTC m=+1836.141845370" watchObservedRunningTime="2026-07-08 22:03:33.205571084 +0000 UTC m=+1836.143903483"
Jul 08 22:03:39.199533 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:39.199498    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-33669def-84cf788bd5-sfbhw"
Jul 08 22:03:42.234051 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:42.233981    2569 generic.go:356] "Generic (PLEG): container finished" podID="1a28b467-ac09-4e09-9a0a-1d2d54954dcd" containerID="0745ff9af04b2e3a6a16719915c9fa78fbb75741f12a3bacaf9ad33e92d8fbc3" exitCode=0
Jul 08 22:03:42.234051 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:42.234031    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p" event={"ID":"1a28b467-ac09-4e09-9a0a-1d2d54954dcd","Type":"ContainerDied","Data":"0745ff9af04b2e3a6a16719915c9fa78fbb75741f12a3bacaf9ad33e92d8fbc3"}
Jul 08 22:03:42.234476 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:42.234433    2569 scope.go:117] "RemoveContainer" containerID="0745ff9af04b2e3a6a16719915c9fa78fbb75741f12a3bacaf9ad33e92d8fbc3"
Jul 08 22:03:42.235498 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:42.235456    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 08 22:03:42.235573 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:42.235555    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 08 22:03:42.235613 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:42.235600    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 08 22:03:42.942442 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:42.942402    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-33669def-84cf788bd5-sfbhw"]
Jul 08 22:03:42.942683 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:42.942656    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-33669def-84cf788bd5-sfbhw" podUID="0b0f0817-559e-4a99-8d95-c1193c01a376" containerName="maas-api" containerID="cri-o://dbc53ab80366613f068ca588076d8be50841457f2854ac3682e04a6c6d009f84" gracePeriod=30
Jul 08 22:03:43.231821 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:43.231798    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-33669def-84cf788bd5-sfbhw"
Jul 08 22:03:43.240639 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:43.240476    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p" event={"ID":"1a28b467-ac09-4e09-9a0a-1d2d54954dcd","Type":"ContainerStarted","Data":"4b3e6acc2a322098cb3c1a6a1f96275dffefa2ce5eacfb39043cb577bbc03f69"}
Jul 08 22:03:43.241863 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:43.241841    2569 generic.go:356] "Generic (PLEG): container finished" podID="0b0f0817-559e-4a99-8d95-c1193c01a376" containerID="dbc53ab80366613f068ca588076d8be50841457f2854ac3682e04a6c6d009f84" exitCode=0
Jul 08 22:03:43.241968 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:43.241876    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-33669def-84cf788bd5-sfbhw"
Jul 08 22:03:43.241968 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:43.241906    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-33669def-84cf788bd5-sfbhw" event={"ID":"0b0f0817-559e-4a99-8d95-c1193c01a376","Type":"ContainerDied","Data":"dbc53ab80366613f068ca588076d8be50841457f2854ac3682e04a6c6d009f84"}
Jul 08 22:03:43.241968 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:43.241941    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-33669def-84cf788bd5-sfbhw" event={"ID":"0b0f0817-559e-4a99-8d95-c1193c01a376","Type":"ContainerDied","Data":"fa5b66bc36320710f15a58710771d48ad129c1e94000213d84d08e33192ddd51"}
Jul 08 22:03:43.241968 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:43.241962    2569 scope.go:117] "RemoveContainer" containerID="dbc53ab80366613f068ca588076d8be50841457f2854ac3682e04a6c6d009f84"
Jul 08 22:03:43.249717 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:43.249697    2569 scope.go:117] "RemoveContainer" containerID="dbc53ab80366613f068ca588076d8be50841457f2854ac3682e04a6c6d009f84"
Jul 08 22:03:43.250210 ip-10-0-131-83 kubenswrapper[2569]: E0708 22:03:43.250184    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbc53ab80366613f068ca588076d8be50841457f2854ac3682e04a6c6d009f84\": container with ID starting with dbc53ab80366613f068ca588076d8be50841457f2854ac3682e04a6c6d009f84 not found: ID does not exist" containerID="dbc53ab80366613f068ca588076d8be50841457f2854ac3682e04a6c6d009f84"
Jul 08 22:03:43.250341 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:43.250221    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbc53ab80366613f068ca588076d8be50841457f2854ac3682e04a6c6d009f84"} err="failed to get container status \"dbc53ab80366613f068ca588076d8be50841457f2854ac3682e04a6c6d009f84\": rpc error: code = NotFound desc = could not find container \"dbc53ab80366613f068ca588076d8be50841457f2854ac3682e04a6c6d009f84\": container with ID starting with dbc53ab80366613f068ca588076d8be50841457f2854ac3682e04a6c6d009f84 not found: ID does not exist"
Jul 08 22:03:43.362093 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:43.362057    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b0f0817-559e-4a99-8d95-c1193c01a376-openshift-service-ca\") pod \"0b0f0817-559e-4a99-8d95-c1193c01a376\" (UID: \"0b0f0817-559e-4a99-8d95-c1193c01a376\") "
Jul 08 22:03:43.362093 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:43.362093    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ssq95\" (UniqueName: \"kubernetes.io/projected/0b0f0817-559e-4a99-8d95-c1193c01a376-kube-api-access-ssq95\") pod \"0b0f0817-559e-4a99-8d95-c1193c01a376\" (UID: \"0b0f0817-559e-4a99-8d95-c1193c01a376\") "
Jul 08 22:03:43.362397 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:43.362130    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b0f0817-559e-4a99-8d95-c1193c01a376-maas-api-tls\") pod \"0b0f0817-559e-4a99-8d95-c1193c01a376\" (UID: \"0b0f0817-559e-4a99-8d95-c1193c01a376\") "
Jul 08 22:03:43.362493 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:43.362449    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b0f0817-559e-4a99-8d95-c1193c01a376-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0b0f0817-559e-4a99-8d95-c1193c01a376" (UID: "0b0f0817-559e-4a99-8d95-c1193c01a376"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:03:43.362577 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:43.362515    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b0f0817-559e-4a99-8d95-c1193c01a376-openshift-service-ca\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:03:43.364426 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:43.364405    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b0f0817-559e-4a99-8d95-c1193c01a376-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0b0f0817-559e-4a99-8d95-c1193c01a376" (UID: "0b0f0817-559e-4a99-8d95-c1193c01a376"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 22:03:43.364514 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:43.364501    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b0f0817-559e-4a99-8d95-c1193c01a376-kube-api-access-ssq95" (OuterVolumeSpecName: "kube-api-access-ssq95") pod "0b0f0817-559e-4a99-8d95-c1193c01a376" (UID: "0b0f0817-559e-4a99-8d95-c1193c01a376"). InnerVolumeSpecName "kube-api-access-ssq95". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:03:43.463398 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:43.463362    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ssq95\" (UniqueName: \"kubernetes.io/projected/0b0f0817-559e-4a99-8d95-c1193c01a376-kube-api-access-ssq95\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:03:43.463398 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:43.463390    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b0f0817-559e-4a99-8d95-c1193c01a376-maas-api-tls\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:03:43.563158 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:43.563131    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-33669def-84cf788bd5-sfbhw"]
Jul 08 22:03:43.566968 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:43.566941    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-33669def-84cf788bd5-sfbhw"]
Jul 08 22:03:43.615252 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:43.615216    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b0f0817-559e-4a99-8d95-c1193c01a376" path="/var/lib/kubelet/pods/0b0f0817-559e-4a99-8d95-c1193c01a376/volumes"
Jul 08 22:03:43.725910 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:43.725872    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"
Jul 08 22:03:43.727240 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:43.727204    2569 patch_prober.go:28] interesting pod/e2e-mt-33669def-openshift-default-7846d94987-6b86p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Jul 08 22:03:43.727398 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:43.727260    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p" podUID="1a28b467-ac09-4e09-9a0a-1d2d54954dcd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Jul 08 22:03:44.725992 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:44.725951    2569 patch_prober.go:28] interesting pod/e2e-mt-33669def-openshift-default-7846d94987-6b86p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Jul 08 22:03:44.726422 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:44.726024    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p" podUID="1a28b467-ac09-4e09-9a0a-1d2d54954dcd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Jul 08 22:03:45.171392 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:45.171352    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"
Jul 08 22:03:45.726595 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:45.726559    2569 patch_prober.go:28] interesting pod/e2e-mt-33669def-openshift-default-7846d94987-6b86p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Jul 08 22:03:45.727021 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:45.726630    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p" podUID="1a28b467-ac09-4e09-9a0a-1d2d54954dcd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Jul 08 22:03:46.725709 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:46.725673    2569 patch_prober.go:28] interesting pod/e2e-mt-33669def-openshift-default-7846d94987-6b86p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Jul 08 22:03:46.725896 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:46.725730    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p" podUID="1a28b467-ac09-4e09-9a0a-1d2d54954dcd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Jul 08 22:03:47.729453 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:47.729419    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"
Jul 08 22:03:47.730456 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:47.730437    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"
Jul 08 22:03:49.104519 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:49.104485    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"]
Jul 08 22:03:49.269423 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:49.269382    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p" podUID="1a28b467-ac09-4e09-9a0a-1d2d54954dcd" containerName="istio-proxy" containerID="cri-o://4b3e6acc2a322098cb3c1a6a1f96275dffefa2ce5eacfb39043cb577bbc03f69" gracePeriod=30
Jul 08 22:03:54.513051 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:54.513026    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"
Jul 08 22:03:54.666833 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:54.666804    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-istio-envoy\") pod \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\" (UID: \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\") "
Jul 08 22:03:54.666971 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:54.666840    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-istiod-ca-cert\") pod \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\" (UID: \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\") "
Jul 08 22:03:54.666971 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:54.666862    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-workload-socket\") pod \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\" (UID: \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\") "
Jul 08 22:03:54.666971 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:54.666896    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-istio-podinfo\") pod \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\" (UID: \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\") "
Jul 08 22:03:54.666971 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:54.666913    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-istio-data\") pod \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\" (UID: \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\") "
Jul 08 22:03:54.666971 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:54.666932    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcm7j\" (UniqueName: \"kubernetes.io/projected/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-kube-api-access-rcm7j\") pod \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\" (UID: \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\") "
Jul 08 22:03:54.666971 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:54.666947    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-workload-certs\") pod \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\" (UID: \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\") "
Jul 08 22:03:54.666971 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:54.666969    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-istio-token\") pod \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\" (UID: \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\") "
Jul 08 22:03:54.667365 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:54.666996    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-credential-socket\") pod \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\" (UID: \"1a28b467-ac09-4e09-9a0a-1d2d54954dcd\") "
Jul 08 22:03:54.667365 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:54.667128    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1a28b467-ac09-4e09-9a0a-1d2d54954dcd" (UID: "1a28b467-ac09-4e09-9a0a-1d2d54954dcd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:03:54.667365 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:54.667236    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1a28b467-ac09-4e09-9a0a-1d2d54954dcd" (UID: "1a28b467-ac09-4e09-9a0a-1d2d54954dcd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:03:54.667365 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:54.667280    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-workload-socket\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:03:54.667588 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:54.667432    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1a28b467-ac09-4e09-9a0a-1d2d54954dcd" (UID: "1a28b467-ac09-4e09-9a0a-1d2d54954dcd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:03:54.667721 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:54.667676    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1a28b467-ac09-4e09-9a0a-1d2d54954dcd" (UID: "1a28b467-ac09-4e09-9a0a-1d2d54954dcd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:03:54.667816 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:54.667779    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-istio-data" (OuterVolumeSpecName: "istio-data") pod "1a28b467-ac09-4e09-9a0a-1d2d54954dcd" (UID: "1a28b467-ac09-4e09-9a0a-1d2d54954dcd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:03:54.669261 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:54.669230    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1a28b467-ac09-4e09-9a0a-1d2d54954dcd" (UID: "1a28b467-ac09-4e09-9a0a-1d2d54954dcd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:03:54.669402 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:54.669343    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1a28b467-ac09-4e09-9a0a-1d2d54954dcd" (UID: "1a28b467-ac09-4e09-9a0a-1d2d54954dcd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 22:03:54.669476 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:54.669408    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-kube-api-access-rcm7j" (OuterVolumeSpecName: "kube-api-access-rcm7j") pod "1a28b467-ac09-4e09-9a0a-1d2d54954dcd" (UID: "1a28b467-ac09-4e09-9a0a-1d2d54954dcd"). InnerVolumeSpecName "kube-api-access-rcm7j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:03:54.669476 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:54.669460    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-istio-token" (OuterVolumeSpecName: "istio-token") pod "1a28b467-ac09-4e09-9a0a-1d2d54954dcd" (UID: "1a28b467-ac09-4e09-9a0a-1d2d54954dcd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:03:54.768056 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:54.768020    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-istio-podinfo\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:03:54.768056 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:54.768051    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-istio-data\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:03:54.768056 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:54.768060    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcm7j\" (UniqueName: \"kubernetes.io/projected/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-kube-api-access-rcm7j\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:03:54.768056 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:54.768069    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-workload-certs\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:03:54.768359 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:54.768077    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-istio-token\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:03:54.768359 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:54.768085    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-credential-socket\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:03:54.768359 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:54.768093    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-istio-envoy\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:03:54.768359 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:54.768100    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a28b467-ac09-4e09-9a0a-1d2d54954dcd-istiod-ca-cert\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:03:55.295995 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:55.295958    2569 generic.go:356] "Generic (PLEG): container finished" podID="1a28b467-ac09-4e09-9a0a-1d2d54954dcd" containerID="4b3e6acc2a322098cb3c1a6a1f96275dffefa2ce5eacfb39043cb577bbc03f69" exitCode=0
Jul 08 22:03:55.296159 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:55.296010    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"
Jul 08 22:03:55.296159 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:55.296050    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p" event={"ID":"1a28b467-ac09-4e09-9a0a-1d2d54954dcd","Type":"ContainerDied","Data":"4b3e6acc2a322098cb3c1a6a1f96275dffefa2ce5eacfb39043cb577bbc03f69"}
Jul 08 22:03:55.296159 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:55.296102    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p" event={"ID":"1a28b467-ac09-4e09-9a0a-1d2d54954dcd","Type":"ContainerDied","Data":"7493aec3c80f49cae6edeabf2bc9242b1a1452018fbbc3dbcba0db5389dc6dfd"}
Jul 08 22:03:55.296159 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:55.296124    2569 scope.go:117] "RemoveContainer" containerID="4b3e6acc2a322098cb3c1a6a1f96275dffefa2ce5eacfb39043cb577bbc03f69"
Jul 08 22:03:55.304769 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:55.304752    2569 scope.go:117] "RemoveContainer" containerID="0745ff9af04b2e3a6a16719915c9fa78fbb75741f12a3bacaf9ad33e92d8fbc3"
Jul 08 22:03:55.312198 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:55.312181    2569 scope.go:117] "RemoveContainer" containerID="4b3e6acc2a322098cb3c1a6a1f96275dffefa2ce5eacfb39043cb577bbc03f69"
Jul 08 22:03:55.312461 ip-10-0-131-83 kubenswrapper[2569]: E0708 22:03:55.312439    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b3e6acc2a322098cb3c1a6a1f96275dffefa2ce5eacfb39043cb577bbc03f69\": container with ID starting with 4b3e6acc2a322098cb3c1a6a1f96275dffefa2ce5eacfb39043cb577bbc03f69 not found: ID does not exist" containerID="4b3e6acc2a322098cb3c1a6a1f96275dffefa2ce5eacfb39043cb577bbc03f69"
Jul 08 22:03:55.312517 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:55.312468    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b3e6acc2a322098cb3c1a6a1f96275dffefa2ce5eacfb39043cb577bbc03f69"} err="failed to get container status \"4b3e6acc2a322098cb3c1a6a1f96275dffefa2ce5eacfb39043cb577bbc03f69\": rpc error: code = NotFound desc = could not find container \"4b3e6acc2a322098cb3c1a6a1f96275dffefa2ce5eacfb39043cb577bbc03f69\": container with ID starting with 4b3e6acc2a322098cb3c1a6a1f96275dffefa2ce5eacfb39043cb577bbc03f69 not found: ID does not exist"
Jul 08 22:03:55.312517 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:55.312487    2569 scope.go:117] "RemoveContainer" containerID="0745ff9af04b2e3a6a16719915c9fa78fbb75741f12a3bacaf9ad33e92d8fbc3"
Jul 08 22:03:55.312737 ip-10-0-131-83 kubenswrapper[2569]: E0708 22:03:55.312721    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0745ff9af04b2e3a6a16719915c9fa78fbb75741f12a3bacaf9ad33e92d8fbc3\": container with ID starting with 0745ff9af04b2e3a6a16719915c9fa78fbb75741f12a3bacaf9ad33e92d8fbc3 not found: ID does not exist" containerID="0745ff9af04b2e3a6a16719915c9fa78fbb75741f12a3bacaf9ad33e92d8fbc3"
Jul 08 22:03:55.312778 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:55.312744    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0745ff9af04b2e3a6a16719915c9fa78fbb75741f12a3bacaf9ad33e92d8fbc3"} err="failed to get container status \"0745ff9af04b2e3a6a16719915c9fa78fbb75741f12a3bacaf9ad33e92d8fbc3\": rpc error: code = NotFound desc = could not find container \"0745ff9af04b2e3a6a16719915c9fa78fbb75741f12a3bacaf9ad33e92d8fbc3\": container with ID starting with 0745ff9af04b2e3a6a16719915c9fa78fbb75741f12a3bacaf9ad33e92d8fbc3 not found: ID does not exist"
Jul 08 22:03:55.316767 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:55.316743    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"]
Jul 08 22:03:55.322148 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:55.322129    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-33669def-openshift-default-7846d94987-6b86p"]
Jul 08 22:03:55.612350 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:03:55.612238    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a28b467-ac09-4e09-9a0a-1d2d54954dcd" path="/var/lib/kubelet/pods/1a28b467-ac09-4e09-9a0a-1d2d54954dcd/volumes"
Jul 08 22:04:08.334850 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.334819    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"]
Jul 08 22:04:08.335369 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.335204    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a28b467-ac09-4e09-9a0a-1d2d54954dcd" containerName="istio-proxy"
Jul 08 22:04:08.335369 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.335218    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a28b467-ac09-4e09-9a0a-1d2d54954dcd" containerName="istio-proxy"
Jul 08 22:04:08.335369 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.335232    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a28b467-ac09-4e09-9a0a-1d2d54954dcd" containerName="istio-proxy"
Jul 08 22:04:08.335369 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.335237    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a28b467-ac09-4e09-9a0a-1d2d54954dcd" containerName="istio-proxy"
Jul 08 22:04:08.335369 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.335247    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b0f0817-559e-4a99-8d95-c1193c01a376" containerName="maas-api"
Jul 08 22:04:08.335369 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.335252    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b0f0817-559e-4a99-8d95-c1193c01a376" containerName="maas-api"
Jul 08 22:04:08.335369 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.335316    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a28b467-ac09-4e09-9a0a-1d2d54954dcd" containerName="istio-proxy"
Jul 08 22:04:08.335369 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.335325    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a28b467-ac09-4e09-9a0a-1d2d54954dcd" containerName="istio-proxy"
Jul 08 22:04:08.335369 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.335336    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b0f0817-559e-4a99-8d95-c1193c01a376" containerName="maas-api"
Jul 08 22:04:08.337317 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.337300    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"
Jul 08 22:04:08.339891 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.339871    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-5efb71b0-openshift-default-dockercfg-zp5kq\""
Jul 08 22:04:08.351389 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.351366    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"]
Jul 08 22:04:08.378469 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.378438    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2ab541f-8d60-496f-b434-20e134443ad2-istio-envoy\") pod \"e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk\" (UID: \"e2ab541f-8d60-496f-b434-20e134443ad2\") " pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"
Jul 08 22:04:08.378651 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.378481    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2ab541f-8d60-496f-b434-20e134443ad2-istio-data\") pod \"e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk\" (UID: \"e2ab541f-8d60-496f-b434-20e134443ad2\") " pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"
Jul 08 22:04:08.378651 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.378498    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2ab541f-8d60-496f-b434-20e134443ad2-istiod-ca-cert\") pod \"e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk\" (UID: \"e2ab541f-8d60-496f-b434-20e134443ad2\") " pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"
Jul 08 22:04:08.378651 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.378577    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2ab541f-8d60-496f-b434-20e134443ad2-istio-podinfo\") pod \"e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk\" (UID: \"e2ab541f-8d60-496f-b434-20e134443ad2\") " pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"
Jul 08 22:04:08.378651 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.378632    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2ab541f-8d60-496f-b434-20e134443ad2-workload-certs\") pod \"e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk\" (UID: \"e2ab541f-8d60-496f-b434-20e134443ad2\") " pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"
Jul 08 22:04:08.378872 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.378697    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2ab541f-8d60-496f-b434-20e134443ad2-credential-socket\") pod \"e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk\" (UID: \"e2ab541f-8d60-496f-b434-20e134443ad2\") " pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"
Jul 08 22:04:08.378872 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.378754    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4pjs\" (UniqueName: \"kubernetes.io/projected/e2ab541f-8d60-496f-b434-20e134443ad2-kube-api-access-s4pjs\") pod \"e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk\" (UID: \"e2ab541f-8d60-496f-b434-20e134443ad2\") " pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"
Jul 08 22:04:08.378872 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.378807    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2ab541f-8d60-496f-b434-20e134443ad2-workload-socket\") pod \"e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk\" (UID: \"e2ab541f-8d60-496f-b434-20e134443ad2\") " pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"
Jul 08 22:04:08.378872 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.378846    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2ab541f-8d60-496f-b434-20e134443ad2-istio-token\") pod \"e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk\" (UID: \"e2ab541f-8d60-496f-b434-20e134443ad2\") " pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"
Jul 08 22:04:08.479834 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.479789    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2ab541f-8d60-496f-b434-20e134443ad2-istio-podinfo\") pod \"e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk\" (UID: \"e2ab541f-8d60-496f-b434-20e134443ad2\") " pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"
Jul 08 22:04:08.479834 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.479837    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2ab541f-8d60-496f-b434-20e134443ad2-workload-certs\") pod \"e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk\" (UID: \"e2ab541f-8d60-496f-b434-20e134443ad2\") " pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"
Jul 08 22:04:08.480097 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.479883    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2ab541f-8d60-496f-b434-20e134443ad2-credential-socket\") pod \"e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk\" (UID: \"e2ab541f-8d60-496f-b434-20e134443ad2\") " pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"
Jul 08 22:04:08.480097 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.479902    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4pjs\" (UniqueName: \"kubernetes.io/projected/e2ab541f-8d60-496f-b434-20e134443ad2-kube-api-access-s4pjs\") pod \"e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk\" (UID: \"e2ab541f-8d60-496f-b434-20e134443ad2\") " pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"
Jul 08 22:04:08.480097 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.479918    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2ab541f-8d60-496f-b434-20e134443ad2-workload-socket\") pod \"e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk\" (UID: \"e2ab541f-8d60-496f-b434-20e134443ad2\") " pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"
Jul 08 22:04:08.480097 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.479942    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2ab541f-8d60-496f-b434-20e134443ad2-istio-token\") pod \"e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk\" (UID: \"e2ab541f-8d60-496f-b434-20e134443ad2\") " pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"
Jul 08 22:04:08.480097 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.479989    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2ab541f-8d60-496f-b434-20e134443ad2-istio-envoy\") pod \"e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk\" (UID: \"e2ab541f-8d60-496f-b434-20e134443ad2\") " pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"
Jul 08 22:04:08.480097 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.480026    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2ab541f-8d60-496f-b434-20e134443ad2-istio-data\") pod \"e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk\" (UID: \"e2ab541f-8d60-496f-b434-20e134443ad2\") " pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"
Jul 08 22:04:08.480097 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.480048    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2ab541f-8d60-496f-b434-20e134443ad2-istiod-ca-cert\") pod \"e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk\" (UID: \"e2ab541f-8d60-496f-b434-20e134443ad2\") " pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"
Jul 08 22:04:08.480510 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.480426    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2ab541f-8d60-496f-b434-20e134443ad2-credential-socket\") pod \"e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk\" (UID: \"e2ab541f-8d60-496f-b434-20e134443ad2\") " pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"
Jul 08 22:04:08.480510 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.480464    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2ab541f-8d60-496f-b434-20e134443ad2-workload-certs\") pod \"e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk\" (UID: \"e2ab541f-8d60-496f-b434-20e134443ad2\") " pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"
Jul 08 22:04:08.480621 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.480533    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2ab541f-8d60-496f-b434-20e134443ad2-istio-data\") pod \"e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk\" (UID: \"e2ab541f-8d60-496f-b434-20e134443ad2\") " pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"
Jul 08 22:04:08.480856 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.480835    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2ab541f-8d60-496f-b434-20e134443ad2-workload-socket\") pod \"e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk\" (UID: \"e2ab541f-8d60-496f-b434-20e134443ad2\") " pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"
Jul 08 22:04:08.480901 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.480890    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2ab541f-8d60-496f-b434-20e134443ad2-istiod-ca-cert\") pod \"e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk\" (UID: \"e2ab541f-8d60-496f-b434-20e134443ad2\") " pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"
Jul 08 22:04:08.482517 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.482484    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2ab541f-8d60-496f-b434-20e134443ad2-istio-envoy\") pod \"e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk\" (UID: \"e2ab541f-8d60-496f-b434-20e134443ad2\") " pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"
Jul 08 22:04:08.482623 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.482515    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2ab541f-8d60-496f-b434-20e134443ad2-istio-podinfo\") pod \"e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk\" (UID: \"e2ab541f-8d60-496f-b434-20e134443ad2\") " pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"
Jul 08 22:04:08.489248 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.489223    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4pjs\" (UniqueName: \"kubernetes.io/projected/e2ab541f-8d60-496f-b434-20e134443ad2-kube-api-access-s4pjs\") pod \"e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk\" (UID: \"e2ab541f-8d60-496f-b434-20e134443ad2\") " pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"
Jul 08 22:04:08.490170 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.490144    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2ab541f-8d60-496f-b434-20e134443ad2-istio-token\") pod \"e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk\" (UID: \"e2ab541f-8d60-496f-b434-20e134443ad2\") " pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"
Jul 08 22:04:08.647171 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.647140    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"
Jul 08 22:04:08.785151 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.785127    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"]
Jul 08 22:04:08.787272 ip-10-0-131-83 kubenswrapper[2569]: W0708 22:04:08.787243    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2ab541f_8d60_496f_b434_20e134443ad2.slice/crio-2d82e430840b17c121c92b3917b9e391f31169320d4ff256c7f3ac4f27ac10e7 WatchSource:0}: Error finding container 2d82e430840b17c121c92b3917b9e391f31169320d4ff256c7f3ac4f27ac10e7: Status 404 returned error can't find the container with id 2d82e430840b17c121c92b3917b9e391f31169320d4ff256c7f3ac4f27ac10e7
Jul 08 22:04:08.789253 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.789223    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 08 22:04:08.789337 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.789323    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 08 22:04:08.789387 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:08.789356    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 08 22:04:09.357269 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:09.357227    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk" event={"ID":"e2ab541f-8d60-496f-b434-20e134443ad2","Type":"ContainerStarted","Data":"3c61fb1e0f86c3edfcdab3514f8c579d853c5e3bbc41f0bdb1104e97e2f40a7e"}
Jul 08 22:04:09.357752 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:09.357309    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk" event={"ID":"e2ab541f-8d60-496f-b434-20e134443ad2","Type":"ContainerStarted","Data":"2d82e430840b17c121c92b3917b9e391f31169320d4ff256c7f3ac4f27ac10e7"}
Jul 08 22:04:09.378472 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:09.378428    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk" podStartSLOduration=1.3784132740000001 podStartE2EDuration="1.378413274s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:04:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:04:09.37664398 +0000 UTC m=+1872.314976379" watchObservedRunningTime="2026-07-08 22:04:09.378413274 +0000 UTC m=+1872.316745674"
Jul 08 22:04:09.647533 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:09.647500    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"
Jul 08 22:04:09.652677 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:09.652652    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"
Jul 08 22:04:10.362024 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:10.361991    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"
Jul 08 22:04:10.362992 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:10.362974    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"
Jul 08 22:04:11.309696 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:11.309660    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5efb71b0-858bf8b785-5hdfw"]
Jul 08 22:04:11.312081 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:11.312065    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5efb71b0-858bf8b785-5hdfw"
Jul 08 22:04:11.315095 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:11.315065    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-5efb71b0-serving-cert\""
Jul 08 22:04:11.325903 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:11.325880    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5efb71b0-858bf8b785-5hdfw"]
Jul 08 22:04:11.406769 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:11.406721    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms2js\" (UniqueName: \"kubernetes.io/projected/9deeaa9f-4842-4795-a88e-70f1d173360a-kube-api-access-ms2js\") pod \"maas-api-e2e-mt-5efb71b0-858bf8b785-5hdfw\" (UID: \"9deeaa9f-4842-4795-a88e-70f1d173360a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5efb71b0-858bf8b785-5hdfw"
Jul 08 22:04:11.407216 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:11.406798    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9deeaa9f-4842-4795-a88e-70f1d173360a-openshift-service-ca\") pod \"maas-api-e2e-mt-5efb71b0-858bf8b785-5hdfw\" (UID: \"9deeaa9f-4842-4795-a88e-70f1d173360a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5efb71b0-858bf8b785-5hdfw"
Jul 08 22:04:11.407216 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:11.406837    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9deeaa9f-4842-4795-a88e-70f1d173360a-maas-api-tls\") pod \"maas-api-e2e-mt-5efb71b0-858bf8b785-5hdfw\" (UID: \"9deeaa9f-4842-4795-a88e-70f1d173360a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5efb71b0-858bf8b785-5hdfw"
Jul 08 22:04:11.507914 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:11.507874    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms2js\" (UniqueName: \"kubernetes.io/projected/9deeaa9f-4842-4795-a88e-70f1d173360a-kube-api-access-ms2js\") pod \"maas-api-e2e-mt-5efb71b0-858bf8b785-5hdfw\" (UID: \"9deeaa9f-4842-4795-a88e-70f1d173360a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5efb71b0-858bf8b785-5hdfw"
Jul 08 22:04:11.507914 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:11.507921    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9deeaa9f-4842-4795-a88e-70f1d173360a-openshift-service-ca\") pod \"maas-api-e2e-mt-5efb71b0-858bf8b785-5hdfw\" (UID: \"9deeaa9f-4842-4795-a88e-70f1d173360a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5efb71b0-858bf8b785-5hdfw"
Jul 08 22:04:11.508189 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:11.507944    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9deeaa9f-4842-4795-a88e-70f1d173360a-maas-api-tls\") pod \"maas-api-e2e-mt-5efb71b0-858bf8b785-5hdfw\" (UID: \"9deeaa9f-4842-4795-a88e-70f1d173360a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5efb71b0-858bf8b785-5hdfw"
Jul 08 22:04:11.508189 ip-10-0-131-83 kubenswrapper[2569]: E0708 22:04:11.508052    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-5efb71b0-serving-cert: secret "maas-api-e2e-mt-5efb71b0-serving-cert" not found
Jul 08 22:04:11.508189 ip-10-0-131-83 kubenswrapper[2569]: E0708 22:04:11.508106    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9deeaa9f-4842-4795-a88e-70f1d173360a-maas-api-tls podName:9deeaa9f-4842-4795-a88e-70f1d173360a nodeName:}" failed. No retries permitted until 2026-07-08 22:04:12.008089445 +0000 UTC m=+1874.946421822 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9deeaa9f-4842-4795-a88e-70f1d173360a-maas-api-tls") pod "maas-api-e2e-mt-5efb71b0-858bf8b785-5hdfw" (UID: "9deeaa9f-4842-4795-a88e-70f1d173360a") : secret "maas-api-e2e-mt-5efb71b0-serving-cert" not found
Jul 08 22:04:11.508637 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:11.508618    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9deeaa9f-4842-4795-a88e-70f1d173360a-openshift-service-ca\") pod \"maas-api-e2e-mt-5efb71b0-858bf8b785-5hdfw\" (UID: \"9deeaa9f-4842-4795-a88e-70f1d173360a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5efb71b0-858bf8b785-5hdfw"
Jul 08 22:04:11.516622 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:11.516598    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms2js\" (UniqueName: \"kubernetes.io/projected/9deeaa9f-4842-4795-a88e-70f1d173360a-kube-api-access-ms2js\") pod \"maas-api-e2e-mt-5efb71b0-858bf8b785-5hdfw\" (UID: \"9deeaa9f-4842-4795-a88e-70f1d173360a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5efb71b0-858bf8b785-5hdfw"
Jul 08 22:04:12.012476 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:12.012438    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9deeaa9f-4842-4795-a88e-70f1d173360a-maas-api-tls\") pod \"maas-api-e2e-mt-5efb71b0-858bf8b785-5hdfw\" (UID: \"9deeaa9f-4842-4795-a88e-70f1d173360a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5efb71b0-858bf8b785-5hdfw"
Jul 08 22:04:12.012659 ip-10-0-131-83 kubenswrapper[2569]: E0708 22:04:12.012606    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-5efb71b0-serving-cert: secret "maas-api-e2e-mt-5efb71b0-serving-cert" not found
Jul 08 22:04:12.012704 ip-10-0-131-83 kubenswrapper[2569]: E0708 22:04:12.012690    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9deeaa9f-4842-4795-a88e-70f1d173360a-maas-api-tls podName:9deeaa9f-4842-4795-a88e-70f1d173360a nodeName:}" failed. No retries permitted until 2026-07-08 22:04:13.012673002 +0000 UTC m=+1875.951005389 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9deeaa9f-4842-4795-a88e-70f1d173360a-maas-api-tls") pod "maas-api-e2e-mt-5efb71b0-858bf8b785-5hdfw" (UID: "9deeaa9f-4842-4795-a88e-70f1d173360a") : secret "maas-api-e2e-mt-5efb71b0-serving-cert" not found
Jul 08 22:04:13.020954 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:13.020915    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9deeaa9f-4842-4795-a88e-70f1d173360a-maas-api-tls\") pod \"maas-api-e2e-mt-5efb71b0-858bf8b785-5hdfw\" (UID: \"9deeaa9f-4842-4795-a88e-70f1d173360a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5efb71b0-858bf8b785-5hdfw"
Jul 08 22:04:13.023612 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:13.023587    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9deeaa9f-4842-4795-a88e-70f1d173360a-maas-api-tls\") pod \"maas-api-e2e-mt-5efb71b0-858bf8b785-5hdfw\" (UID: \"9deeaa9f-4842-4795-a88e-70f1d173360a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5efb71b0-858bf8b785-5hdfw"
Jul 08 22:04:13.122742 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:13.122696    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5efb71b0-858bf8b785-5hdfw"
Jul 08 22:04:13.252909 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:13.252853    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5efb71b0-858bf8b785-5hdfw"]
Jul 08 22:04:13.254897 ip-10-0-131-83 kubenswrapper[2569]: W0708 22:04:13.254870    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9deeaa9f_4842_4795_a88e_70f1d173360a.slice/crio-aa3f92a7a18ffefdf57c333c984dc5fa092c692d736eb8b43a9ffbc3abd2e95f WatchSource:0}: Error finding container aa3f92a7a18ffefdf57c333c984dc5fa092c692d736eb8b43a9ffbc3abd2e95f: Status 404 returned error can't find the container with id aa3f92a7a18ffefdf57c333c984dc5fa092c692d736eb8b43a9ffbc3abd2e95f
Jul 08 22:04:13.375964 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:13.375868    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5efb71b0-858bf8b785-5hdfw" event={"ID":"9deeaa9f-4842-4795-a88e-70f1d173360a","Type":"ContainerStarted","Data":"aa3f92a7a18ffefdf57c333c984dc5fa092c692d736eb8b43a9ffbc3abd2e95f"}
Jul 08 22:04:14.381575 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:14.381532    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5efb71b0-858bf8b785-5hdfw" event={"ID":"9deeaa9f-4842-4795-a88e-70f1d173360a","Type":"ContainerStarted","Data":"7714ea2612281767e61f8abbc51ef775f5c8adb112c7f7f799bb9fef7923b696"}
Jul 08 22:04:14.381972 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:14.381618    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5efb71b0-858bf8b785-5hdfw"
Jul 08 22:04:14.399832 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:14.399779    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5efb71b0-858bf8b785-5hdfw" podStartSLOduration=2.974885501 podStartE2EDuration="3.399763552s" totalImagesPullingTime="424.878051ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:04:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:04:14.397527003 +0000 UTC m=+1877.335859416" watchObservedRunningTime="2026-07-08 22:04:14.399763552 +0000 UTC m=+1877.338095952"
Jul 08 22:04:20.391992 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:20.391963    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5efb71b0-858bf8b785-5hdfw"
Jul 08 22:04:23.432233 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:23.432193    2569 generic.go:356] "Generic (PLEG): container finished" podID="e2ab541f-8d60-496f-b434-20e134443ad2" containerID="3c61fb1e0f86c3edfcdab3514f8c579d853c5e3bbc41f0bdb1104e97e2f40a7e" exitCode=0
Jul 08 22:04:23.432642 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:23.432266    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk" event={"ID":"e2ab541f-8d60-496f-b434-20e134443ad2","Type":"ContainerDied","Data":"3c61fb1e0f86c3edfcdab3514f8c579d853c5e3bbc41f0bdb1104e97e2f40a7e"}
Jul 08 22:04:23.432685 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:23.432646    2569 scope.go:117] "RemoveContainer" containerID="3c61fb1e0f86c3edfcdab3514f8c579d853c5e3bbc41f0bdb1104e97e2f40a7e"
Jul 08 22:04:23.433697 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:23.433662    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 08 22:04:23.433788 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:23.433752    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 08 22:04:23.433826 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:23.433797    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 08 22:04:24.438817 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:24.438777    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk" event={"ID":"e2ab541f-8d60-496f-b434-20e134443ad2","Type":"ContainerStarted","Data":"ae8e1120f87067ae99d7d6ac91bac45b034c96084194cf1131c10ff9dc93862a"}
Jul 08 22:04:24.647962 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:24.647916    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"
Jul 08 22:04:24.649186 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:24.649157    2569 patch_prober.go:28] interesting pod/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 08 22:04:24.649321 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:24.649210    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk" podUID="e2ab541f-8d60-496f-b434-20e134443ad2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 08 22:04:25.362564 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:25.362520    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"
Jul 08 22:04:25.647776 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:25.647738    2569 patch_prober.go:28] interesting pod/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 08 22:04:25.648147 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:25.647797    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk" podUID="e2ab541f-8d60-496f-b434-20e134443ad2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 08 22:04:26.648532 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:26.648490    2569 patch_prober.go:28] interesting pod/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 08 22:04:26.648920 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:26.648549    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk" podUID="e2ab541f-8d60-496f-b434-20e134443ad2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 08 22:04:27.648186 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:27.648149    2569 patch_prober.go:28] interesting pod/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 08 22:04:27.648410 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:27.648213    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk" podUID="e2ab541f-8d60-496f-b434-20e134443ad2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 08 22:04:28.651877 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:28.651847    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"
Jul 08 22:04:28.652768 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:28.652749    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"
Jul 08 22:04:43.632280 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:43.632243    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5efb71b0-858bf8b785-5hdfw"]
Jul 08 22:04:43.632762 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:43.632511    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5efb71b0-858bf8b785-5hdfw" podUID="9deeaa9f-4842-4795-a88e-70f1d173360a" containerName="maas-api" containerID="cri-o://7714ea2612281767e61f8abbc51ef775f5c8adb112c7f7f799bb9fef7923b696" gracePeriod=30
Jul 08 22:04:43.875375 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:43.875350    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5efb71b0-858bf8b785-5hdfw"
Jul 08 22:04:44.002587 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:44.002546    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ms2js\" (UniqueName: \"kubernetes.io/projected/9deeaa9f-4842-4795-a88e-70f1d173360a-kube-api-access-ms2js\") pod \"9deeaa9f-4842-4795-a88e-70f1d173360a\" (UID: \"9deeaa9f-4842-4795-a88e-70f1d173360a\") "
Jul 08 22:04:44.002764 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:44.002654    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9deeaa9f-4842-4795-a88e-70f1d173360a-openshift-service-ca\") pod \"9deeaa9f-4842-4795-a88e-70f1d173360a\" (UID: \"9deeaa9f-4842-4795-a88e-70f1d173360a\") "
Jul 08 22:04:44.002764 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:44.002686    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9deeaa9f-4842-4795-a88e-70f1d173360a-maas-api-tls\") pod \"9deeaa9f-4842-4795-a88e-70f1d173360a\" (UID: \"9deeaa9f-4842-4795-a88e-70f1d173360a\") "
Jul 08 22:04:44.003010 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:44.002985    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9deeaa9f-4842-4795-a88e-70f1d173360a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9deeaa9f-4842-4795-a88e-70f1d173360a" (UID: "9deeaa9f-4842-4795-a88e-70f1d173360a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:04:44.004894 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:44.004862    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9deeaa9f-4842-4795-a88e-70f1d173360a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9deeaa9f-4842-4795-a88e-70f1d173360a" (UID: "9deeaa9f-4842-4795-a88e-70f1d173360a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 22:04:44.004894 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:44.004866    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9deeaa9f-4842-4795-a88e-70f1d173360a-kube-api-access-ms2js" (OuterVolumeSpecName: "kube-api-access-ms2js") pod "9deeaa9f-4842-4795-a88e-70f1d173360a" (UID: "9deeaa9f-4842-4795-a88e-70f1d173360a"). InnerVolumeSpecName "kube-api-access-ms2js". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:04:44.103296 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:44.103253    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9deeaa9f-4842-4795-a88e-70f1d173360a-openshift-service-ca\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:04:44.103296 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:44.103282    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9deeaa9f-4842-4795-a88e-70f1d173360a-maas-api-tls\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:04:44.103296 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:44.103305    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ms2js\" (UniqueName: \"kubernetes.io/projected/9deeaa9f-4842-4795-a88e-70f1d173360a-kube-api-access-ms2js\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:04:44.523723 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:44.523683    2569 generic.go:356] "Generic (PLEG): container finished" podID="9deeaa9f-4842-4795-a88e-70f1d173360a" containerID="7714ea2612281767e61f8abbc51ef775f5c8adb112c7f7f799bb9fef7923b696" exitCode=0
Jul 08 22:04:44.523892 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:44.523732    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5efb71b0-858bf8b785-5hdfw"
Jul 08 22:04:44.523892 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:44.523761    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5efb71b0-858bf8b785-5hdfw" event={"ID":"9deeaa9f-4842-4795-a88e-70f1d173360a","Type":"ContainerDied","Data":"7714ea2612281767e61f8abbc51ef775f5c8adb112c7f7f799bb9fef7923b696"}
Jul 08 22:04:44.523892 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:44.523814    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5efb71b0-858bf8b785-5hdfw" event={"ID":"9deeaa9f-4842-4795-a88e-70f1d173360a","Type":"ContainerDied","Data":"aa3f92a7a18ffefdf57c333c984dc5fa092c692d736eb8b43a9ffbc3abd2e95f"}
Jul 08 22:04:44.523892 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:44.523836    2569 scope.go:117] "RemoveContainer" containerID="7714ea2612281767e61f8abbc51ef775f5c8adb112c7f7f799bb9fef7923b696"
Jul 08 22:04:44.532506 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:44.532487    2569 scope.go:117] "RemoveContainer" containerID="7714ea2612281767e61f8abbc51ef775f5c8adb112c7f7f799bb9fef7923b696"
Jul 08 22:04:44.532754 ip-10-0-131-83 kubenswrapper[2569]: E0708 22:04:44.532734    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7714ea2612281767e61f8abbc51ef775f5c8adb112c7f7f799bb9fef7923b696\": container with ID starting with 7714ea2612281767e61f8abbc51ef775f5c8adb112c7f7f799bb9fef7923b696 not found: ID does not exist" containerID="7714ea2612281767e61f8abbc51ef775f5c8adb112c7f7f799bb9fef7923b696"
Jul 08 22:04:44.532802 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:44.532764    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7714ea2612281767e61f8abbc51ef775f5c8adb112c7f7f799bb9fef7923b696"} err="failed to get container status \"7714ea2612281767e61f8abbc51ef775f5c8adb112c7f7f799bb9fef7923b696\": rpc error: code = NotFound desc = could not find container \"7714ea2612281767e61f8abbc51ef775f5c8adb112c7f7f799bb9fef7923b696\": container with ID starting with 7714ea2612281767e61f8abbc51ef775f5c8adb112c7f7f799bb9fef7923b696 not found: ID does not exist"
Jul 08 22:04:44.544215 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:44.544189    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5efb71b0-858bf8b785-5hdfw"]
Jul 08 22:04:44.549538 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:44.549506    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5efb71b0-858bf8b785-5hdfw"]
Jul 08 22:04:45.612990 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:04:45.612957    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9deeaa9f-4842-4795-a88e-70f1d173360a" path="/var/lib/kubelet/pods/9deeaa9f-4842-4795-a88e-70f1d173360a/volumes"
Jul 08 22:05:36.935365 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:36.935325    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"]
Jul 08 22:05:36.935936 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:36.935567    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk" podUID="e2ab541f-8d60-496f-b434-20e134443ad2" containerName="istio-proxy" containerID="cri-o://ae8e1120f87067ae99d7d6ac91bac45b034c96084194cf1131c10ff9dc93862a" gracePeriod=30
Jul 08 22:05:42.183348 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:42.183318    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"
Jul 08 22:05:42.223192 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:42.223102    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2ab541f-8d60-496f-b434-20e134443ad2-istio-token\") pod \"e2ab541f-8d60-496f-b434-20e134443ad2\" (UID: \"e2ab541f-8d60-496f-b434-20e134443ad2\") "
Jul 08 22:05:42.223192 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:42.223143    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2ab541f-8d60-496f-b434-20e134443ad2-workload-socket\") pod \"e2ab541f-8d60-496f-b434-20e134443ad2\" (UID: \"e2ab541f-8d60-496f-b434-20e134443ad2\") "
Jul 08 22:05:42.223192 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:42.223191    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2ab541f-8d60-496f-b434-20e134443ad2-istio-data\") pod \"e2ab541f-8d60-496f-b434-20e134443ad2\" (UID: \"e2ab541f-8d60-496f-b434-20e134443ad2\") "
Jul 08 22:05:42.223541 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:42.223208    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2ab541f-8d60-496f-b434-20e134443ad2-istio-envoy\") pod \"e2ab541f-8d60-496f-b434-20e134443ad2\" (UID: \"e2ab541f-8d60-496f-b434-20e134443ad2\") "
Jul 08 22:05:42.223541 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:42.223222    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4pjs\" (UniqueName: \"kubernetes.io/projected/e2ab541f-8d60-496f-b434-20e134443ad2-kube-api-access-s4pjs\") pod \"e2ab541f-8d60-496f-b434-20e134443ad2\" (UID: \"e2ab541f-8d60-496f-b434-20e134443ad2\") "
Jul 08 22:05:42.223541 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:42.223243    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2ab541f-8d60-496f-b434-20e134443ad2-workload-certs\") pod \"e2ab541f-8d60-496f-b434-20e134443ad2\" (UID: \"e2ab541f-8d60-496f-b434-20e134443ad2\") "
Jul 08 22:05:42.223541 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:42.223264    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2ab541f-8d60-496f-b434-20e134443ad2-istiod-ca-cert\") pod \"e2ab541f-8d60-496f-b434-20e134443ad2\" (UID: \"e2ab541f-8d60-496f-b434-20e134443ad2\") "
Jul 08 22:05:42.223783 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:42.223552    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2ab541f-8d60-496f-b434-20e134443ad2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e2ab541f-8d60-496f-b434-20e134443ad2" (UID: "e2ab541f-8d60-496f-b434-20e134443ad2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:05:42.223888 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:42.223865    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2ab541f-8d60-496f-b434-20e134443ad2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e2ab541f-8d60-496f-b434-20e134443ad2" (UID: "e2ab541f-8d60-496f-b434-20e134443ad2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:05:42.224019 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:42.223931    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2ab541f-8d60-496f-b434-20e134443ad2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e2ab541f-8d60-496f-b434-20e134443ad2" (UID: "e2ab541f-8d60-496f-b434-20e134443ad2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:05:42.224172 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:42.224151    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2ab541f-8d60-496f-b434-20e134443ad2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e2ab541f-8d60-496f-b434-20e134443ad2" (UID: "e2ab541f-8d60-496f-b434-20e134443ad2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:05:42.224240 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:42.224206    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2ab541f-8d60-496f-b434-20e134443ad2-credential-socket\") pod \"e2ab541f-8d60-496f-b434-20e134443ad2\" (UID: \"e2ab541f-8d60-496f-b434-20e134443ad2\") "
Jul 08 22:05:42.224324 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:42.224273    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2ab541f-8d60-496f-b434-20e134443ad2-istio-podinfo\") pod \"e2ab541f-8d60-496f-b434-20e134443ad2\" (UID: \"e2ab541f-8d60-496f-b434-20e134443ad2\") "
Jul 08 22:05:42.224391 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:42.224342    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2ab541f-8d60-496f-b434-20e134443ad2-istio-data" (OuterVolumeSpecName: "istio-data") pod "e2ab541f-8d60-496f-b434-20e134443ad2" (UID: "e2ab541f-8d60-496f-b434-20e134443ad2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:05:42.224653 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:42.224626    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2ab541f-8d60-496f-b434-20e134443ad2-workload-socket\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:05:42.224653 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:42.224655    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2ab541f-8d60-496f-b434-20e134443ad2-istio-data\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:05:42.224836 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:42.224670    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2ab541f-8d60-496f-b434-20e134443ad2-workload-certs\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:05:42.224836 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:42.224682    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2ab541f-8d60-496f-b434-20e134443ad2-istiod-ca-cert\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:05:42.224836 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:42.224694    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2ab541f-8d60-496f-b434-20e134443ad2-credential-socket\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:05:42.225600 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:42.225575    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2ab541f-8d60-496f-b434-20e134443ad2-istio-token" (OuterVolumeSpecName: "istio-token") pod "e2ab541f-8d60-496f-b434-20e134443ad2" (UID: "e2ab541f-8d60-496f-b434-20e134443ad2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:05:42.225967 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:42.225937    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2ab541f-8d60-496f-b434-20e134443ad2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e2ab541f-8d60-496f-b434-20e134443ad2" (UID: "e2ab541f-8d60-496f-b434-20e134443ad2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:05:42.226049 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:42.225984    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2ab541f-8d60-496f-b434-20e134443ad2-kube-api-access-s4pjs" (OuterVolumeSpecName: "kube-api-access-s4pjs") pod "e2ab541f-8d60-496f-b434-20e134443ad2" (UID: "e2ab541f-8d60-496f-b434-20e134443ad2"). InnerVolumeSpecName "kube-api-access-s4pjs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:05:42.226624 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:42.226604    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e2ab541f-8d60-496f-b434-20e134443ad2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e2ab541f-8d60-496f-b434-20e134443ad2" (UID: "e2ab541f-8d60-496f-b434-20e134443ad2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 22:05:42.325709 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:42.325673    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2ab541f-8d60-496f-b434-20e134443ad2-istio-podinfo\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:05:42.325709 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:42.325701    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2ab541f-8d60-496f-b434-20e134443ad2-istio-token\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:05:42.325709 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:42.325711    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2ab541f-8d60-496f-b434-20e134443ad2-istio-envoy\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:05:42.325709 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:42.325719    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4pjs\" (UniqueName: \"kubernetes.io/projected/e2ab541f-8d60-496f-b434-20e134443ad2-kube-api-access-s4pjs\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:05:42.782344 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:42.782271    2569 generic.go:356] "Generic (PLEG): container finished" podID="e2ab541f-8d60-496f-b434-20e134443ad2" containerID="ae8e1120f87067ae99d7d6ac91bac45b034c96084194cf1131c10ff9dc93862a" exitCode=0
Jul 08 22:05:42.782344 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:42.782334    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"
Jul 08 22:05:42.782671 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:42.782357    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk" event={"ID":"e2ab541f-8d60-496f-b434-20e134443ad2","Type":"ContainerDied","Data":"ae8e1120f87067ae99d7d6ac91bac45b034c96084194cf1131c10ff9dc93862a"}
Jul 08 22:05:42.782671 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:42.782418    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk" event={"ID":"e2ab541f-8d60-496f-b434-20e134443ad2","Type":"ContainerDied","Data":"2d82e430840b17c121c92b3917b9e391f31169320d4ff256c7f3ac4f27ac10e7"}
Jul 08 22:05:42.782671 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:42.782451    2569 scope.go:117] "RemoveContainer" containerID="ae8e1120f87067ae99d7d6ac91bac45b034c96084194cf1131c10ff9dc93862a"
Jul 08 22:05:42.794443 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:42.794419    2569 scope.go:117] "RemoveContainer" containerID="3c61fb1e0f86c3edfcdab3514f8c579d853c5e3bbc41f0bdb1104e97e2f40a7e"
Jul 08 22:05:42.802325 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:42.802296    2569 scope.go:117] "RemoveContainer" containerID="ae8e1120f87067ae99d7d6ac91bac45b034c96084194cf1131c10ff9dc93862a"
Jul 08 22:05:42.802582 ip-10-0-131-83 kubenswrapper[2569]: E0708 22:05:42.802560    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae8e1120f87067ae99d7d6ac91bac45b034c96084194cf1131c10ff9dc93862a\": container with ID starting with ae8e1120f87067ae99d7d6ac91bac45b034c96084194cf1131c10ff9dc93862a not found: ID does not exist" containerID="ae8e1120f87067ae99d7d6ac91bac45b034c96084194cf1131c10ff9dc93862a"
Jul 08 22:05:42.802661 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:42.802594    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae8e1120f87067ae99d7d6ac91bac45b034c96084194cf1131c10ff9dc93862a"} err="failed to get container status \"ae8e1120f87067ae99d7d6ac91bac45b034c96084194cf1131c10ff9dc93862a\": rpc error: code = NotFound desc = could not find container \"ae8e1120f87067ae99d7d6ac91bac45b034c96084194cf1131c10ff9dc93862a\": container with ID starting with ae8e1120f87067ae99d7d6ac91bac45b034c96084194cf1131c10ff9dc93862a not found: ID does not exist"
Jul 08 22:05:42.802661 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:42.802618    2569 scope.go:117] "RemoveContainer" containerID="3c61fb1e0f86c3edfcdab3514f8c579d853c5e3bbc41f0bdb1104e97e2f40a7e"
Jul 08 22:05:42.802860 ip-10-0-131-83 kubenswrapper[2569]: E0708 22:05:42.802840    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c61fb1e0f86c3edfcdab3514f8c579d853c5e3bbc41f0bdb1104e97e2f40a7e\": container with ID starting with 3c61fb1e0f86c3edfcdab3514f8c579d853c5e3bbc41f0bdb1104e97e2f40a7e not found: ID does not exist" containerID="3c61fb1e0f86c3edfcdab3514f8c579d853c5e3bbc41f0bdb1104e97e2f40a7e"
Jul 08 22:05:42.802905 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:42.802866    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c61fb1e0f86c3edfcdab3514f8c579d853c5e3bbc41f0bdb1104e97e2f40a7e"} err="failed to get container status \"3c61fb1e0f86c3edfcdab3514f8c579d853c5e3bbc41f0bdb1104e97e2f40a7e\": rpc error: code = NotFound desc = could not find container \"3c61fb1e0f86c3edfcdab3514f8c579d853c5e3bbc41f0bdb1104e97e2f40a7e\": container with ID starting with 3c61fb1e0f86c3edfcdab3514f8c579d853c5e3bbc41f0bdb1104e97e2f40a7e not found: ID does not exist"
Jul 08 22:05:42.805844 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:42.805823    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"]
Jul 08 22:05:42.809626 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:42.809606    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-5efb71b0-openshift-default-84dd4d66c9-tg9dk"]
Jul 08 22:05:43.616928 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:05:43.616882    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2ab541f-8d60-496f-b434-20e134443ad2" path="/var/lib/kubelet/pods/e2ab541f-8d60-496f-b434-20e134443ad2/volumes"
Jul 08 22:06:32.044671 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.044631    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"]
Jul 08 22:06:32.045153 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.044950    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9deeaa9f-4842-4795-a88e-70f1d173360a" containerName="maas-api"
Jul 08 22:06:32.045153 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.044961    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="9deeaa9f-4842-4795-a88e-70f1d173360a" containerName="maas-api"
Jul 08 22:06:32.045153 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.044972    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2ab541f-8d60-496f-b434-20e134443ad2" containerName="istio-proxy"
Jul 08 22:06:32.045153 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.044979    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2ab541f-8d60-496f-b434-20e134443ad2" containerName="istio-proxy"
Jul 08 22:06:32.045153 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.044988    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2ab541f-8d60-496f-b434-20e134443ad2" containerName="istio-proxy"
Jul 08 22:06:32.045153 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.044993    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2ab541f-8d60-496f-b434-20e134443ad2" containerName="istio-proxy"
Jul 08 22:06:32.045153 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.045046    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="9deeaa9f-4842-4795-a88e-70f1d173360a" containerName="maas-api"
Jul 08 22:06:32.045153 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.045058    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2ab541f-8d60-496f-b434-20e134443ad2" containerName="istio-proxy"
Jul 08 22:06:32.045153 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.045063    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2ab541f-8d60-496f-b434-20e134443ad2" containerName="istio-proxy"
Jul 08 22:06:32.047860 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.047840    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"
Jul 08 22:06:32.050812 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.050792    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-2c94a2-openshift-default-dockercfg-tw4lp\""
Jul 08 22:06:32.070606 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.070581    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"]
Jul 08 22:06:32.073081 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.073057    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/790eaace-d88a-42b5-8528-c52b77f0f547-workload-certs\") pod \"e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4\" (UID: \"790eaace-d88a-42b5-8528-c52b77f0f547\") " pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"
Jul 08 22:06:32.073190 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.073088    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/790eaace-d88a-42b5-8528-c52b77f0f547-istio-podinfo\") pod \"e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4\" (UID: \"790eaace-d88a-42b5-8528-c52b77f0f547\") " pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"
Jul 08 22:06:32.073190 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.073118    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/790eaace-d88a-42b5-8528-c52b77f0f547-workload-socket\") pod \"e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4\" (UID: \"790eaace-d88a-42b5-8528-c52b77f0f547\") " pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"
Jul 08 22:06:32.073190 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.073141    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/790eaace-d88a-42b5-8528-c52b77f0f547-istio-token\") pod \"e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4\" (UID: \"790eaace-d88a-42b5-8528-c52b77f0f547\") " pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"
Jul 08 22:06:32.073190 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.073162    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbgps\" (UniqueName: \"kubernetes.io/projected/790eaace-d88a-42b5-8528-c52b77f0f547-kube-api-access-pbgps\") pod \"e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4\" (UID: \"790eaace-d88a-42b5-8528-c52b77f0f547\") " pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"
Jul 08 22:06:32.073190 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.073183    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/790eaace-d88a-42b5-8528-c52b77f0f547-istio-envoy\") pod \"e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4\" (UID: \"790eaace-d88a-42b5-8528-c52b77f0f547\") " pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"
Jul 08 22:06:32.073391 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.073207    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/790eaace-d88a-42b5-8528-c52b77f0f547-credential-socket\") pod \"e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4\" (UID: \"790eaace-d88a-42b5-8528-c52b77f0f547\") " pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"
Jul 08 22:06:32.073391 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.073307    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/790eaace-d88a-42b5-8528-c52b77f0f547-istiod-ca-cert\") pod \"e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4\" (UID: \"790eaace-d88a-42b5-8528-c52b77f0f547\") " pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"
Jul 08 22:06:32.073391 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.073348    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/790eaace-d88a-42b5-8528-c52b77f0f547-istio-data\") pod \"e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4\" (UID: \"790eaace-d88a-42b5-8528-c52b77f0f547\") " pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"
Jul 08 22:06:32.174271 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.174224    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/790eaace-d88a-42b5-8528-c52b77f0f547-workload-certs\") pod \"e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4\" (UID: \"790eaace-d88a-42b5-8528-c52b77f0f547\") " pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"
Jul 08 22:06:32.174271 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.174267    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/790eaace-d88a-42b5-8528-c52b77f0f547-istio-podinfo\") pod \"e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4\" (UID: \"790eaace-d88a-42b5-8528-c52b77f0f547\") " pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"
Jul 08 22:06:32.174545 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.174323    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/790eaace-d88a-42b5-8528-c52b77f0f547-workload-socket\") pod \"e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4\" (UID: \"790eaace-d88a-42b5-8528-c52b77f0f547\") " pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"
Jul 08 22:06:32.174545 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.174347    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/790eaace-d88a-42b5-8528-c52b77f0f547-istio-token\") pod \"e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4\" (UID: \"790eaace-d88a-42b5-8528-c52b77f0f547\") " pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"
Jul 08 22:06:32.174545 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.174368    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbgps\" (UniqueName: \"kubernetes.io/projected/790eaace-d88a-42b5-8528-c52b77f0f547-kube-api-access-pbgps\") pod \"e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4\" (UID: \"790eaace-d88a-42b5-8528-c52b77f0f547\") " pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"
Jul 08 22:06:32.174545 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.174402    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/790eaace-d88a-42b5-8528-c52b77f0f547-istio-envoy\") pod \"e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4\" (UID: \"790eaace-d88a-42b5-8528-c52b77f0f547\") " pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"
Jul 08 22:06:32.174545 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.174434    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/790eaace-d88a-42b5-8528-c52b77f0f547-credential-socket\") pod \"e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4\" (UID: \"790eaace-d88a-42b5-8528-c52b77f0f547\") " pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"
Jul 08 22:06:32.174545 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.174495    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/790eaace-d88a-42b5-8528-c52b77f0f547-istiod-ca-cert\") pod \"e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4\" (UID: \"790eaace-d88a-42b5-8528-c52b77f0f547\") " pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"
Jul 08 22:06:32.174545 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.174541    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/790eaace-d88a-42b5-8528-c52b77f0f547-istio-data\") pod \"e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4\" (UID: \"790eaace-d88a-42b5-8528-c52b77f0f547\") " pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"
Jul 08 22:06:32.174900 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.174707    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/790eaace-d88a-42b5-8528-c52b77f0f547-workload-certs\") pod \"e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4\" (UID: \"790eaace-d88a-42b5-8528-c52b77f0f547\") " pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"
Jul 08 22:06:32.174900 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.174765    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/790eaace-d88a-42b5-8528-c52b77f0f547-workload-socket\") pod \"e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4\" (UID: \"790eaace-d88a-42b5-8528-c52b77f0f547\") " pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"
Jul 08 22:06:32.175033 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.175013    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/790eaace-d88a-42b5-8528-c52b77f0f547-credential-socket\") pod \"e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4\" (UID: \"790eaace-d88a-42b5-8528-c52b77f0f547\") " pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"
Jul 08 22:06:32.175256 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.175166    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/790eaace-d88a-42b5-8528-c52b77f0f547-istio-data\") pod \"e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4\" (UID: \"790eaace-d88a-42b5-8528-c52b77f0f547\") " pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"
Jul 08 22:06:32.175360 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.175239    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/790eaace-d88a-42b5-8528-c52b77f0f547-istiod-ca-cert\") pod \"e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4\" (UID: \"790eaace-d88a-42b5-8528-c52b77f0f547\") " pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"
Jul 08 22:06:32.176874 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.176855    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/790eaace-d88a-42b5-8528-c52b77f0f547-istio-envoy\") pod \"e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4\" (UID: \"790eaace-d88a-42b5-8528-c52b77f0f547\") " pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"
Jul 08 22:06:32.177014 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.176994    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/790eaace-d88a-42b5-8528-c52b77f0f547-istio-podinfo\") pod \"e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4\" (UID: \"790eaace-d88a-42b5-8528-c52b77f0f547\") " pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"
Jul 08 22:06:32.182420 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.182398    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/790eaace-d88a-42b5-8528-c52b77f0f547-istio-token\") pod \"e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4\" (UID: \"790eaace-d88a-42b5-8528-c52b77f0f547\") " pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"
Jul 08 22:06:32.182603 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.182584    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbgps\" (UniqueName: \"kubernetes.io/projected/790eaace-d88a-42b5-8528-c52b77f0f547-kube-api-access-pbgps\") pod \"e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4\" (UID: \"790eaace-d88a-42b5-8528-c52b77f0f547\") " pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"
Jul 08 22:06:32.357812 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.357720    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"
Jul 08 22:06:32.498862 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.498825    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"]
Jul 08 22:06:32.503509 ip-10-0-131-83 kubenswrapper[2569]: W0708 22:06:32.503473    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod790eaace_d88a_42b5_8528_c52b77f0f547.slice/crio-313f9645354757700ae36e506ba0a3d8be13cc24d7393e5ab53336887d2461f5 WatchSource:0}: Error finding container 313f9645354757700ae36e506ba0a3d8be13cc24d7393e5ab53336887d2461f5: Status 404 returned error can't find the container with id 313f9645354757700ae36e506ba0a3d8be13cc24d7393e5ab53336887d2461f5
Jul 08 22:06:32.506039 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.505996    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 08 22:06:32.506119 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.506085    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 08 22:06:32.506157 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.506126    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 08 22:06:32.998655 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.998618    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4" event={"ID":"790eaace-d88a-42b5-8528-c52b77f0f547","Type":"ContainerStarted","Data":"42e501f486728aa94c164ec20e65dd7894aea3b3918d10603bd73ae42de91495"}
Jul 08 22:06:32.998837 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:32.998688    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4" event={"ID":"790eaace-d88a-42b5-8528-c52b77f0f547","Type":"ContainerStarted","Data":"313f9645354757700ae36e506ba0a3d8be13cc24d7393e5ab53336887d2461f5"}
Jul 08 22:06:33.023977 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:33.023915    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4" podStartSLOduration=1.0238962 podStartE2EDuration="1.0238962s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:06:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:06:33.022582186 +0000 UTC m=+2015.960914606" watchObservedRunningTime="2026-07-08 22:06:33.0238962 +0000 UTC m=+2015.962228601"
Jul 08 22:06:33.358677 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:33.358585    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"
Jul 08 22:06:33.363506 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:33.363473    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"
Jul 08 22:06:34.002571 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:34.002539    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"
Jul 08 22:06:34.003547 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:34.003522    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"
Jul 08 22:06:35.020067 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:35.020036    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2c94a2-64858497fb-2zv44"]
Jul 08 22:06:35.023825 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:35.023803    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c94a2-64858497fb-2zv44"
Jul 08 22:06:35.026064 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:35.026044    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-2c94a2-serving-cert\""
Jul 08 22:06:35.035109 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:35.035080    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2c94a2-64858497fb-2zv44"]
Jul 08 22:06:35.103208 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:35.103174    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrvg6\" (UniqueName: \"kubernetes.io/projected/efe862b1-afdd-4b1a-89cd-144bd206ca2b-kube-api-access-qrvg6\") pod \"maas-api-e2e-inf-a-2c94a2-64858497fb-2zv44\" (UID: \"efe862b1-afdd-4b1a-89cd-144bd206ca2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c94a2-64858497fb-2zv44"
Jul 08 22:06:35.103208 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:35.103213    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efe862b1-afdd-4b1a-89cd-144bd206ca2b-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2c94a2-64858497fb-2zv44\" (UID: \"efe862b1-afdd-4b1a-89cd-144bd206ca2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c94a2-64858497fb-2zv44"
Jul 08 22:06:35.103476 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:35.103361    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efe862b1-afdd-4b1a-89cd-144bd206ca2b-maas-api-tls\") pod \"maas-api-e2e-inf-a-2c94a2-64858497fb-2zv44\" (UID: \"efe862b1-afdd-4b1a-89cd-144bd206ca2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c94a2-64858497fb-2zv44"
Jul 08 22:06:35.204012 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:35.203973    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrvg6\" (UniqueName: \"kubernetes.io/projected/efe862b1-afdd-4b1a-89cd-144bd206ca2b-kube-api-access-qrvg6\") pod \"maas-api-e2e-inf-a-2c94a2-64858497fb-2zv44\" (UID: \"efe862b1-afdd-4b1a-89cd-144bd206ca2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c94a2-64858497fb-2zv44"
Jul 08 22:06:35.204212 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:35.204021    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efe862b1-afdd-4b1a-89cd-144bd206ca2b-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2c94a2-64858497fb-2zv44\" (UID: \"efe862b1-afdd-4b1a-89cd-144bd206ca2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c94a2-64858497fb-2zv44"
Jul 08 22:06:35.204212 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:35.204094    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efe862b1-afdd-4b1a-89cd-144bd206ca2b-maas-api-tls\") pod \"maas-api-e2e-inf-a-2c94a2-64858497fb-2zv44\" (UID: \"efe862b1-afdd-4b1a-89cd-144bd206ca2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c94a2-64858497fb-2zv44"
Jul 08 22:06:35.204385 ip-10-0-131-83 kubenswrapper[2569]: E0708 22:06:35.204237    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-2c94a2-serving-cert: secret "maas-api-e2e-inf-a-2c94a2-serving-cert" not found
Jul 08 22:06:35.204385 ip-10-0-131-83 kubenswrapper[2569]: E0708 22:06:35.204348    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efe862b1-afdd-4b1a-89cd-144bd206ca2b-maas-api-tls podName:efe862b1-afdd-4b1a-89cd-144bd206ca2b nodeName:}" failed. No retries permitted until 2026-07-08 22:06:35.704324286 +0000 UTC m=+2018.642656666 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/efe862b1-afdd-4b1a-89cd-144bd206ca2b-maas-api-tls") pod "maas-api-e2e-inf-a-2c94a2-64858497fb-2zv44" (UID: "efe862b1-afdd-4b1a-89cd-144bd206ca2b") : secret "maas-api-e2e-inf-a-2c94a2-serving-cert" not found
Jul 08 22:06:35.204979 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:35.204948    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efe862b1-afdd-4b1a-89cd-144bd206ca2b-openshift-service-ca\") pod \"maas-api-e2e-inf-a-2c94a2-64858497fb-2zv44\" (UID: \"efe862b1-afdd-4b1a-89cd-144bd206ca2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c94a2-64858497fb-2zv44"
Jul 08 22:06:35.212742 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:35.212720    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrvg6\" (UniqueName: \"kubernetes.io/projected/efe862b1-afdd-4b1a-89cd-144bd206ca2b-kube-api-access-qrvg6\") pod \"maas-api-e2e-inf-a-2c94a2-64858497fb-2zv44\" (UID: \"efe862b1-afdd-4b1a-89cd-144bd206ca2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c94a2-64858497fb-2zv44"
Jul 08 22:06:35.708205 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:35.708171    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efe862b1-afdd-4b1a-89cd-144bd206ca2b-maas-api-tls\") pod \"maas-api-e2e-inf-a-2c94a2-64858497fb-2zv44\" (UID: \"efe862b1-afdd-4b1a-89cd-144bd206ca2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c94a2-64858497fb-2zv44"
Jul 08 22:06:35.710930 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:35.710895    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efe862b1-afdd-4b1a-89cd-144bd206ca2b-maas-api-tls\") pod \"maas-api-e2e-inf-a-2c94a2-64858497fb-2zv44\" (UID: \"efe862b1-afdd-4b1a-89cd-144bd206ca2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c94a2-64858497fb-2zv44"
Jul 08 22:06:35.935385 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:35.935349    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c94a2-64858497fb-2zv44"
Jul 08 22:06:36.071601 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:36.071474    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2c94a2-64858497fb-2zv44"]
Jul 08 22:06:36.074131 ip-10-0-131-83 kubenswrapper[2569]: W0708 22:06:36.074098    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefe862b1_afdd_4b1a_89cd_144bd206ca2b.slice/crio-49c9b6f8b14e9ce030fe9db7a24b53606016b91ac4c59af57cac220d2d8b3233 WatchSource:0}: Error finding container 49c9b6f8b14e9ce030fe9db7a24b53606016b91ac4c59af57cac220d2d8b3233: Status 404 returned error can't find the container with id 49c9b6f8b14e9ce030fe9db7a24b53606016b91ac4c59af57cac220d2d8b3233
Jul 08 22:06:36.075598 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:36.075580    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 22:06:37.016440 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:37.016345    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c94a2-64858497fb-2zv44" event={"ID":"efe862b1-afdd-4b1a-89cd-144bd206ca2b","Type":"ContainerStarted","Data":"e4dd7d9496f8da660ddb30b5c792edc10d6f6947ef9dd9f884bc78e0ad078ba0"}
Jul 08 22:06:37.016440 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:37.016397    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c94a2-64858497fb-2zv44" event={"ID":"efe862b1-afdd-4b1a-89cd-144bd206ca2b","Type":"ContainerStarted","Data":"49c9b6f8b14e9ce030fe9db7a24b53606016b91ac4c59af57cac220d2d8b3233"}
Jul 08 22:06:37.016650 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:37.016459    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c94a2-64858497fb-2zv44"
Jul 08 22:06:37.033067 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:37.033019    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c94a2-64858497fb-2zv44" podStartSLOduration=1.393174225 podStartE2EDuration="2.033003767s" totalImagesPullingTime="639.829542ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:06:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:06:37.032819444 +0000 UTC m=+2019.971151848" watchObservedRunningTime="2026-07-08 22:06:37.033003767 +0000 UTC m=+2019.971336168"
Jul 08 22:06:42.857028 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:42.856989    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3eddaa-687b494d68-st7g4"]
Jul 08 22:06:42.861000 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:42.860976    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3eddaa-687b494d68-st7g4"
Jul 08 22:06:42.863182 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:42.863158    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-3eddaa-serving-cert\""
Jul 08 22:06:42.870412 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:42.870386    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3eddaa-687b494d68-st7g4"]
Jul 08 22:06:42.973897 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:42.973860    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e930235d-bb70-4ebf-8b84-a9e913f18ac8-maas-api-tls\") pod \"maas-api-e2e-inf-b-3eddaa-687b494d68-st7g4\" (UID: \"e930235d-bb70-4ebf-8b84-a9e913f18ac8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3eddaa-687b494d68-st7g4"
Jul 08 22:06:42.974061 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:42.973920    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e930235d-bb70-4ebf-8b84-a9e913f18ac8-openshift-service-ca\") pod \"maas-api-e2e-inf-b-3eddaa-687b494d68-st7g4\" (UID: \"e930235d-bb70-4ebf-8b84-a9e913f18ac8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3eddaa-687b494d68-st7g4"
Jul 08 22:06:42.974061 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:42.973990    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhfkk\" (UniqueName: \"kubernetes.io/projected/e930235d-bb70-4ebf-8b84-a9e913f18ac8-kube-api-access-dhfkk\") pod \"maas-api-e2e-inf-b-3eddaa-687b494d68-st7g4\" (UID: \"e930235d-bb70-4ebf-8b84-a9e913f18ac8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3eddaa-687b494d68-st7g4"
Jul 08 22:06:43.026270 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:43.026241    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c94a2-64858497fb-2zv44"
Jul 08 22:06:43.075268 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:43.075237    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e930235d-bb70-4ebf-8b84-a9e913f18ac8-maas-api-tls\") pod \"maas-api-e2e-inf-b-3eddaa-687b494d68-st7g4\" (UID: \"e930235d-bb70-4ebf-8b84-a9e913f18ac8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3eddaa-687b494d68-st7g4"
Jul 08 22:06:43.075490 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:43.075332    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e930235d-bb70-4ebf-8b84-a9e913f18ac8-openshift-service-ca\") pod \"maas-api-e2e-inf-b-3eddaa-687b494d68-st7g4\" (UID: \"e930235d-bb70-4ebf-8b84-a9e913f18ac8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3eddaa-687b494d68-st7g4"
Jul 08 22:06:43.075490 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:43.075384    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhfkk\" (UniqueName: \"kubernetes.io/projected/e930235d-bb70-4ebf-8b84-a9e913f18ac8-kube-api-access-dhfkk\") pod \"maas-api-e2e-inf-b-3eddaa-687b494d68-st7g4\" (UID: \"e930235d-bb70-4ebf-8b84-a9e913f18ac8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3eddaa-687b494d68-st7g4"
Jul 08 22:06:43.075490 ip-10-0-131-83 kubenswrapper[2569]: E0708 22:06:43.075400    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-3eddaa-serving-cert: secret "maas-api-e2e-inf-b-3eddaa-serving-cert" not found
Jul 08 22:06:43.075490 ip-10-0-131-83 kubenswrapper[2569]: E0708 22:06:43.075467    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e930235d-bb70-4ebf-8b84-a9e913f18ac8-maas-api-tls podName:e930235d-bb70-4ebf-8b84-a9e913f18ac8 nodeName:}" failed. No retries permitted until 2026-07-08 22:06:43.575446429 +0000 UTC m=+2026.513778810 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e930235d-bb70-4ebf-8b84-a9e913f18ac8-maas-api-tls") pod "maas-api-e2e-inf-b-3eddaa-687b494d68-st7g4" (UID: "e930235d-bb70-4ebf-8b84-a9e913f18ac8") : secret "maas-api-e2e-inf-b-3eddaa-serving-cert" not found
Jul 08 22:06:43.075999 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:43.075975    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e930235d-bb70-4ebf-8b84-a9e913f18ac8-openshift-service-ca\") pod \"maas-api-e2e-inf-b-3eddaa-687b494d68-st7g4\" (UID: \"e930235d-bb70-4ebf-8b84-a9e913f18ac8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3eddaa-687b494d68-st7g4"
Jul 08 22:06:43.083421 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:43.083394    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhfkk\" (UniqueName: \"kubernetes.io/projected/e930235d-bb70-4ebf-8b84-a9e913f18ac8-kube-api-access-dhfkk\") pod \"maas-api-e2e-inf-b-3eddaa-687b494d68-st7g4\" (UID: \"e930235d-bb70-4ebf-8b84-a9e913f18ac8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3eddaa-687b494d68-st7g4"
Jul 08 22:06:43.579866 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:43.579827    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e930235d-bb70-4ebf-8b84-a9e913f18ac8-maas-api-tls\") pod \"maas-api-e2e-inf-b-3eddaa-687b494d68-st7g4\" (UID: \"e930235d-bb70-4ebf-8b84-a9e913f18ac8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3eddaa-687b494d68-st7g4"
Jul 08 22:06:43.582383 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:43.582365    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e930235d-bb70-4ebf-8b84-a9e913f18ac8-maas-api-tls\") pod \"maas-api-e2e-inf-b-3eddaa-687b494d68-st7g4\" (UID: \"e930235d-bb70-4ebf-8b84-a9e913f18ac8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3eddaa-687b494d68-st7g4"
Jul 08 22:06:43.773716 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:43.773682    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3eddaa-687b494d68-st7g4"
Jul 08 22:06:43.907997 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:43.907963    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3eddaa-687b494d68-st7g4"]
Jul 08 22:06:43.911003 ip-10-0-131-83 kubenswrapper[2569]: W0708 22:06:43.910970    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode930235d_bb70_4ebf_8b84_a9e913f18ac8.slice/crio-6efac6db2c6d03e2ec61d00172ee42cb5f154cc423b20d4c356a627fded061b0 WatchSource:0}: Error finding container 6efac6db2c6d03e2ec61d00172ee42cb5f154cc423b20d4c356a627fded061b0: Status 404 returned error can't find the container with id 6efac6db2c6d03e2ec61d00172ee42cb5f154cc423b20d4c356a627fded061b0
Jul 08 22:06:44.047342 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:44.047310    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3eddaa-687b494d68-st7g4" event={"ID":"e930235d-bb70-4ebf-8b84-a9e913f18ac8","Type":"ContainerStarted","Data":"6efac6db2c6d03e2ec61d00172ee42cb5f154cc423b20d4c356a627fded061b0"}
Jul 08 22:06:45.053187 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:45.053147    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3eddaa-687b494d68-st7g4" event={"ID":"e930235d-bb70-4ebf-8b84-a9e913f18ac8","Type":"ContainerStarted","Data":"a9e1adac4db503f3516aa9ae6f5b3b715d2624757e4d007c14c40657a4cff44a"}
Jul 08 22:06:45.053574 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:45.053277    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3eddaa-687b494d68-st7g4"
Jul 08 22:06:45.069335 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:45.069271    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3eddaa-687b494d68-st7g4" podStartSLOduration=2.441473604 podStartE2EDuration="3.069256654s" totalImagesPullingTime="627.78305ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:06:45.067998989 +0000 UTC m=+2028.006331400" watchObservedRunningTime="2026-07-08 22:06:45.069256654 +0000 UTC m=+2028.007589053"
Jul 08 22:06:51.064140 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:51.064108    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3eddaa-687b494d68-st7g4"
Jul 08 22:06:52.088944 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:52.088846    2569 generic.go:356] "Generic (PLEG): container finished" podID="790eaace-d88a-42b5-8528-c52b77f0f547" containerID="42e501f486728aa94c164ec20e65dd7894aea3b3918d10603bd73ae42de91495" exitCode=0
Jul 08 22:06:52.088944 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:52.088924    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4" event={"ID":"790eaace-d88a-42b5-8528-c52b77f0f547","Type":"ContainerDied","Data":"42e501f486728aa94c164ec20e65dd7894aea3b3918d10603bd73ae42de91495"}
Jul 08 22:06:52.089418 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:52.089377    2569 scope.go:117] "RemoveContainer" containerID="42e501f486728aa94c164ec20e65dd7894aea3b3918d10603bd73ae42de91495"
Jul 08 22:06:52.090355 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:52.090325    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 08 22:06:52.090461 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:52.090408    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 08 22:06:52.090523 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:52.090456    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 08 22:06:53.099334 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:53.099276    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4" event={"ID":"790eaace-d88a-42b5-8528-c52b77f0f547","Type":"ContainerStarted","Data":"86a69ab5419c1cc3a202c2efd383d864d4dd5ad822f559358f36257eafaf47ca"}
Jul 08 22:06:53.358946 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:53.358850    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"
Jul 08 22:06:53.359104 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:53.359058    2569 patch_prober.go:28] interesting pod/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 08 22:06:53.359147 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:53.359105    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4" podUID="790eaace-d88a-42b5-8528-c52b77f0f547" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 08 22:06:54.358127 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:54.358089    2569 patch_prober.go:28] interesting pod/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 08 22:06:54.358561 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:54.358149    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4" podUID="790eaace-d88a-42b5-8528-c52b77f0f547" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 08 22:06:55.358580 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:55.358507    2569 patch_prober.go:28] interesting pod/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 08 22:06:55.358580 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:55.358565    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4" podUID="790eaace-d88a-42b5-8528-c52b77f0f547" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 08 22:06:56.358896 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:56.358858    2569 patch_prober.go:28] interesting pod/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 08 22:06:56.359330 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:56.358914    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4" podUID="790eaace-d88a-42b5-8528-c52b77f0f547" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 08 22:06:57.362127 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:57.362098    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"
Jul 08 22:06:57.362560 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:57.362391    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"
Jul 08 22:06:57.362980 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:06:57.362964    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"
Jul 08 22:07:57.579027 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:07:57.578990    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2c94a2-64858497fb-2zv44"]
Jul 08 22:07:57.579840 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:07:57.579805    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c94a2-64858497fb-2zv44" podUID="efe862b1-afdd-4b1a-89cd-144bd206ca2b" containerName="maas-api" containerID="cri-o://e4dd7d9496f8da660ddb30b5c792edc10d6f6947ef9dd9f884bc78e0ad078ba0" gracePeriod=30
Jul 08 22:07:57.631891 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:07:57.631859    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6cs4g_a022d640-79f0-4d35-be9a-9c6ac708d10b/ovn-acl-logging/0.log"
Jul 08 22:07:57.633148 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:07:57.633128    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6cs4g_a022d640-79f0-4d35-be9a-9c6ac708d10b/ovn-acl-logging/0.log"
Jul 08 22:07:57.821663 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:07:57.821634    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c94a2-64858497fb-2zv44"
Jul 08 22:07:57.839950 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:07:57.839862    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efe862b1-afdd-4b1a-89cd-144bd206ca2b-openshift-service-ca\") pod \"efe862b1-afdd-4b1a-89cd-144bd206ca2b\" (UID: \"efe862b1-afdd-4b1a-89cd-144bd206ca2b\") "
Jul 08 22:07:57.839950 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:07:57.839930    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efe862b1-afdd-4b1a-89cd-144bd206ca2b-maas-api-tls\") pod \"efe862b1-afdd-4b1a-89cd-144bd206ca2b\" (UID: \"efe862b1-afdd-4b1a-89cd-144bd206ca2b\") "
Jul 08 22:07:57.840189 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:07:57.839956    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrvg6\" (UniqueName: \"kubernetes.io/projected/efe862b1-afdd-4b1a-89cd-144bd206ca2b-kube-api-access-qrvg6\") pod \"efe862b1-afdd-4b1a-89cd-144bd206ca2b\" (UID: \"efe862b1-afdd-4b1a-89cd-144bd206ca2b\") "
Jul 08 22:07:57.840269 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:07:57.840240    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efe862b1-afdd-4b1a-89cd-144bd206ca2b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "efe862b1-afdd-4b1a-89cd-144bd206ca2b" (UID: "efe862b1-afdd-4b1a-89cd-144bd206ca2b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:07:57.842469 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:07:57.842439    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efe862b1-afdd-4b1a-89cd-144bd206ca2b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "efe862b1-afdd-4b1a-89cd-144bd206ca2b" (UID: "efe862b1-afdd-4b1a-89cd-144bd206ca2b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 22:07:57.842573 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:07:57.842541    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efe862b1-afdd-4b1a-89cd-144bd206ca2b-kube-api-access-qrvg6" (OuterVolumeSpecName: "kube-api-access-qrvg6") pod "efe862b1-afdd-4b1a-89cd-144bd206ca2b" (UID: "efe862b1-afdd-4b1a-89cd-144bd206ca2b"). InnerVolumeSpecName "kube-api-access-qrvg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:07:57.941146 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:07:57.941117    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efe862b1-afdd-4b1a-89cd-144bd206ca2b-openshift-service-ca\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:07:57.941146 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:07:57.941142    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efe862b1-afdd-4b1a-89cd-144bd206ca2b-maas-api-tls\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:07:57.941146 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:07:57.941152    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrvg6\" (UniqueName: \"kubernetes.io/projected/efe862b1-afdd-4b1a-89cd-144bd206ca2b-kube-api-access-qrvg6\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:07:58.412197 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:07:58.412157    2569 generic.go:356] "Generic (PLEG): container finished" podID="efe862b1-afdd-4b1a-89cd-144bd206ca2b" containerID="e4dd7d9496f8da660ddb30b5c792edc10d6f6947ef9dd9f884bc78e0ad078ba0" exitCode=0
Jul 08 22:07:58.412197 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:07:58.412202    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c94a2-64858497fb-2zv44"
Jul 08 22:07:58.412429 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:07:58.412204    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c94a2-64858497fb-2zv44" event={"ID":"efe862b1-afdd-4b1a-89cd-144bd206ca2b","Type":"ContainerDied","Data":"e4dd7d9496f8da660ddb30b5c792edc10d6f6947ef9dd9f884bc78e0ad078ba0"}
Jul 08 22:07:58.412429 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:07:58.412375    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-2c94a2-64858497fb-2zv44" event={"ID":"efe862b1-afdd-4b1a-89cd-144bd206ca2b","Type":"ContainerDied","Data":"49c9b6f8b14e9ce030fe9db7a24b53606016b91ac4c59af57cac220d2d8b3233"}
Jul 08 22:07:58.412429 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:07:58.412404    2569 scope.go:117] "RemoveContainer" containerID="e4dd7d9496f8da660ddb30b5c792edc10d6f6947ef9dd9f884bc78e0ad078ba0"
Jul 08 22:07:58.421212 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:07:58.421195    2569 scope.go:117] "RemoveContainer" containerID="e4dd7d9496f8da660ddb30b5c792edc10d6f6947ef9dd9f884bc78e0ad078ba0"
Jul 08 22:07:58.421507 ip-10-0-131-83 kubenswrapper[2569]: E0708 22:07:58.421488    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4dd7d9496f8da660ddb30b5c792edc10d6f6947ef9dd9f884bc78e0ad078ba0\": container with ID starting with e4dd7d9496f8da660ddb30b5c792edc10d6f6947ef9dd9f884bc78e0ad078ba0 not found: ID does not exist" containerID="e4dd7d9496f8da660ddb30b5c792edc10d6f6947ef9dd9f884bc78e0ad078ba0"
Jul 08 22:07:58.421579 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:07:58.421517    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4dd7d9496f8da660ddb30b5c792edc10d6f6947ef9dd9f884bc78e0ad078ba0"} err="failed to get container status \"e4dd7d9496f8da660ddb30b5c792edc10d6f6947ef9dd9f884bc78e0ad078ba0\": rpc error: code = NotFound desc = could not find container \"e4dd7d9496f8da660ddb30b5c792edc10d6f6947ef9dd9f884bc78e0ad078ba0\": container with ID starting with e4dd7d9496f8da660ddb30b5c792edc10d6f6947ef9dd9f884bc78e0ad078ba0 not found: ID does not exist"
Jul 08 22:07:58.456915 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:07:58.456889    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2c94a2-64858497fb-2zv44"]
Jul 08 22:07:58.461971 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:07:58.461947    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-2c94a2-64858497fb-2zv44"]
Jul 08 22:07:59.612478 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:07:59.612445    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efe862b1-afdd-4b1a-89cd-144bd206ca2b" path="/var/lib/kubelet/pods/efe862b1-afdd-4b1a-89cd-144bd206ca2b/volumes"
Jul 08 22:08:39.192246 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:39.192207    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"]
Jul 08 22:08:39.192730 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:39.192480    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4" podUID="790eaace-d88a-42b5-8528-c52b77f0f547" containerName="istio-proxy" containerID="cri-o://86a69ab5419c1cc3a202c2efd383d864d4dd5ad822f559358f36257eafaf47ca" gracePeriod=30
Jul 08 22:08:40.403554 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:40.403516    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3eddaa-687b494d68-st7g4"]
Jul 08 22:08:40.404021 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:40.403746    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3eddaa-687b494d68-st7g4" podUID="e930235d-bb70-4ebf-8b84-a9e913f18ac8" containerName="maas-api" containerID="cri-o://a9e1adac4db503f3516aa9ae6f5b3b715d2624757e4d007c14c40657a4cff44a" gracePeriod=30
Jul 08 22:08:40.600594 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:40.600563    2569 generic.go:356] "Generic (PLEG): container finished" podID="e930235d-bb70-4ebf-8b84-a9e913f18ac8" containerID="a9e1adac4db503f3516aa9ae6f5b3b715d2624757e4d007c14c40657a4cff44a" exitCode=0
Jul 08 22:08:40.600740 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:40.600657    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3eddaa-687b494d68-st7g4" event={"ID":"e930235d-bb70-4ebf-8b84-a9e913f18ac8","Type":"ContainerDied","Data":"a9e1adac4db503f3516aa9ae6f5b3b715d2624757e4d007c14c40657a4cff44a"}
Jul 08 22:08:40.652975 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:40.652951    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3eddaa-687b494d68-st7g4"
Jul 08 22:08:40.817403 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:40.817313    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e930235d-bb70-4ebf-8b84-a9e913f18ac8-openshift-service-ca\") pod \"e930235d-bb70-4ebf-8b84-a9e913f18ac8\" (UID: \"e930235d-bb70-4ebf-8b84-a9e913f18ac8\") "
Jul 08 22:08:40.817403 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:40.817362    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhfkk\" (UniqueName: \"kubernetes.io/projected/e930235d-bb70-4ebf-8b84-a9e913f18ac8-kube-api-access-dhfkk\") pod \"e930235d-bb70-4ebf-8b84-a9e913f18ac8\" (UID: \"e930235d-bb70-4ebf-8b84-a9e913f18ac8\") "
Jul 08 22:08:40.817604 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:40.817429    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e930235d-bb70-4ebf-8b84-a9e913f18ac8-maas-api-tls\") pod \"e930235d-bb70-4ebf-8b84-a9e913f18ac8\" (UID: \"e930235d-bb70-4ebf-8b84-a9e913f18ac8\") "
Jul 08 22:08:40.817737 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:40.817708    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e930235d-bb70-4ebf-8b84-a9e913f18ac8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e930235d-bb70-4ebf-8b84-a9e913f18ac8" (UID: "e930235d-bb70-4ebf-8b84-a9e913f18ac8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:08:40.819640 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:40.819615    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e930235d-bb70-4ebf-8b84-a9e913f18ac8-kube-api-access-dhfkk" (OuterVolumeSpecName: "kube-api-access-dhfkk") pod "e930235d-bb70-4ebf-8b84-a9e913f18ac8" (UID: "e930235d-bb70-4ebf-8b84-a9e913f18ac8"). InnerVolumeSpecName "kube-api-access-dhfkk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:08:40.819755 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:40.819692    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e930235d-bb70-4ebf-8b84-a9e913f18ac8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e930235d-bb70-4ebf-8b84-a9e913f18ac8" (UID: "e930235d-bb70-4ebf-8b84-a9e913f18ac8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 22:08:40.918600 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:40.918564    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e930235d-bb70-4ebf-8b84-a9e913f18ac8-maas-api-tls\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:08:40.918600 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:40.918594    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e930235d-bb70-4ebf-8b84-a9e913f18ac8-openshift-service-ca\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:08:40.918600 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:40.918603    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhfkk\" (UniqueName: \"kubernetes.io/projected/e930235d-bb70-4ebf-8b84-a9e913f18ac8-kube-api-access-dhfkk\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:08:41.607071 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:41.607040    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3eddaa-687b494d68-st7g4"
Jul 08 22:08:41.612448 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:41.612422    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3eddaa-687b494d68-st7g4" event={"ID":"e930235d-bb70-4ebf-8b84-a9e913f18ac8","Type":"ContainerDied","Data":"6efac6db2c6d03e2ec61d00172ee42cb5f154cc423b20d4c356a627fded061b0"}
Jul 08 22:08:41.612615 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:41.612469    2569 scope.go:117] "RemoveContainer" containerID="a9e1adac4db503f3516aa9ae6f5b3b715d2624757e4d007c14c40657a4cff44a"
Jul 08 22:08:41.630639 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:41.630614    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3eddaa-687b494d68-st7g4"]
Jul 08 22:08:41.636413 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:41.636390    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3eddaa-687b494d68-st7g4"]
Jul 08 22:08:42.364931 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:42.364894    2569 patch_prober.go:28] interesting pod/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 08 22:08:42.365096 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:42.364952    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4" podUID="790eaace-d88a-42b5-8528-c52b77f0f547" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 22:08:43.612845 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:43.612805    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e930235d-bb70-4ebf-8b84-a9e913f18ac8" path="/var/lib/kubelet/pods/e930235d-bb70-4ebf-8b84-a9e913f18ac8/volumes"
Jul 08 22:08:44.438950 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:44.438926    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"
Jul 08 22:08:44.447325 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:44.447281    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/790eaace-d88a-42b5-8528-c52b77f0f547-istio-data\") pod \"790eaace-d88a-42b5-8528-c52b77f0f547\" (UID: \"790eaace-d88a-42b5-8528-c52b77f0f547\") "
Jul 08 22:08:44.447479 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:44.447348    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/790eaace-d88a-42b5-8528-c52b77f0f547-istio-envoy\") pod \"790eaace-d88a-42b5-8528-c52b77f0f547\" (UID: \"790eaace-d88a-42b5-8528-c52b77f0f547\") "
Jul 08 22:08:44.447479 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:44.447390    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/790eaace-d88a-42b5-8528-c52b77f0f547-istio-podinfo\") pod \"790eaace-d88a-42b5-8528-c52b77f0f547\" (UID: \"790eaace-d88a-42b5-8528-c52b77f0f547\") "
Jul 08 22:08:44.447479 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:44.447430    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbgps\" (UniqueName: \"kubernetes.io/projected/790eaace-d88a-42b5-8528-c52b77f0f547-kube-api-access-pbgps\") pod \"790eaace-d88a-42b5-8528-c52b77f0f547\" (UID: \"790eaace-d88a-42b5-8528-c52b77f0f547\") "
Jul 08 22:08:44.447479 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:44.447471    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/790eaace-d88a-42b5-8528-c52b77f0f547-workload-certs\") pod \"790eaace-d88a-42b5-8528-c52b77f0f547\" (UID: \"790eaace-d88a-42b5-8528-c52b77f0f547\") "
Jul 08 22:08:44.447697 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:44.447525    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/790eaace-d88a-42b5-8528-c52b77f0f547-istio-token\") pod \"790eaace-d88a-42b5-8528-c52b77f0f547\" (UID: \"790eaace-d88a-42b5-8528-c52b77f0f547\") "
Jul 08 22:08:44.447697 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:44.447568    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/790eaace-d88a-42b5-8528-c52b77f0f547-credential-socket\") pod \"790eaace-d88a-42b5-8528-c52b77f0f547\" (UID: \"790eaace-d88a-42b5-8528-c52b77f0f547\") "
Jul 08 22:08:44.447697 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:44.447595    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/790eaace-d88a-42b5-8528-c52b77f0f547-workload-socket\") pod \"790eaace-d88a-42b5-8528-c52b77f0f547\" (UID: \"790eaace-d88a-42b5-8528-c52b77f0f547\") "
Jul 08 22:08:44.447697 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:44.447645    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/790eaace-d88a-42b5-8528-c52b77f0f547-istiod-ca-cert\") pod \"790eaace-d88a-42b5-8528-c52b77f0f547\" (UID: \"790eaace-d88a-42b5-8528-c52b77f0f547\") "
Jul 08 22:08:44.448015 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:44.447985    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/790eaace-d88a-42b5-8528-c52b77f0f547-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "790eaace-d88a-42b5-8528-c52b77f0f547" (UID: "790eaace-d88a-42b5-8528-c52b77f0f547"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:08:44.448092 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:44.447987    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/790eaace-d88a-42b5-8528-c52b77f0f547-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "790eaace-d88a-42b5-8528-c52b77f0f547" (UID: "790eaace-d88a-42b5-8528-c52b77f0f547"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:08:44.448344 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:44.448097    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/790eaace-d88a-42b5-8528-c52b77f0f547-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "790eaace-d88a-42b5-8528-c52b77f0f547" (UID: "790eaace-d88a-42b5-8528-c52b77f0f547"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:08:44.448344 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:44.448144    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/790eaace-d88a-42b5-8528-c52b77f0f547-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "790eaace-d88a-42b5-8528-c52b77f0f547" (UID: "790eaace-d88a-42b5-8528-c52b77f0f547"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:08:44.448344 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:44.448224    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/790eaace-d88a-42b5-8528-c52b77f0f547-istio-data" (OuterVolumeSpecName: "istio-data") pod "790eaace-d88a-42b5-8528-c52b77f0f547" (UID: "790eaace-d88a-42b5-8528-c52b77f0f547"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:08:44.449769 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:44.449740    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/790eaace-d88a-42b5-8528-c52b77f0f547-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "790eaace-d88a-42b5-8528-c52b77f0f547" (UID: "790eaace-d88a-42b5-8528-c52b77f0f547"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:08:44.449897 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:44.449808    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/790eaace-d88a-42b5-8528-c52b77f0f547-istio-token" (OuterVolumeSpecName: "istio-token") pod "790eaace-d88a-42b5-8528-c52b77f0f547" (UID: "790eaace-d88a-42b5-8528-c52b77f0f547"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:08:44.450187 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:44.450158    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/790eaace-d88a-42b5-8528-c52b77f0f547-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "790eaace-d88a-42b5-8528-c52b77f0f547" (UID: "790eaace-d88a-42b5-8528-c52b77f0f547"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 22:08:44.450360 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:44.450344    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/790eaace-d88a-42b5-8528-c52b77f0f547-kube-api-access-pbgps" (OuterVolumeSpecName: "kube-api-access-pbgps") pod "790eaace-d88a-42b5-8528-c52b77f0f547" (UID: "790eaace-d88a-42b5-8528-c52b77f0f547"). InnerVolumeSpecName "kube-api-access-pbgps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:08:44.548522 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:44.548482    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/790eaace-d88a-42b5-8528-c52b77f0f547-istio-token\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:08:44.548522 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:44.548517    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/790eaace-d88a-42b5-8528-c52b77f0f547-credential-socket\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:08:44.548522 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:44.548528    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/790eaace-d88a-42b5-8528-c52b77f0f547-workload-socket\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:08:44.548776 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:44.548536    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/790eaace-d88a-42b5-8528-c52b77f0f547-istiod-ca-cert\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:08:44.548776 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:44.548545    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/790eaace-d88a-42b5-8528-c52b77f0f547-istio-data\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:08:44.548776 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:44.548553    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/790eaace-d88a-42b5-8528-c52b77f0f547-istio-envoy\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:08:44.548776 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:44.548560    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/790eaace-d88a-42b5-8528-c52b77f0f547-istio-podinfo\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:08:44.548776 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:44.548568    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbgps\" (UniqueName: \"kubernetes.io/projected/790eaace-d88a-42b5-8528-c52b77f0f547-kube-api-access-pbgps\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:08:44.548776 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:44.548577    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/790eaace-d88a-42b5-8528-c52b77f0f547-workload-certs\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:08:44.623409 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:44.623375    2569 generic.go:356] "Generic (PLEG): container finished" podID="790eaace-d88a-42b5-8528-c52b77f0f547" containerID="86a69ab5419c1cc3a202c2efd383d864d4dd5ad822f559358f36257eafaf47ca" exitCode=0
Jul 08 22:08:44.623788 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:44.623438    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"
Jul 08 22:08:44.623788 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:44.623440    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4" event={"ID":"790eaace-d88a-42b5-8528-c52b77f0f547","Type":"ContainerDied","Data":"86a69ab5419c1cc3a202c2efd383d864d4dd5ad822f559358f36257eafaf47ca"}
Jul 08 22:08:44.623788 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:44.623560    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4" event={"ID":"790eaace-d88a-42b5-8528-c52b77f0f547","Type":"ContainerDied","Data":"313f9645354757700ae36e506ba0a3d8be13cc24d7393e5ab53336887d2461f5"}
Jul 08 22:08:44.623788 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:44.623583    2569 scope.go:117] "RemoveContainer" containerID="86a69ab5419c1cc3a202c2efd383d864d4dd5ad822f559358f36257eafaf47ca"
Jul 08 22:08:44.632880 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:44.632858    2569 scope.go:117] "RemoveContainer" containerID="42e501f486728aa94c164ec20e65dd7894aea3b3918d10603bd73ae42de91495"
Jul 08 22:08:44.641016 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:44.640996    2569 scope.go:117] "RemoveContainer" containerID="86a69ab5419c1cc3a202c2efd383d864d4dd5ad822f559358f36257eafaf47ca"
Jul 08 22:08:44.641271 ip-10-0-131-83 kubenswrapper[2569]: E0708 22:08:44.641251    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86a69ab5419c1cc3a202c2efd383d864d4dd5ad822f559358f36257eafaf47ca\": container with ID starting with 86a69ab5419c1cc3a202c2efd383d864d4dd5ad822f559358f36257eafaf47ca not found: ID does not exist" containerID="86a69ab5419c1cc3a202c2efd383d864d4dd5ad822f559358f36257eafaf47ca"
Jul 08 22:08:44.641424 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:44.641279    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86a69ab5419c1cc3a202c2efd383d864d4dd5ad822f559358f36257eafaf47ca"} err="failed to get container status \"86a69ab5419c1cc3a202c2efd383d864d4dd5ad822f559358f36257eafaf47ca\": rpc error: code = NotFound desc = could not find container \"86a69ab5419c1cc3a202c2efd383d864d4dd5ad822f559358f36257eafaf47ca\": container with ID starting with 86a69ab5419c1cc3a202c2efd383d864d4dd5ad822f559358f36257eafaf47ca not found: ID does not exist"
Jul 08 22:08:44.641424 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:44.641311    2569 scope.go:117] "RemoveContainer" containerID="42e501f486728aa94c164ec20e65dd7894aea3b3918d10603bd73ae42de91495"
Jul 08 22:08:44.641578 ip-10-0-131-83 kubenswrapper[2569]: E0708 22:08:44.641560    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42e501f486728aa94c164ec20e65dd7894aea3b3918d10603bd73ae42de91495\": container with ID starting with 42e501f486728aa94c164ec20e65dd7894aea3b3918d10603bd73ae42de91495 not found: ID does not exist" containerID="42e501f486728aa94c164ec20e65dd7894aea3b3918d10603bd73ae42de91495"
Jul 08 22:08:44.641630 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:44.641587    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42e501f486728aa94c164ec20e65dd7894aea3b3918d10603bd73ae42de91495"} err="failed to get container status \"42e501f486728aa94c164ec20e65dd7894aea3b3918d10603bd73ae42de91495\": rpc error: code = NotFound desc = could not find container \"42e501f486728aa94c164ec20e65dd7894aea3b3918d10603bd73ae42de91495\": container with ID starting with 42e501f486728aa94c164ec20e65dd7894aea3b3918d10603bd73ae42de91495 not found: ID does not exist"
Jul 08 22:08:44.644718 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:44.644696    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"]
Jul 08 22:08:44.650445 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:44.650422    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-2c94a2-openshift-default-67d7c566cf-vcnj4"]
Jul 08 22:08:45.612262 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:45.612225    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="790eaace-d88a-42b5-8528-c52b77f0f547" path="/var/lib/kubelet/pods/790eaace-d88a-42b5-8528-c52b77f0f547/volumes"
Jul 08 22:08:46.877446 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:46.877413    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"]
Jul 08 22:08:46.877929 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:46.877907    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="790eaace-d88a-42b5-8528-c52b77f0f547" containerName="istio-proxy"
Jul 08 22:08:46.878014 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:46.877933    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="790eaace-d88a-42b5-8528-c52b77f0f547" containerName="istio-proxy"
Jul 08 22:08:46.878014 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:46.877945    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e930235d-bb70-4ebf-8b84-a9e913f18ac8" containerName="maas-api"
Jul 08 22:08:46.878014 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:46.877952    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e930235d-bb70-4ebf-8b84-a9e913f18ac8" containerName="maas-api"
Jul 08 22:08:46.878014 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:46.877965    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efe862b1-afdd-4b1a-89cd-144bd206ca2b" containerName="maas-api"
Jul 08 22:08:46.878014 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:46.877974    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="efe862b1-afdd-4b1a-89cd-144bd206ca2b" containerName="maas-api"
Jul 08 22:08:46.878014 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:46.877988    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="790eaace-d88a-42b5-8528-c52b77f0f547" containerName="istio-proxy"
Jul 08 22:08:46.878014 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:46.877997    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="790eaace-d88a-42b5-8528-c52b77f0f547" containerName="istio-proxy"
Jul 08 22:08:46.878387 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:46.878119    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="efe862b1-afdd-4b1a-89cd-144bd206ca2b" containerName="maas-api"
Jul 08 22:08:46.878387 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:46.878133    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="e930235d-bb70-4ebf-8b84-a9e913f18ac8" containerName="maas-api"
Jul 08 22:08:46.878387 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:46.878144    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="790eaace-d88a-42b5-8528-c52b77f0f547" containerName="istio-proxy"
Jul 08 22:08:46.878387 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:46.878155    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="790eaace-d88a-42b5-8528-c52b77f0f547" containerName="istio-proxy"
Jul 08 22:08:46.882692 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:46.882669    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"
Jul 08 22:08:46.884936 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:46.884915    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-09afc7-openshift-default-dockercfg-wf2lk\""
Jul 08 22:08:46.890869 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:46.890845    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"]
Jul 08 22:08:46.965867 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:46.965833    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de40aa54-d451-4090-b65b-a3c2f68020b6-istio-podinfo\") pod \"e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr\" (UID: \"de40aa54-d451-4090-b65b-a3c2f68020b6\") " pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"
Jul 08 22:08:46.966031 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:46.965882    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de40aa54-d451-4090-b65b-a3c2f68020b6-workload-socket\") pod \"e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr\" (UID: \"de40aa54-d451-4090-b65b-a3c2f68020b6\") " pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"
Jul 08 22:08:46.966031 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:46.965911    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de40aa54-d451-4090-b65b-a3c2f68020b6-istio-token\") pod \"e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr\" (UID: \"de40aa54-d451-4090-b65b-a3c2f68020b6\") " pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"
Jul 08 22:08:46.966168 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:46.966024    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de40aa54-d451-4090-b65b-a3c2f68020b6-credential-socket\") pod \"e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr\" (UID: \"de40aa54-d451-4090-b65b-a3c2f68020b6\") " pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"
Jul 08 22:08:46.966168 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:46.966065    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de40aa54-d451-4090-b65b-a3c2f68020b6-istiod-ca-cert\") pod \"e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr\" (UID: \"de40aa54-d451-4090-b65b-a3c2f68020b6\") " pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"
Jul 08 22:08:46.966168 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:46.966112    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de40aa54-d451-4090-b65b-a3c2f68020b6-workload-certs\") pod \"e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr\" (UID: \"de40aa54-d451-4090-b65b-a3c2f68020b6\") " pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"
Jul 08 22:08:46.966168 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:46.966142    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de40aa54-d451-4090-b65b-a3c2f68020b6-istio-envoy\") pod \"e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr\" (UID: \"de40aa54-d451-4090-b65b-a3c2f68020b6\") " pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"
Jul 08 22:08:46.966322 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:46.966176    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de40aa54-d451-4090-b65b-a3c2f68020b6-istio-data\") pod \"e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr\" (UID: \"de40aa54-d451-4090-b65b-a3c2f68020b6\") " pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"
Jul 08 22:08:46.966322 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:46.966195    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wrbg\" (UniqueName: \"kubernetes.io/projected/de40aa54-d451-4090-b65b-a3c2f68020b6-kube-api-access-5wrbg\") pod \"e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr\" (UID: \"de40aa54-d451-4090-b65b-a3c2f68020b6\") " pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"
Jul 08 22:08:47.067343 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:47.067300    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de40aa54-d451-4090-b65b-a3c2f68020b6-istiod-ca-cert\") pod \"e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr\" (UID: \"de40aa54-d451-4090-b65b-a3c2f68020b6\") " pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"
Jul 08 22:08:47.067551 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:47.067363    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de40aa54-d451-4090-b65b-a3c2f68020b6-workload-certs\") pod \"e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr\" (UID: \"de40aa54-d451-4090-b65b-a3c2f68020b6\") " pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"
Jul 08 22:08:47.067551 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:47.067399    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de40aa54-d451-4090-b65b-a3c2f68020b6-istio-envoy\") pod \"e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr\" (UID: \"de40aa54-d451-4090-b65b-a3c2f68020b6\") " pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"
Jul 08 22:08:47.067551 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:47.067436    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de40aa54-d451-4090-b65b-a3c2f68020b6-istio-data\") pod \"e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr\" (UID: \"de40aa54-d451-4090-b65b-a3c2f68020b6\") " pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"
Jul 08 22:08:47.067551 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:47.067461    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wrbg\" (UniqueName: \"kubernetes.io/projected/de40aa54-d451-4090-b65b-a3c2f68020b6-kube-api-access-5wrbg\") pod \"e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr\" (UID: \"de40aa54-d451-4090-b65b-a3c2f68020b6\") " pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"
Jul 08 22:08:47.067551 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:47.067510    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de40aa54-d451-4090-b65b-a3c2f68020b6-istio-podinfo\") pod \"e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr\" (UID: \"de40aa54-d451-4090-b65b-a3c2f68020b6\") " pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"
Jul 08 22:08:47.067551 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:47.067543    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de40aa54-d451-4090-b65b-a3c2f68020b6-workload-socket\") pod \"e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr\" (UID: \"de40aa54-d451-4090-b65b-a3c2f68020b6\") " pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"
Jul 08 22:08:47.067896 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:47.067568    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de40aa54-d451-4090-b65b-a3c2f68020b6-istio-token\") pod \"e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr\" (UID: \"de40aa54-d451-4090-b65b-a3c2f68020b6\") " pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"
Jul 08 22:08:47.067896 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:47.067631    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de40aa54-d451-4090-b65b-a3c2f68020b6-credential-socket\") pod \"e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr\" (UID: \"de40aa54-d451-4090-b65b-a3c2f68020b6\") " pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"
Jul 08 22:08:47.067896 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:47.067787    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de40aa54-d451-4090-b65b-a3c2f68020b6-workload-certs\") pod \"e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr\" (UID: \"de40aa54-d451-4090-b65b-a3c2f68020b6\") " pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"
Jul 08 22:08:47.068088 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:47.067919    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de40aa54-d451-4090-b65b-a3c2f68020b6-credential-socket\") pod \"e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr\" (UID: \"de40aa54-d451-4090-b65b-a3c2f68020b6\") " pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"
Jul 08 22:08:47.068088 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:47.068036    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de40aa54-d451-4090-b65b-a3c2f68020b6-istiod-ca-cert\") pod \"e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr\" (UID: \"de40aa54-d451-4090-b65b-a3c2f68020b6\") " pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"
Jul 08 22:08:47.068088 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:47.068045    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de40aa54-d451-4090-b65b-a3c2f68020b6-workload-socket\") pod \"e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr\" (UID: \"de40aa54-d451-4090-b65b-a3c2f68020b6\") " pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"
Jul 08 22:08:47.068388 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:47.068348    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de40aa54-d451-4090-b65b-a3c2f68020b6-istio-data\") pod \"e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr\" (UID: \"de40aa54-d451-4090-b65b-a3c2f68020b6\") " pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"
Jul 08 22:08:47.070593 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:47.070571    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de40aa54-d451-4090-b65b-a3c2f68020b6-istio-podinfo\") pod \"e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr\" (UID: \"de40aa54-d451-4090-b65b-a3c2f68020b6\") " pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"
Jul 08 22:08:47.071277 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:47.071261    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de40aa54-d451-4090-b65b-a3c2f68020b6-istio-envoy\") pod \"e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr\" (UID: \"de40aa54-d451-4090-b65b-a3c2f68020b6\") " pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"
Jul 08 22:08:47.077662 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:47.077639    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de40aa54-d451-4090-b65b-a3c2f68020b6-istio-token\") pod \"e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr\" (UID: \"de40aa54-d451-4090-b65b-a3c2f68020b6\") " pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"
Jul 08 22:08:47.077869 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:47.077850    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wrbg\" (UniqueName: \"kubernetes.io/projected/de40aa54-d451-4090-b65b-a3c2f68020b6-kube-api-access-5wrbg\") pod \"e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr\" (UID: \"de40aa54-d451-4090-b65b-a3c2f68020b6\") " pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"
Jul 08 22:08:47.194047 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:47.194001    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"
Jul 08 22:08:47.333217 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:47.333178    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"]
Jul 08 22:08:47.336872 ip-10-0-131-83 kubenswrapper[2569]: W0708 22:08:47.336846    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde40aa54_d451_4090_b65b_a3c2f68020b6.slice/crio-6630770c6014d0abf702b3bcb78d8ed279124dbad504dd6b90d51d6b08af1fa1 WatchSource:0}: Error finding container 6630770c6014d0abf702b3bcb78d8ed279124dbad504dd6b90d51d6b08af1fa1: Status 404 returned error can't find the container with id 6630770c6014d0abf702b3bcb78d8ed279124dbad504dd6b90d51d6b08af1fa1
Jul 08 22:08:47.339240 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:47.339200    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 08 22:08:47.339359 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:47.339337    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 08 22:08:47.339411 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:47.339380    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 08 22:08:47.639942 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:47.639905    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr" event={"ID":"de40aa54-d451-4090-b65b-a3c2f68020b6","Type":"ContainerStarted","Data":"4ba5f99ad3a67e4d12a056a7678d4b05292f1a030e4a4ef2449c0bd697be3cf9"}
Jul 08 22:08:47.640130 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:47.639968    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr" event={"ID":"de40aa54-d451-4090-b65b-a3c2f68020b6","Type":"ContainerStarted","Data":"6630770c6014d0abf702b3bcb78d8ed279124dbad504dd6b90d51d6b08af1fa1"}
Jul 08 22:08:47.676313 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:47.676247    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr" podStartSLOduration=1.676230188 podStartE2EDuration="1.676230188s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:08:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:08:47.674537038 +0000 UTC m=+2150.612869449" watchObservedRunningTime="2026-07-08 22:08:47.676230188 +0000 UTC m=+2150.614562589"
Jul 08 22:08:48.194470 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:48.194432    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"
Jul 08 22:08:48.199397 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:48.199361    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"
Jul 08 22:08:48.644532 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:48.644507    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"
Jul 08 22:08:48.645552 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:48.645533    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"
Jul 08 22:08:49.635697 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:49.635617    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-09afc7-9bbbc5466-sdg99"]
Jul 08 22:08:49.639481 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:49.639458    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09afc7-9bbbc5466-sdg99"
Jul 08 22:08:49.641717 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:49.641687    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-09afc7-serving-cert\""
Jul 08 22:08:49.652202 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:49.652157    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-09afc7-9bbbc5466-sdg99"]
Jul 08 22:08:49.690492 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:49.690454    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnfnh\" (UniqueName: \"kubernetes.io/projected/da5ed38b-1276-4911-9375-f898bcf7590f-kube-api-access-tnfnh\") pod \"maas-api-e2e-api-a-09afc7-9bbbc5466-sdg99\" (UID: \"da5ed38b-1276-4911-9375-f898bcf7590f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09afc7-9bbbc5466-sdg99"
Jul 08 22:08:49.690673 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:49.690624    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da5ed38b-1276-4911-9375-f898bcf7590f-openshift-service-ca\") pod \"maas-api-e2e-api-a-09afc7-9bbbc5466-sdg99\" (UID: \"da5ed38b-1276-4911-9375-f898bcf7590f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09afc7-9bbbc5466-sdg99"
Jul 08 22:08:49.690775 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:49.690757    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da5ed38b-1276-4911-9375-f898bcf7590f-maas-api-tls\") pod \"maas-api-e2e-api-a-09afc7-9bbbc5466-sdg99\" (UID: \"da5ed38b-1276-4911-9375-f898bcf7590f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09afc7-9bbbc5466-sdg99"
Jul 08 22:08:49.791639 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:49.791595    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da5ed38b-1276-4911-9375-f898bcf7590f-maas-api-tls\") pod \"maas-api-e2e-api-a-09afc7-9bbbc5466-sdg99\" (UID: \"da5ed38b-1276-4911-9375-f898bcf7590f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09afc7-9bbbc5466-sdg99"
Jul 08 22:08:49.791639 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:49.791647    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnfnh\" (UniqueName: \"kubernetes.io/projected/da5ed38b-1276-4911-9375-f898bcf7590f-kube-api-access-tnfnh\") pod \"maas-api-e2e-api-a-09afc7-9bbbc5466-sdg99\" (UID: \"da5ed38b-1276-4911-9375-f898bcf7590f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09afc7-9bbbc5466-sdg99"
Jul 08 22:08:49.791877 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:49.791704    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da5ed38b-1276-4911-9375-f898bcf7590f-openshift-service-ca\") pod \"maas-api-e2e-api-a-09afc7-9bbbc5466-sdg99\" (UID: \"da5ed38b-1276-4911-9375-f898bcf7590f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09afc7-9bbbc5466-sdg99"
Jul 08 22:08:49.791877 ip-10-0-131-83 kubenswrapper[2569]: E0708 22:08:49.791783    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-09afc7-serving-cert: secret "maas-api-e2e-api-a-09afc7-serving-cert" not found
Jul 08 22:08:49.791965 ip-10-0-131-83 kubenswrapper[2569]: E0708 22:08:49.791895    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da5ed38b-1276-4911-9375-f898bcf7590f-maas-api-tls podName:da5ed38b-1276-4911-9375-f898bcf7590f nodeName:}" failed. No retries permitted until 2026-07-08 22:08:50.291873679 +0000 UTC m=+2153.230206061 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/da5ed38b-1276-4911-9375-f898bcf7590f-maas-api-tls") pod "maas-api-e2e-api-a-09afc7-9bbbc5466-sdg99" (UID: "da5ed38b-1276-4911-9375-f898bcf7590f") : secret "maas-api-e2e-api-a-09afc7-serving-cert" not found
Jul 08 22:08:49.792386 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:49.792369    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da5ed38b-1276-4911-9375-f898bcf7590f-openshift-service-ca\") pod \"maas-api-e2e-api-a-09afc7-9bbbc5466-sdg99\" (UID: \"da5ed38b-1276-4911-9375-f898bcf7590f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09afc7-9bbbc5466-sdg99"
Jul 08 22:08:49.802513 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:49.802481    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnfnh\" (UniqueName: \"kubernetes.io/projected/da5ed38b-1276-4911-9375-f898bcf7590f-kube-api-access-tnfnh\") pod \"maas-api-e2e-api-a-09afc7-9bbbc5466-sdg99\" (UID: \"da5ed38b-1276-4911-9375-f898bcf7590f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09afc7-9bbbc5466-sdg99"
Jul 08 22:08:50.295432 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:50.295395    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da5ed38b-1276-4911-9375-f898bcf7590f-maas-api-tls\") pod \"maas-api-e2e-api-a-09afc7-9bbbc5466-sdg99\" (UID: \"da5ed38b-1276-4911-9375-f898bcf7590f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09afc7-9bbbc5466-sdg99"
Jul 08 22:08:50.298025 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:50.298001    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da5ed38b-1276-4911-9375-f898bcf7590f-maas-api-tls\") pod \"maas-api-e2e-api-a-09afc7-9bbbc5466-sdg99\" (UID: \"da5ed38b-1276-4911-9375-f898bcf7590f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09afc7-9bbbc5466-sdg99"
Jul 08 22:08:50.552516 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:50.552430    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09afc7-9bbbc5466-sdg99"
Jul 08 22:08:50.692737 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:50.692712    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-09afc7-9bbbc5466-sdg99"]
Jul 08 22:08:50.694590 ip-10-0-131-83 kubenswrapper[2569]: W0708 22:08:50.694564    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda5ed38b_1276_4911_9375_f898bcf7590f.slice/crio-fa03e51c3fd04d860c6844512a6e4b0007369b37a4fad98c9687d06507133ba0 WatchSource:0}: Error finding container fa03e51c3fd04d860c6844512a6e4b0007369b37a4fad98c9687d06507133ba0: Status 404 returned error can't find the container with id fa03e51c3fd04d860c6844512a6e4b0007369b37a4fad98c9687d06507133ba0
Jul 08 22:08:51.662045 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:51.661996    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09afc7-9bbbc5466-sdg99" event={"ID":"da5ed38b-1276-4911-9375-f898bcf7590f","Type":"ContainerStarted","Data":"529103f123acbe97b61c91b45d729870ba21e81f1b963e900c3c9650e378e407"}
Jul 08 22:08:51.662259 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:51.662053    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09afc7-9bbbc5466-sdg99" event={"ID":"da5ed38b-1276-4911-9375-f898bcf7590f","Type":"ContainerStarted","Data":"fa03e51c3fd04d860c6844512a6e4b0007369b37a4fad98c9687d06507133ba0"}
Jul 08 22:08:51.662259 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:51.662194    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09afc7-9bbbc5466-sdg99"
Jul 08 22:08:51.677821 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:51.677775    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09afc7-9bbbc5466-sdg99" podStartSLOduration=2.222253034 podStartE2EDuration="2.677759939s" totalImagesPullingTime="455.506905ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:08:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:08:51.676516815 +0000 UTC m=+2154.614849231" watchObservedRunningTime="2026-07-08 22:08:51.677759939 +0000 UTC m=+2154.616092340"
Jul 08 22:08:57.452116 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:57.452071    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-648128-b5d465756-c6rp8"]
Jul 08 22:08:57.456355 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:57.456327    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-648128-b5d465756-c6rp8"
Jul 08 22:08:57.458626 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:57.458597    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-648128-serving-cert\""
Jul 08 22:08:57.464205 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:57.464179    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-648128-b5d465756-c6rp8"]
Jul 08 22:08:57.559008 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:57.558957    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6145b9aa-a54b-4845-9dc7-d6b1590ebb70-maas-api-tls\") pod \"maas-api-e2e-api-b-648128-b5d465756-c6rp8\" (UID: \"6145b9aa-a54b-4845-9dc7-d6b1590ebb70\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-648128-b5d465756-c6rp8"
Jul 08 22:08:57.559189 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:57.559066    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6145b9aa-a54b-4845-9dc7-d6b1590ebb70-openshift-service-ca\") pod \"maas-api-e2e-api-b-648128-b5d465756-c6rp8\" (UID: \"6145b9aa-a54b-4845-9dc7-d6b1590ebb70\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-648128-b5d465756-c6rp8"
Jul 08 22:08:57.559189 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:57.559104    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbh5h\" (UniqueName: \"kubernetes.io/projected/6145b9aa-a54b-4845-9dc7-d6b1590ebb70-kube-api-access-rbh5h\") pod \"maas-api-e2e-api-b-648128-b5d465756-c6rp8\" (UID: \"6145b9aa-a54b-4845-9dc7-d6b1590ebb70\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-648128-b5d465756-c6rp8"
Jul 08 22:08:57.660555 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:57.660523    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6145b9aa-a54b-4845-9dc7-d6b1590ebb70-maas-api-tls\") pod \"maas-api-e2e-api-b-648128-b5d465756-c6rp8\" (UID: \"6145b9aa-a54b-4845-9dc7-d6b1590ebb70\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-648128-b5d465756-c6rp8"
Jul 08 22:08:57.660555 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:57.660559    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6145b9aa-a54b-4845-9dc7-d6b1590ebb70-openshift-service-ca\") pod \"maas-api-e2e-api-b-648128-b5d465756-c6rp8\" (UID: \"6145b9aa-a54b-4845-9dc7-d6b1590ebb70\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-648128-b5d465756-c6rp8"
Jul 08 22:08:57.660755 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:57.660584    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbh5h\" (UniqueName: \"kubernetes.io/projected/6145b9aa-a54b-4845-9dc7-d6b1590ebb70-kube-api-access-rbh5h\") pod \"maas-api-e2e-api-b-648128-b5d465756-c6rp8\" (UID: \"6145b9aa-a54b-4845-9dc7-d6b1590ebb70\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-648128-b5d465756-c6rp8"
Jul 08 22:08:57.661222 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:57.661202    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6145b9aa-a54b-4845-9dc7-d6b1590ebb70-openshift-service-ca\") pod \"maas-api-e2e-api-b-648128-b5d465756-c6rp8\" (UID: \"6145b9aa-a54b-4845-9dc7-d6b1590ebb70\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-648128-b5d465756-c6rp8"
Jul 08 22:08:57.663372 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:57.663353    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-648128-serving-cert\""
Jul 08 22:08:57.669840 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:57.669819    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbh5h\" (UniqueName: \"kubernetes.io/projected/6145b9aa-a54b-4845-9dc7-d6b1590ebb70-kube-api-access-rbh5h\") pod \"maas-api-e2e-api-b-648128-b5d465756-c6rp8\" (UID: \"6145b9aa-a54b-4845-9dc7-d6b1590ebb70\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-648128-b5d465756-c6rp8"
Jul 08 22:08:57.672893 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:57.672872    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09afc7-9bbbc5466-sdg99"
Jul 08 22:08:57.674270 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:57.674253    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6145b9aa-a54b-4845-9dc7-d6b1590ebb70-maas-api-tls\") pod \"maas-api-e2e-api-b-648128-b5d465756-c6rp8\" (UID: \"6145b9aa-a54b-4845-9dc7-d6b1590ebb70\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-648128-b5d465756-c6rp8"
Jul 08 22:08:57.769034 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:57.768942    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-648128-b5d465756-c6rp8"
Jul 08 22:08:57.904401 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:57.904366    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-648128-b5d465756-c6rp8"]
Jul 08 22:08:57.909321 ip-10-0-131-83 kubenswrapper[2569]: W0708 22:08:57.909241    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6145b9aa_a54b_4845_9dc7_d6b1590ebb70.slice/crio-9d5373b4ca796baa4e9717dabcb6bb4f5bf2b8337227089d7f22233b827da92f WatchSource:0}: Error finding container 9d5373b4ca796baa4e9717dabcb6bb4f5bf2b8337227089d7f22233b827da92f: Status 404 returned error can't find the container with id 9d5373b4ca796baa4e9717dabcb6bb4f5bf2b8337227089d7f22233b827da92f
Jul 08 22:08:58.694537 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:58.694504    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-648128-b5d465756-c6rp8" event={"ID":"6145b9aa-a54b-4845-9dc7-d6b1590ebb70","Type":"ContainerStarted","Data":"b203d7a583fdc0d81b009b2cd2ab2926325815bea5cd3925aa58245bf7452a71"}
Jul 08 22:08:58.694918 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:58.694556    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-648128-b5d465756-c6rp8" event={"ID":"6145b9aa-a54b-4845-9dc7-d6b1590ebb70","Type":"ContainerStarted","Data":"9d5373b4ca796baa4e9717dabcb6bb4f5bf2b8337227089d7f22233b827da92f"}
Jul 08 22:08:58.694918 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:58.694584    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-648128-b5d465756-c6rp8"
Jul 08 22:08:58.714623 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:08:58.714526    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-648128-b5d465756-c6rp8" podStartSLOduration=1.166880231 podStartE2EDuration="1.71450987s" totalImagesPullingTime="547.629639ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:08:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:08:58.712581385 +0000 UTC m=+2161.650913802" watchObservedRunningTime="2026-07-08 22:08:58.71450987 +0000 UTC m=+2161.652842301"
Jul 08 22:09:04.686486 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:04.686436    2569 patch_prober.go:28] interesting pod/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 08 22:09:04.686911 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:04.686510    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr" podUID="de40aa54-d451-4090-b65b-a3c2f68020b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 08 22:09:04.707932 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:04.707897    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-648128-b5d465756-c6rp8"
Jul 08 22:09:06.746499 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:06.746465    2569 generic.go:356] "Generic (PLEG): container finished" podID="de40aa54-d451-4090-b65b-a3c2f68020b6" containerID="4ba5f99ad3a67e4d12a056a7678d4b05292f1a030e4a4ef2449c0bd697be3cf9" exitCode=0
Jul 08 22:09:06.746907 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:06.746540    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr" event={"ID":"de40aa54-d451-4090-b65b-a3c2f68020b6","Type":"ContainerDied","Data":"4ba5f99ad3a67e4d12a056a7678d4b05292f1a030e4a4ef2449c0bd697be3cf9"}
Jul 08 22:09:06.747010 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:06.746991    2569 scope.go:117] "RemoveContainer" containerID="4ba5f99ad3a67e4d12a056a7678d4b05292f1a030e4a4ef2449c0bd697be3cf9"
Jul 08 22:09:06.748092 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:06.748058    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 08 22:09:06.748189 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:06.748139    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 08 22:09:06.748252 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:06.748185    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 08 22:09:07.753342 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:07.753309    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr" event={"ID":"de40aa54-d451-4090-b65b-a3c2f68020b6","Type":"ContainerStarted","Data":"50c712c425b4453730e8b594f9b63ce439213edeb91a81ddb8970def3c27aa43"}
Jul 08 22:09:08.194555 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:08.194434    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"
Jul 08 22:09:08.195223 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:08.195194    2569 patch_prober.go:28] interesting pod/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 08 22:09:08.195478 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:08.195448    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr" podUID="de40aa54-d451-4090-b65b-a3c2f68020b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 08 22:09:09.194986 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:09.194933    2569 patch_prober.go:28] interesting pod/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 08 22:09:09.195574 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:09.195007    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr" podUID="de40aa54-d451-4090-b65b-a3c2f68020b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 08 22:09:10.194722 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:10.194682    2569 patch_prober.go:28] interesting pod/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 08 22:09:10.195016 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:10.194983    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr" podUID="de40aa54-d451-4090-b65b-a3c2f68020b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 08 22:09:10.473934 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:10.473851    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-09afc7-9bbbc5466-sdg99"]
Jul 08 22:09:10.474099 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:10.474072    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09afc7-9bbbc5466-sdg99" podUID="da5ed38b-1276-4911-9375-f898bcf7590f" containerName="maas-api" containerID="cri-o://529103f123acbe97b61c91b45d729870ba21e81f1b963e900c3c9650e378e407" gracePeriod=30
Jul 08 22:09:10.765218 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:10.765191    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09afc7-9bbbc5466-sdg99"
Jul 08 22:09:10.766644 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:10.766622    2569 generic.go:356] "Generic (PLEG): container finished" podID="da5ed38b-1276-4911-9375-f898bcf7590f" containerID="529103f123acbe97b61c91b45d729870ba21e81f1b963e900c3c9650e378e407" exitCode=0
Jul 08 22:09:10.766771 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:10.766655    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09afc7-9bbbc5466-sdg99"
Jul 08 22:09:10.766771 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:10.766702    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09afc7-9bbbc5466-sdg99" event={"ID":"da5ed38b-1276-4911-9375-f898bcf7590f","Type":"ContainerDied","Data":"529103f123acbe97b61c91b45d729870ba21e81f1b963e900c3c9650e378e407"}
Jul 08 22:09:10.766771 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:10.766762    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09afc7-9bbbc5466-sdg99" event={"ID":"da5ed38b-1276-4911-9375-f898bcf7590f","Type":"ContainerDied","Data":"fa03e51c3fd04d860c6844512a6e4b0007369b37a4fad98c9687d06507133ba0"}
Jul 08 22:09:10.766939 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:10.766791    2569 scope.go:117] "RemoveContainer" containerID="529103f123acbe97b61c91b45d729870ba21e81f1b963e900c3c9650e378e407"
Jul 08 22:09:10.774744 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:10.774725    2569 scope.go:117] "RemoveContainer" containerID="529103f123acbe97b61c91b45d729870ba21e81f1b963e900c3c9650e378e407"
Jul 08 22:09:10.775029 ip-10-0-131-83 kubenswrapper[2569]: E0708 22:09:10.775004    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"529103f123acbe97b61c91b45d729870ba21e81f1b963e900c3c9650e378e407\": container with ID starting with 529103f123acbe97b61c91b45d729870ba21e81f1b963e900c3c9650e378e407 not found: ID does not exist" containerID="529103f123acbe97b61c91b45d729870ba21e81f1b963e900c3c9650e378e407"
Jul 08 22:09:10.775129 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:10.775038    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"529103f123acbe97b61c91b45d729870ba21e81f1b963e900c3c9650e378e407"} err="failed to get container status \"529103f123acbe97b61c91b45d729870ba21e81f1b963e900c3c9650e378e407\": rpc error: code = NotFound desc = could not find container \"529103f123acbe97b61c91b45d729870ba21e81f1b963e900c3c9650e378e407\": container with ID starting with 529103f123acbe97b61c91b45d729870ba21e81f1b963e900c3c9650e378e407 not found: ID does not exist"
Jul 08 22:09:10.885484 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:10.885451    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da5ed38b-1276-4911-9375-f898bcf7590f-openshift-service-ca\") pod \"da5ed38b-1276-4911-9375-f898bcf7590f\" (UID: \"da5ed38b-1276-4911-9375-f898bcf7590f\") "
Jul 08 22:09:10.885484 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:10.885492    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da5ed38b-1276-4911-9375-f898bcf7590f-maas-api-tls\") pod \"da5ed38b-1276-4911-9375-f898bcf7590f\" (UID: \"da5ed38b-1276-4911-9375-f898bcf7590f\") "
Jul 08 22:09:10.885694 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:10.885517    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnfnh\" (UniqueName: \"kubernetes.io/projected/da5ed38b-1276-4911-9375-f898bcf7590f-kube-api-access-tnfnh\") pod \"da5ed38b-1276-4911-9375-f898bcf7590f\" (UID: \"da5ed38b-1276-4911-9375-f898bcf7590f\") "
Jul 08 22:09:10.885894 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:10.885863    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da5ed38b-1276-4911-9375-f898bcf7590f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "da5ed38b-1276-4911-9375-f898bcf7590f" (UID: "da5ed38b-1276-4911-9375-f898bcf7590f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:09:10.900480 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:10.900428    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da5ed38b-1276-4911-9375-f898bcf7590f-kube-api-access-tnfnh" (OuterVolumeSpecName: "kube-api-access-tnfnh") pod "da5ed38b-1276-4911-9375-f898bcf7590f" (UID: "da5ed38b-1276-4911-9375-f898bcf7590f"). InnerVolumeSpecName "kube-api-access-tnfnh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:09:10.905460 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:10.905240    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da5ed38b-1276-4911-9375-f898bcf7590f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "da5ed38b-1276-4911-9375-f898bcf7590f" (UID: "da5ed38b-1276-4911-9375-f898bcf7590f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 22:09:10.986940 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:10.986855    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da5ed38b-1276-4911-9375-f898bcf7590f-openshift-service-ca\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:09:10.986940 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:10.986896    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da5ed38b-1276-4911-9375-f898bcf7590f-maas-api-tls\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:09:10.986940 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:10.986912    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnfnh\" (UniqueName: \"kubernetes.io/projected/da5ed38b-1276-4911-9375-f898bcf7590f-kube-api-access-tnfnh\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:09:11.090198 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:11.090160    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-09afc7-9bbbc5466-sdg99"]
Jul 08 22:09:11.092726 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:11.092691    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-09afc7-9bbbc5466-sdg99"]
Jul 08 22:09:11.194846 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:11.194810    2569 patch_prober.go:28] interesting pod/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 08 22:09:11.195136 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:11.195108    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr" podUID="de40aa54-d451-4090-b65b-a3c2f68020b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 08 22:09:11.614775 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:11.614739    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da5ed38b-1276-4911-9375-f898bcf7590f" path="/var/lib/kubelet/pods/da5ed38b-1276-4911-9375-f898bcf7590f/volumes"
Jul 08 22:09:12.198475 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:12.198447    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"
Jul 08 22:09:12.198852 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:12.198749    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"
Jul 08 22:09:12.199490 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:12.199463    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"
Jul 08 22:09:16.348456 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:16.348413    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"]
Jul 08 22:09:16.348962 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:16.348632    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr" podUID="de40aa54-d451-4090-b65b-a3c2f68020b6" containerName="istio-proxy" containerID="cri-o://50c712c425b4453730e8b594f9b63ce439213edeb91a81ddb8970def3c27aa43" gracePeriod=30
Jul 08 22:09:17.379579 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:17.379518    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-648128-b5d465756-c6rp8"]
Jul 08 22:09:17.380060 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:17.379802    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-648128-b5d465756-c6rp8" podUID="6145b9aa-a54b-4845-9dc7-d6b1590ebb70" containerName="maas-api" containerID="cri-o://b203d7a583fdc0d81b009b2cd2ab2926325815bea5cd3925aa58245bf7452a71" gracePeriod=30
Jul 08 22:09:17.637959 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:17.637887    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-648128-b5d465756-c6rp8"
Jul 08 22:09:17.756089 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:17.756050    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6145b9aa-a54b-4845-9dc7-d6b1590ebb70-openshift-service-ca\") pod \"6145b9aa-a54b-4845-9dc7-d6b1590ebb70\" (UID: \"6145b9aa-a54b-4845-9dc7-d6b1590ebb70\") "
Jul 08 22:09:17.756089 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:17.756099    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6145b9aa-a54b-4845-9dc7-d6b1590ebb70-maas-api-tls\") pod \"6145b9aa-a54b-4845-9dc7-d6b1590ebb70\" (UID: \"6145b9aa-a54b-4845-9dc7-d6b1590ebb70\") "
Jul 08 22:09:17.756390 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:17.756218    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rbh5h\" (UniqueName: \"kubernetes.io/projected/6145b9aa-a54b-4845-9dc7-d6b1590ebb70-kube-api-access-rbh5h\") pod \"6145b9aa-a54b-4845-9dc7-d6b1590ebb70\" (UID: \"6145b9aa-a54b-4845-9dc7-d6b1590ebb70\") "
Jul 08 22:09:17.756526 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:17.756504    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6145b9aa-a54b-4845-9dc7-d6b1590ebb70-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6145b9aa-a54b-4845-9dc7-d6b1590ebb70" (UID: "6145b9aa-a54b-4845-9dc7-d6b1590ebb70"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:09:17.758332 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:17.758306    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6145b9aa-a54b-4845-9dc7-d6b1590ebb70-kube-api-access-rbh5h" (OuterVolumeSpecName: "kube-api-access-rbh5h") pod "6145b9aa-a54b-4845-9dc7-d6b1590ebb70" (UID: "6145b9aa-a54b-4845-9dc7-d6b1590ebb70"). InnerVolumeSpecName "kube-api-access-rbh5h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:09:17.758438 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:17.758414    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6145b9aa-a54b-4845-9dc7-d6b1590ebb70-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6145b9aa-a54b-4845-9dc7-d6b1590ebb70" (UID: "6145b9aa-a54b-4845-9dc7-d6b1590ebb70"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 22:09:17.801791 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:17.801761    2569 generic.go:356] "Generic (PLEG): container finished" podID="6145b9aa-a54b-4845-9dc7-d6b1590ebb70" containerID="b203d7a583fdc0d81b009b2cd2ab2926325815bea5cd3925aa58245bf7452a71" exitCode=0
Jul 08 22:09:17.801791 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:17.801797    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-648128-b5d465756-c6rp8" event={"ID":"6145b9aa-a54b-4845-9dc7-d6b1590ebb70","Type":"ContainerDied","Data":"b203d7a583fdc0d81b009b2cd2ab2926325815bea5cd3925aa58245bf7452a71"}
Jul 08 22:09:17.802006 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:17.801808    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-648128-b5d465756-c6rp8"
Jul 08 22:09:17.802006 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:17.801835    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-648128-b5d465756-c6rp8" event={"ID":"6145b9aa-a54b-4845-9dc7-d6b1590ebb70","Type":"ContainerDied","Data":"9d5373b4ca796baa4e9717dabcb6bb4f5bf2b8337227089d7f22233b827da92f"}
Jul 08 22:09:17.802006 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:17.801855    2569 scope.go:117] "RemoveContainer" containerID="b203d7a583fdc0d81b009b2cd2ab2926325815bea5cd3925aa58245bf7452a71"
Jul 08 22:09:17.811025 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:17.811009    2569 scope.go:117] "RemoveContainer" containerID="b203d7a583fdc0d81b009b2cd2ab2926325815bea5cd3925aa58245bf7452a71"
Jul 08 22:09:17.811274 ip-10-0-131-83 kubenswrapper[2569]: E0708 22:09:17.811253    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b203d7a583fdc0d81b009b2cd2ab2926325815bea5cd3925aa58245bf7452a71\": container with ID starting with b203d7a583fdc0d81b009b2cd2ab2926325815bea5cd3925aa58245bf7452a71 not found: ID does not exist" containerID="b203d7a583fdc0d81b009b2cd2ab2926325815bea5cd3925aa58245bf7452a71"
Jul 08 22:09:17.811398 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:17.811280    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b203d7a583fdc0d81b009b2cd2ab2926325815bea5cd3925aa58245bf7452a71"} err="failed to get container status \"b203d7a583fdc0d81b009b2cd2ab2926325815bea5cd3925aa58245bf7452a71\": rpc error: code = NotFound desc = could not find container \"b203d7a583fdc0d81b009b2cd2ab2926325815bea5cd3925aa58245bf7452a71\": container with ID starting with b203d7a583fdc0d81b009b2cd2ab2926325815bea5cd3925aa58245bf7452a71 not found: ID does not exist"
Jul 08 22:09:17.822611 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:17.822584    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-648128-b5d465756-c6rp8"]
Jul 08 22:09:17.826107 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:17.826082    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-648128-b5d465756-c6rp8"]
Jul 08 22:09:17.857772 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:17.857743    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6145b9aa-a54b-4845-9dc7-d6b1590ebb70-openshift-service-ca\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:09:17.857772 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:17.857771    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6145b9aa-a54b-4845-9dc7-d6b1590ebb70-maas-api-tls\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:09:17.857922 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:17.857782    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbh5h\" (UniqueName: \"kubernetes.io/projected/6145b9aa-a54b-4845-9dc7-d6b1590ebb70-kube-api-access-rbh5h\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:09:19.612586 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:19.612550    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6145b9aa-a54b-4845-9dc7-d6b1590ebb70" path="/var/lib/kubelet/pods/6145b9aa-a54b-4845-9dc7-d6b1590ebb70/volumes"
Jul 08 22:09:21.601265 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:21.601239    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"
Jul 08 22:09:21.691469 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:21.691434    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de40aa54-d451-4090-b65b-a3c2f68020b6-credential-socket\") pod \"de40aa54-d451-4090-b65b-a3c2f68020b6\" (UID: \"de40aa54-d451-4090-b65b-a3c2f68020b6\") "
Jul 08 22:09:21.691661 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:21.691494    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de40aa54-d451-4090-b65b-a3c2f68020b6-workload-socket\") pod \"de40aa54-d451-4090-b65b-a3c2f68020b6\" (UID: \"de40aa54-d451-4090-b65b-a3c2f68020b6\") "
Jul 08 22:09:21.691661 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:21.691520    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de40aa54-d451-4090-b65b-a3c2f68020b6-istio-podinfo\") pod \"de40aa54-d451-4090-b65b-a3c2f68020b6\" (UID: \"de40aa54-d451-4090-b65b-a3c2f68020b6\") "
Jul 08 22:09:21.691661 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:21.691546    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de40aa54-d451-4090-b65b-a3c2f68020b6-workload-certs\") pod \"de40aa54-d451-4090-b65b-a3c2f68020b6\" (UID: \"de40aa54-d451-4090-b65b-a3c2f68020b6\") "
Jul 08 22:09:21.691661 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:21.691574    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de40aa54-d451-4090-b65b-a3c2f68020b6-istiod-ca-cert\") pod \"de40aa54-d451-4090-b65b-a3c2f68020b6\" (UID: \"de40aa54-d451-4090-b65b-a3c2f68020b6\") "
Jul 08 22:09:21.691661 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:21.691593    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de40aa54-d451-4090-b65b-a3c2f68020b6-istio-envoy\") pod \"de40aa54-d451-4090-b65b-a3c2f68020b6\" (UID: \"de40aa54-d451-4090-b65b-a3c2f68020b6\") "
Jul 08 22:09:21.691661 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:21.691652    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de40aa54-d451-4090-b65b-a3c2f68020b6-istio-token\") pod \"de40aa54-d451-4090-b65b-a3c2f68020b6\" (UID: \"de40aa54-d451-4090-b65b-a3c2f68020b6\") "
Jul 08 22:09:21.691993 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:21.691683    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wrbg\" (UniqueName: \"kubernetes.io/projected/de40aa54-d451-4090-b65b-a3c2f68020b6-kube-api-access-5wrbg\") pod \"de40aa54-d451-4090-b65b-a3c2f68020b6\" (UID: \"de40aa54-d451-4090-b65b-a3c2f68020b6\") "
Jul 08 22:09:21.691993 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:21.691713    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de40aa54-d451-4090-b65b-a3c2f68020b6-istio-data\") pod \"de40aa54-d451-4090-b65b-a3c2f68020b6\" (UID: \"de40aa54-d451-4090-b65b-a3c2f68020b6\") "
Jul 08 22:09:21.691993 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:21.691782    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de40aa54-d451-4090-b65b-a3c2f68020b6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "de40aa54-d451-4090-b65b-a3c2f68020b6" (UID: "de40aa54-d451-4090-b65b-a3c2f68020b6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:09:21.691993 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:21.691843    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de40aa54-d451-4090-b65b-a3c2f68020b6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "de40aa54-d451-4090-b65b-a3c2f68020b6" (UID: "de40aa54-d451-4090-b65b-a3c2f68020b6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:09:21.691993 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:21.691872    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de40aa54-d451-4090-b65b-a3c2f68020b6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "de40aa54-d451-4090-b65b-a3c2f68020b6" (UID: "de40aa54-d451-4090-b65b-a3c2f68020b6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:09:21.692273 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:21.692044    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de40aa54-d451-4090-b65b-a3c2f68020b6-credential-socket\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:09:21.692273 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:21.692064    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de40aa54-d451-4090-b65b-a3c2f68020b6-workload-socket\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:09:21.692273 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:21.692077    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de40aa54-d451-4090-b65b-a3c2f68020b6-workload-certs\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:09:21.692273 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:21.692153    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de40aa54-d451-4090-b65b-a3c2f68020b6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "de40aa54-d451-4090-b65b-a3c2f68020b6" (UID: "de40aa54-d451-4090-b65b-a3c2f68020b6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:09:21.692928 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:21.692904    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de40aa54-d451-4090-b65b-a3c2f68020b6-istio-data" (OuterVolumeSpecName: "istio-data") pod "de40aa54-d451-4090-b65b-a3c2f68020b6" (UID: "de40aa54-d451-4090-b65b-a3c2f68020b6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:09:21.693986 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:21.693965    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de40aa54-d451-4090-b65b-a3c2f68020b6-istio-token" (OuterVolumeSpecName: "istio-token") pod "de40aa54-d451-4090-b65b-a3c2f68020b6" (UID: "de40aa54-d451-4090-b65b-a3c2f68020b6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:09:21.694114 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:21.694094    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/de40aa54-d451-4090-b65b-a3c2f68020b6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "de40aa54-d451-4090-b65b-a3c2f68020b6" (UID: "de40aa54-d451-4090-b65b-a3c2f68020b6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 22:09:21.694478 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:21.694453    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de40aa54-d451-4090-b65b-a3c2f68020b6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "de40aa54-d451-4090-b65b-a3c2f68020b6" (UID: "de40aa54-d451-4090-b65b-a3c2f68020b6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:09:21.694595 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:21.694538    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de40aa54-d451-4090-b65b-a3c2f68020b6-kube-api-access-5wrbg" (OuterVolumeSpecName: "kube-api-access-5wrbg") pod "de40aa54-d451-4090-b65b-a3c2f68020b6" (UID: "de40aa54-d451-4090-b65b-a3c2f68020b6"). InnerVolumeSpecName "kube-api-access-5wrbg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:09:21.793133 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:21.793095    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de40aa54-d451-4090-b65b-a3c2f68020b6-istio-token\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:09:21.793133 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:21.793126    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wrbg\" (UniqueName: \"kubernetes.io/projected/de40aa54-d451-4090-b65b-a3c2f68020b6-kube-api-access-5wrbg\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:09:21.793133 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:21.793136    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de40aa54-d451-4090-b65b-a3c2f68020b6-istio-data\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:09:21.793133 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:21.793145    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de40aa54-d451-4090-b65b-a3c2f68020b6-istio-podinfo\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:09:21.793441 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:21.793153    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de40aa54-d451-4090-b65b-a3c2f68020b6-istiod-ca-cert\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:09:21.793441 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:21.793160    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de40aa54-d451-4090-b65b-a3c2f68020b6-istio-envoy\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:09:21.821952 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:21.821915    2569 generic.go:356] "Generic (PLEG): container finished" podID="de40aa54-d451-4090-b65b-a3c2f68020b6" containerID="50c712c425b4453730e8b594f9b63ce439213edeb91a81ddb8970def3c27aa43" exitCode=0
Jul 08 22:09:21.822115 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:21.821968    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"
Jul 08 22:09:21.822115 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:21.821977    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr" event={"ID":"de40aa54-d451-4090-b65b-a3c2f68020b6","Type":"ContainerDied","Data":"50c712c425b4453730e8b594f9b63ce439213edeb91a81ddb8970def3c27aa43"}
Jul 08 22:09:21.822115 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:21.822028    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr" event={"ID":"de40aa54-d451-4090-b65b-a3c2f68020b6","Type":"ContainerDied","Data":"6630770c6014d0abf702b3bcb78d8ed279124dbad504dd6b90d51d6b08af1fa1"}
Jul 08 22:09:21.822115 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:21.822049    2569 scope.go:117] "RemoveContainer" containerID="50c712c425b4453730e8b594f9b63ce439213edeb91a81ddb8970def3c27aa43"
Jul 08 22:09:21.831626 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:21.831603    2569 scope.go:117] "RemoveContainer" containerID="4ba5f99ad3a67e4d12a056a7678d4b05292f1a030e4a4ef2449c0bd697be3cf9"
Jul 08 22:09:21.839321 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:21.839299    2569 scope.go:117] "RemoveContainer" containerID="50c712c425b4453730e8b594f9b63ce439213edeb91a81ddb8970def3c27aa43"
Jul 08 22:09:21.839583 ip-10-0-131-83 kubenswrapper[2569]: E0708 22:09:21.839565    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50c712c425b4453730e8b594f9b63ce439213edeb91a81ddb8970def3c27aa43\": container with ID starting with 50c712c425b4453730e8b594f9b63ce439213edeb91a81ddb8970def3c27aa43 not found: ID does not exist" containerID="50c712c425b4453730e8b594f9b63ce439213edeb91a81ddb8970def3c27aa43"
Jul 08 22:09:21.839653 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:21.839589    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50c712c425b4453730e8b594f9b63ce439213edeb91a81ddb8970def3c27aa43"} err="failed to get container status \"50c712c425b4453730e8b594f9b63ce439213edeb91a81ddb8970def3c27aa43\": rpc error: code = NotFound desc = could not find container \"50c712c425b4453730e8b594f9b63ce439213edeb91a81ddb8970def3c27aa43\": container with ID starting with 50c712c425b4453730e8b594f9b63ce439213edeb91a81ddb8970def3c27aa43 not found: ID does not exist"
Jul 08 22:09:21.839653 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:21.839608    2569 scope.go:117] "RemoveContainer" containerID="4ba5f99ad3a67e4d12a056a7678d4b05292f1a030e4a4ef2449c0bd697be3cf9"
Jul 08 22:09:21.839858 ip-10-0-131-83 kubenswrapper[2569]: E0708 22:09:21.839841    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ba5f99ad3a67e4d12a056a7678d4b05292f1a030e4a4ef2449c0bd697be3cf9\": container with ID starting with 4ba5f99ad3a67e4d12a056a7678d4b05292f1a030e4a4ef2449c0bd697be3cf9 not found: ID does not exist" containerID="4ba5f99ad3a67e4d12a056a7678d4b05292f1a030e4a4ef2449c0bd697be3cf9"
Jul 08 22:09:21.839906 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:21.839865    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ba5f99ad3a67e4d12a056a7678d4b05292f1a030e4a4ef2449c0bd697be3cf9"} err="failed to get container status \"4ba5f99ad3a67e4d12a056a7678d4b05292f1a030e4a4ef2449c0bd697be3cf9\": rpc error: code = NotFound desc = could not find container \"4ba5f99ad3a67e4d12a056a7678d4b05292f1a030e4a4ef2449c0bd697be3cf9\": container with ID starting with 4ba5f99ad3a67e4d12a056a7678d4b05292f1a030e4a4ef2449c0bd697be3cf9 not found: ID does not exist"
Jul 08 22:09:21.844662 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:21.844638    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"]
Jul 08 22:09:21.851910 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:21.851886    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-09afc7-openshift-default-5ff7f464c-jhpbr"]
Jul 08 22:09:23.612415 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:23.612382    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de40aa54-d451-4090-b65b-a3c2f68020b6" path="/var/lib/kubelet/pods/de40aa54-d451-4090-b65b-a3c2f68020b6/volumes"
Jul 08 22:09:23.902306 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:23.902252    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"]
Jul 08 22:09:23.902769 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:23.902753    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da5ed38b-1276-4911-9375-f898bcf7590f" containerName="maas-api"
Jul 08 22:09:23.902821 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:23.902774    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="da5ed38b-1276-4911-9375-f898bcf7590f" containerName="maas-api"
Jul 08 22:09:23.902821 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:23.902791    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de40aa54-d451-4090-b65b-a3c2f68020b6" containerName="istio-proxy"
Jul 08 22:09:23.902821 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:23.902800    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="de40aa54-d451-4090-b65b-a3c2f68020b6" containerName="istio-proxy"
Jul 08 22:09:23.902821 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:23.902811    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6145b9aa-a54b-4845-9dc7-d6b1590ebb70" containerName="maas-api"
Jul 08 22:09:23.902821 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:23.902819    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="6145b9aa-a54b-4845-9dc7-d6b1590ebb70" containerName="maas-api"
Jul 08 22:09:23.902991 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:23.902907    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="de40aa54-d451-4090-b65b-a3c2f68020b6" containerName="istio-proxy"
Jul 08 22:09:23.902991 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:23.902919    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="de40aa54-d451-4090-b65b-a3c2f68020b6" containerName="istio-proxy"
Jul 08 22:09:23.902991 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:23.902929    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="6145b9aa-a54b-4845-9dc7-d6b1590ebb70" containerName="maas-api"
Jul 08 22:09:23.902991 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:23.902939    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="da5ed38b-1276-4911-9375-f898bcf7590f" containerName="maas-api"
Jul 08 22:09:23.907366 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:23.907345    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"
Jul 08 22:09:23.909551 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:23.909530    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-c45f56-openshift-default-dockercfg-fvjhb\""
Jul 08 22:09:23.915080 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:23.915056    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"]
Jul 08 22:09:24.012615 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:24.012566    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-istio-data\") pod \"e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp\" (UID: \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\") " pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"
Jul 08 22:09:24.012797 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:24.012623    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-workload-certs\") pod \"e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp\" (UID: \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\") " pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"
Jul 08 22:09:24.012797 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:24.012657    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-istiod-ca-cert\") pod \"e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp\" (UID: \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\") " pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"
Jul 08 22:09:24.012797 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:24.012688    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-credential-socket\") pod \"e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp\" (UID: \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\") " pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"
Jul 08 22:09:24.012797 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:24.012774    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-istio-token\") pod \"e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp\" (UID: \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\") " pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"
Jul 08 22:09:24.013011 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:24.012834    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-istio-podinfo\") pod \"e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp\" (UID: \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\") " pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"
Jul 08 22:09:24.013011 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:24.012875    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhll2\" (UniqueName: \"kubernetes.io/projected/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-kube-api-access-zhll2\") pod \"e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp\" (UID: \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\") " pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"
Jul 08 22:09:24.013011 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:24.012925    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-workload-socket\") pod \"e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp\" (UID: \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\") " pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"
Jul 08 22:09:24.013011 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:24.012969    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-istio-envoy\") pod \"e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp\" (UID: \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\") " pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"
Jul 08 22:09:24.113836 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:24.113801    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-istio-podinfo\") pod \"e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp\" (UID: \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\") " pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"
Jul 08 22:09:24.114001 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:24.113844    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhll2\" (UniqueName: \"kubernetes.io/projected/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-kube-api-access-zhll2\") pod \"e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp\" (UID: \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\") " pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"
Jul 08 22:09:24.114001 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:24.113867    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-workload-socket\") pod \"e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp\" (UID: \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\") " pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"
Jul 08 22:09:24.114001 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:24.113894    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-istio-envoy\") pod \"e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp\" (UID: \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\") " pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"
Jul 08 22:09:24.114001 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:24.113937    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-istio-data\") pod \"e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp\" (UID: \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\") " pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"
Jul 08 22:09:24.114001 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:24.113961    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-workload-certs\") pod \"e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp\" (UID: \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\") " pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"
Jul 08 22:09:24.114001 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:24.113986    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-istiod-ca-cert\") pod \"e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp\" (UID: \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\") " pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"
Jul 08 22:09:24.114355 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:24.114018    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-credential-socket\") pod \"e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp\" (UID: \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\") " pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"
Jul 08 22:09:24.114355 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:24.114045    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-istio-token\") pod \"e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp\" (UID: \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\") " pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"
Jul 08 22:09:24.114464 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:24.114423    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-workload-socket\") pod \"e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp\" (UID: \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\") " pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"
Jul 08 22:09:24.114520 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:24.114460    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-workload-certs\") pod \"e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp\" (UID: \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\") " pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"
Jul 08 22:09:24.114634 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:24.114608    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-istio-data\") pod \"e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp\" (UID: \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\") " pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"
Jul 08 22:09:24.114634 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:24.114626    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-credential-socket\") pod \"e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp\" (UID: \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\") " pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"
Jul 08 22:09:24.115007 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:24.114852    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-istiod-ca-cert\") pod \"e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp\" (UID: \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\") " pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"
Jul 08 22:09:24.116376 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:24.116356    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-istio-envoy\") pod \"e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp\" (UID: \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\") " pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"
Jul 08 22:09:24.116466 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:24.116416    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-istio-podinfo\") pod \"e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp\" (UID: \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\") " pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"
Jul 08 22:09:24.125201 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:24.125181    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-istio-token\") pod \"e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp\" (UID: \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\") " pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"
Jul 08 22:09:24.125310 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:24.125217    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhll2\" (UniqueName: \"kubernetes.io/projected/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-kube-api-access-zhll2\") pod \"e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp\" (UID: \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\") " pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"
Jul 08 22:09:24.217608 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:24.217508    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"
Jul 08 22:09:24.355573 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:24.355487    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"]
Jul 08 22:09:24.357810 ip-10-0-131-83 kubenswrapper[2569]: W0708 22:09:24.357782    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0188ee5_85ff_4eed_a30d_1e0a3eed8a95.slice/crio-43d837bb133de12198a1eba3a9e49e80392cc36577063e5804f0067bc4ac1e28 WatchSource:0}: Error finding container 43d837bb133de12198a1eba3a9e49e80392cc36577063e5804f0067bc4ac1e28: Status 404 returned error can't find the container with id 43d837bb133de12198a1eba3a9e49e80392cc36577063e5804f0067bc4ac1e28
Jul 08 22:09:24.359962 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:24.359923    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 08 22:09:24.360076 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:24.360004    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 08 22:09:24.360076 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:24.360051    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 08 22:09:24.837640 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:24.837600    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp" event={"ID":"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95","Type":"ContainerStarted","Data":"68fbcae12ab1e6cc94c98574d9f2c71d39a678dda820adfef4aa199b54f0fdeb"}
Jul 08 22:09:24.838028 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:24.837699    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp" event={"ID":"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95","Type":"ContainerStarted","Data":"43d837bb133de12198a1eba3a9e49e80392cc36577063e5804f0067bc4ac1e28"}
Jul 08 22:09:24.857280 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:24.857224    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp" podStartSLOduration=1.8572081489999999 podStartE2EDuration="1.857208149s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:09:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:09:24.855673592 +0000 UTC m=+2187.794006008" watchObservedRunningTime="2026-07-08 22:09:24.857208149 +0000 UTC m=+2187.795540552"
Jul 08 22:09:25.218516 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:25.218482    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"
Jul 08 22:09:25.220004 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:25.219974    2569 patch_prober.go:28] interesting pod/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 08 22:09:25.220144 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:25.220034    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp" podUID="d0188ee5-85ff-4eed-a30d-1e0a3eed8a95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 08 22:09:26.222745 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:26.222715    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"
Jul 08 22:09:26.847999 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:26.847963    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"
Jul 08 22:09:26.849101 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:26.849078    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"
Jul 08 22:09:27.060837 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:27.060806    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c45f56-7669495bb-6mfjb"]
Jul 08 22:09:27.061151 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:27.061138    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de40aa54-d451-4090-b65b-a3c2f68020b6" containerName="istio-proxy"
Jul 08 22:09:27.061199 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:27.061153    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="de40aa54-d451-4090-b65b-a3c2f68020b6" containerName="istio-proxy"
Jul 08 22:09:27.064137 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:27.064118    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c45f56-7669495bb-6mfjb"
Jul 08 22:09:27.068517 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:27.068496    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-c45f56-serving-cert\""
Jul 08 22:09:27.078874 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:27.078853    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c45f56-7669495bb-6mfjb"]
Jul 08 22:09:27.143788 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:27.143756    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41ae0572-3508-4e96-bb19-300c4aafe2e1-maas-api-tls\") pod \"maas-api-e2e-shared-a-c45f56-7669495bb-6mfjb\" (UID: \"41ae0572-3508-4e96-bb19-300c4aafe2e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c45f56-7669495bb-6mfjb"
Jul 08 22:09:27.143948 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:27.143817    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krqn7\" (UniqueName: \"kubernetes.io/projected/41ae0572-3508-4e96-bb19-300c4aafe2e1-kube-api-access-krqn7\") pod \"maas-api-e2e-shared-a-c45f56-7669495bb-6mfjb\" (UID: \"41ae0572-3508-4e96-bb19-300c4aafe2e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c45f56-7669495bb-6mfjb"
Jul 08 22:09:27.143948 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:27.143862    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41ae0572-3508-4e96-bb19-300c4aafe2e1-openshift-service-ca\") pod \"maas-api-e2e-shared-a-c45f56-7669495bb-6mfjb\" (UID: \"41ae0572-3508-4e96-bb19-300c4aafe2e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c45f56-7669495bb-6mfjb"
Jul 08 22:09:27.244665 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:27.244629    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41ae0572-3508-4e96-bb19-300c4aafe2e1-maas-api-tls\") pod \"maas-api-e2e-shared-a-c45f56-7669495bb-6mfjb\" (UID: \"41ae0572-3508-4e96-bb19-300c4aafe2e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c45f56-7669495bb-6mfjb"
Jul 08 22:09:27.245106 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:27.244687    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krqn7\" (UniqueName: \"kubernetes.io/projected/41ae0572-3508-4e96-bb19-300c4aafe2e1-kube-api-access-krqn7\") pod \"maas-api-e2e-shared-a-c45f56-7669495bb-6mfjb\" (UID: \"41ae0572-3508-4e96-bb19-300c4aafe2e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c45f56-7669495bb-6mfjb"
Jul 08 22:09:27.245106 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:27.244732    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41ae0572-3508-4e96-bb19-300c4aafe2e1-openshift-service-ca\") pod \"maas-api-e2e-shared-a-c45f56-7669495bb-6mfjb\" (UID: \"41ae0572-3508-4e96-bb19-300c4aafe2e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c45f56-7669495bb-6mfjb"
Jul 08 22:09:27.245407 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:27.245387    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41ae0572-3508-4e96-bb19-300c4aafe2e1-openshift-service-ca\") pod \"maas-api-e2e-shared-a-c45f56-7669495bb-6mfjb\" (UID: \"41ae0572-3508-4e96-bb19-300c4aafe2e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c45f56-7669495bb-6mfjb"
Jul 08 22:09:27.247492 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:27.247463    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41ae0572-3508-4e96-bb19-300c4aafe2e1-maas-api-tls\") pod \"maas-api-e2e-shared-a-c45f56-7669495bb-6mfjb\" (UID: \"41ae0572-3508-4e96-bb19-300c4aafe2e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c45f56-7669495bb-6mfjb"
Jul 08 22:09:27.253567 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:27.253543    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krqn7\" (UniqueName: \"kubernetes.io/projected/41ae0572-3508-4e96-bb19-300c4aafe2e1-kube-api-access-krqn7\") pod \"maas-api-e2e-shared-a-c45f56-7669495bb-6mfjb\" (UID: \"41ae0572-3508-4e96-bb19-300c4aafe2e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c45f56-7669495bb-6mfjb"
Jul 08 22:09:27.374568 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:27.374531    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c45f56-7669495bb-6mfjb"
Jul 08 22:09:27.528547 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:27.528508    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c45f56-7669495bb-6mfjb"]
Jul 08 22:09:27.531666 ip-10-0-131-83 kubenswrapper[2569]: W0708 22:09:27.531640    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41ae0572_3508_4e96_bb19_300c4aafe2e1.slice/crio-3e7362326ed2de3bedeab905f2c6ca67506624d671e6d2b3124e53f7f36c2924 WatchSource:0}: Error finding container 3e7362326ed2de3bedeab905f2c6ca67506624d671e6d2b3124e53f7f36c2924: Status 404 returned error can't find the container with id 3e7362326ed2de3bedeab905f2c6ca67506624d671e6d2b3124e53f7f36c2924
Jul 08 22:09:27.853111 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:27.853024    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c45f56-7669495bb-6mfjb" event={"ID":"41ae0572-3508-4e96-bb19-300c4aafe2e1","Type":"ContainerStarted","Data":"3e7362326ed2de3bedeab905f2c6ca67506624d671e6d2b3124e53f7f36c2924"}
Jul 08 22:09:28.859203 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:28.859165    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c45f56-7669495bb-6mfjb" event={"ID":"41ae0572-3508-4e96-bb19-300c4aafe2e1","Type":"ContainerStarted","Data":"e5ca29cdbebce56b42f213281bcde4d71a8da746be157535800bfedb2c529c0d"}
Jul 08 22:09:28.878091 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:28.878039    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c45f56-7669495bb-6mfjb" podStartSLOduration=1.343607451 podStartE2EDuration="1.878023243s" totalImagesPullingTime="534.415792ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:09:28.876872998 +0000 UTC m=+2191.815205444" watchObservedRunningTime="2026-07-08 22:09:28.878023243 +0000 UTC m=+2191.816355642"
Jul 08 22:09:29.868590 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:29.868546    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c45f56-7669495bb-6mfjb"
Jul 08 22:09:34.556999 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:34.556966    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-ca01c9-785b88cb75-tlxld"]
Jul 08 22:09:34.560662 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:34.560640    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ca01c9-785b88cb75-tlxld"
Jul 08 22:09:34.568209 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:34.568183    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-ca01c9-serving-cert\""
Jul 08 22:09:34.583381 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:34.583355    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-ca01c9-785b88cb75-tlxld"]
Jul 08 22:09:34.614924 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:34.614884    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg8nx\" (UniqueName: \"kubernetes.io/projected/6dc11faa-24bf-471a-8fd3-813071038c08-kube-api-access-cg8nx\") pod \"maas-api-e2e-shared-b-ca01c9-785b88cb75-tlxld\" (UID: \"6dc11faa-24bf-471a-8fd3-813071038c08\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ca01c9-785b88cb75-tlxld"
Jul 08 22:09:34.615122 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:34.614939    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6dc11faa-24bf-471a-8fd3-813071038c08-openshift-service-ca\") pod \"maas-api-e2e-shared-b-ca01c9-785b88cb75-tlxld\" (UID: \"6dc11faa-24bf-471a-8fd3-813071038c08\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ca01c9-785b88cb75-tlxld"
Jul 08 22:09:34.615122 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:34.615000    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6dc11faa-24bf-471a-8fd3-813071038c08-maas-api-tls\") pod \"maas-api-e2e-shared-b-ca01c9-785b88cb75-tlxld\" (UID: \"6dc11faa-24bf-471a-8fd3-813071038c08\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ca01c9-785b88cb75-tlxld"
Jul 08 22:09:34.715880 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:34.715824    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6dc11faa-24bf-471a-8fd3-813071038c08-openshift-service-ca\") pod \"maas-api-e2e-shared-b-ca01c9-785b88cb75-tlxld\" (UID: \"6dc11faa-24bf-471a-8fd3-813071038c08\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ca01c9-785b88cb75-tlxld"
Jul 08 22:09:34.716037 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:34.715889    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6dc11faa-24bf-471a-8fd3-813071038c08-maas-api-tls\") pod \"maas-api-e2e-shared-b-ca01c9-785b88cb75-tlxld\" (UID: \"6dc11faa-24bf-471a-8fd3-813071038c08\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ca01c9-785b88cb75-tlxld"
Jul 08 22:09:34.716037 ip-10-0-131-83 kubenswrapper[2569]: E0708 22:09:34.715996    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-ca01c9-serving-cert: secret "maas-api-e2e-shared-b-ca01c9-serving-cert" not found
Jul 08 22:09:34.716037 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:34.716002    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg8nx\" (UniqueName: \"kubernetes.io/projected/6dc11faa-24bf-471a-8fd3-813071038c08-kube-api-access-cg8nx\") pod \"maas-api-e2e-shared-b-ca01c9-785b88cb75-tlxld\" (UID: \"6dc11faa-24bf-471a-8fd3-813071038c08\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ca01c9-785b88cb75-tlxld"
Jul 08 22:09:34.716172 ip-10-0-131-83 kubenswrapper[2569]: E0708 22:09:34.716063    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc11faa-24bf-471a-8fd3-813071038c08-maas-api-tls podName:6dc11faa-24bf-471a-8fd3-813071038c08 nodeName:}" failed. No retries permitted until 2026-07-08 22:09:35.216041532 +0000 UTC m=+2198.154373913 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6dc11faa-24bf-471a-8fd3-813071038c08-maas-api-tls") pod "maas-api-e2e-shared-b-ca01c9-785b88cb75-tlxld" (UID: "6dc11faa-24bf-471a-8fd3-813071038c08") : secret "maas-api-e2e-shared-b-ca01c9-serving-cert" not found
Jul 08 22:09:34.716582 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:34.716560    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6dc11faa-24bf-471a-8fd3-813071038c08-openshift-service-ca\") pod \"maas-api-e2e-shared-b-ca01c9-785b88cb75-tlxld\" (UID: \"6dc11faa-24bf-471a-8fd3-813071038c08\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ca01c9-785b88cb75-tlxld"
Jul 08 22:09:34.724497 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:34.724467    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg8nx\" (UniqueName: \"kubernetes.io/projected/6dc11faa-24bf-471a-8fd3-813071038c08-kube-api-access-cg8nx\") pod \"maas-api-e2e-shared-b-ca01c9-785b88cb75-tlxld\" (UID: \"6dc11faa-24bf-471a-8fd3-813071038c08\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ca01c9-785b88cb75-tlxld"
Jul 08 22:09:35.219434 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:35.219390    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6dc11faa-24bf-471a-8fd3-813071038c08-maas-api-tls\") pod \"maas-api-e2e-shared-b-ca01c9-785b88cb75-tlxld\" (UID: \"6dc11faa-24bf-471a-8fd3-813071038c08\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ca01c9-785b88cb75-tlxld"
Jul 08 22:09:35.221835 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:35.221806    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6dc11faa-24bf-471a-8fd3-813071038c08-maas-api-tls\") pod \"maas-api-e2e-shared-b-ca01c9-785b88cb75-tlxld\" (UID: \"6dc11faa-24bf-471a-8fd3-813071038c08\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ca01c9-785b88cb75-tlxld"
Jul 08 22:09:35.471973 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:35.471879    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ca01c9-785b88cb75-tlxld"
Jul 08 22:09:35.658006 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:35.657968    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-ca01c9-785b88cb75-tlxld"]
Jul 08 22:09:35.878811 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:35.878731    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c45f56-7669495bb-6mfjb"
Jul 08 22:09:35.904390 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:35.904348    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ca01c9-785b88cb75-tlxld" event={"ID":"6dc11faa-24bf-471a-8fd3-813071038c08","Type":"ContainerStarted","Data":"dd6ce64ec09186f0aa7dedfeb1c1c360856b904503866d5932347bfd28e34749"}
Jul 08 22:09:36.911348 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:36.911277    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ca01c9-785b88cb75-tlxld" event={"ID":"6dc11faa-24bf-471a-8fd3-813071038c08","Type":"ContainerStarted","Data":"9696b75032ff185d0f12e93e08a06aa9b3c7d9ea8c695ccfe68b60ffc7fc2375"}
Jul 08 22:09:36.911723 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:36.911401    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ca01c9-785b88cb75-tlxld"
Jul 08 22:09:36.927681 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:36.927631    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ca01c9-785b88cb75-tlxld" podStartSLOduration=2.489742674 podStartE2EDuration="2.927613897s" totalImagesPullingTime="437.871223ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:09:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:09:36.926873669 +0000 UTC m=+2199.865206090" watchObservedRunningTime="2026-07-08 22:09:36.927613897 +0000 UTC m=+2199.865946319"
Jul 08 22:09:39.925822 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:39.925792    2569 generic.go:356] "Generic (PLEG): container finished" podID="d0188ee5-85ff-4eed-a30d-1e0a3eed8a95" containerID="68fbcae12ab1e6cc94c98574d9f2c71d39a678dda820adfef4aa199b54f0fdeb" exitCode=0
Jul 08 22:09:39.926229 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:39.925872    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp" event={"ID":"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95","Type":"ContainerDied","Data":"68fbcae12ab1e6cc94c98574d9f2c71d39a678dda820adfef4aa199b54f0fdeb"}
Jul 08 22:09:39.926311 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:39.926276    2569 scope.go:117] "RemoveContainer" containerID="68fbcae12ab1e6cc94c98574d9f2c71d39a678dda820adfef4aa199b54f0fdeb"
Jul 08 22:09:39.927440 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:39.927407    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 08 22:09:39.927527 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:39.927499    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 08 22:09:39.927568 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:39.927532    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 08 22:09:40.932528 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:40.932490    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp" event={"ID":"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95","Type":"ContainerStarted","Data":"5d91997944e6410916eece1e50e05ea4fa02647c1dd97f53617bcc233411d8b4"}
Jul 08 22:09:41.217794 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:41.217683    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"
Jul 08 22:09:41.218963 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:41.218940    2569 patch_prober.go:28] interesting pod/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 08 22:09:41.219021 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:41.218990    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp" podUID="d0188ee5-85ff-4eed-a30d-1e0a3eed8a95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 08 22:09:41.848679 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:41.848643    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"
Jul 08 22:09:42.218768 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:42.218730    2569 patch_prober.go:28] interesting pod/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 08 22:09:42.219242 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:42.218794    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp" podUID="d0188ee5-85ff-4eed-a30d-1e0a3eed8a95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 08 22:09:42.923466 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:42.923437    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ca01c9-785b88cb75-tlxld"
Jul 08 22:09:43.218711 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:43.218621    2569 patch_prober.go:28] interesting pod/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 08 22:09:43.218711 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:43.218673    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp" podUID="d0188ee5-85ff-4eed-a30d-1e0a3eed8a95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 08 22:09:44.218377 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:44.218334    2569 patch_prober.go:28] interesting pod/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 08 22:09:44.218565 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:44.218396    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp" podUID="d0188ee5-85ff-4eed-a30d-1e0a3eed8a95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 08 22:09:45.222682 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:45.222654    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"
Jul 08 22:09:45.223640 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:09:45.223621    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"
Jul 08 22:12:44.498876 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:44.498827    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c45f56-7669495bb-6mfjb"]
Jul 08 22:12:44.499511 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:44.499073    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c45f56-7669495bb-6mfjb" podUID="41ae0572-3508-4e96-bb19-300c4aafe2e1" containerName="maas-api" containerID="cri-o://e5ca29cdbebce56b42f213281bcde4d71a8da746be157535800bfedb2c529c0d" gracePeriod=30
Jul 08 22:12:44.741430 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:44.741395    2569 generic.go:356] "Generic (PLEG): container finished" podID="41ae0572-3508-4e96-bb19-300c4aafe2e1" containerID="e5ca29cdbebce56b42f213281bcde4d71a8da746be157535800bfedb2c529c0d" exitCode=0
Jul 08 22:12:44.741563 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:44.741476    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c45f56-7669495bb-6mfjb" event={"ID":"41ae0572-3508-4e96-bb19-300c4aafe2e1","Type":"ContainerDied","Data":"e5ca29cdbebce56b42f213281bcde4d71a8da746be157535800bfedb2c529c0d"}
Jul 08 22:12:44.741563 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:44.741530    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c45f56-7669495bb-6mfjb" event={"ID":"41ae0572-3508-4e96-bb19-300c4aafe2e1","Type":"ContainerDied","Data":"3e7362326ed2de3bedeab905f2c6ca67506624d671e6d2b3124e53f7f36c2924"}
Jul 08 22:12:44.741563 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:44.741548    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e7362326ed2de3bedeab905f2c6ca67506624d671e6d2b3124e53f7f36c2924"
Jul 08 22:12:44.746515 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:44.746489    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c45f56-7669495bb-6mfjb"
Jul 08 22:12:44.910488 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:44.910454    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41ae0572-3508-4e96-bb19-300c4aafe2e1-openshift-service-ca\") pod \"41ae0572-3508-4e96-bb19-300c4aafe2e1\" (UID: \"41ae0572-3508-4e96-bb19-300c4aafe2e1\") "
Jul 08 22:12:44.910670 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:44.910505    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41ae0572-3508-4e96-bb19-300c4aafe2e1-maas-api-tls\") pod \"41ae0572-3508-4e96-bb19-300c4aafe2e1\" (UID: \"41ae0572-3508-4e96-bb19-300c4aafe2e1\") "
Jul 08 22:12:44.910670 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:44.910548    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krqn7\" (UniqueName: \"kubernetes.io/projected/41ae0572-3508-4e96-bb19-300c4aafe2e1-kube-api-access-krqn7\") pod \"41ae0572-3508-4e96-bb19-300c4aafe2e1\" (UID: \"41ae0572-3508-4e96-bb19-300c4aafe2e1\") "
Jul 08 22:12:44.910927 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:44.910898    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41ae0572-3508-4e96-bb19-300c4aafe2e1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "41ae0572-3508-4e96-bb19-300c4aafe2e1" (UID: "41ae0572-3508-4e96-bb19-300c4aafe2e1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:12:44.912920 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:44.912888    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41ae0572-3508-4e96-bb19-300c4aafe2e1-kube-api-access-krqn7" (OuterVolumeSpecName: "kube-api-access-krqn7") pod "41ae0572-3508-4e96-bb19-300c4aafe2e1" (UID: "41ae0572-3508-4e96-bb19-300c4aafe2e1"). InnerVolumeSpecName "kube-api-access-krqn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:12:44.912920 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:44.912906    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41ae0572-3508-4e96-bb19-300c4aafe2e1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "41ae0572-3508-4e96-bb19-300c4aafe2e1" (UID: "41ae0572-3508-4e96-bb19-300c4aafe2e1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 22:12:45.012243 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:45.012205    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41ae0572-3508-4e96-bb19-300c4aafe2e1-openshift-service-ca\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:12:45.012243 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:45.012237    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41ae0572-3508-4e96-bb19-300c4aafe2e1-maas-api-tls\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:12:45.012243 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:45.012247    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krqn7\" (UniqueName: \"kubernetes.io/projected/41ae0572-3508-4e96-bb19-300c4aafe2e1-kube-api-access-krqn7\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:12:45.746151 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:45.746119    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c45f56-7669495bb-6mfjb"
Jul 08 22:12:45.761843 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:45.761816    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c45f56-7669495bb-6mfjb"]
Jul 08 22:12:45.765355 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:45.765324    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c45f56-7669495bb-6mfjb"]
Jul 08 22:12:47.612171 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:47.612137    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41ae0572-3508-4e96-bb19-300c4aafe2e1" path="/var/lib/kubelet/pods/41ae0572-3508-4e96-bb19-300c4aafe2e1/volumes"
Jul 08 22:12:50.080911 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:50.080875    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"]
Jul 08 22:12:50.081564 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:50.081106    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp" podUID="d0188ee5-85ff-4eed-a30d-1e0a3eed8a95" containerName="istio-proxy" containerID="cri-o://5d91997944e6410916eece1e50e05ea4fa02647c1dd97f53617bcc233411d8b4" gracePeriod=30
Jul 08 22:12:51.175145 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:51.175114    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-ca01c9-785b88cb75-tlxld"]
Jul 08 22:12:51.175656 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:51.175363    2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ca01c9-785b88cb75-tlxld" podUID="6dc11faa-24bf-471a-8fd3-813071038c08" containerName="maas-api" containerID="cri-o://9696b75032ff185d0f12e93e08a06aa9b3c7d9ea8c695ccfe68b60ffc7fc2375" gracePeriod=30
Jul 08 22:12:51.423179 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:51.423150    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ca01c9-785b88cb75-tlxld"
Jul 08 22:12:51.462165 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:51.462089    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cg8nx\" (UniqueName: \"kubernetes.io/projected/6dc11faa-24bf-471a-8fd3-813071038c08-kube-api-access-cg8nx\") pod \"6dc11faa-24bf-471a-8fd3-813071038c08\" (UID: \"6dc11faa-24bf-471a-8fd3-813071038c08\") "
Jul 08 22:12:51.462165 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:51.462143    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6dc11faa-24bf-471a-8fd3-813071038c08-maas-api-tls\") pod \"6dc11faa-24bf-471a-8fd3-813071038c08\" (UID: \"6dc11faa-24bf-471a-8fd3-813071038c08\") "
Jul 08 22:12:51.462356 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:51.462191    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6dc11faa-24bf-471a-8fd3-813071038c08-openshift-service-ca\") pod \"6dc11faa-24bf-471a-8fd3-813071038c08\" (UID: \"6dc11faa-24bf-471a-8fd3-813071038c08\") "
Jul 08 22:12:51.462579 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:51.462556    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6dc11faa-24bf-471a-8fd3-813071038c08-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6dc11faa-24bf-471a-8fd3-813071038c08" (UID: "6dc11faa-24bf-471a-8fd3-813071038c08"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:12:51.464308 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:51.464254    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dc11faa-24bf-471a-8fd3-813071038c08-kube-api-access-cg8nx" (OuterVolumeSpecName: "kube-api-access-cg8nx") pod "6dc11faa-24bf-471a-8fd3-813071038c08" (UID: "6dc11faa-24bf-471a-8fd3-813071038c08"). InnerVolumeSpecName "kube-api-access-cg8nx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:12:51.464395 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:51.464350    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6dc11faa-24bf-471a-8fd3-813071038c08-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6dc11faa-24bf-471a-8fd3-813071038c08" (UID: "6dc11faa-24bf-471a-8fd3-813071038c08"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 22:12:51.563414 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:51.563379    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6dc11faa-24bf-471a-8fd3-813071038c08-maas-api-tls\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:12:51.563414 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:51.563405    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6dc11faa-24bf-471a-8fd3-813071038c08-openshift-service-ca\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:12:51.563414 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:51.563417    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cg8nx\" (UniqueName: \"kubernetes.io/projected/6dc11faa-24bf-471a-8fd3-813071038c08-kube-api-access-cg8nx\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:12:51.776372 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:51.776256    2569 generic.go:356] "Generic (PLEG): container finished" podID="6dc11faa-24bf-471a-8fd3-813071038c08" containerID="9696b75032ff185d0f12e93e08a06aa9b3c7d9ea8c695ccfe68b60ffc7fc2375" exitCode=0
Jul 08 22:12:51.776372 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:51.776322    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ca01c9-785b88cb75-tlxld"
Jul 08 22:12:51.776372 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:51.776342    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ca01c9-785b88cb75-tlxld" event={"ID":"6dc11faa-24bf-471a-8fd3-813071038c08","Type":"ContainerDied","Data":"9696b75032ff185d0f12e93e08a06aa9b3c7d9ea8c695ccfe68b60ffc7fc2375"}
Jul 08 22:12:51.776650 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:51.776398    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ca01c9-785b88cb75-tlxld" event={"ID":"6dc11faa-24bf-471a-8fd3-813071038c08","Type":"ContainerDied","Data":"dd6ce64ec09186f0aa7dedfeb1c1c360856b904503866d5932347bfd28e34749"}
Jul 08 22:12:51.776650 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:51.776421    2569 scope.go:117] "RemoveContainer" containerID="9696b75032ff185d0f12e93e08a06aa9b3c7d9ea8c695ccfe68b60ffc7fc2375"
Jul 08 22:12:51.784560 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:51.784540    2569 scope.go:117] "RemoveContainer" containerID="9696b75032ff185d0f12e93e08a06aa9b3c7d9ea8c695ccfe68b60ffc7fc2375"
Jul 08 22:12:51.784806 ip-10-0-131-83 kubenswrapper[2569]: E0708 22:12:51.784787    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9696b75032ff185d0f12e93e08a06aa9b3c7d9ea8c695ccfe68b60ffc7fc2375\": container with ID starting with 9696b75032ff185d0f12e93e08a06aa9b3c7d9ea8c695ccfe68b60ffc7fc2375 not found: ID does not exist" containerID="9696b75032ff185d0f12e93e08a06aa9b3c7d9ea8c695ccfe68b60ffc7fc2375"
Jul 08 22:12:51.784875 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:51.784820    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9696b75032ff185d0f12e93e08a06aa9b3c7d9ea8c695ccfe68b60ffc7fc2375"} err="failed to get container status \"9696b75032ff185d0f12e93e08a06aa9b3c7d9ea8c695ccfe68b60ffc7fc2375\": rpc error: code = NotFound desc = could not find container \"9696b75032ff185d0f12e93e08a06aa9b3c7d9ea8c695ccfe68b60ffc7fc2375\": container with ID starting with 9696b75032ff185d0f12e93e08a06aa9b3c7d9ea8c695ccfe68b60ffc7fc2375 not found: ID does not exist"
Jul 08 22:12:51.791318 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:51.791276    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-ca01c9-785b88cb75-tlxld"]
Jul 08 22:12:51.794422 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:51.794400    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-ca01c9-785b88cb75-tlxld"]
Jul 08 22:12:53.612340 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:53.612301    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6dc11faa-24bf-471a-8fd3-813071038c08" path="/var/lib/kubelet/pods/6dc11faa-24bf-471a-8fd3-813071038c08/volumes"
Jul 08 22:12:55.324705 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:55.324675    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"
Jul 08 22:12:55.393379 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:55.393354    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-istio-data\") pod \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\" (UID: \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\") "
Jul 08 22:12:55.393546 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:55.393400    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zhll2\" (UniqueName: \"kubernetes.io/projected/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-kube-api-access-zhll2\") pod \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\" (UID: \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\") "
Jul 08 22:12:55.393546 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:55.393424    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-istio-podinfo\") pod \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\" (UID: \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\") "
Jul 08 22:12:55.393546 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:55.393445    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-istiod-ca-cert\") pod \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\" (UID: \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\") "
Jul 08 22:12:55.393546 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:55.393483    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-workload-certs\") pod \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\" (UID: \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\") "
Jul 08 22:12:55.393546 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:55.393518    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-workload-socket\") pod \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\" (UID: \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\") "
Jul 08 22:12:55.393546 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:55.393536    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-credential-socket\") pod \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\" (UID: \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\") "
Jul 08 22:12:55.393840 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:55.393556    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-istio-token\") pod \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\" (UID: \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\") "
Jul 08 22:12:55.393840 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:55.393577    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-istio-envoy\") pod \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\" (UID: \"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95\") "
Jul 08 22:12:55.393990 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:55.393869    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d0188ee5-85ff-4eed-a30d-1e0a3eed8a95" (UID: "d0188ee5-85ff-4eed-a30d-1e0a3eed8a95"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:12:55.393990 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:55.393885    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d0188ee5-85ff-4eed-a30d-1e0a3eed8a95" (UID: "d0188ee5-85ff-4eed-a30d-1e0a3eed8a95"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:12:55.394115 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:55.394090    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d0188ee5-85ff-4eed-a30d-1e0a3eed8a95" (UID: "d0188ee5-85ff-4eed-a30d-1e0a3eed8a95"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:12:55.394388 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:55.394322    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d0188ee5-85ff-4eed-a30d-1e0a3eed8a95" (UID: "d0188ee5-85ff-4eed-a30d-1e0a3eed8a95"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:12:55.394575 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:55.394552    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-istio-data" (OuterVolumeSpecName: "istio-data") pod "d0188ee5-85ff-4eed-a30d-1e0a3eed8a95" (UID: "d0188ee5-85ff-4eed-a30d-1e0a3eed8a95"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:12:55.395817 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:55.395798    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d0188ee5-85ff-4eed-a30d-1e0a3eed8a95" (UID: "d0188ee5-85ff-4eed-a30d-1e0a3eed8a95"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 08 22:12:55.395817 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:55.395803    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-kube-api-access-zhll2" (OuterVolumeSpecName: "kube-api-access-zhll2") pod "d0188ee5-85ff-4eed-a30d-1e0a3eed8a95" (UID: "d0188ee5-85ff-4eed-a30d-1e0a3eed8a95"). InnerVolumeSpecName "kube-api-access-zhll2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:12:55.396371 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:55.396353    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d0188ee5-85ff-4eed-a30d-1e0a3eed8a95" (UID: "d0188ee5-85ff-4eed-a30d-1e0a3eed8a95"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:12:55.396475 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:55.396455    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-istio-token" (OuterVolumeSpecName: "istio-token") pod "d0188ee5-85ff-4eed-a30d-1e0a3eed8a95" (UID: "d0188ee5-85ff-4eed-a30d-1e0a3eed8a95"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:12:55.494596 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:55.494565    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-istio-token\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:12:55.494596 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:55.494588    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-istio-envoy\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:12:55.494596 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:55.494597    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-istio-data\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:12:55.494596 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:55.494606    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhll2\" (UniqueName: \"kubernetes.io/projected/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-kube-api-access-zhll2\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:12:55.494854 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:55.494616    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-istio-podinfo\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:12:55.494854 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:55.494623    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-istiod-ca-cert\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:12:55.494854 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:55.494631    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-workload-certs\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:12:55.494854 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:55.494638    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-workload-socket\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:12:55.494854 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:55.494645    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95-credential-socket\") on node \"ip-10-0-131-83.ec2.internal\" DevicePath \"\""
Jul 08 22:12:55.801061 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:55.800961    2569 generic.go:356] "Generic (PLEG): container finished" podID="d0188ee5-85ff-4eed-a30d-1e0a3eed8a95" containerID="5d91997944e6410916eece1e50e05ea4fa02647c1dd97f53617bcc233411d8b4" exitCode=0
Jul 08 22:12:55.801061 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:55.801021    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"
Jul 08 22:12:55.801061 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:55.801040    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp" event={"ID":"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95","Type":"ContainerDied","Data":"5d91997944e6410916eece1e50e05ea4fa02647c1dd97f53617bcc233411d8b4"}
Jul 08 22:12:55.801332 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:55.801121    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp" event={"ID":"d0188ee5-85ff-4eed-a30d-1e0a3eed8a95","Type":"ContainerDied","Data":"43d837bb133de12198a1eba3a9e49e80392cc36577063e5804f0067bc4ac1e28"}
Jul 08 22:12:55.801332 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:55.801143    2569 scope.go:117] "RemoveContainer" containerID="5d91997944e6410916eece1e50e05ea4fa02647c1dd97f53617bcc233411d8b4"
Jul 08 22:12:55.809681 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:55.809670    2569 scope.go:117] "RemoveContainer" containerID="68fbcae12ab1e6cc94c98574d9f2c71d39a678dda820adfef4aa199b54f0fdeb"
Jul 08 22:12:55.817656 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:55.817640    2569 scope.go:117] "RemoveContainer" containerID="5d91997944e6410916eece1e50e05ea4fa02647c1dd97f53617bcc233411d8b4"
Jul 08 22:12:55.817938 ip-10-0-131-83 kubenswrapper[2569]: E0708 22:12:55.817920    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d91997944e6410916eece1e50e05ea4fa02647c1dd97f53617bcc233411d8b4\": container with ID starting with 5d91997944e6410916eece1e50e05ea4fa02647c1dd97f53617bcc233411d8b4 not found: ID does not exist" containerID="5d91997944e6410916eece1e50e05ea4fa02647c1dd97f53617bcc233411d8b4"
Jul 08 22:12:55.818004 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:55.817944    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d91997944e6410916eece1e50e05ea4fa02647c1dd97f53617bcc233411d8b4"} err="failed to get container status \"5d91997944e6410916eece1e50e05ea4fa02647c1dd97f53617bcc233411d8b4\": rpc error: code = NotFound desc = could not find container \"5d91997944e6410916eece1e50e05ea4fa02647c1dd97f53617bcc233411d8b4\": container with ID starting with 5d91997944e6410916eece1e50e05ea4fa02647c1dd97f53617bcc233411d8b4 not found: ID does not exist"
Jul 08 22:12:55.818004 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:55.817958    2569 scope.go:117] "RemoveContainer" containerID="68fbcae12ab1e6cc94c98574d9f2c71d39a678dda820adfef4aa199b54f0fdeb"
Jul 08 22:12:55.818210 ip-10-0-131-83 kubenswrapper[2569]: E0708 22:12:55.818188    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68fbcae12ab1e6cc94c98574d9f2c71d39a678dda820adfef4aa199b54f0fdeb\": container with ID starting with 68fbcae12ab1e6cc94c98574d9f2c71d39a678dda820adfef4aa199b54f0fdeb not found: ID does not exist" containerID="68fbcae12ab1e6cc94c98574d9f2c71d39a678dda820adfef4aa199b54f0fdeb"
Jul 08 22:12:55.818261 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:55.818212    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68fbcae12ab1e6cc94c98574d9f2c71d39a678dda820adfef4aa199b54f0fdeb"} err="failed to get container status \"68fbcae12ab1e6cc94c98574d9f2c71d39a678dda820adfef4aa199b54f0fdeb\": rpc error: code = NotFound desc = could not find container \"68fbcae12ab1e6cc94c98574d9f2c71d39a678dda820adfef4aa199b54f0fdeb\": container with ID starting with 68fbcae12ab1e6cc94c98574d9f2c71d39a678dda820adfef4aa199b54f0fdeb not found: ID does not exist"
Jul 08 22:12:55.818807 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:55.818789    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"]
Jul 08 22:12:55.822600 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:55.822577    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-c45f56-openshift-default-65b5464959-l4bfp"]
Jul 08 22:12:57.613142 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:57.613111    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0188ee5-85ff-4eed-a30d-1e0a3eed8a95" path="/var/lib/kubelet/pods/d0188ee5-85ff-4eed-a30d-1e0a3eed8a95/volumes"
Jul 08 22:12:57.656306 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:57.656257    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6cs4g_a022d640-79f0-4d35-be9a-9c6ac708d10b/ovn-acl-logging/0.log"
Jul 08 22:12:57.658529 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:12:57.658508    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6cs4g_a022d640-79f0-4d35-be9a-9c6ac708d10b/ovn-acl-logging/0.log"
Jul 08 22:13:02.406900 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:02.406866    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-695b55744f-9mdpv_4f8d0932-ecb8-48a8-88f9-93404d35e422/manager/0.log"
Jul 08 22:13:02.875839 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:02.875745    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-697f9f6747-j4fkf_311e0f15-cd19-4f00-9770-2c15217b7c1f/manager/0.log"
Jul 08 22:13:02.881182 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:02.881161    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-697f9f6747-j4fkf_311e0f15-cd19-4f00-9770-2c15217b7c1f/copy-manifests/0.log"
Jul 08 22:13:05.501527 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:05.501497    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-czj5t_285ec293-34e7-4e34-a97b-95e2b44d94e0/discovery/0.log"
Jul 08 22:13:05.949755 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:05.949722    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-8r7ss_a22bc284-b6bc-4dfe-b2fc-a2e6838441ac/payload-pre-processing/0.log"
Jul 08 22:13:06.068904 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:06.068872    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-zh7w7_806002e7-9884-45f8-86b0-fc291ae52159/payload-processing/0.log"
Jul 08 22:13:06.503336 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:06.503280    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-hrxrx_70bed7d3-110f-4207-8870-ee2bed023b26/main/0.log"
Jul 08 22:13:06.720196 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:06.720162    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-f4mpl_ee0021cd-5293-482b-9a8d-4a65fc6154b5/main/0.log"
Jul 08 22:13:13.750182 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:13.750142    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-pmsd9_863b1cfe-1f2f-426e-9a5e-c6aee4205013/global-pull-secret-syncer/0.log"
Jul 08 22:13:13.877071 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:13.877031    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hhqv4_e7921e50-7309-4703-8a27-a9e51260d4a0/konnectivity-agent/0.log"
Jul 08 22:13:13.958946 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:13.958910    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-83.ec2.internal_53be9f26ebbce9e8712878906521c6f8/haproxy/0.log"
Jul 08 22:13:21.289040 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:21.289011    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jpv5h_9ad794e7-84bd-4227-b444-4a136303fbcc/node-exporter/0.log"
Jul 08 22:13:21.317461 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:21.317427    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jpv5h_9ad794e7-84bd-4227-b444-4a136303fbcc/kube-rbac-proxy/0.log"
Jul 08 22:13:21.342432 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:21.342411    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jpv5h_9ad794e7-84bd-4227-b444-4a136303fbcc/init-textfile/0.log"
Jul 08 22:13:21.586699 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:21.586624    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_616cabd0-d6cc-4d63-bb79-b17309267714/prometheus/0.log"
Jul 08 22:13:21.607435 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:21.607411    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_616cabd0-d6cc-4d63-bb79-b17309267714/config-reloader/0.log"
Jul 08 22:13:21.627867 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:21.627827    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_616cabd0-d6cc-4d63-bb79-b17309267714/thanos-sidecar/0.log"
Jul 08 22:13:21.649730 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:21.649704    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_616cabd0-d6cc-4d63-bb79-b17309267714/kube-rbac-proxy-web/0.log"
Jul 08 22:13:21.678139 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:21.678109    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_616cabd0-d6cc-4d63-bb79-b17309267714/kube-rbac-proxy/0.log"
Jul 08 22:13:21.699646 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:21.699625    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_616cabd0-d6cc-4d63-bb79-b17309267714/kube-rbac-proxy-thanos/0.log"
Jul 08 22:13:21.723210 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:21.723191    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_616cabd0-d6cc-4d63-bb79-b17309267714/init-config-reloader/0.log"
Jul 08 22:13:21.753740 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:21.753713    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-c66mk_1f5acf9f-3a72-4646-9cb7-5d94b2eff7e8/prometheus-operator/0.log"
Jul 08 22:13:21.769100 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:21.769078    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-c66mk_1f5acf9f-3a72-4646-9cb7-5d94b2eff7e8/kube-rbac-proxy/0.log"
Jul 08 22:13:24.402904 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:24.402866    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rf8nv/perf-node-gather-daemonset-rh9gj"]
Jul 08 22:13:24.403273 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:24.403181    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dc11faa-24bf-471a-8fd3-813071038c08" containerName="maas-api"
Jul 08 22:13:24.403273 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:24.403192    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dc11faa-24bf-471a-8fd3-813071038c08" containerName="maas-api"
Jul 08 22:13:24.403273 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:24.403200    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41ae0572-3508-4e96-bb19-300c4aafe2e1" containerName="maas-api"
Jul 08 22:13:24.403273 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:24.403205    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="41ae0572-3508-4e96-bb19-300c4aafe2e1" containerName="maas-api"
Jul 08 22:13:24.403273 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:24.403218    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0188ee5-85ff-4eed-a30d-1e0a3eed8a95" containerName="istio-proxy"
Jul 08 22:13:24.403273 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:24.403223    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0188ee5-85ff-4eed-a30d-1e0a3eed8a95" containerName="istio-proxy"
Jul 08 22:13:24.403273 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:24.403234    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0188ee5-85ff-4eed-a30d-1e0a3eed8a95" containerName="istio-proxy"
Jul 08 22:13:24.403273 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:24.403239    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0188ee5-85ff-4eed-a30d-1e0a3eed8a95" containerName="istio-proxy"
Jul 08 22:13:24.403561 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:24.403321    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0188ee5-85ff-4eed-a30d-1e0a3eed8a95" containerName="istio-proxy"
Jul 08 22:13:24.403561 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:24.403329    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0188ee5-85ff-4eed-a30d-1e0a3eed8a95" containerName="istio-proxy"
Jul 08 22:13:24.403561 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:24.403336    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="41ae0572-3508-4e96-bb19-300c4aafe2e1" containerName="maas-api"
Jul 08 22:13:24.403561 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:24.403342    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dc11faa-24bf-471a-8fd3-813071038c08" containerName="maas-api"
Jul 08 22:13:24.406464 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:24.406446    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rf8nv/perf-node-gather-daemonset-rh9gj"
Jul 08 22:13:24.410144 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:24.410118    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rf8nv\"/\"openshift-service-ca.crt\""
Jul 08 22:13:24.410277 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:24.410117    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rf8nv\"/\"kube-root-ca.crt\""
Jul 08 22:13:24.410898 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:24.410883    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rf8nv\"/\"default-dockercfg-zdh2k\""
Jul 08 22:13:24.414135 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:24.414114    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rf8nv/perf-node-gather-daemonset-rh9gj"]
Jul 08 22:13:24.557812 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:24.557773    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c6d4c3cb-45e7-47bc-97cc-27c8677365d1-proc\") pod \"perf-node-gather-daemonset-rh9gj\" (UID: \"c6d4c3cb-45e7-47bc-97cc-27c8677365d1\") " pod="openshift-must-gather-rf8nv/perf-node-gather-daemonset-rh9gj"
Jul 08 22:13:24.557812 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:24.557816    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hchs\" (UniqueName: \"kubernetes.io/projected/c6d4c3cb-45e7-47bc-97cc-27c8677365d1-kube-api-access-9hchs\") pod \"perf-node-gather-daemonset-rh9gj\" (UID: \"c6d4c3cb-45e7-47bc-97cc-27c8677365d1\") " pod="openshift-must-gather-rf8nv/perf-node-gather-daemonset-rh9gj"
Jul 08 22:13:24.558041 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:24.557840    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c6d4c3cb-45e7-47bc-97cc-27c8677365d1-sys\") pod \"perf-node-gather-daemonset-rh9gj\" (UID: \"c6d4c3cb-45e7-47bc-97cc-27c8677365d1\") " pod="openshift-must-gather-rf8nv/perf-node-gather-daemonset-rh9gj"
Jul 08 22:13:24.558041 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:24.557859    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c6d4c3cb-45e7-47bc-97cc-27c8677365d1-lib-modules\") pod \"perf-node-gather-daemonset-rh9gj\" (UID: \"c6d4c3cb-45e7-47bc-97cc-27c8677365d1\") " pod="openshift-must-gather-rf8nv/perf-node-gather-daemonset-rh9gj"
Jul 08 22:13:24.558041 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:24.557876    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c6d4c3cb-45e7-47bc-97cc-27c8677365d1-podres\") pod \"perf-node-gather-daemonset-rh9gj\" (UID: \"c6d4c3cb-45e7-47bc-97cc-27c8677365d1\") " pod="openshift-must-gather-rf8nv/perf-node-gather-daemonset-rh9gj"
Jul 08 22:13:24.658622 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:24.658527    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c6d4c3cb-45e7-47bc-97cc-27c8677365d1-proc\") pod \"perf-node-gather-daemonset-rh9gj\" (UID: \"c6d4c3cb-45e7-47bc-97cc-27c8677365d1\") " pod="openshift-must-gather-rf8nv/perf-node-gather-daemonset-rh9gj"
Jul 08 22:13:24.658622 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:24.658578    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hchs\" (UniqueName: \"kubernetes.io/projected/c6d4c3cb-45e7-47bc-97cc-27c8677365d1-kube-api-access-9hchs\") pod \"perf-node-gather-daemonset-rh9gj\" (UID: \"c6d4c3cb-45e7-47bc-97cc-27c8677365d1\") " pod="openshift-must-gather-rf8nv/perf-node-gather-daemonset-rh9gj"
Jul 08 22:13:24.658622 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:24.658604    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c6d4c3cb-45e7-47bc-97cc-27c8677365d1-sys\") pod \"perf-node-gather-daemonset-rh9gj\" (UID: \"c6d4c3cb-45e7-47bc-97cc-27c8677365d1\") " pod="openshift-must-gather-rf8nv/perf-node-gather-daemonset-rh9gj"
Jul 08 22:13:24.658883 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:24.658628    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c6d4c3cb-45e7-47bc-97cc-27c8677365d1-lib-modules\") pod \"perf-node-gather-daemonset-rh9gj\" (UID: \"c6d4c3cb-45e7-47bc-97cc-27c8677365d1\") " pod="openshift-must-gather-rf8nv/perf-node-gather-daemonset-rh9gj"
Jul 08 22:13:24.658883 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:24.658652    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c6d4c3cb-45e7-47bc-97cc-27c8677365d1-podres\") pod \"perf-node-gather-daemonset-rh9gj\" (UID: \"c6d4c3cb-45e7-47bc-97cc-27c8677365d1\") " pod="openshift-must-gather-rf8nv/perf-node-gather-daemonset-rh9gj"
Jul 08 22:13:24.658883 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:24.658679    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c6d4c3cb-45e7-47bc-97cc-27c8677365d1-sys\") pod \"perf-node-gather-daemonset-rh9gj\" (UID: \"c6d4c3cb-45e7-47bc-97cc-27c8677365d1\") " pod="openshift-must-gather-rf8nv/perf-node-gather-daemonset-rh9gj"
Jul 08 22:13:24.658883 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:24.658680    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c6d4c3cb-45e7-47bc-97cc-27c8677365d1-proc\") pod \"perf-node-gather-daemonset-rh9gj\" (UID: \"c6d4c3cb-45e7-47bc-97cc-27c8677365d1\") " pod="openshift-must-gather-rf8nv/perf-node-gather-daemonset-rh9gj"
Jul 08 22:13:24.658883 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:24.658781    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c6d4c3cb-45e7-47bc-97cc-27c8677365d1-lib-modules\") pod \"perf-node-gather-daemonset-rh9gj\" (UID: \"c6d4c3cb-45e7-47bc-97cc-27c8677365d1\") " pod="openshift-must-gather-rf8nv/perf-node-gather-daemonset-rh9gj"
Jul 08 22:13:24.658883 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:24.658800    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c6d4c3cb-45e7-47bc-97cc-27c8677365d1-podres\") pod \"perf-node-gather-daemonset-rh9gj\" (UID: \"c6d4c3cb-45e7-47bc-97cc-27c8677365d1\") " pod="openshift-must-gather-rf8nv/perf-node-gather-daemonset-rh9gj"
Jul 08 22:13:24.665933 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:24.665899    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hchs\" (UniqueName: \"kubernetes.io/projected/c6d4c3cb-45e7-47bc-97cc-27c8677365d1-kube-api-access-9hchs\") pod \"perf-node-gather-daemonset-rh9gj\" (UID: \"c6d4c3cb-45e7-47bc-97cc-27c8677365d1\") " pod="openshift-must-gather-rf8nv/perf-node-gather-daemonset-rh9gj"
Jul 08 22:13:24.716935 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:24.716907    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rf8nv/perf-node-gather-daemonset-rh9gj"
Jul 08 22:13:24.846494 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:24.846464    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rf8nv/perf-node-gather-daemonset-rh9gj"]
Jul 08 22:13:24.848891 ip-10-0-131-83 kubenswrapper[2569]: W0708 22:13:24.848866    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc6d4c3cb_45e7_47bc_97cc_27c8677365d1.slice/crio-bb0f317b4f19c174eb199c668550a64fb493f481a5e7588192be7e259f5dd98a WatchSource:0}: Error finding container bb0f317b4f19c174eb199c668550a64fb493f481a5e7588192be7e259f5dd98a: Status 404 returned error can't find the container with id bb0f317b4f19c174eb199c668550a64fb493f481a5e7588192be7e259f5dd98a
Jul 08 22:13:24.934045 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:24.933951    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rf8nv/perf-node-gather-daemonset-rh9gj" event={"ID":"c6d4c3cb-45e7-47bc-97cc-27c8677365d1","Type":"ContainerStarted","Data":"b8783ea8ad999bd7ee11153d978eec8ee0918eaa00a9654c20d43a6f11518ffa"}
Jul 08 22:13:24.934045 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:24.934010    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rf8nv/perf-node-gather-daemonset-rh9gj" event={"ID":"c6d4c3cb-45e7-47bc-97cc-27c8677365d1","Type":"ContainerStarted","Data":"bb0f317b4f19c174eb199c668550a64fb493f481a5e7588192be7e259f5dd98a"}
Jul 08 22:13:24.934045 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:24.934030    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rf8nv/perf-node-gather-daemonset-rh9gj"
Jul 08 22:13:24.948670 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:24.948610    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rf8nv/perf-node-gather-daemonset-rh9gj" podStartSLOduration=0.948590637 podStartE2EDuration="948.590637ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:13:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:13:24.947939106 +0000 UTC m=+2427.886271522" watchObservedRunningTime="2026-07-08 22:13:24.948590637 +0000 UTC m=+2427.886923038"
Jul 08 22:13:26.223974 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:26.223935    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wp7gn_519c6282-5e7c-4c40-bf12-c64727f8ab86/dns/0.log"
Jul 08 22:13:26.243047 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:26.243024    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wp7gn_519c6282-5e7c-4c40-bf12-c64727f8ab86/kube-rbac-proxy/0.log"
Jul 08 22:13:26.263626 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:26.263606    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5wfz7_1cdf17b8-152a-4cca-9050-ef85d4131f91/dns-node-resolver/0.log"
Jul 08 22:13:26.920106 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:26.920082    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mdr2r_6f70df4a-7077-418a-9afe-02c4e6792fcc/node-ca/0.log"
Jul 08 22:13:28.008182 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:28.008146    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-czj5t_285ec293-34e7-4e34-a97b-95e2b44d94e0/discovery/0.log"
Jul 08 22:13:28.219754 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:28.219719    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-8r7ss_a22bc284-b6bc-4dfe-b2fc-a2e6838441ac/payload-pre-processing/0.log"
Jul 08 22:13:28.303186 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:28.303096    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-zh7w7_806002e7-9884-45f8-86b0-fc291ae52159/payload-processing/0.log"
Jul 08 22:13:28.991184 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:28.991151    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4ppnj_3fd2f0f8-98cb-4352-b6bd-3f7ef41af8de/serve-healthcheck-canary/0.log"
Jul 08 22:13:29.581791 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:29.581760    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j4qdz_01ac1d4d-312a-4c8e-972a-ac9543c11c52/kube-rbac-proxy/0.log"
Jul 08 22:13:29.600840 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:29.600819    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j4qdz_01ac1d4d-312a-4c8e-972a-ac9543c11c52/exporter/0.log"
Jul 08 22:13:29.621635 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:29.621604    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j4qdz_01ac1d4d-312a-4c8e-972a-ac9543c11c52/extractor/0.log"
Jul 08 22:13:30.948128 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:30.948099    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rf8nv/perf-node-gather-daemonset-rh9gj"
Jul 08 22:13:32.072426 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:32.072391    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-695b55744f-9mdpv_4f8d0932-ecb8-48a8-88f9-93404d35e422/manager/0.log"
Jul 08 22:13:32.298573 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:32.298536    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-697f9f6747-j4fkf_311e0f15-cd19-4f00-9770-2c15217b7c1f/manager/0.log"
Jul 08 22:13:32.317046 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:32.317019    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-697f9f6747-j4fkf_311e0f15-cd19-4f00-9770-2c15217b7c1f/copy-manifests/0.log"
Jul 08 22:13:33.683587 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:33.683547    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5947469944-tdgk4_8131d178-f3e1-44ad-ba15-796677ad213a/manager/0.log"
Jul 08 22:13:34.400436 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:34.400393    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-czj5t_285ec293-34e7-4e34-a97b-95e2b44d94e0/discovery/0.log"
Jul 08 22:13:34.534882 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:34.534783    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-8r7ss_a22bc284-b6bc-4dfe-b2fc-a2e6838441ac/payload-pre-processing/0.log"
Jul 08 22:13:34.595570 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:34.595531    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-zh7w7_806002e7-9884-45f8-86b0-fc291ae52159/payload-processing/0.log"
Jul 08 22:13:35.969924 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:35.969848    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-czj5t_285ec293-34e7-4e34-a97b-95e2b44d94e0/discovery/0.log"
Jul 08 22:13:36.111163 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:36.111131    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-8r7ss_a22bc284-b6bc-4dfe-b2fc-a2e6838441ac/payload-pre-processing/0.log"
Jul 08 22:13:36.175396 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:36.175361    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-zh7w7_806002e7-9884-45f8-86b0-fc291ae52159/payload-processing/0.log"
Jul 08 22:13:38.862165 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:38.862137    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-dp8p7_d9b15199-4f38-4e8c-b9a6-917b2f1ba64d/migrator/0.log"
Jul 08 22:13:38.882358 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:38.882331    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-dp8p7_d9b15199-4f38-4e8c-b9a6-917b2f1ba64d/graceful-termination/0.log"
Jul 08 22:13:40.686629 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:40.686606    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wbw7t_773e320a-2215-4512-a09c-2249707f24f7/kube-multus-additional-cni-plugins/0.log"
Jul 08 22:13:40.709235 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:40.709210    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wbw7t_773e320a-2215-4512-a09c-2249707f24f7/egress-router-binary-copy/0.log"
Jul 08 22:13:40.728888 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:40.728860    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wbw7t_773e320a-2215-4512-a09c-2249707f24f7/cni-plugins/0.log"
Jul 08 22:13:40.747333 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:40.747311    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wbw7t_773e320a-2215-4512-a09c-2249707f24f7/bond-cni-plugin/0.log"
Jul 08 22:13:40.767027 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:40.767004    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wbw7t_773e320a-2215-4512-a09c-2249707f24f7/routeoverride-cni/0.log"
Jul 08 22:13:40.786364 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:40.786347    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wbw7t_773e320a-2215-4512-a09c-2249707f24f7/whereabouts-cni-bincopy/0.log"
Jul 08 22:13:40.805994 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:40.805974    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wbw7t_773e320a-2215-4512-a09c-2249707f24f7/whereabouts-cni/0.log"
Jul 08 22:13:40.843453 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:40.843427    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-bgl2j_24a0bf73-fc2c-4fea-9e48-4692b50c95fc/kube-multus/0.log"
Jul 08 22:13:40.942402 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:40.942320    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xnzfd_6dbaf20f-e3bc-4428-9365-fd159b742280/network-metrics-daemon/0.log"
Jul 08 22:13:40.960096 ip-10-0-131-83 kubenswrapper[2569]: I0708 22:13:40.960069    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xnzfd_6dbaf20f-e3bc-4428-9365-fd159b742280/kube-rbac-proxy/0.log"