Jul 31 21:59:49.289377 ip-10-0-130-191 systemd[1]: Starting Kubernetes Kubelet...
Jul 31 21:59:49.603549 ip-10-0-130-191 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 31 21:59:49.603549 ip-10-0-130-191 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 31 21:59:49.603549 ip-10-0-130-191 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 31 21:59:49.603549 ip-10-0-130-191 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 31 21:59:49.603549 ip-10-0-130-191 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 31 21:59:49.605100 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.605009    2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 31 21:59:49.610326 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610301    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 21:59:49.610423 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610415    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 21:59:49.610423 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610421    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 21:59:49.610423 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610425    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 21:59:49.610503 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610428    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 21:59:49.610503 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610431    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 21:59:49.610503 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610434    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 21:59:49.610503 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610437    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 21:59:49.610503 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610442    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 21:59:49.610503 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610445    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 21:59:49.610503 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610448    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 21:59:49.610503 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610450    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 21:59:49.610503 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610454    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 21:59:49.610503 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610457    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 21:59:49.610503 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610461    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 21:59:49.610503 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610465    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 21:59:49.610503 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610468    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 21:59:49.610503 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610472    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 21:59:49.610503 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610475    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 21:59:49.610503 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610479    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 21:59:49.610503 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610481    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 21:59:49.610503 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610484    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 21:59:49.610503 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610487    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 21:59:49.610971 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610491    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 21:59:49.610971 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610494    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 21:59:49.610971 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610497    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 21:59:49.610971 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610500    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 21:59:49.610971 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610503    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 21:59:49.610971 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610506    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 21:59:49.610971 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610509    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 21:59:49.610971 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610514    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 21:59:49.610971 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610518    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 21:59:49.610971 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610520    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 21:59:49.610971 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610523    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 21:59:49.610971 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610526    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 21:59:49.610971 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610529    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 21:59:49.610971 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610532    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 21:59:49.610971 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610534    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 21:59:49.610971 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610537    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 21:59:49.610971 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610540    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 21:59:49.610971 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610542    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 21:59:49.610971 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610544    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 21:59:49.610971 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610547    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 21:59:49.611453 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610549    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 21:59:49.611453 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610552    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 21:59:49.611453 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610555    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 21:59:49.611453 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610557    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 21:59:49.611453 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610560    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 21:59:49.611453 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610562    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 21:59:49.611453 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610565    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 21:59:49.611453 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610567    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 21:59:49.611453 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610570    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 21:59:49.611453 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610572    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 21:59:49.611453 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610575    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 21:59:49.611453 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610578    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 21:59:49.611453 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610584    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 21:59:49.611453 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610588    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 21:59:49.611453 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610591    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 21:59:49.611453 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610594    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 21:59:49.611453 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610597    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 21:59:49.611453 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610600    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 21:59:49.611453 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610603    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 21:59:49.611921 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610605    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 21:59:49.611921 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610608    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 21:59:49.611921 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610611    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 21:59:49.611921 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610613    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 21:59:49.611921 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610616    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 21:59:49.611921 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610619    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 21:59:49.611921 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610621    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 21:59:49.611921 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610624    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 21:59:49.611921 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610627    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 21:59:49.611921 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610629    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 21:59:49.611921 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610632    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 21:59:49.611921 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610634    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 21:59:49.611921 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610637    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 21:59:49.611921 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610640    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 21:59:49.611921 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610642    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 21:59:49.611921 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610645    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 21:59:49.611921 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610647    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 21:59:49.611921 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610651    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 21:59:49.611921 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610653    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 21:59:49.611921 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610656    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 21:59:49.612399 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610659    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 21:59:49.612399 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610662    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 21:59:49.612399 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610665    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 21:59:49.612399 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610669    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 21:59:49.612399 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610672    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 21:59:49.612399 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610676    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 21:59:49.612399 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610679    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 21:59:49.612399 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610682    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 21:59:49.612399 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610685    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 21:59:49.612399 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610688    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 21:59:49.612399 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610691    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 21:59:49.612399 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610694    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 21:59:49.612399 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610696    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 21:59:49.612399 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610699    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 21:59:49.612399 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610702    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 21:59:49.612399 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610705    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 21:59:49.612399 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.610707    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 21:59:49.612399 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612045    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 21:59:49.612399 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612054    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 21:59:49.612870 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612058    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 21:59:49.612870 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612061    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 21:59:49.612870 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612064    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 21:59:49.612870 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612067    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 21:59:49.612870 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612070    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 21:59:49.612870 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612073    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 21:59:49.612870 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612076    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 21:59:49.612870 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612078    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 21:59:49.612870 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612081    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 21:59:49.612870 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612083    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 21:59:49.612870 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612086    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 21:59:49.612870 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612088    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 21:59:49.612870 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612091    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 21:59:49.612870 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612093    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 21:59:49.612870 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612096    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 21:59:49.612870 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612099    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 21:59:49.612870 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612103    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 21:59:49.612870 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612106    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 21:59:49.612870 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612108    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 21:59:49.613347 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612111    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 21:59:49.613347 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612114    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 21:59:49.613347 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612116    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 21:59:49.613347 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612119    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 21:59:49.613347 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612121    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 21:59:49.613347 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612124    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 21:59:49.613347 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612127    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 21:59:49.613347 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612129    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 21:59:49.613347 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612132    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 21:59:49.613347 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612134    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 21:59:49.613347 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612137    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 21:59:49.613347 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612139    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 21:59:49.613347 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612142    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 21:59:49.613347 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612144    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 21:59:49.613347 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612147    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 21:59:49.613347 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612149    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 21:59:49.613347 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612152    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 21:59:49.613347 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612155    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 21:59:49.613347 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612157    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 21:59:49.613347 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612160    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 21:59:49.613962 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612162    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 21:59:49.613962 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612165    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 21:59:49.613962 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612168    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 21:59:49.613962 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612171    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 21:59:49.613962 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612174    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 21:59:49.613962 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612176    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 21:59:49.613962 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612180    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 21:59:49.613962 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612184    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 21:59:49.613962 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612188    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 21:59:49.613962 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612192    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 21:59:49.613962 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612195    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 21:59:49.613962 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612197    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 21:59:49.613962 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612200    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 21:59:49.613962 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612203    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 21:59:49.613962 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612206    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 21:59:49.613962 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612208    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 21:59:49.613962 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612211    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 21:59:49.613962 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612214    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 21:59:49.613962 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612216    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 21:59:49.614432 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612219    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 21:59:49.614432 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612222    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 21:59:49.614432 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612224    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 21:59:49.614432 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612227    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 21:59:49.614432 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612230    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 21:59:49.614432 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612232    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 21:59:49.614432 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612235    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 21:59:49.614432 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612237    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 21:59:49.614432 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612240    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 21:59:49.614432 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612243    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 21:59:49.614432 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612246    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 21:59:49.614432 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612248    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 21:59:49.614432 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612251    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 21:59:49.614432 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612254    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 21:59:49.614432 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612256    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 21:59:49.614432 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612259    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 21:59:49.614432 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612261    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 21:59:49.614432 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612264    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 21:59:49.614432 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612267    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 21:59:49.614432 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612269    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 21:59:49.614432 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612272    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 21:59:49.614958 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612274    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 21:59:49.614958 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612278    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 21:59:49.614958 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612281    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 21:59:49.614958 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612284    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 21:59:49.614958 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612287    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 21:59:49.614958 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612289    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 21:59:49.614958 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612292    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 21:59:49.614958 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612294    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 21:59:49.614958 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612297    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 21:59:49.614958 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612299    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 21:59:49.614958 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612302    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 21:59:49.614958 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612305    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 21:59:49.614958 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612307    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 21:59:49.614958 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612310    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 21:59:49.614958 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612313    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 21:59:49.614958 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612315    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 21:59:49.614958 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612318    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 21:59:49.614958 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.612320    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 21:59:49.614958 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613164    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 21:59:49.615426 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613172    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 21:59:49.615426 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613176    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 21:59:49.615426 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613180    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 21:59:49.615426 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613183    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 21:59:49.615426 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613186    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 21:59:49.615426 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613188    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 21:59:49.615426 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613191    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 21:59:49.615426 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613194    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 21:59:49.615426 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613196    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 21:59:49.615426 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613199    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 21:59:49.615426 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613201    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 21:59:49.615426 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613204    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 21:59:49.615426 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613206    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 21:59:49.615426 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613210    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 21:59:49.615426 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613212    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 21:59:49.615426 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613216    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 21:59:49.615426 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613219    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 21:59:49.615426 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613222    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 21:59:49.615426 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613225    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 21:59:49.615426 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613227    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 21:59:49.615935 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613230    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 21:59:49.615935 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613232    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 21:59:49.615935 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613235    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 21:59:49.615935 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613237    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 21:59:49.615935 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613240    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 21:59:49.615935 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613242    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 21:59:49.615935 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613245    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 21:59:49.615935 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613248    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 21:59:49.615935 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613250    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 21:59:49.615935 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613253    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 21:59:49.615935 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613255    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 21:59:49.615935 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613257    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 21:59:49.615935 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613260    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 21:59:49.615935 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613263    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 21:59:49.615935 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613265    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 21:59:49.615935 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613268    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 21:59:49.615935 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613270    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 21:59:49.615935 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613273    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 21:59:49.615935 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613275    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 21:59:49.615935 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613278    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 21:59:49.616424 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613280    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 21:59:49.616424 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613283    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 21:59:49.616424 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613285    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 21:59:49.616424 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613288    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 21:59:49.616424 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613290    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 21:59:49.616424 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613293    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 21:59:49.616424 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613296    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 21:59:49.616424 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613298    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 21:59:49.616424 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613301    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 21:59:49.616424 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613304    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 21:59:49.616424 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613306    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 21:59:49.616424 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613309    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 21:59:49.616424 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613311    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 21:59:49.616424 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613314    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 21:59:49.616424 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613316    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 21:59:49.616424 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613319    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 21:59:49.616424 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613321    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 21:59:49.616424 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613325    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 21:59:49.616424 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613329    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 21:59:49.616936 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613331    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 21:59:49.616936 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613334    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 21:59:49.616936 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613337    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 21:59:49.616936 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613339    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 21:59:49.616936 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613342    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 21:59:49.616936 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613344    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 21:59:49.616936 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613347    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 21:59:49.616936 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613349    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 21:59:49.616936 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613352    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 21:59:49.616936 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613355    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 21:59:49.616936 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613358    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 21:59:49.616936 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613360    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 21:59:49.616936 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613363    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 21:59:49.616936 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613366    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 21:59:49.616936 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613368    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 21:59:49.616936 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613370    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 21:59:49.616936 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613373    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 21:59:49.616936 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613376    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 21:59:49.616936 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613380    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 21:59:49.616936 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613383    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 21:59:49.617422 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613385    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 21:59:49.617422 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613388    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 21:59:49.617422 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613391    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 21:59:49.617422 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613394    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 21:59:49.617422 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613396    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 21:59:49.617422 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613399    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 21:59:49.617422 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613401    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 21:59:49.617422 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613404    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 21:59:49.617422 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613406    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 21:59:49.617422 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613409    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 21:59:49.617422 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613411    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 21:59:49.617422 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613413    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 21:59:49.617422 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613416    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 21:59:49.617422 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613420    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 21:59:49.617422 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613423    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 21:59:49.617422 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613426    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 21:59:49.617422 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613429    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 21:59:49.617422 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613432    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 21:59:49.617422 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.613434    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 21:59:49.617422 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613494    2573 flags.go:64] FLAG: --address="0.0.0.0"
Jul 31 21:59:49.617933 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613500    2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 31 21:59:49.617933 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613506    2573 flags.go:64] FLAG: --anonymous-auth="true"
Jul 31 21:59:49.617933 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613511    2573 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 31 21:59:49.617933 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613518    2573 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 31 21:59:49.617933 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613521    2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 31 21:59:49.617933 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613525    2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 31 21:59:49.617933 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613528    2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 31 21:59:49.617933 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613532    2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 31 21:59:49.617933 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613534    2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 31 21:59:49.617933 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613538    2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 31 21:59:49.617933 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613541    2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 31 21:59:49.617933 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613545    2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 31 21:59:49.617933 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613548    2573 flags.go:64] FLAG: --cgroup-root=""
Jul 31 21:59:49.617933 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613550    2573 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 31 21:59:49.617933 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613553    2573 flags.go:64] FLAG: --client-ca-file=""
Jul 31 21:59:49.617933 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613557    2573 flags.go:64] FLAG: --cloud-provider="external"
Jul 31 21:59:49.617933 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613561    2573 flags.go:64] FLAG: --cluster-dns="[]"
Jul 31 21:59:49.617933 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613565    2573 flags.go:64] FLAG: --cluster-domain=""
Jul 31 21:59:49.617933 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613568    2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 31 21:59:49.617933 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613571    2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 31 21:59:49.617933 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613574    2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 31 21:59:49.617933 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613577    2573 flags.go:64] FLAG: --container-log-max-files="5"
Jul 31 21:59:49.617933 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613581    2573 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 31 21:59:49.617933 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613583    2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 31 21:59:49.618527 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613586    2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 31 21:59:49.618527 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613590    2573 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 31 21:59:49.618527 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613593    2573 flags.go:64] FLAG: --contention-profiling="false"
Jul 31 21:59:49.618527 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613596    2573 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 31 21:59:49.618527 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613599    2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 31 21:59:49.618527 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613602    2573 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 31 21:59:49.618527 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613605    2573 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 31 21:59:49.618527 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613608    2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 31 21:59:49.618527 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613612    2573 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 31 21:59:49.618527 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613615    2573 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 31 21:59:49.618527 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613617    2573 flags.go:64] FLAG: --enable-load-reader="false"
Jul 31 21:59:49.618527 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613620    2573 flags.go:64] FLAG: --enable-server="true"
Jul 31 21:59:49.618527 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613623    2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 31 21:59:49.618527 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613628    2573 flags.go:64] FLAG: --event-burst="100"
Jul 31 21:59:49.618527 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613631    2573 flags.go:64] FLAG: --event-qps="50"
Jul 31 21:59:49.618527 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613634    2573 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 31 21:59:49.618527 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613636    2573 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 31 21:59:49.618527 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613639    2573 flags.go:64] FLAG: --eviction-hard=""
Jul 31 21:59:49.618527 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613643    2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 31 21:59:49.618527 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613646    2573 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 31 21:59:49.618527 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613649    2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 31 21:59:49.618527 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613652    2573 flags.go:64] FLAG: --eviction-soft=""
Jul 31 21:59:49.618527 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613655    2573 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 31 21:59:49.618527 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613658    2573 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 31 21:59:49.618527 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613662    2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 31 21:59:49.619166 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613665    2573 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 31 21:59:49.619166 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613668    2573 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 31 21:59:49.619166 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613671    2573 flags.go:64] FLAG: --fail-swap-on="true"
Jul 31 21:59:49.619166 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613673    2573 flags.go:64] FLAG: --feature-gates=""
Jul 31 21:59:49.619166 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613677    2573 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 31 21:59:49.619166 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613681    2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 31 21:59:49.619166 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613684    2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 31 21:59:49.619166 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613687    2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 31 21:59:49.619166 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613693    2573 flags.go:64] FLAG: --healthz-port="10248"
Jul 31 21:59:49.619166 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613696    2573 flags.go:64] FLAG: --help="false"
Jul 31 21:59:49.619166 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613699    2573 flags.go:64] FLAG: --hostname-override="ip-10-0-130-191.ec2.internal"
Jul 31 21:59:49.619166 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613704    2573 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 31 21:59:49.619166 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613707    2573 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 31 21:59:49.619166 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613710    2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 31 21:59:49.619166 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613713    2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 31 21:59:49.619166 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613716    2573 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 31 21:59:49.619166 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613719    2573 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 31 21:59:49.619166 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613724    2573 flags.go:64] FLAG: --image-service-endpoint=""
Jul 31 21:59:49.619166 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613727    2573 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 31 21:59:49.619166 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613730    2573 flags.go:64] FLAG: --kube-api-burst="100"
Jul 31 21:59:49.619166 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613733    2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 31 21:59:49.619166 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613736    2573 flags.go:64] FLAG: --kube-api-qps="50"
Jul 31 21:59:49.619166 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613739    2573 flags.go:64] FLAG: --kube-reserved=""
Jul 31 21:59:49.619166 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613741    2573 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 31 21:59:49.619769 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613744    2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 31 21:59:49.619769 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613748    2573 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 31 21:59:49.619769 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613750    2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 31 21:59:49.619769 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613753    2573 flags.go:64] FLAG: --lock-file=""
Jul 31 21:59:49.619769 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613756    2573 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 31 21:59:49.619769 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613759    2573 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 31 21:59:49.619769 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613762    2573 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 31 21:59:49.619769 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613767    2573 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 31 21:59:49.619769 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613770    2573 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 31 21:59:49.619769 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613773    2573 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 31 21:59:49.619769 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613776    2573 flags.go:64] FLAG: --logging-format="text"
Jul 31 21:59:49.619769 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613779    2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 31 21:59:49.619769 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613782    2573 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 31 21:59:49.619769 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613785    2573 flags.go:64] FLAG: --manifest-url=""
Jul 31 21:59:49.619769 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613788    2573 flags.go:64] FLAG: --manifest-url-header=""
Jul 31 21:59:49.619769 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613791    2573 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 31 21:59:49.619769 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613794    2573 flags.go:64] FLAG: --max-open-files="1000000"
Jul 31 21:59:49.619769 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613813    2573 flags.go:64] FLAG: --max-pods="110"
Jul 31 21:59:49.619769 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613816    2573 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 31 21:59:49.619769 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613820    2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 31 21:59:49.619769 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613823    2573 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 31 21:59:49.619769 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613826    2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 31 21:59:49.619769 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613829    2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 31 21:59:49.619769 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613832    2573 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 31 21:59:49.619769 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613835    2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 31 21:59:49.620394 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613842    2573 flags.go:64] FLAG: --node-status-max-images="50"
Jul 31 21:59:49.620394 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613845    2573 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 31 21:59:49.620394 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613848    2573 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 31 21:59:49.620394 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613852    2573 flags.go:64] FLAG: --pod-cidr=""
Jul 31 21:59:49.620394 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613854    2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Jul 31 21:59:49.620394 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613860    2573 flags.go:64] FLAG: --pod-manifest-path=""
Jul 31 21:59:49.620394 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613863    2573 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 31 21:59:49.620394 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613866    2573 flags.go:64] FLAG: --pods-per-core="0"
Jul 31 21:59:49.620394 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613869    2573 flags.go:64] FLAG: --port="10250"
Jul 31 21:59:49.620394 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613873    2573 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 31 21:59:49.620394 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613876    2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07ea6032312ea165b"
Jul 31 21:59:49.620394 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613879    2573 flags.go:64] FLAG: --qos-reserved=""
Jul 31 21:59:49.620394 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613882    2573 flags.go:64] FLAG: --read-only-port="10255"
Jul 31 21:59:49.620394 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613885    2573 flags.go:64] FLAG: --register-node="true"
Jul 31 21:59:49.620394 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613888    2573 flags.go:64] FLAG: --register-with-taints=""
Jul 31 21:59:49.620394 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613899    2573 flags.go:64] FLAG: --registry-burst="10"
Jul 31 21:59:49.620394 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613904    2573 flags.go:64] FLAG: --registry-qps="5"
Jul 31 21:59:49.620394 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613907    2573 flags.go:64] FLAG: --reserved-cpus=""
Jul 31 21:59:49.620394 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613910    2573 flags.go:64] FLAG: --reserved-memory=""
Jul 31 21:59:49.620394 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613914    2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 31 21:59:49.620394 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613917    2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 31 21:59:49.620394 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613919    2573 flags.go:64] FLAG: --rotate-certificates="false"
Jul 31 21:59:49.620394 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613922    2573 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 31 21:59:49.620394 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613925    2573 flags.go:64] FLAG: --runonce="false"
Jul 31 21:59:49.620394 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613928    2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 31 21:59:49.621018 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613931    2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 31 21:59:49.621018 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613934    2573 flags.go:64] FLAG: --seccomp-default="false"
Jul 31 21:59:49.621018 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613938    2573 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 31 21:59:49.621018 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613941    2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 31 21:59:49.621018 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613943    2573 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 31 21:59:49.621018 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613946    2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 31 21:59:49.621018 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613949    2573 flags.go:64] FLAG: --storage-driver-password="root"
Jul 31 21:59:49.621018 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613953    2573 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 31 21:59:49.621018 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613956    2573 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 31 21:59:49.621018 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613959    2573 flags.go:64] FLAG: --storage-driver-user="root"
Jul 31 21:59:49.621018 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613962    2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 31 21:59:49.621018 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613965    2573 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 31 21:59:49.621018 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613968    2573 flags.go:64] FLAG: --system-cgroups=""
Jul 31 21:59:49.621018 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613971    2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 31 21:59:49.621018 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613977    2573 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 31 21:59:49.621018 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613980    2573 flags.go:64] FLAG: --tls-cert-file=""
Jul 31 21:59:49.621018 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613982    2573 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 31 21:59:49.621018 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613986    2573 flags.go:64] FLAG: --tls-min-version=""
Jul 31 21:59:49.621018 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613989    2573 flags.go:64] FLAG: --tls-private-key-file=""
Jul 31 21:59:49.621018 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613992    2573 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 31 21:59:49.621018 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613995    2573 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 31 21:59:49.621018 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.613998    2573 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 31 21:59:49.621018 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.614001    2573 flags.go:64] FLAG: --v="2"
Jul 31 21:59:49.621018 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.614005    2573 flags.go:64] FLAG: --version="false"
Jul 31 21:59:49.621018 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.614009    2573 flags.go:64] FLAG: --vmodule=""
Jul 31 21:59:49.621653 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.614012    2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 31 21:59:49.621653 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.614016    2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 31 21:59:49.621653 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614122    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 21:59:49.621653 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614126    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 21:59:49.621653 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614129    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 21:59:49.621653 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614132    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 21:59:49.621653 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614135    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 21:59:49.621653 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614137    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 21:59:49.621653 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614140    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 21:59:49.621653 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614145    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 21:59:49.621653 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614149    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 21:59:49.621653 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614153    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 21:59:49.621653 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614156    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 21:59:49.621653 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614159    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 21:59:49.621653 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614162    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 21:59:49.621653 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614165    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 21:59:49.621653 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614168    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 21:59:49.621653 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614170    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 21:59:49.621653 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614175    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 21:59:49.622205 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614178    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 21:59:49.622205 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614181    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 21:59:49.622205 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614184    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 21:59:49.622205 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614186    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 21:59:49.622205 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614189    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 21:59:49.622205 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614191    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 21:59:49.622205 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614194    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 21:59:49.622205 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614197    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 21:59:49.622205 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614199    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 21:59:49.622205 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614202    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 21:59:49.622205 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614205    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 21:59:49.622205 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614207    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 21:59:49.622205 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614210    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 21:59:49.622205 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614213    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 21:59:49.622205 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614215    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 21:59:49.622205 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614218    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 21:59:49.622205 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614221    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 21:59:49.622205 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614223    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 21:59:49.622205 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614226    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 21:59:49.622205 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614228    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 21:59:49.622688 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614231    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 21:59:49.622688 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614233    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 21:59:49.622688 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614237    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 21:59:49.622688 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614240    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 21:59:49.622688 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614243    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 21:59:49.622688 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614246    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 21:59:49.622688 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614248    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 21:59:49.622688 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614251    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 21:59:49.622688 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614253    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 21:59:49.622688 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614256    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 21:59:49.622688 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614258    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 21:59:49.622688 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614261    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 21:59:49.622688 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614264    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 21:59:49.622688 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614266    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 21:59:49.622688 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614269    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 21:59:49.622688 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614271    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 21:59:49.622688 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614274    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 21:59:49.622688 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614276    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 21:59:49.622688 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614279    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 21:59:49.622688 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614281    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 21:59:49.623194 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614284    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 21:59:49.623194 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614286    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 21:59:49.623194 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614289    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 21:59:49.623194 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614291    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 21:59:49.623194 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614294    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 21:59:49.623194 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614297    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 21:59:49.623194 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614300    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 21:59:49.623194 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614304    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 21:59:49.623194 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614307    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 21:59:49.623194 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614310    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 21:59:49.623194 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614313    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 21:59:49.623194 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614316    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 21:59:49.623194 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614318    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 21:59:49.623194 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614321    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 21:59:49.623194 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614325    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 21:59:49.623194 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614327    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 21:59:49.623194 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614330    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 21:59:49.623194 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614332    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 21:59:49.623194 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614335    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 21:59:49.623661 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614338    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 21:59:49.623661 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614341    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 21:59:49.623661 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614343    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 21:59:49.623661 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614346    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 21:59:49.623661 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614349    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 21:59:49.623661 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614351    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 21:59:49.623661 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614354    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 21:59:49.623661 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614356    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 21:59:49.623661 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614359    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 21:59:49.623661 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614362    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 21:59:49.623661 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614364    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 21:59:49.623661 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614367    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 21:59:49.623661 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614369    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 21:59:49.623661 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614372    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 21:59:49.623661 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614374    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 21:59:49.623661 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614377    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 21:59:49.623661 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614379    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 21:59:49.623661 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614382    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 21:59:49.623661 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614384    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 21:59:49.623661 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614387    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 21:59:49.624167 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614390    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 21:59:49.624167 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614393    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 21:59:49.624167 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.614395    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 21:59:49.624167 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.614853    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 31 21:59:49.624167 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.620950    2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 31 21:59:49.624167 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.620963    2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 31 21:59:49.624167 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.621533    2573 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 31 21:59:49.624167 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.621540    2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 31 21:59:49.624167 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621600    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 21:59:49.624167 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621605    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 21:59:49.624167 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621609    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 21:59:49.624167 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621612    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 21:59:49.624167 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621615    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 21:59:49.624167 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621618    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 21:59:49.624167 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621621    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 21:59:49.624556 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621624    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 21:59:49.624556 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621627    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 21:59:49.624556 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621630    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 21:59:49.624556 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621633    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 21:59:49.624556 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621637    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 21:59:49.624556 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621641    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 21:59:49.624556 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621644    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 21:59:49.624556 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621647    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 21:59:49.624556 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621650    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 21:59:49.624556 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621652    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 21:59:49.624556 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621655    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 21:59:49.624556 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621658    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 21:59:49.624556 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621660    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 21:59:49.624556 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621663    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 21:59:49.624556 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621666    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 21:59:49.624556 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621669    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 21:59:49.624556 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621672    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 21:59:49.624556 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621676    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 21:59:49.624556 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621680    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 21:59:49.624556 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621682    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 21:59:49.625037 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621685    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 21:59:49.625037 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621688    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 21:59:49.625037 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621691    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 21:59:49.625037 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621694    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 21:59:49.625037 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621697    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 21:59:49.625037 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621699    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 21:59:49.625037 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621702    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 21:59:49.625037 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621705    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 21:59:49.625037 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621707    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 21:59:49.625037 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621710    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 21:59:49.625037 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621712    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 21:59:49.625037 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621715    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 21:59:49.625037 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621717    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 21:59:49.625037 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621720    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 21:59:49.625037 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621722    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 21:59:49.625037 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621725    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 21:59:49.625037 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621727    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 21:59:49.625037 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621730    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 21:59:49.625037 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621732    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 21:59:49.625037 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621735    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 21:59:49.625513 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621738    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 21:59:49.625513 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621740    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 21:59:49.625513 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621744    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 21:59:49.625513 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621748    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 21:59:49.625513 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621751    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 21:59:49.625513 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621754    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 21:59:49.625513 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621757    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 21:59:49.625513 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621759    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 21:59:49.625513 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621762    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 21:59:49.625513 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621765    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 21:59:49.625513 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621767    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 21:59:49.625513 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621770    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 21:59:49.625513 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621773    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 21:59:49.625513 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621775    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 21:59:49.625513 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621779    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 21:59:49.625513 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621782    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 21:59:49.625513 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621784    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 21:59:49.625513 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621787    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 21:59:49.625513 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621789    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 21:59:49.625998 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621792    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 21:59:49.625998 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621794    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 21:59:49.625998 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621810    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 21:59:49.625998 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621813    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 21:59:49.625998 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621816    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 21:59:49.625998 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621818    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 21:59:49.625998 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621821    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 21:59:49.625998 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621823    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 21:59:49.625998 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621826    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 21:59:49.625998 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621829    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 21:59:49.625998 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621831    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 21:59:49.625998 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621834    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 21:59:49.625998 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621838    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 21:59:49.625998 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621840    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 21:59:49.625998 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621843    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 21:59:49.625998 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621846    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 21:59:49.625998 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621848    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 21:59:49.625998 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621851    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 21:59:49.625998 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621853    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 21:59:49.626455 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621856    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 21:59:49.626455 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621858    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 21:59:49.626455 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621861    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 21:59:49.626455 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621863    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 21:59:49.626455 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621866    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 21:59:49.626455 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621868    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 21:59:49.626455 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621871    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 21:59:49.626455 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621873    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 21:59:49.626455 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621876    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 21:59:49.626455 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621879    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 21:59:49.626455 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621882    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 21:59:49.626455 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621885    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 21:59:49.626455 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621888    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 21:59:49.626455 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.621890    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 21:59:49.626455 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.621902    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 31 21:59:49.626915 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622018    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 21:59:49.626915 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622023    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 21:59:49.626915 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622027    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 21:59:49.626915 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622030    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 21:59:49.626915 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622033    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 21:59:49.626915 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622035    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 21:59:49.626915 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622038    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 21:59:49.626915 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622041    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 21:59:49.626915 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622043    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 21:59:49.626915 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622046    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 21:59:49.626915 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622048    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 21:59:49.626915 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622051    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 21:59:49.626915 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622054    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 21:59:49.626915 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622056    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 21:59:49.626915 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622059    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 21:59:49.626915 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622061    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 21:59:49.626915 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622064    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 21:59:49.626915 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622066    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 21:59:49.626915 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622069    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 21:59:49.627371 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622071    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 21:59:49.627371 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622074    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 21:59:49.627371 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622076    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 21:59:49.627371 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622079    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 21:59:49.627371 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622081    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 21:59:49.627371 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622084    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 21:59:49.627371 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622086    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 21:59:49.627371 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622089    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 21:59:49.627371 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622092    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 21:59:49.627371 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622095    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 21:59:49.627371 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622097    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 21:59:49.627371 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622101    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 21:59:49.627371 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622104    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 21:59:49.627371 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622107    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 21:59:49.627371 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622110    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 21:59:49.627371 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622112    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 21:59:49.627371 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622115    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 21:59:49.627371 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622117    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 21:59:49.627371 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622120    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 21:59:49.627866 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622124    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 21:59:49.627866 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622127    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 21:59:49.627866 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622129    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 21:59:49.627866 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622132    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 21:59:49.627866 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622135    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 21:59:49.627866 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622138    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 21:59:49.627866 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622140    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 21:59:49.627866 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622143    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 21:59:49.627866 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622145    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 21:59:49.627866 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622148    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 21:59:49.627866 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622150    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 21:59:49.627866 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622153    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 21:59:49.627866 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622155    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 21:59:49.627866 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622158    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 21:59:49.627866 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622160    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 21:59:49.627866 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622163    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 21:59:49.627866 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622165    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 21:59:49.627866 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622168    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 21:59:49.627866 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622170    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 21:59:49.627866 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622173    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 21:59:49.628514 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622175    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 21:59:49.628514 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622178    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 21:59:49.628514 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622180    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 21:59:49.628514 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622184    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 21:59:49.628514 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622186    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 21:59:49.628514 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622189    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 21:59:49.628514 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622191    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 21:59:49.628514 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622194    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 21:59:49.628514 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622196    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 21:59:49.628514 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622199    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 21:59:49.628514 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622202    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 21:59:49.628514 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622204    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 21:59:49.628514 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622207    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 21:59:49.628514 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622209    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 21:59:49.628514 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622212    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 21:59:49.628514 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622215    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 21:59:49.628514 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622217    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 21:59:49.628514 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622220    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 21:59:49.628514 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622223    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 21:59:49.628514 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622225    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 21:59:49.629052 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622228    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 21:59:49.629052 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622230    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 21:59:49.629052 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622233    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 21:59:49.629052 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622235    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 21:59:49.629052 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622237    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 21:59:49.629052 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622240    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 21:59:49.629052 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622242    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 21:59:49.629052 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622245    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 21:59:49.629052 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622247    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 21:59:49.629052 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622249    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 21:59:49.629052 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622252    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 21:59:49.629052 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622254    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 21:59:49.629052 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622257    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 21:59:49.629052 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622259    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 21:59:49.629052 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622262    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 21:59:49.629052 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622264    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 21:59:49.629052 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622267    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 21:59:49.629052 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622270    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 21:59:49.629052 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622272    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 21:59:49.629052 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622275    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 21:59:49.629533 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:49.622278    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 21:59:49.629533 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.622283    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 31 21:59:49.629533 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.622379    2573 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 31 21:59:49.629533 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.624158    2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 31 21:59:49.629533 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.625582    2573 server.go:1019] "Starting client certificate rotation"
Jul 31 21:59:49.629533 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.625682    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 31 21:59:49.629533 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.625710    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 31 21:59:49.629533 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.627553    2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 31 21:59:49.629533 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.628632    2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 31 21:59:49.636527 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.636511    2573 log.go:25] "Validated CRI v1 runtime API"
Jul 31 21:59:49.638501 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.638487    2573 log.go:25] "Validated CRI v1 image API"
Jul 31 21:59:49.639260 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.639246    2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 31 21:59:49.641152 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.641124    2573 fs.go:135] Filesystem UUIDs: map[01799fa3-7d25-4558-b9b2-379c02a2e1b7:/dev/nvme0n1p4 5759e4ee-4d45-47b4-b2bb-78366bedba47:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 31 21:59:49.641242 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.641150    2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 31 21:59:49.646779 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.646673    2573 manager.go:216] Machine: {Timestamp:2026-07-31 21:59:49.645049978 +0000 UTC m=+0.259841039 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104625 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a8fb83b469c8f965b591e3d1d65b3 SystemUUID:ec2a8fb8-3b46-9c8f-965b-591e3d1d65b3 BootID:e236230f-9721-43f2-b65c-e3a5bf90dbe1 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:53:09:81:7e:f1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:53:09:81:7e:f1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:56:9c:41:ba:c5:bf Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 31 21:59:49.646779 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.646773    2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 31 21:59:49.646892 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.646852    2573 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 31 21:59:49.647652 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.647629    2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 31 21:59:49.647779 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.647653    2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-191.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 31 21:59:49.648652 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.648642    2573 topology_manager.go:138] "Creating topology manager with none policy"
Jul 31 21:59:49.648687 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.648655    2573 container_manager_linux.go:309] "Creating device plugin manager"
Jul 31 21:59:49.648687 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.648666    2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 31 21:59:49.649169 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.649156    2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 31 21:59:49.649875 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.649863    2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 31 21:59:49.653862 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.653850    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 31 21:59:49.653992 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.653982    2573 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 31 21:59:49.654024 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.654009    2573 kubelet.go:486] "Attempting to sync node with API server"
Jul 31 21:59:49.654024 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.654019    2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 31 21:59:49.654082 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.654028    2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 31 21:59:49.654082 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.654037    2573 kubelet.go:398] "Adding apiserver pod source"
Jul 31 21:59:49.654082 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.654045    2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 31 21:59:49.654407 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.654393    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 31 21:59:49.654445 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.654420    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 31 21:59:49.656063 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.656045    2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 31 21:59:49.656178 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.656161    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 31 21:59:49.657270 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.657256    2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 31 21:59:49.657321 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.657286    2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 31 21:59:49.658207 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.658195    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 31 21:59:49.658247 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.658212    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 31 21:59:49.658247 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.658229    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 31 21:59:49.658247 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.658235    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 31 21:59:49.658247 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.658243    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 31 21:59:49.658247 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.658248    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 31 21:59:49.658372 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.658256    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 31 21:59:49.658372 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.658261    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 31 21:59:49.658372 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.658267    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 31 21:59:49.658372 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.658271    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 31 21:59:49.658372 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.658284    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 31 21:59:49.658372 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.658289    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 31 21:59:49.658841 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.658833    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 31 21:59:49.658841 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.658841    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 31 21:59:49.661691 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.661679    2573 server.go:1268] "Started kubelet"
Jul 31 21:59:49.661776 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.661754    2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 31 21:59:49.661873 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.661831    2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 31 21:59:49.661922 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.661903    2573 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 31 21:59:49.662726 ip-10-0-130-191 systemd[1]: Started Kubernetes Kubelet.
Jul 31 21:59:49.662922 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.662900    2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 31 21:59:49.665524 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.665399    2573 server.go:310] "Adding debug handlers to kubelet server"
Jul 31 21:59:49.667821 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:49.667783    2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 31 21:59:49.668892 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.668874    2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-191.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 31 21:59:49.668958 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:49.668891    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-191.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 31 21:59:49.668958 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:49.668894    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 31 21:59:49.669334 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.669313    2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 31 21:59:49.669334 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.669331    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 31 21:59:49.669487 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:49.669402    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-191.ec2.internal\" not found"
Jul 31 21:59:49.669867 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.669852    2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 31 21:59:49.669950 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:49.668968    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-191.ec2.internal.18c77ecb79be10ed  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-191.ec2.internal,UID:ip-10-0-130-191.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-191.ec2.internal,},FirstTimestamp:2026-07-31 21:59:49.661651181 +0000 UTC m=+0.276442241,LastTimestamp:2026-07-31 21:59:49.661651181 +0000 UTC m=+0.276442241,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-191.ec2.internal,}"
Jul 31 21:59:49.670061 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.670043    2573 factory.go:55] Registering systemd factory
Jul 31 21:59:49.670128 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.670067    2573 factory.go:223] Registration of the systemd container factory successfully
Jul 31 21:59:49.670128 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.670054    2573 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 31 21:59:49.670128 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.670104    2573 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 31 21:59:49.670277 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.670262    2573 reconstruct.go:97] "Volume reconstruction finished"
Jul 31 21:59:49.670323 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.670278    2573 reconciler.go:29] "Reconciler: start to sync state"
Jul 31 21:59:49.670323 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.670270    2573 factory.go:153] Registering CRI-O factory
Jul 31 21:59:49.670323 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.670295    2573 factory.go:223] Registration of the crio container factory successfully
Jul 31 21:59:49.670415 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.670352    2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 31 21:59:49.670415 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.670376    2573 factory.go:103] Registering Raw factory
Jul 31 21:59:49.670415 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.670390    2573 manager.go:1196] Started watching for new ooms in manager
Jul 31 21:59:49.670832 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.670820    2573 manager.go:349] Starting recovery of all containers
Jul 31 21:59:49.676817 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:49.676781    2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-191.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 31 21:59:49.677051 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:49.677018    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 31 21:59:49.678794 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.678771    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bxzdb"
Jul 31 21:59:49.681155 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.681138    2573 manager.go:354] Recovery completed
Jul 31 21:59:49.686178 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.686167    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 21:59:49.687155 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.687140    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bxzdb"
Jul 31 21:59:49.687867 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.687851    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-191.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 21:59:49.687953 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.687881    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-191.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 21:59:49.687953 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.687896    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-191.ec2.internal" event="NodeHasSufficientPID"
Jul 31 21:59:49.688341 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.688329    2573 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 31 21:59:49.688341 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.688341    2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 31 21:59:49.688469 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.688357    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 31 21:59:49.688469 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.688404    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 21:59:49.689107 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.689085    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-191.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 21:59:49.689176 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.689116    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-191.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 21:59:49.689653 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.689641    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-191.ec2.internal" event="NodeHasSufficientPID"
Jul 31 21:59:49.690018 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:49.689959    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-191.ec2.internal.18c77ecb7b4e12ca  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-191.ec2.internal,UID:ip-10-0-130-191.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-191.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-191.ec2.internal,},FirstTimestamp:2026-07-31 21:59:49.687866058 +0000 UTC m=+0.302657121,LastTimestamp:2026-07-31 21:59:49.687866058 +0000 UTC m=+0.302657121,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-191.ec2.internal,}"
Jul 31 21:59:49.690431 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.690419    2573 policy_none.go:49] "None policy: Start"
Jul 31 21:59:49.690472 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.690437    2573 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 31 21:59:49.690472 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.690447    2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 31 21:59:49.692428 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.692415    2573 policy_none.go:47] "Start"
Jul 31 21:59:49.727411 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.727312    2573 manager.go:337] "Starting Device Plugin manager"
Jul 31 21:59:49.727488 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:49.727424    2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 31 21:59:49.727488 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.727433    2573 server.go:87] "Starting device plugin registration server"
Jul 31 21:59:49.727621 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.727610    2573 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 31 21:59:49.727669 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.727623    2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 31 21:59:49.727727 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.727714    2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 31 21:59:49.727789 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.727779    2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 31 21:59:49.727864 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.727790    2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 31 21:59:49.728230 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:49.728212    2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 31 21:59:49.728311 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:49.728259    2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-191.ec2.internal\" not found"
Jul 31 21:59:49.807908 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.807883    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 31 21:59:49.809994 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.809043    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 31 21:59:49.809994 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.809074    2573 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 31 21:59:49.809994 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.809093    2573 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 31 21:59:49.809994 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:49.809123    2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 31 21:59:49.813543 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.813524    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 21:59:49.828600 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.828588    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 21:59:49.829296 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.829281    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-191.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 21:59:49.829364 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.829311    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-191.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 21:59:49.829364 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.829325    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-191.ec2.internal" event="NodeHasSufficientPID"
Jul 31 21:59:49.829364 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.829343    2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-191.ec2.internal"
Jul 31 21:59:49.839212 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:49.839199    2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-191.ec2.internal"
Jul 31 21:59:49.839256 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:49.839217    2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-191.ec2.internal\": node \"ip-10-0-130-191.ec2.internal\" not found"
Jul 31 21:59:49.860162 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:49.860121    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-191.ec2.internal\" not found"
Jul 31 21:59:51.429661 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:51.429641    2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-191.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-191.ec2.internal"]
Jul 31 21:59:51.429735 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:51.429689    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 21:59:51.430448 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:51.430433    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-191.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 21:59:51.430522 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:51.430457    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-191.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 21:59:51.430522 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:51.430467    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-191.ec2.internal" event="NodeHasSufficientPID"
Jul 31 21:59:51.432674 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:51.432662    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 21:59:51.432816 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:51.432802    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-191.ec2.internal"
Jul 31 21:59:51.432852 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:51.432830    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 21:59:51.433360 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:51.433330    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-191.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 21:59:51.433360 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:51.433359    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-191.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 21:59:51.433514 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:51.433362    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-191.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 21:59:51.433514 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:51.433373    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-191.ec2.internal" event="NodeHasSufficientPID"
Jul 31 21:59:51.433514 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:51.433380    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-191.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 21:59:51.433514 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:51.433398    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-191.ec2.internal" event="NodeHasSufficientPID"
Jul 31 21:59:51.435549 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:51.435534    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-191.ec2.internal"
Jul 31 21:59:51.435629 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:51.435560    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 21:59:51.436173 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:51.436158    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-191.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 21:59:51.436249 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:51.436182    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-191.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 21:59:51.436249 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:51.436196    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-191.ec2.internal" event="NodeHasSufficientPID"
Jul 31 21:59:51.458828 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:51.458813    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-191.ec2.internal\" not found" node="ip-10-0-130-191.ec2.internal"
Jul 31 21:59:51.463098 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:51.463075    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-191.ec2.internal\" not found" node="ip-10-0-130-191.ec2.internal"
Jul 31 21:59:51.480312 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:51.480283    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-191.ec2.internal\" not found"
Jul 31 21:59:51.491838 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:51.491818    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/02608697884207c81c1068d58a177703-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-191.ec2.internal\" (UID: \"02608697884207c81c1068d58a177703\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-191.ec2.internal"
Jul 31 21:59:51.491917 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:51.491842    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/02608697884207c81c1068d58a177703-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-191.ec2.internal\" (UID: \"02608697884207c81c1068d58a177703\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-191.ec2.internal"
Jul 31 21:59:51.491917 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:51.491859    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d8d2242e12894094bb066f41e4e156aa-config\") pod \"kube-apiserver-proxy-ip-10-0-130-191.ec2.internal\" (UID: \"d8d2242e12894094bb066f41e4e156aa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-191.ec2.internal"
Jul 31 21:59:51.580857 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:51.580841    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-191.ec2.internal\" not found"
Jul 31 21:59:51.592087 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:51.592061    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/02608697884207c81c1068d58a177703-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-191.ec2.internal\" (UID: \"02608697884207c81c1068d58a177703\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-191.ec2.internal"
Jul 31 21:59:51.592144 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:51.592099    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/02608697884207c81c1068d58a177703-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-191.ec2.internal\" (UID: \"02608697884207c81c1068d58a177703\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-191.ec2.internal"
Jul 31 21:59:51.592144 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:51.592122    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d8d2242e12894094bb066f41e4e156aa-config\") pod \"kube-apiserver-proxy-ip-10-0-130-191.ec2.internal\" (UID: \"d8d2242e12894094bb066f41e4e156aa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-191.ec2.internal"
Jul 31 21:59:51.592144 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:51.592128    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/02608697884207c81c1068d58a177703-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-191.ec2.internal\" (UID: \"02608697884207c81c1068d58a177703\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-191.ec2.internal"
Jul 31 21:59:51.592236 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:51.592158    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d8d2242e12894094bb066f41e4e156aa-config\") pod \"kube-apiserver-proxy-ip-10-0-130-191.ec2.internal\" (UID: \"d8d2242e12894094bb066f41e4e156aa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-191.ec2.internal"
Jul 31 21:59:51.592236 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:51.592160    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/02608697884207c81c1068d58a177703-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-191.ec2.internal\" (UID: \"02608697884207c81c1068d58a177703\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-191.ec2.internal"
Jul 31 21:59:51.681230 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:51.681188    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-191.ec2.internal\" not found"
Jul 31 21:59:51.761714 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:51.761691    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-191.ec2.internal"
Jul 31 21:59:51.765274 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:51.765257    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-191.ec2.internal"
Jul 31 21:59:51.781771 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:51.781751    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-191.ec2.internal\" not found"
Jul 31 21:59:51.882255 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:51.882225    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-191.ec2.internal\" not found"
Jul 31 21:59:51.982791 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:51.982737    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-191.ec2.internal\" not found"
Jul 31 21:59:52.083312 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:52.083284    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-191.ec2.internal\" not found"
Jul 31 21:59:52.141901 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:52.141883    2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 21:59:52.144635 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:52.144620    2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 31 21:59:52.144749 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:52.144731    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 31 21:59:52.144805 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:52.144778    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 31 21:59:52.184107 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:52.184086    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-191.ec2.internal\" not found"
Jul 31 21:59:52.211175 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:52.211138    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-30 21:54:51 +0000 UTC" deadline="2028-04-30 06:40:22.162043094 +0000 UTC"
Jul 31 21:59:52.211175 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:52.211175    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15320h40m29.950872432s"
Jul 31 21:59:52.252318 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:52.252237    2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 21:59:52.284291 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:52.284265    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-191.ec2.internal\" not found"
Jul 31 21:59:52.294243 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:52.294212    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8d2242e12894094bb066f41e4e156aa.slice/crio-be9b2c98543a6996cbec650ba9f7a862a159c7d349ef97caaacc1248a127e8b8 WatchSource:0}: Error finding container be9b2c98543a6996cbec650ba9f7a862a159c7d349ef97caaacc1248a127e8b8: Status 404 returned error can't find the container with id be9b2c98543a6996cbec650ba9f7a862a159c7d349ef97caaacc1248a127e8b8
Jul 31 21:59:52.294771 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:52.294750    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02608697884207c81c1068d58a177703.slice/crio-56a720bd5186e48608b4df304bf8e6e7c5ae9e52e0bff7c6f21098f63b5e99b7 WatchSource:0}: Error finding container 56a720bd5186e48608b4df304bf8e6e7c5ae9e52e0bff7c6f21098f63b5e99b7: Status 404 returned error can't find the container with id 56a720bd5186e48608b4df304bf8e6e7c5ae9e52e0bff7c6f21098f63b5e99b7
Jul 31 21:59:52.298768 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:52.298754    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 21:59:52.331968 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:52.331928    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-191.ec2.internal" event={"ID":"02608697884207c81c1068d58a177703","Type":"ContainerStarted","Data":"56a720bd5186e48608b4df304bf8e6e7c5ae9e52e0bff7c6f21098f63b5e99b7"}
Jul 31 21:59:52.332909 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:52.332890    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-191.ec2.internal" event={"ID":"d8d2242e12894094bb066f41e4e156aa","Type":"ContainerStarted","Data":"be9b2c98543a6996cbec650ba9f7a862a159c7d349ef97caaacc1248a127e8b8"}
Jul 31 21:59:52.385055 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:52.385030    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-191.ec2.internal\" not found"
Jul 31 21:59:52.475764 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:52.475743    2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 21:59:52.489383 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:52.489370    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-191.ec2.internal"
Jul 31 21:59:52.500193 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:52.500178    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 31 21:59:52.501037 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:52.501026    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-191.ec2.internal"
Jul 31 21:59:52.509007 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:52.508956    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 31 21:59:53.174535 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.174507    2573 apiserver.go:52] "Watching apiserver"
Jul 31 21:59:53.182831 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.182809    2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 31 21:59:53.183272 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.183245    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-422sp","kube-system/konnectivity-agent-r44dc","kube-system/kube-apiserver-proxy-ip-10-0-130-191.ec2.internal","openshift-image-registry/node-ca-fv879","openshift-multus/multus-additional-cni-plugins-46mtl","openshift-multus/multus-svhwq","openshift-multus/network-metrics-daemon-dpcw4","openshift-network-operator/iptables-alerter-krlnf","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plplk","openshift-cluster-node-tuning-operator/tuned-djtgp","openshift-dns/node-resolver-s4gbt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-191.ec2.internal","openshift-network-diagnostics/network-check-target-5sf9m","openshift-ovn-kubernetes/ovnkube-node-4ddp8"]
Jul 31 21:59:53.186034 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.186008    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 21:59:53.186135 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:53.186106    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpcw4" podUID="5cd860f1-df9a-4df3-9bea-45d697a20f92"
Jul 31 21:59:53.188220 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.188162    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sf9m"
Jul 31 21:59:53.188328 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:53.188225    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sf9m" podUID="bac49c41-6245-48dd-b89d-5e799e544e08"
Jul 31 21:59:53.190063 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.190043    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 31 21:59:53.190383 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.190365    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.192740 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.192717    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fv879"
Jul 31 21:59:53.195159 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.194952    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-46mtl"
Jul 31 21:59:53.195680 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.195661    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 31 21:59:53.195774 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.195686    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 31 21:59:53.195774 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.195705    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 31 21:59:53.195774 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.195746    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 31 21:59:53.195774 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.195687    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 31 21:59:53.196115 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.196096    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 31 21:59:53.196230 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.196148    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 31 21:59:53.196380 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.196273    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xjfr2\""
Jul 31 21:59:53.196380 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.196323    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 31 21:59:53.196511 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.196393    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 31 21:59:53.196511 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.196465    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mcjc6\""
Jul 31 21:59:53.197656 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.197639    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.197909 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.197818    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 31 21:59:53.197909 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.197880    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 31 21:59:53.199470 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.199446    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-node-log\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.199559 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.199480    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-host-cni-bin\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.199559 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.199525    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/79e15037-4ffd-47f1-b983-34f06895b2a3-ovnkube-config\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.199559 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.199552    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8pqf\" (UniqueName: \"kubernetes.io/projected/bac49c41-6245-48dd-b89d-5e799e544e08-kube-api-access-p8pqf\") pod \"network-check-target-5sf9m\" (UID: \"bac49c41-6245-48dd-b89d-5e799e544e08\") " pod="openshift-network-diagnostics/network-check-target-5sf9m"
Jul 31 21:59:53.199706 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.199575    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-systemd-units\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.199706 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.199597    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-etc-openvswitch\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.199706 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.199629    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-host-run-ovn-kubernetes\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.199706 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.199671    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.199863 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.199705    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctnpl\" (UniqueName: \"kubernetes.io/projected/79e15037-4ffd-47f1-b983-34f06895b2a3-kube-api-access-ctnpl\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.199863 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.199734    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gkmk\" (UniqueName: \"kubernetes.io/projected/5cd860f1-df9a-4df3-9bea-45d697a20f92-kube-api-access-5gkmk\") pod \"network-metrics-daemon-dpcw4\" (UID: \"5cd860f1-df9a-4df3-9bea-45d697a20f92\") " pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 21:59:53.199863 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.199756    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-host-slash\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.199863 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.199778    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-host-run-netns\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.199863 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.199800    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-run-systemd\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.199863 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.199823    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/79e15037-4ffd-47f1-b983-34f06895b2a3-env-overrides\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.199863 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.199845    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/79e15037-4ffd-47f1-b983-34f06895b2a3-ovnkube-script-lib\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.200101 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.199882    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cd860f1-df9a-4df3-9bea-45d697a20f92-metrics-certs\") pod \"network-metrics-daemon-dpcw4\" (UID: \"5cd860f1-df9a-4df3-9bea-45d697a20f92\") " pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 21:59:53.200101 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.199910    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-host-kubelet\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.200101 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.199939    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-log-socket\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.200101 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.199972    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-host-cni-netd\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.200101 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.199994    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/79e15037-4ffd-47f1-b983-34f06895b2a3-ovn-node-metrics-cert\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.200101 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.200019    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-var-lib-openvswitch\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.200101 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.200049    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-run-openvswitch\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.200101 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.200094    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-run-ovn\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.200427 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.200226    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plplk"
Jul 31 21:59:53.202267 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.202252    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 21:59:53.202380 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:53.202333    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-422sp" podUID="4fbb48e0-0e3e-4864-a018-acb5bb48e0a8"
Jul 31 21:59:53.204612 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.204589    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r44dc"
Jul 31 21:59:53.204693 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.204668    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 31 21:59:53.205279 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.205253    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 31 21:59:53.205488 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.205470    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 31 21:59:53.205565 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.205510    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 31 21:59:53.206010 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.205990    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 31 21:59:53.206110 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.206044    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 31 21:59:53.206197 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.206177    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5mm64\""
Jul 31 21:59:53.206348 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.206331    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pdjhc\""
Jul 31 21:59:53.206604 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.206442    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 31 21:59:53.206604 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.206472    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-q9wg2\""
Jul 31 21:59:53.207231 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.207212    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.209898 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.209880    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s4gbt"
Jul 31 21:59:53.212737 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.212661    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-krlnf"
Jul 31 21:59:53.212946 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.212780    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 31 21:59:53.213713 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.213696    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 31 21:59:53.214482 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.214440    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 31 21:59:53.214550 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.214513    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 31 21:59:53.215252 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.215233    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7wdq9\""
Jul 31 21:59:53.215615 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.215590    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-c7g8f\""
Jul 31 21:59:53.215709 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.215630    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-csph2\""
Jul 31 21:59:53.216198 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.216152    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 31 21:59:53.216901 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.216882    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 31 21:59:53.217837 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.217534    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 31 21:59:53.222732 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.222656    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 31 21:59:53.223072 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.222918    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5f278\""
Jul 31 21:59:53.225652 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.225635    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 31 21:59:53.228277 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.228262    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 31 21:59:53.289462 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.289441    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zq4rk"
Jul 31 21:59:53.290144 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.290124    2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 31 21:59:53.300692 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.300668    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.300780 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.300715    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctnpl\" (UniqueName: \"kubernetes.io/projected/79e15037-4ffd-47f1-b983-34f06895b2a3-kube-api-access-ctnpl\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.300780 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.300745    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7529582d-7128-42da-ae3c-147316632064-system-cni-dir\") pod \"multus-additional-cni-plugins-46mtl\" (UID: \"7529582d-7128-42da-ae3c-147316632064\") " pod="openshift-multus/multus-additional-cni-plugins-46mtl"
Jul 31 21:59:53.300780 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.300769    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7529582d-7128-42da-ae3c-147316632064-os-release\") pod \"multus-additional-cni-plugins-46mtl\" (UID: \"7529582d-7128-42da-ae3c-147316632064\") " pod="openshift-multus/multus-additional-cni-plugins-46mtl"
Jul 31 21:59:53.300940 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.300784    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.300940 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.300795    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gkmk\" (UniqueName: \"kubernetes.io/projected/5cd860f1-df9a-4df3-9bea-45d697a20f92-kube-api-access-5gkmk\") pod \"network-metrics-daemon-dpcw4\" (UID: \"5cd860f1-df9a-4df3-9bea-45d697a20f92\") " pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 21:59:53.300940 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.300823    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/79e15037-4ffd-47f1-b983-34f06895b2a3-ovnkube-script-lib\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.300940 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.300858    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7ea8a115-e5a1-4056-bd0e-a74666e07032-etc-selinux\") pod \"aws-ebs-csi-driver-node-plplk\" (UID: \"7ea8a115-e5a1-4056-bd0e-a74666e07032\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plplk"
Jul 31 21:59:53.300940 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.300881    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4fbb48e0-0e3e-4864-a018-acb5bb48e0a8-dbus\") pod \"global-pull-secret-syncer-422sp\" (UID: \"4fbb48e0-0e3e-4864-a018-acb5bb48e0a8\") " pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 21:59:53.300940 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.300914    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/085556af-0fc0-4c79-9f9c-ca71dc96dcfc-serviceca\") pod \"node-ca-fv879\" (UID: \"085556af-0fc0-4c79-9f9c-ca71dc96dcfc\") " pod="openshift-image-registry/node-ca-fv879"
Jul 31 21:59:53.300940 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.300938    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/35bdf8db-313d-4461-9a2c-4e885c896c3a-multus-socket-dir-parent\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.301263 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.300970    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cd860f1-df9a-4df3-9bea-45d697a20f92-metrics-certs\") pod \"network-metrics-daemon-dpcw4\" (UID: \"5cd860f1-df9a-4df3-9bea-45d697a20f92\") " pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 21:59:53.301263 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.301001    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/79e15037-4ffd-47f1-b983-34f06895b2a3-ovn-node-metrics-cert\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.301263 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.301025    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63d076da-c8ff-4bb5-adc0-bdc834bdf23f-var-lib-kubelet\") pod \"tuned-djtgp\" (UID: \"63d076da-c8ff-4bb5-adc0-bdc834bdf23f\") " pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.301263 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.301054    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7529582d-7128-42da-ae3c-147316632064-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-46mtl\" (UID: \"7529582d-7128-42da-ae3c-147316632064\") " pod="openshift-multus/multus-additional-cni-plugins-46mtl"
Jul 31 21:59:53.301263 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.301079    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v5bn\" (UniqueName: \"kubernetes.io/projected/9c7c0bd9-8cdd-46bf-ba9c-81c59d68cec8-kube-api-access-2v5bn\") pod \"iptables-alerter-krlnf\" (UID: \"9c7c0bd9-8cdd-46bf-ba9c-81c59d68cec8\") " pod="openshift-network-operator/iptables-alerter-krlnf"
Jul 31 21:59:53.301263 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:53.301084    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 21:59:53.301263 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.301101    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/63d076da-c8ff-4bb5-adc0-bdc834bdf23f-host\") pod \"tuned-djtgp\" (UID: \"63d076da-c8ff-4bb5-adc0-bdc834bdf23f\") " pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.301263 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.301124    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/63d076da-c8ff-4bb5-adc0-bdc834bdf23f-etc-tuned\") pod \"tuned-djtgp\" (UID: \"63d076da-c8ff-4bb5-adc0-bdc834bdf23f\") " pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.301263 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:53.301151    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cd860f1-df9a-4df3-9bea-45d697a20f92-metrics-certs podName:5cd860f1-df9a-4df3-9bea-45d697a20f92 nodeName:}" failed. No retries permitted until 2026-07-31 21:59:53.80112435 +0000 UTC m=+2.896415478 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5cd860f1-df9a-4df3-9bea-45d697a20f92-metrics-certs") pod "network-metrics-daemon-dpcw4" (UID: "5cd860f1-df9a-4df3-9bea-45d697a20f92") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 21:59:53.301263 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.301175    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63d076da-c8ff-4bb5-adc0-bdc834bdf23f-tmp\") pod \"tuned-djtgp\" (UID: \"63d076da-c8ff-4bb5-adc0-bdc834bdf23f\") " pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.301263 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.301205    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7529582d-7128-42da-ae3c-147316632064-tuning-conf-dir\") pod \"multus-additional-cni-plugins-46mtl\" (UID: \"7529582d-7128-42da-ae3c-147316632064\") " pod="openshift-multus/multus-additional-cni-plugins-46mtl"
Jul 31 21:59:53.301263 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.301231    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-etc-openvswitch\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.301263 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.301257    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4fbb48e0-0e3e-4864-a018-acb5bb48e0a8-original-pull-secret\") pod \"global-pull-secret-syncer-422sp\" (UID: \"4fbb48e0-0e3e-4864-a018-acb5bb48e0a8\") " pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 21:59:53.301895 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.301286    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/35bdf8db-313d-4461-9a2c-4e885c896c3a-cni-binary-copy\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.301895 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.301327    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/63d076da-c8ff-4bb5-adc0-bdc834bdf23f-etc-systemd\") pod \"tuned-djtgp\" (UID: \"63d076da-c8ff-4bb5-adc0-bdc834bdf23f\") " pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.301895 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.301346    2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 31 21:59:53.301895 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.301369    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-etc-openvswitch\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.301895 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.301369    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7529582d-7128-42da-ae3c-147316632064-cnibin\") pod \"multus-additional-cni-plugins-46mtl\" (UID: \"7529582d-7128-42da-ae3c-147316632064\") " pod="openshift-multus/multus-additional-cni-plugins-46mtl"
Jul 31 21:59:53.301895 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.301423    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7ea8a115-e5a1-4056-bd0e-a74666e07032-socket-dir\") pod \"aws-ebs-csi-driver-node-plplk\" (UID: \"7ea8a115-e5a1-4056-bd0e-a74666e07032\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plplk"
Jul 31 21:59:53.301895 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.301449    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ghdw\" (UniqueName: \"kubernetes.io/projected/7ea8a115-e5a1-4056-bd0e-a74666e07032-kube-api-access-6ghdw\") pod \"aws-ebs-csi-driver-node-plplk\" (UID: \"7ea8a115-e5a1-4056-bd0e-a74666e07032\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plplk"
Jul 31 21:59:53.301895 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.301475    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c7c0bd9-8cdd-46bf-ba9c-81c59d68cec8-iptables-alerter-script\") pod \"iptables-alerter-krlnf\" (UID: \"9c7c0bd9-8cdd-46bf-ba9c-81c59d68cec8\") " pod="openshift-network-operator/iptables-alerter-krlnf"
Jul 31 21:59:53.301895 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.301498    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/35bdf8db-313d-4461-9a2c-4e885c896c3a-host-var-lib-kubelet\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.301895 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.301521    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/35bdf8db-313d-4461-9a2c-4e885c896c3a-hostroot\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.301895 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.301546    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-host-kubelet\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.301895 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.301576    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6q8k\" (UniqueName: \"kubernetes.io/projected/63d076da-c8ff-4bb5-adc0-bdc834bdf23f-kube-api-access-w6q8k\") pod \"tuned-djtgp\" (UID: \"63d076da-c8ff-4bb5-adc0-bdc834bdf23f\") " pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.301895 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.301615    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-host-kubelet\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.301895 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.301657    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsrbp\" (UniqueName: \"kubernetes.io/projected/7529582d-7128-42da-ae3c-147316632064-kube-api-access-gsrbp\") pod \"multus-additional-cni-plugins-46mtl\" (UID: \"7529582d-7128-42da-ae3c-147316632064\") " pod="openshift-multus/multus-additional-cni-plugins-46mtl"
Jul 31 21:59:53.301895 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.301683    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/35bdf8db-313d-4461-9a2c-4e885c896c3a-system-cni-dir\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.301895 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.301703    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/35bdf8db-313d-4461-9a2c-4e885c896c3a-cnibin\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.301895 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.301718    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/35bdf8db-313d-4461-9a2c-4e885c896c3a-os-release\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.302721 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.301743    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-run-ovn\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.302721 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.301767    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7ea8a115-e5a1-4056-bd0e-a74666e07032-device-dir\") pod \"aws-ebs-csi-driver-node-plplk\" (UID: \"7ea8a115-e5a1-4056-bd0e-a74666e07032\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plplk"
Jul 31 21:59:53.302721 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.301790    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c7c0bd9-8cdd-46bf-ba9c-81c59d68cec8-host-slash\") pod \"iptables-alerter-krlnf\" (UID: \"9c7c0bd9-8cdd-46bf-ba9c-81c59d68cec8\") " pod="openshift-network-operator/iptables-alerter-krlnf"
Jul 31 21:59:53.302721 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.301805    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7ea8a115-e5a1-4056-bd0e-a74666e07032-kubelet-dir\") pod \"aws-ebs-csi-driver-node-plplk\" (UID: \"7ea8a115-e5a1-4056-bd0e-a74666e07032\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plplk"
Jul 31 21:59:53.302721 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.301821    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-systemd-units\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.302721 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.301821    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-run-ovn\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.302721 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.301852    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-host-run-ovn-kubernetes\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.302721 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.301905    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-systemd-units\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.302721 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.301926    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-host-run-ovn-kubernetes\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.302721 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.301905    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/63d076da-c8ff-4bb5-adc0-bdc834bdf23f-etc-sysctl-conf\") pod \"tuned-djtgp\" (UID: \"63d076da-c8ff-4bb5-adc0-bdc834bdf23f\") " pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.302721 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.301968    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3b94b353-7445-4d82-8517-72dae731db0d-agent-certs\") pod \"konnectivity-agent-r44dc\" (UID: \"3b94b353-7445-4d82-8517-72dae731db0d\") " pod="kube-system/konnectivity-agent-r44dc"
Jul 31 21:59:53.302721 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302007    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/35bdf8db-313d-4461-9a2c-4e885c896c3a-host-run-multus-certs\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.302721 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302038    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-host-slash\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.302721 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302057    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-run-systemd\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.302721 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302077    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/79e15037-4ffd-47f1-b983-34f06895b2a3-env-overrides\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.302721 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302097    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7529582d-7128-42da-ae3c-147316632064-cni-binary-copy\") pod \"multus-additional-cni-plugins-46mtl\" (UID: \"7529582d-7128-42da-ae3c-147316632064\") " pod="openshift-multus/multus-additional-cni-plugins-46mtl"
Jul 31 21:59:53.302721 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302104    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-host-slash\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.303418 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302113    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/085556af-0fc0-4c79-9f9c-ca71dc96dcfc-host\") pod \"node-ca-fv879\" (UID: \"085556af-0fc0-4c79-9f9c-ca71dc96dcfc\") " pod="openshift-image-registry/node-ca-fv879"
Jul 31 21:59:53.303418 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302119    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-run-systemd\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.303418 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302127    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/35bdf8db-313d-4461-9a2c-4e885c896c3a-host-run-netns\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.303418 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302143    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-log-socket\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.303418 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302167    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-host-cni-netd\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.303418 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302189    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/63d076da-c8ff-4bb5-adc0-bdc834bdf23f-etc-sysctl-d\") pod \"tuned-djtgp\" (UID: \"63d076da-c8ff-4bb5-adc0-bdc834bdf23f\") " pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.303418 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302198    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-log-socket\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.303418 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302207    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3b94b353-7445-4d82-8517-72dae731db0d-konnectivity-ca\") pod \"konnectivity-agent-r44dc\" (UID: \"3b94b353-7445-4d82-8517-72dae731db0d\") " pod="kube-system/konnectivity-agent-r44dc"
Jul 31 21:59:53.303418 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302223    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4spq\" (UniqueName: \"kubernetes.io/projected/085556af-0fc0-4c79-9f9c-ca71dc96dcfc-kube-api-access-p4spq\") pod \"node-ca-fv879\" (UID: \"085556af-0fc0-4c79-9f9c-ca71dc96dcfc\") " pod="openshift-image-registry/node-ca-fv879"
Jul 31 21:59:53.303418 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302243    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-host-cni-netd\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.303418 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302246    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/35bdf8db-313d-4461-9a2c-4e885c896c3a-multus-cni-dir\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.303418 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302278    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-var-lib-openvswitch\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.303418 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302323    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-run-openvswitch\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.303418 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302342    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-var-lib-openvswitch\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.303418 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302366    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-host-cni-bin\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.303418 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302384    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-run-openvswitch\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.303418 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302388    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/79e15037-4ffd-47f1-b983-34f06895b2a3-ovnkube-config\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.304079 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302384    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/79e15037-4ffd-47f1-b983-34f06895b2a3-ovnkube-script-lib\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.304079 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302425    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/63d076da-c8ff-4bb5-adc0-bdc834bdf23f-etc-modprobe-d\") pod \"tuned-djtgp\" (UID: \"63d076da-c8ff-4bb5-adc0-bdc834bdf23f\") " pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.304079 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302448    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/63d076da-c8ff-4bb5-adc0-bdc834bdf23f-etc-sysconfig\") pod \"tuned-djtgp\" (UID: \"63d076da-c8ff-4bb5-adc0-bdc834bdf23f\") " pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.304079 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302472    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7ea8a115-e5a1-4056-bd0e-a74666e07032-sys-fs\") pod \"aws-ebs-csi-driver-node-plplk\" (UID: \"7ea8a115-e5a1-4056-bd0e-a74666e07032\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plplk"
Jul 31 21:59:53.304079 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302493    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/79e15037-4ffd-47f1-b983-34f06895b2a3-env-overrides\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.304079 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302494    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/35bdf8db-313d-4461-9a2c-4e885c896c3a-host-run-k8s-cni-cncf-io\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.304079 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302543    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/35bdf8db-313d-4461-9a2c-4e885c896c3a-host-var-lib-cni-bin\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.304079 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302569    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/35bdf8db-313d-4461-9a2c-4e885c896c3a-host-var-lib-cni-multus\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.304079 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302591    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35bdf8db-313d-4461-9a2c-4e885c896c3a-etc-kubernetes\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.304079 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302494    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-host-cni-bin\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.304079 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302617    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrl7h\" (UniqueName: \"kubernetes.io/projected/35bdf8db-313d-4461-9a2c-4e885c896c3a-kube-api-access-rrl7h\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.304079 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302640    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-host-run-netns\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.304079 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302661    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63d076da-c8ff-4bb5-adc0-bdc834bdf23f-sys\") pod \"tuned-djtgp\" (UID: \"63d076da-c8ff-4bb5-adc0-bdc834bdf23f\") " pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.304079 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302683    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16745241-a6b7-41c6-9c97-176962591677-tmp-dir\") pod \"node-resolver-s4gbt\" (UID: \"16745241-a6b7-41c6-9c97-176962591677\") " pod="openshift-dns/node-resolver-s4gbt"
Jul 31 21:59:53.304079 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302712    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-host-run-netns\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.304079 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302719    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/35bdf8db-313d-4461-9a2c-4e885c896c3a-multus-conf-dir\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.304079 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302754    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/63d076da-c8ff-4bb5-adc0-bdc834bdf23f-run\") pod \"tuned-djtgp\" (UID: \"63d076da-c8ff-4bb5-adc0-bdc834bdf23f\") " pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.304745 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302785    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/79e15037-4ffd-47f1-b983-34f06895b2a3-ovnkube-config\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.304745 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302778    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/63d076da-c8ff-4bb5-adc0-bdc834bdf23f-lib-modules\") pod \"tuned-djtgp\" (UID: \"63d076da-c8ff-4bb5-adc0-bdc834bdf23f\") " pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.304745 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302831    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7529582d-7128-42da-ae3c-147316632064-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-46mtl\" (UID: \"7529582d-7128-42da-ae3c-147316632064\") " pod="openshift-multus/multus-additional-cni-plugins-46mtl"
Jul 31 21:59:53.304745 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302863    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/35bdf8db-313d-4461-9a2c-4e885c896c3a-multus-daemon-config\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.304745 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302893    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-node-log\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.304745 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302914    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63d076da-c8ff-4bb5-adc0-bdc834bdf23f-etc-kubernetes\") pod \"tuned-djtgp\" (UID: \"63d076da-c8ff-4bb5-adc0-bdc834bdf23f\") " pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.304745 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302968    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/79e15037-4ffd-47f1-b983-34f06895b2a3-node-log\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.304745 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.302967    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4fbb48e0-0e3e-4864-a018-acb5bb48e0a8-kubelet-config\") pod \"global-pull-secret-syncer-422sp\" (UID: \"4fbb48e0-0e3e-4864-a018-acb5bb48e0a8\") " pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 21:59:53.304745 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.303023    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/16745241-a6b7-41c6-9c97-176962591677-hosts-file\") pod \"node-resolver-s4gbt\" (UID: \"16745241-a6b7-41c6-9c97-176962591677\") " pod="openshift-dns/node-resolver-s4gbt"
Jul 31 21:59:53.304745 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.303053    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf4s6\" (UniqueName: \"kubernetes.io/projected/16745241-a6b7-41c6-9c97-176962591677-kube-api-access-vf4s6\") pod \"node-resolver-s4gbt\" (UID: \"16745241-a6b7-41c6-9c97-176962591677\") " pod="openshift-dns/node-resolver-s4gbt"
Jul 31 21:59:53.304745 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.303097    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7ea8a115-e5a1-4056-bd0e-a74666e07032-registration-dir\") pod \"aws-ebs-csi-driver-node-plplk\" (UID: \"7ea8a115-e5a1-4056-bd0e-a74666e07032\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plplk"
Jul 31 21:59:53.304745 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.303159    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8pqf\" (UniqueName: \"kubernetes.io/projected/bac49c41-6245-48dd-b89d-5e799e544e08-kube-api-access-p8pqf\") pod \"network-check-target-5sf9m\" (UID: \"bac49c41-6245-48dd-b89d-5e799e544e08\") " pod="openshift-network-diagnostics/network-check-target-5sf9m"
Jul 31 21:59:53.304745 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.303987    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zq4rk"
Jul 31 21:59:53.305332 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.304809    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/79e15037-4ffd-47f1-b983-34f06895b2a3-ovn-node-metrics-cert\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.327745 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.327717    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctnpl\" (UniqueName: \"kubernetes.io/projected/79e15037-4ffd-47f1-b983-34f06895b2a3-kube-api-access-ctnpl\") pod \"ovnkube-node-4ddp8\" (UID: \"79e15037-4ffd-47f1-b983-34f06895b2a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.328208 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.328188    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gkmk\" (UniqueName: \"kubernetes.io/projected/5cd860f1-df9a-4df3-9bea-45d697a20f92-kube-api-access-5gkmk\") pod \"network-metrics-daemon-dpcw4\" (UID: \"5cd860f1-df9a-4df3-9bea-45d697a20f92\") " pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 21:59:53.332157 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:53.332136    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 21:59:53.332157 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:53.332159    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 21:59:53.332295 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:53.332172    2573 projected.go:196] Error preparing data for projected volume kube-api-access-p8pqf for pod openshift-network-diagnostics/network-check-target-5sf9m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 21:59:53.332295 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:53.332236    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bac49c41-6245-48dd-b89d-5e799e544e08-kube-api-access-p8pqf podName:bac49c41-6245-48dd-b89d-5e799e544e08 nodeName:}" failed. No retries permitted until 2026-07-31 21:59:53.832219746 +0000 UTC m=+2.927510883 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-p8pqf" (UniqueName: "kubernetes.io/projected/bac49c41-6245-48dd-b89d-5e799e544e08-kube-api-access-p8pqf") pod "network-check-target-5sf9m" (UID: "bac49c41-6245-48dd-b89d-5e799e544e08") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 21:59:53.403623 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.403599    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/63d076da-c8ff-4bb5-adc0-bdc834bdf23f-run\") pod \"tuned-djtgp\" (UID: \"63d076da-c8ff-4bb5-adc0-bdc834bdf23f\") " pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.403623 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.403626    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/63d076da-c8ff-4bb5-adc0-bdc834bdf23f-lib-modules\") pod \"tuned-djtgp\" (UID: \"63d076da-c8ff-4bb5-adc0-bdc834bdf23f\") " pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.403793 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.403643    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7529582d-7128-42da-ae3c-147316632064-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-46mtl\" (UID: \"7529582d-7128-42da-ae3c-147316632064\") " pod="openshift-multus/multus-additional-cni-plugins-46mtl"
Jul 31 21:59:53.403793 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.403668    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/35bdf8db-313d-4461-9a2c-4e885c896c3a-multus-daemon-config\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.403793 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.403786    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63d076da-c8ff-4bb5-adc0-bdc834bdf23f-etc-kubernetes\") pod \"tuned-djtgp\" (UID: \"63d076da-c8ff-4bb5-adc0-bdc834bdf23f\") " pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.403944 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.403817    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4fbb48e0-0e3e-4864-a018-acb5bb48e0a8-kubelet-config\") pod \"global-pull-secret-syncer-422sp\" (UID: \"4fbb48e0-0e3e-4864-a018-acb5bb48e0a8\") " pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 21:59:53.403944 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.403844    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/63d076da-c8ff-4bb5-adc0-bdc834bdf23f-lib-modules\") pod \"tuned-djtgp\" (UID: \"63d076da-c8ff-4bb5-adc0-bdc834bdf23f\") " pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.403944 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.403787    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/63d076da-c8ff-4bb5-adc0-bdc834bdf23f-run\") pod \"tuned-djtgp\" (UID: \"63d076da-c8ff-4bb5-adc0-bdc834bdf23f\") " pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.403944 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.403845    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/16745241-a6b7-41c6-9c97-176962591677-hosts-file\") pod \"node-resolver-s4gbt\" (UID: \"16745241-a6b7-41c6-9c97-176962591677\") " pod="openshift-dns/node-resolver-s4gbt"
Jul 31 21:59:53.403944 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.403868    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63d076da-c8ff-4bb5-adc0-bdc834bdf23f-etc-kubernetes\") pod \"tuned-djtgp\" (UID: \"63d076da-c8ff-4bb5-adc0-bdc834bdf23f\") " pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.403944 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.403901    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf4s6\" (UniqueName: \"kubernetes.io/projected/16745241-a6b7-41c6-9c97-176962591677-kube-api-access-vf4s6\") pod \"node-resolver-s4gbt\" (UID: \"16745241-a6b7-41c6-9c97-176962591677\") " pod="openshift-dns/node-resolver-s4gbt"
Jul 31 21:59:53.403944 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.403909    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/16745241-a6b7-41c6-9c97-176962591677-hosts-file\") pod \"node-resolver-s4gbt\" (UID: \"16745241-a6b7-41c6-9c97-176962591677\") " pod="openshift-dns/node-resolver-s4gbt"
Jul 31 21:59:53.403944 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.403935    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4fbb48e0-0e3e-4864-a018-acb5bb48e0a8-kubelet-config\") pod \"global-pull-secret-syncer-422sp\" (UID: \"4fbb48e0-0e3e-4864-a018-acb5bb48e0a8\") " pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 21:59:53.404336 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.403981    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7ea8a115-e5a1-4056-bd0e-a74666e07032-registration-dir\") pod \"aws-ebs-csi-driver-node-plplk\" (UID: \"7ea8a115-e5a1-4056-bd0e-a74666e07032\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plplk"
Jul 31 21:59:53.404336 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.404102    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7ea8a115-e5a1-4056-bd0e-a74666e07032-registration-dir\") pod \"aws-ebs-csi-driver-node-plplk\" (UID: \"7ea8a115-e5a1-4056-bd0e-a74666e07032\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plplk"
Jul 31 21:59:53.404336 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.404113    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7529582d-7128-42da-ae3c-147316632064-system-cni-dir\") pod \"multus-additional-cni-plugins-46mtl\" (UID: \"7529582d-7128-42da-ae3c-147316632064\") " pod="openshift-multus/multus-additional-cni-plugins-46mtl"
Jul 31 21:59:53.404336 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.404142    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7529582d-7128-42da-ae3c-147316632064-os-release\") pod \"multus-additional-cni-plugins-46mtl\" (UID: \"7529582d-7128-42da-ae3c-147316632064\") " pod="openshift-multus/multus-additional-cni-plugins-46mtl"
Jul 31 21:59:53.404336 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.404149    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7529582d-7128-42da-ae3c-147316632064-system-cni-dir\") pod \"multus-additional-cni-plugins-46mtl\" (UID: \"7529582d-7128-42da-ae3c-147316632064\") " pod="openshift-multus/multus-additional-cni-plugins-46mtl"
Jul 31 21:59:53.404336 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.404169    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7ea8a115-e5a1-4056-bd0e-a74666e07032-etc-selinux\") pod \"aws-ebs-csi-driver-node-plplk\" (UID: \"7ea8a115-e5a1-4056-bd0e-a74666e07032\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plplk"
Jul 31 21:59:53.404336 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.404199    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4fbb48e0-0e3e-4864-a018-acb5bb48e0a8-dbus\") pod \"global-pull-secret-syncer-422sp\" (UID: \"4fbb48e0-0e3e-4864-a018-acb5bb48e0a8\") " pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 21:59:53.404336 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.404205    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7529582d-7128-42da-ae3c-147316632064-os-release\") pod \"multus-additional-cni-plugins-46mtl\" (UID: \"7529582d-7128-42da-ae3c-147316632064\") " pod="openshift-multus/multus-additional-cni-plugins-46mtl"
Jul 31 21:59:53.404336 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.404221    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/085556af-0fc0-4c79-9f9c-ca71dc96dcfc-serviceca\") pod \"node-ca-fv879\" (UID: \"085556af-0fc0-4c79-9f9c-ca71dc96dcfc\") " pod="openshift-image-registry/node-ca-fv879"
Jul 31 21:59:53.404336 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.404239    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/35bdf8db-313d-4461-9a2c-4e885c896c3a-multus-daemon-config\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.404336 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.404244    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/35bdf8db-313d-4461-9a2c-4e885c896c3a-multus-socket-dir-parent\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.404336 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.404250    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7529582d-7128-42da-ae3c-147316632064-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-46mtl\" (UID: \"7529582d-7128-42da-ae3c-147316632064\") " pod="openshift-multus/multus-additional-cni-plugins-46mtl"
Jul 31 21:59:53.404336 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.404318    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7ea8a115-e5a1-4056-bd0e-a74666e07032-etc-selinux\") pod \"aws-ebs-csi-driver-node-plplk\" (UID: \"7ea8a115-e5a1-4056-bd0e-a74666e07032\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plplk"
Jul 31 21:59:53.404336 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.404327    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/35bdf8db-313d-4461-9a2c-4e885c896c3a-multus-socket-dir-parent\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.404336 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.404338    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4fbb48e0-0e3e-4864-a018-acb5bb48e0a8-dbus\") pod \"global-pull-secret-syncer-422sp\" (UID: \"4fbb48e0-0e3e-4864-a018-acb5bb48e0a8\") " pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 21:59:53.405042 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.404337    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63d076da-c8ff-4bb5-adc0-bdc834bdf23f-var-lib-kubelet\") pod \"tuned-djtgp\" (UID: \"63d076da-c8ff-4bb5-adc0-bdc834bdf23f\") " pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.405042 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.404382    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63d076da-c8ff-4bb5-adc0-bdc834bdf23f-var-lib-kubelet\") pod \"tuned-djtgp\" (UID: \"63d076da-c8ff-4bb5-adc0-bdc834bdf23f\") " pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.405042 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.404400    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7529582d-7128-42da-ae3c-147316632064-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-46mtl\" (UID: \"7529582d-7128-42da-ae3c-147316632064\") " pod="openshift-multus/multus-additional-cni-plugins-46mtl"
Jul 31 21:59:53.405042 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.404428    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v5bn\" (UniqueName: \"kubernetes.io/projected/9c7c0bd9-8cdd-46bf-ba9c-81c59d68cec8-kube-api-access-2v5bn\") pod \"iptables-alerter-krlnf\" (UID: \"9c7c0bd9-8cdd-46bf-ba9c-81c59d68cec8\") " pod="openshift-network-operator/iptables-alerter-krlnf"
Jul 31 21:59:53.405042 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.404447    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/63d076da-c8ff-4bb5-adc0-bdc834bdf23f-host\") pod \"tuned-djtgp\" (UID: \"63d076da-c8ff-4bb5-adc0-bdc834bdf23f\") " pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.405042 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.404468    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/63d076da-c8ff-4bb5-adc0-bdc834bdf23f-etc-tuned\") pod \"tuned-djtgp\" (UID: \"63d076da-c8ff-4bb5-adc0-bdc834bdf23f\") " pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.405042 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.404493    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63d076da-c8ff-4bb5-adc0-bdc834bdf23f-tmp\") pod \"tuned-djtgp\" (UID: \"63d076da-c8ff-4bb5-adc0-bdc834bdf23f\") " pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.405042 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.404515    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7529582d-7128-42da-ae3c-147316632064-tuning-conf-dir\") pod \"multus-additional-cni-plugins-46mtl\" (UID: \"7529582d-7128-42da-ae3c-147316632064\") " pod="openshift-multus/multus-additional-cni-plugins-46mtl"
Jul 31 21:59:53.405042 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.404517    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/63d076da-c8ff-4bb5-adc0-bdc834bdf23f-host\") pod \"tuned-djtgp\" (UID: \"63d076da-c8ff-4bb5-adc0-bdc834bdf23f\") " pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.405042 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.404554    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4fbb48e0-0e3e-4864-a018-acb5bb48e0a8-original-pull-secret\") pod \"global-pull-secret-syncer-422sp\" (UID: \"4fbb48e0-0e3e-4864-a018-acb5bb48e0a8\") " pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 21:59:53.405042 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.404582    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/35bdf8db-313d-4461-9a2c-4e885c896c3a-cni-binary-copy\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.405042 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.404603    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/63d076da-c8ff-4bb5-adc0-bdc834bdf23f-etc-systemd\") pod \"tuned-djtgp\" (UID: \"63d076da-c8ff-4bb5-adc0-bdc834bdf23f\") " pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.405042 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.404625    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7529582d-7128-42da-ae3c-147316632064-cnibin\") pod \"multus-additional-cni-plugins-46mtl\" (UID: \"7529582d-7128-42da-ae3c-147316632064\") " pod="openshift-multus/multus-additional-cni-plugins-46mtl"
Jul 31 21:59:53.405042 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.404649    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7ea8a115-e5a1-4056-bd0e-a74666e07032-socket-dir\") pod \"aws-ebs-csi-driver-node-plplk\" (UID: \"7ea8a115-e5a1-4056-bd0e-a74666e07032\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plplk"
Jul 31 21:59:53.405042 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.404674    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ghdw\" (UniqueName: \"kubernetes.io/projected/7ea8a115-e5a1-4056-bd0e-a74666e07032-kube-api-access-6ghdw\") pod \"aws-ebs-csi-driver-node-plplk\" (UID: \"7ea8a115-e5a1-4056-bd0e-a74666e07032\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plplk"
Jul 31 21:59:53.405042 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.404699    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c7c0bd9-8cdd-46bf-ba9c-81c59d68cec8-iptables-alerter-script\") pod \"iptables-alerter-krlnf\" (UID: \"9c7c0bd9-8cdd-46bf-ba9c-81c59d68cec8\") " pod="openshift-network-operator/iptables-alerter-krlnf"
Jul 31 21:59:53.405042 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.404727    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/35bdf8db-313d-4461-9a2c-4e885c896c3a-host-var-lib-kubelet\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.405872 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.404755    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/35bdf8db-313d-4461-9a2c-4e885c896c3a-hostroot\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.405872 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.404781    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6q8k\" (UniqueName: \"kubernetes.io/projected/63d076da-c8ff-4bb5-adc0-bdc834bdf23f-kube-api-access-w6q8k\") pod \"tuned-djtgp\" (UID: \"63d076da-c8ff-4bb5-adc0-bdc834bdf23f\") " pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.405872 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.404807    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsrbp\" (UniqueName: \"kubernetes.io/projected/7529582d-7128-42da-ae3c-147316632064-kube-api-access-gsrbp\") pod \"multus-additional-cni-plugins-46mtl\" (UID: \"7529582d-7128-42da-ae3c-147316632064\") " pod="openshift-multus/multus-additional-cni-plugins-46mtl"
Jul 31 21:59:53.405872 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.404822    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7529582d-7128-42da-ae3c-147316632064-cnibin\") pod \"multus-additional-cni-plugins-46mtl\" (UID: \"7529582d-7128-42da-ae3c-147316632064\") " pod="openshift-multus/multus-additional-cni-plugins-46mtl"
Jul 31 21:59:53.405872 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.404834    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/35bdf8db-313d-4461-9a2c-4e885c896c3a-system-cni-dir\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.405872 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.404848    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7529582d-7128-42da-ae3c-147316632064-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-46mtl\" (UID: \"7529582d-7128-42da-ae3c-147316632064\") " pod="openshift-multus/multus-additional-cni-plugins-46mtl"
Jul 31 21:59:53.405872 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.404857    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/35bdf8db-313d-4461-9a2c-4e885c896c3a-cnibin\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.405872 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.404881    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/35bdf8db-313d-4461-9a2c-4e885c896c3a-os-release\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.405872 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.404676    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/085556af-0fc0-4c79-9f9c-ca71dc96dcfc-serviceca\") pod \"node-ca-fv879\" (UID: \"085556af-0fc0-4c79-9f9c-ca71dc96dcfc\") " pod="openshift-image-registry/node-ca-fv879"
Jul 31 21:59:53.405872 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.404976    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7529582d-7128-42da-ae3c-147316632064-tuning-conf-dir\") pod \"multus-additional-cni-plugins-46mtl\" (UID: \"7529582d-7128-42da-ae3c-147316632064\") " pod="openshift-multus/multus-additional-cni-plugins-46mtl"
Jul 31 21:59:53.405872 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:53.405026    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 21:59:53.405872 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.405047    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/63d076da-c8ff-4bb5-adc0-bdc834bdf23f-etc-systemd\") pod \"tuned-djtgp\" (UID: \"63d076da-c8ff-4bb5-adc0-bdc834bdf23f\") " pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.405872 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.405052    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/35bdf8db-313d-4461-9a2c-4e885c896c3a-host-var-lib-kubelet\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.405872 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:53.405073    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fbb48e0-0e3e-4864-a018-acb5bb48e0a8-original-pull-secret podName:4fbb48e0-0e3e-4864-a018-acb5bb48e0a8 nodeName:}" failed. No retries permitted until 2026-07-31 21:59:53.905056486 +0000 UTC m=+3.000347640 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4fbb48e0-0e3e-4864-a018-acb5bb48e0a8-original-pull-secret") pod "global-pull-secret-syncer-422sp" (UID: "4fbb48e0-0e3e-4864-a018-acb5bb48e0a8") : object "kube-system"/"original-pull-secret" not registered
Jul 31 21:59:53.405872 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.405112    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7ea8a115-e5a1-4056-bd0e-a74666e07032-device-dir\") pod \"aws-ebs-csi-driver-node-plplk\" (UID: \"7ea8a115-e5a1-4056-bd0e-a74666e07032\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plplk"
Jul 31 21:59:53.405872 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.405151    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c7c0bd9-8cdd-46bf-ba9c-81c59d68cec8-host-slash\") pod \"iptables-alerter-krlnf\" (UID: \"9c7c0bd9-8cdd-46bf-ba9c-81c59d68cec8\") " pod="openshift-network-operator/iptables-alerter-krlnf"
Jul 31 21:59:53.405872 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.405176    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7ea8a115-e5a1-4056-bd0e-a74666e07032-kubelet-dir\") pod \"aws-ebs-csi-driver-node-plplk\" (UID: \"7ea8a115-e5a1-4056-bd0e-a74666e07032\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plplk"
Jul 31 21:59:53.406713 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.405194    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/35bdf8db-313d-4461-9a2c-4e885c896c3a-hostroot\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.406713 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.405286    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/35bdf8db-313d-4461-9a2c-4e885c896c3a-system-cni-dir\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.406713 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.405324    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/35bdf8db-313d-4461-9a2c-4e885c896c3a-cni-binary-copy\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.406713 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.405349    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/35bdf8db-313d-4461-9a2c-4e885c896c3a-cnibin\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.406713 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.405373    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7ea8a115-e5a1-4056-bd0e-a74666e07032-device-dir\") pod \"aws-ebs-csi-driver-node-plplk\" (UID: \"7ea8a115-e5a1-4056-bd0e-a74666e07032\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plplk"
Jul 31 21:59:53.406713 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.405379    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/35bdf8db-313d-4461-9a2c-4e885c896c3a-os-release\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.406713 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.405446    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c7c0bd9-8cdd-46bf-ba9c-81c59d68cec8-host-slash\") pod \"iptables-alerter-krlnf\" (UID: \"9c7c0bd9-8cdd-46bf-ba9c-81c59d68cec8\") " pod="openshift-network-operator/iptables-alerter-krlnf"
Jul 31 21:59:53.406713 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.405511    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7ea8a115-e5a1-4056-bd0e-a74666e07032-kubelet-dir\") pod \"aws-ebs-csi-driver-node-plplk\" (UID: \"7ea8a115-e5a1-4056-bd0e-a74666e07032\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plplk"
Jul 31 21:59:53.406713 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.405534    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/63d076da-c8ff-4bb5-adc0-bdc834bdf23f-etc-sysctl-conf\") pod \"tuned-djtgp\" (UID: \"63d076da-c8ff-4bb5-adc0-bdc834bdf23f\") " pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.406713 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.405590    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3b94b353-7445-4d82-8517-72dae731db0d-agent-certs\") pod \"konnectivity-agent-r44dc\" (UID: \"3b94b353-7445-4d82-8517-72dae731db0d\") " pod="kube-system/konnectivity-agent-r44dc"
Jul 31 21:59:53.406713 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.405628    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/35bdf8db-313d-4461-9a2c-4e885c896c3a-host-run-multus-certs\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.406713 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.405635    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7ea8a115-e5a1-4056-bd0e-a74666e07032-socket-dir\") pod \"aws-ebs-csi-driver-node-plplk\" (UID: \"7ea8a115-e5a1-4056-bd0e-a74666e07032\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plplk"
Jul 31 21:59:53.406713 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.405695    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7529582d-7128-42da-ae3c-147316632064-cni-binary-copy\") pod \"multus-additional-cni-plugins-46mtl\" (UID: \"7529582d-7128-42da-ae3c-147316632064\") " pod="openshift-multus/multus-additional-cni-plugins-46mtl"
Jul 31 21:59:53.406713 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.405732    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/085556af-0fc0-4c79-9f9c-ca71dc96dcfc-host\") pod \"node-ca-fv879\" (UID: \"085556af-0fc0-4c79-9f9c-ca71dc96dcfc\") " pod="openshift-image-registry/node-ca-fv879"
Jul 31 21:59:53.406713 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.405755    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/35bdf8db-313d-4461-9a2c-4e885c896c3a-host-run-netns\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.406713 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.405897    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/63d076da-c8ff-4bb5-adc0-bdc834bdf23f-etc-sysctl-conf\") pod \"tuned-djtgp\" (UID: \"63d076da-c8ff-4bb5-adc0-bdc834bdf23f\") " pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.406713 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.405909    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/35bdf8db-313d-4461-9a2c-4e885c896c3a-host-run-netns\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.406713 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.405955    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/085556af-0fc0-4c79-9f9c-ca71dc96dcfc-host\") pod \"node-ca-fv879\" (UID: \"085556af-0fc0-4c79-9f9c-ca71dc96dcfc\") " pod="openshift-image-registry/node-ca-fv879"
Jul 31 21:59:53.407541 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.405965    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/63d076da-c8ff-4bb5-adc0-bdc834bdf23f-etc-sysctl-d\") pod \"tuned-djtgp\" (UID: \"63d076da-c8ff-4bb5-adc0-bdc834bdf23f\") " pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.407541 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.405998    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3b94b353-7445-4d82-8517-72dae731db0d-konnectivity-ca\") pod \"konnectivity-agent-r44dc\" (UID: \"3b94b353-7445-4d82-8517-72dae731db0d\") " pod="kube-system/konnectivity-agent-r44dc"
Jul 31 21:59:53.407541 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.406028    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4spq\" (UniqueName: \"kubernetes.io/projected/085556af-0fc0-4c79-9f9c-ca71dc96dcfc-kube-api-access-p4spq\") pod \"node-ca-fv879\" (UID: \"085556af-0fc0-4c79-9f9c-ca71dc96dcfc\") " pod="openshift-image-registry/node-ca-fv879"
Jul 31 21:59:53.407541 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.406054    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/35bdf8db-313d-4461-9a2c-4e885c896c3a-multus-cni-dir\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.407541 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.406103    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/63d076da-c8ff-4bb5-adc0-bdc834bdf23f-etc-modprobe-d\") pod \"tuned-djtgp\" (UID: \"63d076da-c8ff-4bb5-adc0-bdc834bdf23f\") " pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.407541 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.406109    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/63d076da-c8ff-4bb5-adc0-bdc834bdf23f-etc-sysctl-d\") pod \"tuned-djtgp\" (UID: \"63d076da-c8ff-4bb5-adc0-bdc834bdf23f\") " pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.407541 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.406128    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/63d076da-c8ff-4bb5-adc0-bdc834bdf23f-etc-sysconfig\") pod \"tuned-djtgp\" (UID: \"63d076da-c8ff-4bb5-adc0-bdc834bdf23f\") " pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.407541 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.406152    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7ea8a115-e5a1-4056-bd0e-a74666e07032-sys-fs\") pod \"aws-ebs-csi-driver-node-plplk\" (UID: \"7ea8a115-e5a1-4056-bd0e-a74666e07032\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plplk"
Jul 31 21:59:53.407541 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.406177    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/35bdf8db-313d-4461-9a2c-4e885c896c3a-host-run-k8s-cni-cncf-io\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.407541 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.406201    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/35bdf8db-313d-4461-9a2c-4e885c896c3a-host-var-lib-cni-bin\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.407541 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.406218    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7529582d-7128-42da-ae3c-147316632064-cni-binary-copy\") pod \"multus-additional-cni-plugins-46mtl\" (UID: \"7529582d-7128-42da-ae3c-147316632064\") " pod="openshift-multus/multus-additional-cni-plugins-46mtl"
Jul 31 21:59:53.407541 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.406226    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/35bdf8db-313d-4461-9a2c-4e885c896c3a-host-var-lib-cni-multus\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.407541 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.406249    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35bdf8db-313d-4461-9a2c-4e885c896c3a-etc-kubernetes\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.407541 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.406276    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrl7h\" (UniqueName: \"kubernetes.io/projected/35bdf8db-313d-4461-9a2c-4e885c896c3a-kube-api-access-rrl7h\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.407541 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.406282    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/63d076da-c8ff-4bb5-adc0-bdc834bdf23f-etc-sysconfig\") pod \"tuned-djtgp\" (UID: \"63d076da-c8ff-4bb5-adc0-bdc834bdf23f\") " pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.407541 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.406378    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7ea8a115-e5a1-4056-bd0e-a74666e07032-sys-fs\") pod \"aws-ebs-csi-driver-node-plplk\" (UID: \"7ea8a115-e5a1-4056-bd0e-a74666e07032\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plplk"
Jul 31 21:59:53.407541 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.406382    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/35bdf8db-313d-4461-9a2c-4e885c896c3a-multus-cni-dir\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.408126 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.406407    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c7c0bd9-8cdd-46bf-ba9c-81c59d68cec8-iptables-alerter-script\") pod \"iptables-alerter-krlnf\" (UID: \"9c7c0bd9-8cdd-46bf-ba9c-81c59d68cec8\") " pod="openshift-network-operator/iptables-alerter-krlnf"
Jul 31 21:59:53.408126 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.406415    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/35bdf8db-313d-4461-9a2c-4e885c896c3a-host-var-lib-cni-bin\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.408126 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.406420    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/63d076da-c8ff-4bb5-adc0-bdc834bdf23f-etc-modprobe-d\") pod \"tuned-djtgp\" (UID: \"63d076da-c8ff-4bb5-adc0-bdc834bdf23f\") " pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.408126 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.406458    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/35bdf8db-313d-4461-9a2c-4e885c896c3a-host-run-k8s-cni-cncf-io\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.408126 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.406469    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35bdf8db-313d-4461-9a2c-4e885c896c3a-etc-kubernetes\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.408126 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.406500    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/35bdf8db-313d-4461-9a2c-4e885c896c3a-host-var-lib-cni-multus\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.408126 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.406607    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/35bdf8db-313d-4461-9a2c-4e885c896c3a-host-run-multus-certs\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.408126 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.406620    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63d076da-c8ff-4bb5-adc0-bdc834bdf23f-sys\") pod \"tuned-djtgp\" (UID: \"63d076da-c8ff-4bb5-adc0-bdc834bdf23f\") " pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.408126 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.406316    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63d076da-c8ff-4bb5-adc0-bdc834bdf23f-sys\") pod \"tuned-djtgp\" (UID: \"63d076da-c8ff-4bb5-adc0-bdc834bdf23f\") " pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.408126 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.406673    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16745241-a6b7-41c6-9c97-176962591677-tmp-dir\") pod \"node-resolver-s4gbt\" (UID: \"16745241-a6b7-41c6-9c97-176962591677\") " pod="openshift-dns/node-resolver-s4gbt"
Jul 31 21:59:53.408126 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.406695    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/35bdf8db-313d-4461-9a2c-4e885c896c3a-multus-conf-dir\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.408126 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.406756    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/35bdf8db-313d-4461-9a2c-4e885c896c3a-multus-conf-dir\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.408126 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.406997    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16745241-a6b7-41c6-9c97-176962591677-tmp-dir\") pod \"node-resolver-s4gbt\" (UID: \"16745241-a6b7-41c6-9c97-176962591677\") " pod="openshift-dns/node-resolver-s4gbt"
Jul 31 21:59:53.408126 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.407385    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/63d076da-c8ff-4bb5-adc0-bdc834bdf23f-etc-tuned\") pod \"tuned-djtgp\" (UID: \"63d076da-c8ff-4bb5-adc0-bdc834bdf23f\") " pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.408126 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.407456    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3b94b353-7445-4d82-8517-72dae731db0d-konnectivity-ca\") pod \"konnectivity-agent-r44dc\" (UID: \"3b94b353-7445-4d82-8517-72dae731db0d\") " pod="kube-system/konnectivity-agent-r44dc"
Jul 31 21:59:53.408126 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.408023    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63d076da-c8ff-4bb5-adc0-bdc834bdf23f-tmp\") pod \"tuned-djtgp\" (UID: \"63d076da-c8ff-4bb5-adc0-bdc834bdf23f\") " pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.408662 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.408160    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3b94b353-7445-4d82-8517-72dae731db0d-agent-certs\") pod \"konnectivity-agent-r44dc\" (UID: \"3b94b353-7445-4d82-8517-72dae731db0d\") " pod="kube-system/konnectivity-agent-r44dc"
Jul 31 21:59:53.424473 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.424450    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf4s6\" (UniqueName: \"kubernetes.io/projected/16745241-a6b7-41c6-9c97-176962591677-kube-api-access-vf4s6\") pod \"node-resolver-s4gbt\" (UID: \"16745241-a6b7-41c6-9c97-176962591677\") " pod="openshift-dns/node-resolver-s4gbt"
Jul 31 21:59:53.428650 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.428604    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v5bn\" (UniqueName: \"kubernetes.io/projected/9c7c0bd9-8cdd-46bf-ba9c-81c59d68cec8-kube-api-access-2v5bn\") pod \"iptables-alerter-krlnf\" (UID: \"9c7c0bd9-8cdd-46bf-ba9c-81c59d68cec8\") " pod="openshift-network-operator/iptables-alerter-krlnf"
Jul 31 21:59:53.430317 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.430280    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsrbp\" (UniqueName: \"kubernetes.io/projected/7529582d-7128-42da-ae3c-147316632064-kube-api-access-gsrbp\") pod \"multus-additional-cni-plugins-46mtl\" (UID: \"7529582d-7128-42da-ae3c-147316632064\") " pod="openshift-multus/multus-additional-cni-plugins-46mtl"
Jul 31 21:59:53.432448 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.432426    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6q8k\" (UniqueName: \"kubernetes.io/projected/63d076da-c8ff-4bb5-adc0-bdc834bdf23f-kube-api-access-w6q8k\") pod \"tuned-djtgp\" (UID: \"63d076da-c8ff-4bb5-adc0-bdc834bdf23f\") " pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.432681 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.432658    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ghdw\" (UniqueName: \"kubernetes.io/projected/7ea8a115-e5a1-4056-bd0e-a74666e07032-kube-api-access-6ghdw\") pod \"aws-ebs-csi-driver-node-plplk\" (UID: \"7ea8a115-e5a1-4056-bd0e-a74666e07032\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plplk"
Jul 31 21:59:53.434349 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.434286    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4spq\" (UniqueName: \"kubernetes.io/projected/085556af-0fc0-4c79-9f9c-ca71dc96dcfc-kube-api-access-p4spq\") pod \"node-ca-fv879\" (UID: \"085556af-0fc0-4c79-9f9c-ca71dc96dcfc\") " pod="openshift-image-registry/node-ca-fv879"
Jul 31 21:59:53.434631 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.434612    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrl7h\" (UniqueName: \"kubernetes.io/projected/35bdf8db-313d-4461-9a2c-4e885c896c3a-kube-api-access-rrl7h\") pod \"multus-svhwq\" (UID: \"35bdf8db-313d-4461-9a2c-4e885c896c3a\") " pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.501257 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.501232    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 21:59:53.508710 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.508694    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fv879"
Jul 31 21:59:53.516927 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.516908    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-46mtl"
Jul 31 21:59:53.523999 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.523981    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-svhwq"
Jul 31 21:59:53.530570 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.530552    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plplk"
Jul 31 21:59:53.537681 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.537662    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r44dc"
Jul 31 21:59:53.545097 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.545080    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-djtgp"
Jul 31 21:59:53.552241 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.552224    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s4gbt"
Jul 31 21:59:53.559998 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.559978    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-krlnf"
Jul 31 21:59:53.688529 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.688458    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 21:59:53.809118 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.809088    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cd860f1-df9a-4df3-9bea-45d697a20f92-metrics-certs\") pod \"network-metrics-daemon-dpcw4\" (UID: \"5cd860f1-df9a-4df3-9bea-45d697a20f92\") " pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 21:59:53.809276 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:53.809216    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 21:59:53.809354 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:53.809287    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cd860f1-df9a-4df3-9bea-45d697a20f92-metrics-certs podName:5cd860f1-df9a-4df3-9bea-45d697a20f92 nodeName:}" failed. No retries permitted until 2026-07-31 21:59:54.809266631 +0000 UTC m=+3.904557769 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5cd860f1-df9a-4df3-9bea-45d697a20f92-metrics-certs") pod "network-metrics-daemon-dpcw4" (UID: "5cd860f1-df9a-4df3-9bea-45d697a20f92") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 21:59:53.909749 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.909717    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8pqf\" (UniqueName: \"kubernetes.io/projected/bac49c41-6245-48dd-b89d-5e799e544e08-kube-api-access-p8pqf\") pod \"network-check-target-5sf9m\" (UID: \"bac49c41-6245-48dd-b89d-5e799e544e08\") " pod="openshift-network-diagnostics/network-check-target-5sf9m"
Jul 31 21:59:53.909929 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:53.909775    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4fbb48e0-0e3e-4864-a018-acb5bb48e0a8-original-pull-secret\") pod \"global-pull-secret-syncer-422sp\" (UID: \"4fbb48e0-0e3e-4864-a018-acb5bb48e0a8\") " pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 21:59:53.909929 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:53.909884    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 21:59:53.909929 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:53.909897    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 21:59:53.909929 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:53.909918    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 21:59:53.910098 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:53.909943    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fbb48e0-0e3e-4864-a018-acb5bb48e0a8-original-pull-secret podName:4fbb48e0-0e3e-4864-a018-acb5bb48e0a8 nodeName:}" failed. No retries permitted until 2026-07-31 21:59:54.909922671 +0000 UTC m=+4.005213814 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4fbb48e0-0e3e-4864-a018-acb5bb48e0a8-original-pull-secret") pod "global-pull-secret-syncer-422sp" (UID: "4fbb48e0-0e3e-4864-a018-acb5bb48e0a8") : object "kube-system"/"original-pull-secret" not registered
Jul 31 21:59:53.910098 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:53.909945    2573 projected.go:196] Error preparing data for projected volume kube-api-access-p8pqf for pod openshift-network-diagnostics/network-check-target-5sf9m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 21:59:53.910098 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:53.909979    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bac49c41-6245-48dd-b89d-5e799e544e08-kube-api-access-p8pqf podName:bac49c41-6245-48dd-b89d-5e799e544e08 nodeName:}" failed. No retries permitted until 2026-07-31 21:59:54.909973556 +0000 UTC m=+4.005264693 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-p8pqf" (UniqueName: "kubernetes.io/projected/bac49c41-6245-48dd-b89d-5e799e544e08-kube-api-access-p8pqf") pod "network-check-target-5sf9m" (UID: "bac49c41-6245-48dd-b89d-5e799e544e08") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 21:59:54.127544 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:54.127517    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63d076da_c8ff_4bb5_adc0_bdc834bdf23f.slice/crio-c0e78b59aa64e1eec72b2785ed4b9691ab36f326aaec4f68b105d102c02b269d WatchSource:0}: Error finding container c0e78b59aa64e1eec72b2785ed4b9691ab36f326aaec4f68b105d102c02b269d: Status 404 returned error can't find the container with id c0e78b59aa64e1eec72b2785ed4b9691ab36f326aaec4f68b105d102c02b269d
Jul 31 21:59:54.129438 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:54.129413    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ea8a115_e5a1_4056_bd0e_a74666e07032.slice/crio-fbd004f7fca321e45012dc22b3c48134ae54f0a851dd9b40d041c227aa3cefa3 WatchSource:0}: Error finding container fbd004f7fca321e45012dc22b3c48134ae54f0a851dd9b40d041c227aa3cefa3: Status 404 returned error can't find the container with id fbd004f7fca321e45012dc22b3c48134ae54f0a851dd9b40d041c227aa3cefa3
Jul 31 21:59:54.132533 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:54.132509    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b94b353_7445_4d82_8517_72dae731db0d.slice/crio-45d4ac2a9c35b53586a4eaabf08ee252c778fd3a76ce215d43491d93e551f35f WatchSource:0}: Error finding container 45d4ac2a9c35b53586a4eaabf08ee252c778fd3a76ce215d43491d93e551f35f: Status 404 returned error can't find the container with id 45d4ac2a9c35b53586a4eaabf08ee252c778fd3a76ce215d43491d93e551f35f
Jul 31 21:59:54.133318 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:54.133280    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7529582d_7128_42da_ae3c_147316632064.slice/crio-eb449583bd20dbebe3716b4b099702d277d09ddcce6be8e3eb2c5159f1fc377c WatchSource:0}: Error finding container eb449583bd20dbebe3716b4b099702d277d09ddcce6be8e3eb2c5159f1fc377c: Status 404 returned error can't find the container with id eb449583bd20dbebe3716b4b099702d277d09ddcce6be8e3eb2c5159f1fc377c
Jul 31 21:59:54.134262 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:54.134162    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c7c0bd9_8cdd_46bf_ba9c_81c59d68cec8.slice/crio-ae26bf020b6e488709339eb785e0ae08c6257fb071c9fc052b3f9448c7038baa WatchSource:0}: Error finding container ae26bf020b6e488709339eb785e0ae08c6257fb071c9fc052b3f9448c7038baa: Status 404 returned error can't find the container with id ae26bf020b6e488709339eb785e0ae08c6257fb071c9fc052b3f9448c7038baa
Jul 31 21:59:54.134956 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:54.134866    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79e15037_4ffd_47f1_b983_34f06895b2a3.slice/crio-02d180c4390066a837782d82807f94d5564472d3885d6a810a704a279d2c0fbb WatchSource:0}: Error finding container 02d180c4390066a837782d82807f94d5564472d3885d6a810a704a279d2c0fbb: Status 404 returned error can't find the container with id 02d180c4390066a837782d82807f94d5564472d3885d6a810a704a279d2c0fbb
Jul 31 21:59:54.136059 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:54.135921    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod085556af_0fc0_4c79_9f9c_ca71dc96dcfc.slice/crio-3de9ff15596a547c15578db20edb46320d9ea7600670ab6929f82d659468a6c7 WatchSource:0}: Error finding container 3de9ff15596a547c15578db20edb46320d9ea7600670ab6929f82d659468a6c7: Status 404 returned error can't find the container with id 3de9ff15596a547c15578db20edb46320d9ea7600670ab6929f82d659468a6c7
Jul 31 21:59:54.136793 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:54.136772    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35bdf8db_313d_4461_9a2c_4e885c896c3a.slice/crio-ff5d8f03dc04a9341c5f885ddb8301babe6b29c0f8da37bb96d8dfe67af4bcbb WatchSource:0}: Error finding container ff5d8f03dc04a9341c5f885ddb8301babe6b29c0f8da37bb96d8dfe67af4bcbb: Status 404 returned error can't find the container with id ff5d8f03dc04a9341c5f885ddb8301babe6b29c0f8da37bb96d8dfe67af4bcbb
Jul 31 21:59:54.138791 ip-10-0-130-191 kubenswrapper[2573]: W0731 21:59:54.138768    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16745241_a6b7_41c6_9c97_176962591677.slice/crio-edb9195d2222a59fd25186c35a13848d452cd33b27a104ef8bef4361b3a5009d WatchSource:0}: Error finding container edb9195d2222a59fd25186c35a13848d452cd33b27a104ef8bef4361b3a5009d: Status 404 returned error can't find the container with id edb9195d2222a59fd25186c35a13848d452cd33b27a104ef8bef4361b3a5009d
Jul 31 21:59:54.307508 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:54.307431    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-30 21:54:53 +0000 UTC" deadline="2028-02-20 15:34:01.01344528 +0000 UTC"
Jul 31 21:59:54.307921 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:54.307512    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13649h34m6.705941933s"
Jul 31 21:59:54.329088 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:54.329067    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 21:59:54.329182 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:54.329161    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpcw4" podUID="5cd860f1-df9a-4df3-9bea-45d697a20f92"
Jul 31 21:59:54.337041 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:54.337017    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-191.ec2.internal" event={"ID":"d8d2242e12894094bb066f41e4e156aa","Type":"ContainerStarted","Data":"5ce9f8492a4a3f0a3d1ada2d98efb139271cb1d3f4414b24d20f43f2d4803e68"}
Jul 31 21:59:54.338149 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:54.338127    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-svhwq" event={"ID":"35bdf8db-313d-4461-9a2c-4e885c896c3a","Type":"ContainerStarted","Data":"ff5d8f03dc04a9341c5f885ddb8301babe6b29c0f8da37bb96d8dfe67af4bcbb"}
Jul 31 21:59:54.339212 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:54.339189    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fv879" event={"ID":"085556af-0fc0-4c79-9f9c-ca71dc96dcfc","Type":"ContainerStarted","Data":"3de9ff15596a547c15578db20edb46320d9ea7600670ab6929f82d659468a6c7"}
Jul 31 21:59:54.340160 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:54.340141    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-krlnf" event={"ID":"9c7c0bd9-8cdd-46bf-ba9c-81c59d68cec8","Type":"ContainerStarted","Data":"ae26bf020b6e488709339eb785e0ae08c6257fb071c9fc052b3f9448c7038baa"}
Jul 31 21:59:54.341387 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:54.341364    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-46mtl" event={"ID":"7529582d-7128-42da-ae3c-147316632064","Type":"ContainerStarted","Data":"eb449583bd20dbebe3716b4b099702d277d09ddcce6be8e3eb2c5159f1fc377c"}
Jul 31 21:59:54.342425 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:54.342404    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s4gbt" event={"ID":"16745241-a6b7-41c6-9c97-176962591677","Type":"ContainerStarted","Data":"edb9195d2222a59fd25186c35a13848d452cd33b27a104ef8bef4361b3a5009d"}
Jul 31 21:59:54.343416 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:54.343390    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8" event={"ID":"79e15037-4ffd-47f1-b983-34f06895b2a3","Type":"ContainerStarted","Data":"02d180c4390066a837782d82807f94d5564472d3885d6a810a704a279d2c0fbb"}
Jul 31 21:59:54.344703 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:54.344672    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r44dc" event={"ID":"3b94b353-7445-4d82-8517-72dae731db0d","Type":"ContainerStarted","Data":"45d4ac2a9c35b53586a4eaabf08ee252c778fd3a76ce215d43491d93e551f35f"}
Jul 31 21:59:54.345625 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:54.345607    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plplk" event={"ID":"7ea8a115-e5a1-4056-bd0e-a74666e07032","Type":"ContainerStarted","Data":"fbd004f7fca321e45012dc22b3c48134ae54f0a851dd9b40d041c227aa3cefa3"}
Jul 31 21:59:54.346557 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:54.346538    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-djtgp" event={"ID":"63d076da-c8ff-4bb5-adc0-bdc834bdf23f","Type":"ContainerStarted","Data":"c0e78b59aa64e1eec72b2785ed4b9691ab36f326aaec4f68b105d102c02b269d"}
Jul 31 21:59:54.351122 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:54.351085    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-191.ec2.internal" podStartSLOduration=2.351073767 podStartE2EDuration="2.351073767s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:59:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:59:54.350767787 +0000 UTC m=+3.446058953" watchObservedRunningTime="2026-07-31 21:59:54.351073767 +0000 UTC m=+3.446364912"
Jul 31 21:59:54.816537 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:54.816450    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cd860f1-df9a-4df3-9bea-45d697a20f92-metrics-certs\") pod \"network-metrics-daemon-dpcw4\" (UID: \"5cd860f1-df9a-4df3-9bea-45d697a20f92\") " pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 21:59:54.816686 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:54.816618    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 21:59:54.816686 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:54.816679    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cd860f1-df9a-4df3-9bea-45d697a20f92-metrics-certs podName:5cd860f1-df9a-4df3-9bea-45d697a20f92 nodeName:}" failed. No retries permitted until 2026-07-31 21:59:56.816660413 +0000 UTC m=+5.911951542 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5cd860f1-df9a-4df3-9bea-45d697a20f92-metrics-certs") pod "network-metrics-daemon-dpcw4" (UID: "5cd860f1-df9a-4df3-9bea-45d697a20f92") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 21:59:54.917570 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:54.917535    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8pqf\" (UniqueName: \"kubernetes.io/projected/bac49c41-6245-48dd-b89d-5e799e544e08-kube-api-access-p8pqf\") pod \"network-check-target-5sf9m\" (UID: \"bac49c41-6245-48dd-b89d-5e799e544e08\") " pod="openshift-network-diagnostics/network-check-target-5sf9m"
Jul 31 21:59:54.917733 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:54.917605    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4fbb48e0-0e3e-4864-a018-acb5bb48e0a8-original-pull-secret\") pod \"global-pull-secret-syncer-422sp\" (UID: \"4fbb48e0-0e3e-4864-a018-acb5bb48e0a8\") " pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 21:59:54.917798 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:54.917734    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 21:59:54.917798 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:54.917792    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fbb48e0-0e3e-4864-a018-acb5bb48e0a8-original-pull-secret podName:4fbb48e0-0e3e-4864-a018-acb5bb48e0a8 nodeName:}" failed. No retries permitted until 2026-07-31 21:59:56.917773172 +0000 UTC m=+6.013064313 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4fbb48e0-0e3e-4864-a018-acb5bb48e0a8-original-pull-secret") pod "global-pull-secret-syncer-422sp" (UID: "4fbb48e0-0e3e-4864-a018-acb5bb48e0a8") : object "kube-system"/"original-pull-secret" not registered
Jul 31 21:59:54.918201 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:54.918181    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 21:59:54.918281 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:54.918211    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 21:59:54.918281 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:54.918225    2573 projected.go:196] Error preparing data for projected volume kube-api-access-p8pqf for pod openshift-network-diagnostics/network-check-target-5sf9m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 21:59:54.918281 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:54.918268    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bac49c41-6245-48dd-b89d-5e799e544e08-kube-api-access-p8pqf podName:bac49c41-6245-48dd-b89d-5e799e544e08 nodeName:}" failed. No retries permitted until 2026-07-31 21:59:56.918253958 +0000 UTC m=+6.013545097 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-p8pqf" (UniqueName: "kubernetes.io/projected/bac49c41-6245-48dd-b89d-5e799e544e08-kube-api-access-p8pqf") pod "network-check-target-5sf9m" (UID: "bac49c41-6245-48dd-b89d-5e799e544e08") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 21:59:55.142252 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:55.142181    2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 21:59:55.308662 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:55.308623    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-30 21:54:53 +0000 UTC" deadline="2028-03-27 16:14:14.666110151 +0000 UTC"
Jul 31 21:59:55.308662 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:55.308661    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14514h14m19.357454602s"
Jul 31 21:59:55.332155 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:55.331491    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sf9m"
Jul 31 21:59:55.332155 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:55.331611    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sf9m" podUID="bac49c41-6245-48dd-b89d-5e799e544e08"
Jul 31 21:59:55.332155 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:55.331986    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 21:59:55.332155 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:55.332080    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-422sp" podUID="4fbb48e0-0e3e-4864-a018-acb5bb48e0a8"
Jul 31 21:59:55.371574 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:55.370514    2573 generic.go:356] "Generic (PLEG): container finished" podID="02608697884207c81c1068d58a177703" containerID="d66abd9d16673269e543748e29e0fb652042213413b352d51f74c1b1a2ba0fb7" exitCode=0
Jul 31 21:59:55.371574 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:55.371378    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-191.ec2.internal" event={"ID":"02608697884207c81c1068d58a177703","Type":"ContainerDied","Data":"d66abd9d16673269e543748e29e0fb652042213413b352d51f74c1b1a2ba0fb7"}
Jul 31 21:59:56.329615 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:56.329581    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 21:59:56.330050 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:56.329715    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpcw4" podUID="5cd860f1-df9a-4df3-9bea-45d697a20f92"
Jul 31 21:59:56.377687 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:56.377636    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-191.ec2.internal" event={"ID":"02608697884207c81c1068d58a177703","Type":"ContainerStarted","Data":"ca5d1e17308029d39a54be6ce97d45dd45c7d6596dd0789cbe33a9e86787df29"}
Jul 31 21:59:56.834248 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:56.834216    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cd860f1-df9a-4df3-9bea-45d697a20f92-metrics-certs\") pod \"network-metrics-daemon-dpcw4\" (UID: \"5cd860f1-df9a-4df3-9bea-45d697a20f92\") " pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 21:59:56.834505 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:56.834420    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 21:59:56.834505 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:56.834486    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cd860f1-df9a-4df3-9bea-45d697a20f92-metrics-certs podName:5cd860f1-df9a-4df3-9bea-45d697a20f92 nodeName:}" failed. No retries permitted until 2026-07-31 22:00:00.83446648 +0000 UTC m=+9.929757607 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5cd860f1-df9a-4df3-9bea-45d697a20f92-metrics-certs") pod "network-metrics-daemon-dpcw4" (UID: "5cd860f1-df9a-4df3-9bea-45d697a20f92") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 21:59:56.935457 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:56.935270    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4fbb48e0-0e3e-4864-a018-acb5bb48e0a8-original-pull-secret\") pod \"global-pull-secret-syncer-422sp\" (UID: \"4fbb48e0-0e3e-4864-a018-acb5bb48e0a8\") " pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 21:59:56.935457 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:56.935371    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8pqf\" (UniqueName: \"kubernetes.io/projected/bac49c41-6245-48dd-b89d-5e799e544e08-kube-api-access-p8pqf\") pod \"network-check-target-5sf9m\" (UID: \"bac49c41-6245-48dd-b89d-5e799e544e08\") " pod="openshift-network-diagnostics/network-check-target-5sf9m"
Jul 31 21:59:56.935670 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:56.935510    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 21:59:56.935670 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:56.935532    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 21:59:56.935670 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:56.935543    2573 projected.go:196] Error preparing data for projected volume kube-api-access-p8pqf for pod openshift-network-diagnostics/network-check-target-5sf9m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 21:59:56.935670 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:56.935593    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bac49c41-6245-48dd-b89d-5e799e544e08-kube-api-access-p8pqf podName:bac49c41-6245-48dd-b89d-5e799e544e08 nodeName:}" failed. No retries permitted until 2026-07-31 22:00:00.935576938 +0000 UTC m=+10.030868076 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-p8pqf" (UniqueName: "kubernetes.io/projected/bac49c41-6245-48dd-b89d-5e799e544e08-kube-api-access-p8pqf") pod "network-check-target-5sf9m" (UID: "bac49c41-6245-48dd-b89d-5e799e544e08") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 21:59:56.936118 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:56.935993    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 21:59:56.936118 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:56.936048    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fbb48e0-0e3e-4864-a018-acb5bb48e0a8-original-pull-secret podName:4fbb48e0-0e3e-4864-a018-acb5bb48e0a8 nodeName:}" failed. No retries permitted until 2026-07-31 22:00:00.936030782 +0000 UTC m=+10.031321925 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4fbb48e0-0e3e-4864-a018-acb5bb48e0a8-original-pull-secret") pod "global-pull-secret-syncer-422sp" (UID: "4fbb48e0-0e3e-4864-a018-acb5bb48e0a8") : object "kube-system"/"original-pull-secret" not registered
Jul 31 21:59:57.334270 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:57.333468    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sf9m"
Jul 31 21:59:57.334270 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:57.333589    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sf9m" podUID="bac49c41-6245-48dd-b89d-5e799e544e08"
Jul 31 21:59:57.334270 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:57.333943    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 21:59:57.334270 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:57.334031    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-422sp" podUID="4fbb48e0-0e3e-4864-a018-acb5bb48e0a8"
Jul 31 21:59:57.334270 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:57.334087    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 21:59:57.334270 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:57.334173    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpcw4" podUID="5cd860f1-df9a-4df3-9bea-45d697a20f92"
Jul 31 21:59:59.329808 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:59.329273    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 21:59:59.329808 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:59.329273    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sf9m"
Jul 31 21:59:59.329808 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:59.329443    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpcw4" podUID="5cd860f1-df9a-4df3-9bea-45d697a20f92"
Jul 31 21:59:59.329808 ip-10-0-130-191 kubenswrapper[2573]: I0731 21:59:59.329273    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 21:59:59.329808 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:59.329505    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sf9m" podUID="bac49c41-6245-48dd-b89d-5e799e544e08"
Jul 31 21:59:59.329808 ip-10-0-130-191 kubenswrapper[2573]: E0731 21:59:59.329593    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-422sp" podUID="4fbb48e0-0e3e-4864-a018-acb5bb48e0a8"
Jul 31 22:00:00.868208 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:00.868173    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cd860f1-df9a-4df3-9bea-45d697a20f92-metrics-certs\") pod \"network-metrics-daemon-dpcw4\" (UID: \"5cd860f1-df9a-4df3-9bea-45d697a20f92\") " pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 22:00:00.868669 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:00.868367    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 22:00:00.868669 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:00.868434    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cd860f1-df9a-4df3-9bea-45d697a20f92-metrics-certs podName:5cd860f1-df9a-4df3-9bea-45d697a20f92 nodeName:}" failed. No retries permitted until 2026-07-31 22:00:08.868415407 +0000 UTC m=+17.963706532 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5cd860f1-df9a-4df3-9bea-45d697a20f92-metrics-certs") pod "network-metrics-daemon-dpcw4" (UID: "5cd860f1-df9a-4df3-9bea-45d697a20f92") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 22:00:00.968706 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:00.968665    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4fbb48e0-0e3e-4864-a018-acb5bb48e0a8-original-pull-secret\") pod \"global-pull-secret-syncer-422sp\" (UID: \"4fbb48e0-0e3e-4864-a018-acb5bb48e0a8\") " pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 22:00:00.968876 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:00.968751    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8pqf\" (UniqueName: \"kubernetes.io/projected/bac49c41-6245-48dd-b89d-5e799e544e08-kube-api-access-p8pqf\") pod \"network-check-target-5sf9m\" (UID: \"bac49c41-6245-48dd-b89d-5e799e544e08\") " pod="openshift-network-diagnostics/network-check-target-5sf9m"
Jul 31 22:00:00.968943 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:00.968880    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 22:00:00.968943 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:00.968906    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 22:00:00.968943 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:00.968918    2573 projected.go:196] Error preparing data for projected volume kube-api-access-p8pqf for pod openshift-network-diagnostics/network-check-target-5sf9m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 22:00:00.969136 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:00.968999    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 22:00:00.969136 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:00.969023    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bac49c41-6245-48dd-b89d-5e799e544e08-kube-api-access-p8pqf podName:bac49c41-6245-48dd-b89d-5e799e544e08 nodeName:}" failed. No retries permitted until 2026-07-31 22:00:08.969004012 +0000 UTC m=+18.064295151 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-p8pqf" (UniqueName: "kubernetes.io/projected/bac49c41-6245-48dd-b89d-5e799e544e08-kube-api-access-p8pqf") pod "network-check-target-5sf9m" (UID: "bac49c41-6245-48dd-b89d-5e799e544e08") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 22:00:00.969509 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:00.969492    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fbb48e0-0e3e-4864-a018-acb5bb48e0a8-original-pull-secret podName:4fbb48e0-0e3e-4864-a018-acb5bb48e0a8 nodeName:}" failed. No retries permitted until 2026-07-31 22:00:08.969471744 +0000 UTC m=+18.064762871 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4fbb48e0-0e3e-4864-a018-acb5bb48e0a8-original-pull-secret") pod "global-pull-secret-syncer-422sp" (UID: "4fbb48e0-0e3e-4864-a018-acb5bb48e0a8") : object "kube-system"/"original-pull-secret" not registered
Jul 31 22:00:01.330291 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:01.330251    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 22:00:01.330472 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:01.330373    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-422sp" podUID="4fbb48e0-0e3e-4864-a018-acb5bb48e0a8"
Jul 31 22:00:01.330781 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:01.330611    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sf9m"
Jul 31 22:00:01.330781 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:01.330709    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sf9m" podUID="bac49c41-6245-48dd-b89d-5e799e544e08"
Jul 31 22:00:01.330781 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:01.330758    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 22:00:01.330987 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:01.330856    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpcw4" podUID="5cd860f1-df9a-4df3-9bea-45d697a20f92"
Jul 31 22:00:03.329390 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:03.329263    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 22:00:03.329390 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:03.329273    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sf9m"
Jul 31 22:00:03.329890 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:03.329429    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpcw4" podUID="5cd860f1-df9a-4df3-9bea-45d697a20f92"
Jul 31 22:00:03.329890 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:03.329868    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sf9m" podUID="bac49c41-6245-48dd-b89d-5e799e544e08"
Jul 31 22:00:03.329997 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:03.329936    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 22:00:03.330056 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:03.330025    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-422sp" podUID="4fbb48e0-0e3e-4864-a018-acb5bb48e0a8"
Jul 31 22:00:05.329294 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:05.329261    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 22:00:05.329294 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:05.329259    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sf9m"
Jul 31 22:00:05.329828 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:05.329260    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 22:00:05.329828 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:05.329461    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpcw4" podUID="5cd860f1-df9a-4df3-9bea-45d697a20f92"
Jul 31 22:00:05.329828 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:05.329540    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sf9m" podUID="bac49c41-6245-48dd-b89d-5e799e544e08"
Jul 31 22:00:05.329828 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:05.329630    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-422sp" podUID="4fbb48e0-0e3e-4864-a018-acb5bb48e0a8"
Jul 31 22:00:07.329185 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:07.329148    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 22:00:07.329731 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:07.329149    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 22:00:07.329731 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:07.329148    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sf9m"
Jul 31 22:00:07.329731 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:07.329291    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpcw4" podUID="5cd860f1-df9a-4df3-9bea-45d697a20f92"
Jul 31 22:00:07.329731 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:07.329392    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-422sp" podUID="4fbb48e0-0e3e-4864-a018-acb5bb48e0a8"
Jul 31 22:00:07.329731 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:07.329515    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sf9m" podUID="bac49c41-6245-48dd-b89d-5e799e544e08"
Jul 31 22:00:08.931525 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:08.931486    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cd860f1-df9a-4df3-9bea-45d697a20f92-metrics-certs\") pod \"network-metrics-daemon-dpcw4\" (UID: \"5cd860f1-df9a-4df3-9bea-45d697a20f92\") " pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 22:00:08.932099 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:08.931668    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 22:00:08.932099 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:08.931749    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cd860f1-df9a-4df3-9bea-45d697a20f92-metrics-certs podName:5cd860f1-df9a-4df3-9bea-45d697a20f92 nodeName:}" failed. No retries permitted until 2026-07-31 22:00:24.931727833 +0000 UTC m=+34.027018979 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5cd860f1-df9a-4df3-9bea-45d697a20f92-metrics-certs") pod "network-metrics-daemon-dpcw4" (UID: "5cd860f1-df9a-4df3-9bea-45d697a20f92") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 22:00:09.032034 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:09.031992    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8pqf\" (UniqueName: \"kubernetes.io/projected/bac49c41-6245-48dd-b89d-5e799e544e08-kube-api-access-p8pqf\") pod \"network-check-target-5sf9m\" (UID: \"bac49c41-6245-48dd-b89d-5e799e544e08\") " pod="openshift-network-diagnostics/network-check-target-5sf9m"
Jul 31 22:00:09.032220 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:09.032163    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 22:00:09.032220 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:09.032189    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 22:00:09.032220 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:09.032202    2573 projected.go:196] Error preparing data for projected volume kube-api-access-p8pqf for pod openshift-network-diagnostics/network-check-target-5sf9m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 22:00:09.032416 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:09.032242    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 22:00:09.032416 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:09.032254    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bac49c41-6245-48dd-b89d-5e799e544e08-kube-api-access-p8pqf podName:bac49c41-6245-48dd-b89d-5e799e544e08 nodeName:}" failed. No retries permitted until 2026-07-31 22:00:25.032239863 +0000 UTC m=+34.127530987 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-p8pqf" (UniqueName: "kubernetes.io/projected/bac49c41-6245-48dd-b89d-5e799e544e08-kube-api-access-p8pqf") pod "network-check-target-5sf9m" (UID: "bac49c41-6245-48dd-b89d-5e799e544e08") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 22:00:09.032416 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:09.032161    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4fbb48e0-0e3e-4864-a018-acb5bb48e0a8-original-pull-secret\") pod \"global-pull-secret-syncer-422sp\" (UID: \"4fbb48e0-0e3e-4864-a018-acb5bb48e0a8\") " pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 22:00:09.032416 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:09.032326    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fbb48e0-0e3e-4864-a018-acb5bb48e0a8-original-pull-secret podName:4fbb48e0-0e3e-4864-a018-acb5bb48e0a8 nodeName:}" failed. No retries permitted until 2026-07-31 22:00:25.032310257 +0000 UTC m=+34.127601396 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4fbb48e0-0e3e-4864-a018-acb5bb48e0a8-original-pull-secret") pod "global-pull-secret-syncer-422sp" (UID: "4fbb48e0-0e3e-4864-a018-acb5bb48e0a8") : object "kube-system"/"original-pull-secret" not registered
Jul 31 22:00:09.329825 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:09.329751    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sf9m"
Jul 31 22:00:09.329825 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:09.329782    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 22:00:09.330032 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:09.329751    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 22:00:09.330032 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:09.329869    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sf9m" podUID="bac49c41-6245-48dd-b89d-5e799e544e08"
Jul 31 22:00:09.330032 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:09.329969    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpcw4" podUID="5cd860f1-df9a-4df3-9bea-45d697a20f92"
Jul 31 22:00:09.330171 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:09.330038    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-422sp" podUID="4fbb48e0-0e3e-4864-a018-acb5bb48e0a8"
Jul 31 22:00:11.330422 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:11.330385    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 22:00:11.330874 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:11.330469    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 22:00:11.330874 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:11.330512    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sf9m"
Jul 31 22:00:11.330874 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:11.330520    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-422sp" podUID="4fbb48e0-0e3e-4864-a018-acb5bb48e0a8"
Jul 31 22:00:11.330874 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:11.330585    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sf9m" podUID="bac49c41-6245-48dd-b89d-5e799e544e08"
Jul 31 22:00:11.330874 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:11.330663    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpcw4" podUID="5cd860f1-df9a-4df3-9bea-45d697a20f92"
Jul 31 22:00:13.329205 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:13.328860    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 22:00:13.330107 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:13.328878    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sf9m"
Jul 31 22:00:13.330107 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:13.329256    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpcw4" podUID="5cd860f1-df9a-4df3-9bea-45d697a20f92"
Jul 31 22:00:13.330107 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:13.328891    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 22:00:13.330107 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:13.329338    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sf9m" podUID="bac49c41-6245-48dd-b89d-5e799e544e08"
Jul 31 22:00:13.330107 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:13.329447    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-422sp" podUID="4fbb48e0-0e3e-4864-a018-acb5bb48e0a8"
Jul 31 22:00:13.412763 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:13.412732    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s4gbt" event={"ID":"16745241-a6b7-41c6-9c97-176962591677","Type":"ContainerStarted","Data":"8fa63646c4314936afc92f7d28ab81b4af74f0c61b67d251c031c51b096b4aac"}
Jul 31 22:00:13.416062 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:13.416040    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ddp8_79e15037-4ffd-47f1-b983-34f06895b2a3/ovn-acl-logging/0.log"
Jul 31 22:00:13.416399 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:13.416377    2573 generic.go:356] "Generic (PLEG): container finished" podID="79e15037-4ffd-47f1-b983-34f06895b2a3" containerID="61640ac8b3008a2c5c60c238825e850993201d35e3881de12ea2dcec3e76db1c" exitCode=1
Jul 31 22:00:13.416520 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:13.416457    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8" event={"ID":"79e15037-4ffd-47f1-b983-34f06895b2a3","Type":"ContainerStarted","Data":"c9e65955bd5a39216e2dd2d5a6a0910284b3b4d685733b757a3881239aec6e29"}
Jul 31 22:00:13.416586 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:13.416550    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8" event={"ID":"79e15037-4ffd-47f1-b983-34f06895b2a3","Type":"ContainerStarted","Data":"4172f5be677ab14a47da0a4d587f7d75ff73f29e1a92d8e4297d98b4d1cd0fbe"}
Jul 31 22:00:13.416625 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:13.416606    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8" event={"ID":"79e15037-4ffd-47f1-b983-34f06895b2a3","Type":"ContainerStarted","Data":"405bfeac5d281488744f5751482bd425e1ad831f0b7b79f45f0cc7ade78ea4fa"}
Jul 31 22:00:13.416658 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:13.416650    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8" event={"ID":"79e15037-4ffd-47f1-b983-34f06895b2a3","Type":"ContainerStarted","Data":"1c9bb101ce82be1975fe0ab49aa7d2f95ac88ec24e9248cb4bc3fb03284871c8"}
Jul 31 22:00:13.416714 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:13.416697    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8" event={"ID":"79e15037-4ffd-47f1-b983-34f06895b2a3","Type":"ContainerDied","Data":"61640ac8b3008a2c5c60c238825e850993201d35e3881de12ea2dcec3e76db1c"}
Jul 31 22:00:13.416820 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:13.416753    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8" event={"ID":"79e15037-4ffd-47f1-b983-34f06895b2a3","Type":"ContainerStarted","Data":"89dd39e902c8d2bebacf2b24a9de65a9a9c0f5ce4accaf09a5101cdee9b54570"}
Jul 31 22:00:13.418124 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:13.418096    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r44dc" event={"ID":"3b94b353-7445-4d82-8517-72dae731db0d","Type":"ContainerStarted","Data":"9ca263f3fe3e9cd33d53f40069647a2b4fd2717e94820cfd1ac12b461d148eb8"}
Jul 31 22:00:13.419677 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:13.419654    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plplk" event={"ID":"7ea8a115-e5a1-4056-bd0e-a74666e07032","Type":"ContainerStarted","Data":"a6ff35d7f5565d0363f04a49144b5128baf079a432b6bc2f4420d226878ff1dc"}
Jul 31 22:00:13.421129 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:13.421106    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-djtgp" event={"ID":"63d076da-c8ff-4bb5-adc0-bdc834bdf23f","Type":"ContainerStarted","Data":"a8bfa8cafb2ed0b5f48e0716a79896fd826310065738dcad9cdd05b26e7730eb"}
Jul 31 22:00:13.422885 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:13.422863    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-svhwq" event={"ID":"35bdf8db-313d-4461-9a2c-4e885c896c3a","Type":"ContainerStarted","Data":"5f31d3b4a41b8017877081ea430153f6dfe6c2509059936680a480f602412c9c"}
Jul 31 22:00:13.424418 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:13.424394    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fv879" event={"ID":"085556af-0fc0-4c79-9f9c-ca71dc96dcfc","Type":"ContainerStarted","Data":"07e7e8c628361d0cc8312c5c8a2169c48092450bb2f299a8af5219846f2f4cfb"}
Jul 31 22:00:13.426050 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:13.426024    2573 generic.go:356] "Generic (PLEG): container finished" podID="7529582d-7128-42da-ae3c-147316632064" containerID="4e6eaf9cff87621b72367cf906af0917856cb27d303b3294dbf37851e14df6f4" exitCode=0
Jul 31 22:00:13.426150 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:13.426061    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-46mtl" event={"ID":"7529582d-7128-42da-ae3c-147316632064","Type":"ContainerDied","Data":"4e6eaf9cff87621b72367cf906af0917856cb27d303b3294dbf37851e14df6f4"}
Jul 31 22:00:13.432427 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:13.432392    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-s4gbt" podStartSLOduration=4.3260221 podStartE2EDuration="22.432379604s" totalImagesPullingTime="18.106357504s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:59:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:00:13.431818681 +0000 UTC m=+22.527109831" watchObservedRunningTime="2026-07-31 22:00:13.432379604 +0000 UTC m=+22.527670751"
Jul 31 22:00:13.432525 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:13.432465    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-191.ec2.internal" podStartSLOduration=21.432456071 podStartE2EDuration="21.432456071s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:59:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:59:56.393836213 +0000 UTC m=+5.489127361" watchObservedRunningTime="2026-07-31 22:00:13.432456071 +0000 UTC m=+22.527747218"
Jul 31 22:00:13.474853 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:13.474806    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-r44dc" podStartSLOduration=8.534548112 podStartE2EDuration="22.474791023s" totalImagesPullingTime="13.940242911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:59:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:00:13.449330378 +0000 UTC m=+22.544621524" watchObservedRunningTime="2026-07-31 22:00:13.474791023 +0000 UTC m=+22.570082168"
Jul 31 22:00:13.475248 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:13.475220    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-djtgp" podStartSLOduration=4.226364116 podStartE2EDuration="22.475211949s" totalImagesPullingTime="18.248847833s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:59:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:00:13.474563618 +0000 UTC m=+22.569854767" watchObservedRunningTime="2026-07-31 22:00:13.475211949 +0000 UTC m=+22.570503094"
Jul 31 22:00:13.519770 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:13.519721    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fv879" podStartSLOduration=4.396559446 podStartE2EDuration="22.519703623s" totalImagesPullingTime="18.123144177s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:59:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:00:13.493476635 +0000 UTC m=+22.588767780" watchObservedRunningTime="2026-07-31 22:00:13.519703623 +0000 UTC m=+22.614994771"
Jul 31 22:00:13.519922 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:13.519895    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-svhwq" podStartSLOduration=4.281473419 podStartE2EDuration="22.519884738s" totalImagesPullingTime="18.238411319s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:59:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:00:13.519611821 +0000 UTC m=+22.614902967" watchObservedRunningTime="2026-07-31 22:00:13.519884738 +0000 UTC m=+22.615175886"
Jul 31 22:00:13.906074 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:13.906054    2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 31 22:00:14.260026 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:14.259900    2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-31T22:00:13.906069993Z","UUID":"7c7e962a-ff58-4e16-96f1-ce5b8e29c06d","Handler":null,"Name":"","Endpoint":""}
Jul 31 22:00:14.262485 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:14.262460    2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 31 22:00:14.262619 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:14.262497    2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 31 22:00:14.429667 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:14.429571    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-krlnf" event={"ID":"9c7c0bd9-8cdd-46bf-ba9c-81c59d68cec8","Type":"ContainerStarted","Data":"14a284af5dbb1d47abca445a37eb4e78ead4a32b50d041e1142be2e91168ab26"}
Jul 31 22:00:14.431592 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:14.431567    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plplk" event={"ID":"7ea8a115-e5a1-4056-bd0e-a74666e07032","Type":"ContainerStarted","Data":"41df9a3988addda1c3ef5c0d5a4da7f849ec7b63e438a0ed921242681a9dec30"}
Jul 31 22:00:14.445105 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:14.444977    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-krlnf" podStartSLOduration=5.201991767 podStartE2EDuration="23.444960446s" totalImagesPullingTime="18.242968679s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:59:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:00:14.444550814 +0000 UTC m=+23.539841966" watchObservedRunningTime="2026-07-31 22:00:14.444960446 +0000 UTC m=+23.540251597"
Jul 31 22:00:15.329529 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:15.329505    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 22:00:15.329529 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:15.329517    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 22:00:15.329736 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:15.329636    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpcw4" podUID="5cd860f1-df9a-4df3-9bea-45d697a20f92"
Jul 31 22:00:15.329736 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:15.329727    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sf9m"
Jul 31 22:00:15.329915 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:15.329884    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-422sp" podUID="4fbb48e0-0e3e-4864-a018-acb5bb48e0a8"
Jul 31 22:00:15.330010 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:15.329986    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sf9m" podUID="bac49c41-6245-48dd-b89d-5e799e544e08"
Jul 31 22:00:15.437723 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:15.437701    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ddp8_79e15037-4ffd-47f1-b983-34f06895b2a3/ovn-acl-logging/0.log"
Jul 31 22:00:15.438702 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:15.438679    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8" event={"ID":"79e15037-4ffd-47f1-b983-34f06895b2a3","Type":"ContainerStarted","Data":"112d91c9722b285ea95fc9af34b2a82e8071413a0d96e5c7baa949bd9b8f3a50"}
Jul 31 22:00:16.724171 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:16.723984    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-r44dc"
Jul 31 22:00:16.724669 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:16.724644    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-r44dc"
Jul 31 22:00:17.329502 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:17.329469    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 22:00:17.329657 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:17.329510    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sf9m"
Jul 31 22:00:17.329657 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:17.329484    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 22:00:17.329657 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:17.329591    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-422sp" podUID="4fbb48e0-0e3e-4864-a018-acb5bb48e0a8"
Jul 31 22:00:17.329839 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:17.329684    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpcw4" podUID="5cd860f1-df9a-4df3-9bea-45d697a20f92"
Jul 31 22:00:17.329839 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:17.329775    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sf9m" podUID="bac49c41-6245-48dd-b89d-5e799e544e08"
Jul 31 22:00:18.447112 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:18.447089    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ddp8_79e15037-4ffd-47f1-b983-34f06895b2a3/ovn-acl-logging/0.log"
Jul 31 22:00:18.447733 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:18.447448    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8" event={"ID":"79e15037-4ffd-47f1-b983-34f06895b2a3","Type":"ContainerStarted","Data":"b8af2d9055f786d230efa81deaa8e74ec673b59651618ec6bf002dd195a2f648"}
Jul 31 22:00:18.447733 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:18.447690    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 22:00:18.447913 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:18.447896    2573 scope.go:117] "RemoveContainer" containerID="61640ac8b3008a2c5c60c238825e850993201d35e3881de12ea2dcec3e76db1c"
Jul 31 22:00:18.449512 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:18.449490    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plplk" event={"ID":"7ea8a115-e5a1-4056-bd0e-a74666e07032","Type":"ContainerStarted","Data":"11c64e5c3753c84fec3ab1e4b5f3c9cf5d8137a4efb0e552948d557d26c83109"}
Jul 31 22:00:18.463189 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:18.463172    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 22:00:18.523472 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:18.523385    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-plplk" podStartSLOduration=3.886797418 podStartE2EDuration="27.523367983s" totalImagesPullingTime="23.636570565s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:59:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:00:18.522999651 +0000 UTC m=+27.618290796" watchObservedRunningTime="2026-07-31 22:00:18.523367983 +0000 UTC m=+27.618659128"
Jul 31 22:00:19.329489 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:19.329324    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 22:00:19.329600 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:19.329330    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 22:00:19.329600 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:19.329569    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpcw4" podUID="5cd860f1-df9a-4df3-9bea-45d697a20f92"
Jul 31 22:00:19.329666 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:19.329629    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-422sp" podUID="4fbb48e0-0e3e-4864-a018-acb5bb48e0a8"
Jul 31 22:00:19.329666 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:19.329355    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sf9m"
Jul 31 22:00:19.329758 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:19.329738    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sf9m" podUID="bac49c41-6245-48dd-b89d-5e799e544e08"
Jul 31 22:00:19.454945 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:19.454925    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ddp8_79e15037-4ffd-47f1-b983-34f06895b2a3/ovn-acl-logging/0.log"
Jul 31 22:00:19.458074 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:19.458046    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8" event={"ID":"79e15037-4ffd-47f1-b983-34f06895b2a3","Type":"ContainerStarted","Data":"e1a5632b371b08c35e788c77e71d0560b297bdb01192bf61fa027c420541d62a"}
Jul 31 22:00:19.458074 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:19.458073    2573 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 31 22:00:19.458369 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:19.458348    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 22:00:19.459909 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:19.459890    2573 generic.go:356] "Generic (PLEG): container finished" podID="7529582d-7128-42da-ae3c-147316632064" containerID="870be4e05bcf9ecfaeef2b21a862a4c9e9e88ee8e7213a0966d3a69be9d6482d" exitCode=0
Jul 31 22:00:19.460005 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:19.459973    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-46mtl" event={"ID":"7529582d-7128-42da-ae3c-147316632064","Type":"ContainerDied","Data":"870be4e05bcf9ecfaeef2b21a862a4c9e9e88ee8e7213a0966d3a69be9d6482d"}
Jul 31 22:00:19.473422 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:19.473403    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 22:00:19.493641 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:19.493607    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8" podStartSLOduration=9.977715616 podStartE2EDuration="28.493597487s" totalImagesPullingTime="18.515881871s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:59:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:00:19.493401104 +0000 UTC m=+28.588692251" watchObservedRunningTime="2026-07-31 22:00:19.493597487 +0000 UTC m=+28.588888633"
Jul 31 22:00:20.347246 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:20.347206    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dpcw4"]
Jul 31 22:00:20.347461 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:20.347363    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 22:00:20.347511 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:20.347489    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpcw4" podUID="5cd860f1-df9a-4df3-9bea-45d697a20f92"
Jul 31 22:00:20.351040 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:20.351017    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5sf9m"]
Jul 31 22:00:20.351181 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:20.351121    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sf9m"
Jul 31 22:00:20.351246 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:20.351217    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sf9m" podUID="bac49c41-6245-48dd-b89d-5e799e544e08"
Jul 31 22:00:20.351796 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:20.351775    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-422sp"]
Jul 31 22:00:20.351890 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:20.351877    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 22:00:20.351989 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:20.351970    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-422sp" podUID="4fbb48e0-0e3e-4864-a018-acb5bb48e0a8"
Jul 31 22:00:20.461635 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:20.461614    2573 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 31 22:00:20.698157 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:20.698131    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 22:00:21.221467 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:21.221441    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-r44dc"
Jul 31 22:00:21.221606 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:21.221575    2573 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 31 22:00:21.221980 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:21.221955    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-r44dc"
Jul 31 22:00:21.466220 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:21.466053    2573 generic.go:356] "Generic (PLEG): container finished" podID="7529582d-7128-42da-ae3c-147316632064" containerID="3c87487fba904f3ee62380c9db70803fb7612a8a9c844613f303e7c7cee1c605" exitCode=0
Jul 31 22:00:21.466739 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:21.466129    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-46mtl" event={"ID":"7529582d-7128-42da-ae3c-147316632064","Type":"ContainerDied","Data":"3c87487fba904f3ee62380c9db70803fb7612a8a9c844613f303e7c7cee1c605"}
Jul 31 22:00:22.212944 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:22.212915    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s4gbt_16745241-a6b7-41c6-9c97-176962591677/dns-node-resolver/0.log"
Jul 31 22:00:22.329626 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:22.329564    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sf9m"
Jul 31 22:00:22.329738 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:22.329650    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 22:00:22.329738 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:22.329655    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sf9m" podUID="bac49c41-6245-48dd-b89d-5e799e544e08"
Jul 31 22:00:22.329738 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:22.329676    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 22:00:22.329831 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:22.329751    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-422sp" podUID="4fbb48e0-0e3e-4864-a018-acb5bb48e0a8"
Jul 31 22:00:22.329831 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:22.329814    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpcw4" podUID="5cd860f1-df9a-4df3-9bea-45d697a20f92"
Jul 31 22:00:23.184153 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:23.184128    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fv879_085556af-0fc0-4c79-9f9c-ca71dc96dcfc/node-ca/0.log"
Jul 31 22:00:23.472118 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:23.472044    2573 generic.go:356] "Generic (PLEG): container finished" podID="7529582d-7128-42da-ae3c-147316632064" containerID="ae2d15f147580d7611864ba29043c70a6dde0a574d57904a21350c79ce9ccc2d" exitCode=0
Jul 31 22:00:23.472118 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:23.472108    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-46mtl" event={"ID":"7529582d-7128-42da-ae3c-147316632064","Type":"ContainerDied","Data":"ae2d15f147580d7611864ba29043c70a6dde0a574d57904a21350c79ce9ccc2d"}
Jul 31 22:00:24.329749 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:24.329672    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sf9m"
Jul 31 22:00:24.330161 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:24.329787    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 22:00:24.330161 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:24.329795    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sf9m" podUID="bac49c41-6245-48dd-b89d-5e799e544e08"
Jul 31 22:00:24.330161 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:24.329885    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpcw4" podUID="5cd860f1-df9a-4df3-9bea-45d697a20f92"
Jul 31 22:00:24.330161 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:24.329797    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 22:00:24.330161 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:24.329975    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-422sp" podUID="4fbb48e0-0e3e-4864-a018-acb5bb48e0a8"
Jul 31 22:00:24.952028 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:24.952000    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cd860f1-df9a-4df3-9bea-45d697a20f92-metrics-certs\") pod \"network-metrics-daemon-dpcw4\" (UID: \"5cd860f1-df9a-4df3-9bea-45d697a20f92\") " pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 22:00:24.952186 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:24.952126    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 22:00:24.952186 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:24.952180    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cd860f1-df9a-4df3-9bea-45d697a20f92-metrics-certs podName:5cd860f1-df9a-4df3-9bea-45d697a20f92 nodeName:}" failed. No retries permitted until 2026-07-31 22:00:56.952164185 +0000 UTC m=+66.047455326 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5cd860f1-df9a-4df3-9bea-45d697a20f92-metrics-certs") pod "network-metrics-daemon-dpcw4" (UID: "5cd860f1-df9a-4df3-9bea-45d697a20f92") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 22:00:25.052476 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:25.052442    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8pqf\" (UniqueName: \"kubernetes.io/projected/bac49c41-6245-48dd-b89d-5e799e544e08-kube-api-access-p8pqf\") pod \"network-check-target-5sf9m\" (UID: \"bac49c41-6245-48dd-b89d-5e799e544e08\") " pod="openshift-network-diagnostics/network-check-target-5sf9m"
Jul 31 22:00:25.052664 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:25.052498    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4fbb48e0-0e3e-4864-a018-acb5bb48e0a8-original-pull-secret\") pod \"global-pull-secret-syncer-422sp\" (UID: \"4fbb48e0-0e3e-4864-a018-acb5bb48e0a8\") " pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 22:00:25.052664 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:25.052617    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 22:00:25.052664 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:25.052626    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 22:00:25.052664 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:25.052652    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 22:00:25.052664 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:25.052664    2573 projected.go:196] Error preparing data for projected volume kube-api-access-p8pqf for pod openshift-network-diagnostics/network-check-target-5sf9m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 22:00:25.052859 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:25.052673    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fbb48e0-0e3e-4864-a018-acb5bb48e0a8-original-pull-secret podName:4fbb48e0-0e3e-4864-a018-acb5bb48e0a8 nodeName:}" failed. No retries permitted until 2026-07-31 22:00:57.052658463 +0000 UTC m=+66.147949590 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4fbb48e0-0e3e-4864-a018-acb5bb48e0a8-original-pull-secret") pod "global-pull-secret-syncer-422sp" (UID: "4fbb48e0-0e3e-4864-a018-acb5bb48e0a8") : object "kube-system"/"original-pull-secret" not registered
Jul 31 22:00:25.052859 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:25.052713    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bac49c41-6245-48dd-b89d-5e799e544e08-kube-api-access-p8pqf podName:bac49c41-6245-48dd-b89d-5e799e544e08 nodeName:}" failed. No retries permitted until 2026-07-31 22:00:57.052696147 +0000 UTC m=+66.147987285 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-p8pqf" (UniqueName: "kubernetes.io/projected/bac49c41-6245-48dd-b89d-5e799e544e08-kube-api-access-p8pqf") pod "network-check-target-5sf9m" (UID: "bac49c41-6245-48dd-b89d-5e799e544e08") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 22:00:26.328796 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:26.328758    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 22:00:26.329292 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:26.328758    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sf9m"
Jul 31 22:00:26.329292 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:26.328878    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-422sp" podUID="4fbb48e0-0e3e-4864-a018-acb5bb48e0a8"
Jul 31 22:00:26.329292 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:26.328962    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sf9m" podUID="bac49c41-6245-48dd-b89d-5e799e544e08"
Jul 31 22:00:26.329292 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:26.328766    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 22:00:26.329292 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:26.329072    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpcw4" podUID="5cd860f1-df9a-4df3-9bea-45d697a20f92"
Jul 31 22:00:28.329587 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:28.329542    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 22:00:28.330140 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:28.329544    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 22:00:28.330140 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:28.329658    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpcw4" podUID="5cd860f1-df9a-4df3-9bea-45d697a20f92"
Jul 31 22:00:28.330140 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:28.329671    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sf9m"
Jul 31 22:00:28.330140 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:28.329747    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-422sp" podUID="4fbb48e0-0e3e-4864-a018-acb5bb48e0a8"
Jul 31 22:00:28.330140 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:28.329805    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sf9m" podUID="bac49c41-6245-48dd-b89d-5e799e544e08"
Jul 31 22:00:28.486840 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:28.486811    2573 generic.go:356] "Generic (PLEG): container finished" podID="7529582d-7128-42da-ae3c-147316632064" containerID="4c9441274d19ee46024d1c46a3f665d58a94bdfe3f28cf30ec1812221aa8b4ba" exitCode=0
Jul 31 22:00:28.487004 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:28.486874    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-46mtl" event={"ID":"7529582d-7128-42da-ae3c-147316632064","Type":"ContainerDied","Data":"4c9441274d19ee46024d1c46a3f665d58a94bdfe3f28cf30ec1812221aa8b4ba"}
Jul 31 22:00:29.491774 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:29.491744    2573 generic.go:356] "Generic (PLEG): container finished" podID="7529582d-7128-42da-ae3c-147316632064" containerID="a0e01332a2597820458cf00aa0dc1c6279e414eaf1113051f500deb4aed0e8ba" exitCode=0
Jul 31 22:00:29.492110 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:29.491802    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-46mtl" event={"ID":"7529582d-7128-42da-ae3c-147316632064","Type":"ContainerDied","Data":"a0e01332a2597820458cf00aa0dc1c6279e414eaf1113051f500deb4aed0e8ba"}
Jul 31 22:00:30.329264 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:30.329237    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 22:00:30.329264 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:30.329257    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sf9m"
Jul 31 22:00:30.329455 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:30.329341    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 22:00:30.329455 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:30.329354    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-422sp" podUID="4fbb48e0-0e3e-4864-a018-acb5bb48e0a8"
Jul 31 22:00:30.329455 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:30.329419    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpcw4" podUID="5cd860f1-df9a-4df3-9bea-45d697a20f92"
Jul 31 22:00:30.329549 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:30.329470    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sf9m" podUID="bac49c41-6245-48dd-b89d-5e799e544e08"
Jul 31 22:00:30.497255 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:30.497214    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-46mtl" event={"ID":"7529582d-7128-42da-ae3c-147316632064","Type":"ContainerStarted","Data":"7eb9baefcb37748c5e1e349cd34f857ad2abdb147a678ddb31b695874d628340"}
Jul 31 22:00:30.528781 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:30.528733    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-46mtl" podStartSLOduration=9.455871805 podStartE2EDuration="39.528714987s" totalImagesPullingTime="30.072843182s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:59:51 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:00:30.527645758 +0000 UTC m=+39.622936915" watchObservedRunningTime="2026-07-31 22:00:30.528714987 +0000 UTC m=+39.624006133"
Jul 31 22:00:32.329347 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:32.329312    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sf9m"
Jul 31 22:00:32.329781 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:32.329312    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 22:00:32.329781 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:32.329408    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sf9m" podUID="bac49c41-6245-48dd-b89d-5e799e544e08"
Jul 31 22:00:32.329781 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:32.329316    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 22:00:32.329781 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:32.329476    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-422sp" podUID="4fbb48e0-0e3e-4864-a018-acb5bb48e0a8"
Jul 31 22:00:32.329781 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:32.329590    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpcw4" podUID="5cd860f1-df9a-4df3-9bea-45d697a20f92"
Jul 31 22:00:34.329085 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:34.329052    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 22:00:34.329085 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:34.329078    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 22:00:34.329514 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:34.329165    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-422sp" podUID="4fbb48e0-0e3e-4864-a018-acb5bb48e0a8"
Jul 31 22:00:34.329514 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:34.329217    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sf9m"
Jul 31 22:00:34.329514 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:34.329313    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpcw4" podUID="5cd860f1-df9a-4df3-9bea-45d697a20f92"
Jul 31 22:00:34.329514 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:34.329398    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sf9m" podUID="bac49c41-6245-48dd-b89d-5e799e544e08"
Jul 31 22:00:36.328903 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:36.328873    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sf9m"
Jul 31 22:00:36.329387 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:36.328961    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 22:00:36.329387 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:36.328969    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sf9m" podUID="bac49c41-6245-48dd-b89d-5e799e544e08"
Jul 31 22:00:36.329387 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:36.329035    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-422sp" podUID="4fbb48e0-0e3e-4864-a018-acb5bb48e0a8"
Jul 31 22:00:36.329387 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:36.329048    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 22:00:36.329387 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:36.329124    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpcw4" podUID="5cd860f1-df9a-4df3-9bea-45d697a20f92"
Jul 31 22:00:38.329070 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:38.329040    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sf9m"
Jul 31 22:00:38.329447 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:38.329125    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 22:00:38.329447 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:38.329152    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 22:00:38.329447 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:38.329151    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sf9m" podUID="bac49c41-6245-48dd-b89d-5e799e544e08"
Jul 31 22:00:38.329447 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:38.329218    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-422sp" podUID="4fbb48e0-0e3e-4864-a018-acb5bb48e0a8"
Jul 31 22:00:38.329447 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:38.329291    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpcw4" podUID="5cd860f1-df9a-4df3-9bea-45d697a20f92"
Jul 31 22:00:40.329747 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:40.329723    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sf9m"
Jul 31 22:00:40.330106 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:40.329806    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sf9m" podUID="bac49c41-6245-48dd-b89d-5e799e544e08"
Jul 31 22:00:40.330106 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:40.329878    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 22:00:40.330106 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:40.329950    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-422sp" podUID="4fbb48e0-0e3e-4864-a018-acb5bb48e0a8"
Jul 31 22:00:40.330106 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:40.329957    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 22:00:40.330106 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:40.330016    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpcw4" podUID="5cd860f1-df9a-4df3-9bea-45d697a20f92"
Jul 31 22:00:42.329780 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:42.329751    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 22:00:42.330118 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:42.329751    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sf9m"
Jul 31 22:00:42.330118 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:42.329839    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-422sp" podUID="4fbb48e0-0e3e-4864-a018-acb5bb48e0a8"
Jul 31 22:00:42.330118 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:42.329888    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 22:00:42.330118 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:42.329992    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpcw4" podUID="5cd860f1-df9a-4df3-9bea-45d697a20f92"
Jul 31 22:00:42.330118 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:42.330074    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sf9m" podUID="bac49c41-6245-48dd-b89d-5e799e544e08"
Jul 31 22:00:44.329443 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:44.329415    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 22:00:44.329789 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:44.329415    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 22:00:44.329789 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:44.329511    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpcw4" podUID="5cd860f1-df9a-4df3-9bea-45d697a20f92"
Jul 31 22:00:44.329789 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:44.329578    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-422sp" podUID="4fbb48e0-0e3e-4864-a018-acb5bb48e0a8"
Jul 31 22:00:44.329789 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:44.329419    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sf9m"
Jul 31 22:00:44.329789 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:44.329635    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sf9m" podUID="bac49c41-6245-48dd-b89d-5e799e544e08"
Jul 31 22:00:46.328945 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:46.328917    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sf9m"
Jul 31 22:00:46.329402 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:46.328957    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 22:00:46.329402 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:46.329029    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sf9m" podUID="bac49c41-6245-48dd-b89d-5e799e544e08"
Jul 31 22:00:46.329402 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:46.329065    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-422sp" podUID="4fbb48e0-0e3e-4864-a018-acb5bb48e0a8"
Jul 31 22:00:46.329402 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:46.329110    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 22:00:46.329402 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:46.329200    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpcw4" podUID="5cd860f1-df9a-4df3-9bea-45d697a20f92"
Jul 31 22:00:48.296879 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.296814    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-191.ec2.internal" event="NodeReady"
Jul 31 22:00:48.297200 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.296910    2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 31 22:00:48.329647 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.329626    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sf9m"
Jul 31 22:00:48.329760 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.329625    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 22:00:48.329832 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.329625    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 22:00:48.331926 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.331909    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 31 22:00:48.332619 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.332605    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nslhh\""
Jul 31 22:00:48.332619 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.332617    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sb6cn\""
Jul 31 22:00:48.332735 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.332685    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 31 22:00:48.332735 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.332702    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 31 22:00:48.332811 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.332688    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 31 22:00:48.346165 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.346144    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8854b8786-5mz8k"]
Jul 31 22:00:48.349655 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.349637    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8854b8786-5mz8k"
Jul 31 22:00:48.352580 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.352560    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-55g2j\""
Jul 31 22:00:48.352695 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.352652    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 31 22:00:48.352821 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.352799    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 31 22:00:48.352953 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.352939    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 31 22:00:48.358625 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.358609    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 31 22:00:48.373411 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.373390    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8854b8786-5mz8k"]
Jul 31 22:00:48.374042 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.374025    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bdmbh"]
Jul 31 22:00:48.377231 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.377210    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jfgw6"]
Jul 31 22:00:48.377379 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.377362    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bdmbh"
Jul 31 22:00:48.379906 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.379890    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jdkvx\""
Jul 31 22:00:48.379988 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.379906    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 31 22:00:48.379988 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.379890    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 31 22:00:48.380230 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.380213    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jfgw6"
Jul 31 22:00:48.386413 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.386398    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 31 22:00:48.386819 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.386807    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-w8lz5\""
Jul 31 22:00:48.386863 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.386843    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 31 22:00:48.386911 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.386896    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 31 22:00:48.389876 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.389858    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jfgw6"]
Jul 31 22:00:48.394196 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.394177    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bdmbh"]
Jul 31 22:00:48.423223 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.423203    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86970815-e08d-4724-a775-9dce7783c699-cert\") pod \"ingress-canary-jfgw6\" (UID: \"86970815-e08d-4724-a775-9dce7783c699\") " pod="openshift-ingress-canary/ingress-canary-jfgw6"
Jul 31 22:00:48.423348 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.423245    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/65d82f87-e385-44d0-ae72-38856f99b680-registry-certificates\") pod \"image-registry-8854b8786-5mz8k\" (UID: \"65d82f87-e385-44d0-ae72-38856f99b680\") " pod="openshift-image-registry/image-registry-8854b8786-5mz8k"
Jul 31 22:00:48.423348 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.423280    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65d82f87-e385-44d0-ae72-38856f99b680-bound-sa-token\") pod \"image-registry-8854b8786-5mz8k\" (UID: \"65d82f87-e385-44d0-ae72-38856f99b680\") " pod="openshift-image-registry/image-registry-8854b8786-5mz8k"
Jul 31 22:00:48.423436 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.423351    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65d82f87-e385-44d0-ae72-38856f99b680-registry-tls\") pod \"image-registry-8854b8786-5mz8k\" (UID: \"65d82f87-e385-44d0-ae72-38856f99b680\") " pod="openshift-image-registry/image-registry-8854b8786-5mz8k"
Jul 31 22:00:48.423436 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.423373    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/65d82f87-e385-44d0-ae72-38856f99b680-trusted-ca\") pod \"image-registry-8854b8786-5mz8k\" (UID: \"65d82f87-e385-44d0-ae72-38856f99b680\") " pod="openshift-image-registry/image-registry-8854b8786-5mz8k"
Jul 31 22:00:48.423436 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.423388    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc043b76-8ded-42e8-b6b1-98cf73ac6303-tmp-dir\") pod \"dns-default-bdmbh\" (UID: \"cc043b76-8ded-42e8-b6b1-98cf73ac6303\") " pod="openshift-dns/dns-default-bdmbh"
Jul 31 22:00:48.423436 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.423404    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/65d82f87-e385-44d0-ae72-38856f99b680-installation-pull-secrets\") pod \"image-registry-8854b8786-5mz8k\" (UID: \"65d82f87-e385-44d0-ae72-38856f99b680\") " pod="openshift-image-registry/image-registry-8854b8786-5mz8k"
Jul 31 22:00:48.423436 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.423421    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc043b76-8ded-42e8-b6b1-98cf73ac6303-metrics-tls\") pod \"dns-default-bdmbh\" (UID: \"cc043b76-8ded-42e8-b6b1-98cf73ac6303\") " pod="openshift-dns/dns-default-bdmbh"
Jul 31 22:00:48.423436 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.423435    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg7s7\" (UniqueName: \"kubernetes.io/projected/cc043b76-8ded-42e8-b6b1-98cf73ac6303-kube-api-access-vg7s7\") pod \"dns-default-bdmbh\" (UID: \"cc043b76-8ded-42e8-b6b1-98cf73ac6303\") " pod="openshift-dns/dns-default-bdmbh"
Jul 31 22:00:48.423663 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.423465    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cc043b76-8ded-42e8-b6b1-98cf73ac6303-config-volume\") pod \"dns-default-bdmbh\" (UID: \"cc043b76-8ded-42e8-b6b1-98cf73ac6303\") " pod="openshift-dns/dns-default-bdmbh"
Jul 31 22:00:48.423663 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.423508    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/65d82f87-e385-44d0-ae72-38856f99b680-image-registry-private-configuration\") pod \"image-registry-8854b8786-5mz8k\" (UID: \"65d82f87-e385-44d0-ae72-38856f99b680\") " pod="openshift-image-registry/image-registry-8854b8786-5mz8k"
Jul 31 22:00:48.423663 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.423543    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/65d82f87-e385-44d0-ae72-38856f99b680-ca-trust-extracted\") pod \"image-registry-8854b8786-5mz8k\" (UID: \"65d82f87-e385-44d0-ae72-38856f99b680\") " pod="openshift-image-registry/image-registry-8854b8786-5mz8k"
Jul 31 22:00:48.423663 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.423557    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8nsl\" (UniqueName: \"kubernetes.io/projected/86970815-e08d-4724-a775-9dce7783c699-kube-api-access-x8nsl\") pod \"ingress-canary-jfgw6\" (UID: \"86970815-e08d-4724-a775-9dce7783c699\") " pod="openshift-ingress-canary/ingress-canary-jfgw6"
Jul 31 22:00:48.423663 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.423578    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5b7t\" (UniqueName: \"kubernetes.io/projected/65d82f87-e385-44d0-ae72-38856f99b680-kube-api-access-s5b7t\") pod \"image-registry-8854b8786-5mz8k\" (UID: \"65d82f87-e385-44d0-ae72-38856f99b680\") " pod="openshift-image-registry/image-registry-8854b8786-5mz8k"
Jul 31 22:00:48.482146 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.482127    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-r5bwg"]
Jul 31 22:00:48.485162 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.485148    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-r5bwg"
Jul 31 22:00:48.489861 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.489841    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 31 22:00:48.489954 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.489841    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 31 22:00:48.489954 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.489841    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-snlzz\""
Jul 31 22:00:48.490058 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.489841    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 31 22:00:48.490825 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.490807    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 31 22:00:48.502846 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.502828    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-r5bwg"]
Jul 31 22:00:48.523925 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.523905    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vg7s7\" (UniqueName: \"kubernetes.io/projected/cc043b76-8ded-42e8-b6b1-98cf73ac6303-kube-api-access-vg7s7\") pod \"dns-default-bdmbh\" (UID: \"cc043b76-8ded-42e8-b6b1-98cf73ac6303\") " pod="openshift-dns/dns-default-bdmbh"
Jul 31 22:00:48.524024 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.523938    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4db250ca-5c14-4b35-b230-2bf6dd980dac-data-volume\") pod \"insights-runtime-extractor-r5bwg\" (UID: \"4db250ca-5c14-4b35-b230-2bf6dd980dac\") " pod="openshift-insights/insights-runtime-extractor-r5bwg"
Jul 31 22:00:48.524024 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.523967    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cc043b76-8ded-42e8-b6b1-98cf73ac6303-config-volume\") pod \"dns-default-bdmbh\" (UID: \"cc043b76-8ded-42e8-b6b1-98cf73ac6303\") " pod="openshift-dns/dns-default-bdmbh"
Jul 31 22:00:48.524024 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.523997    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4db250ca-5c14-4b35-b230-2bf6dd980dac-crio-socket\") pod \"insights-runtime-extractor-r5bwg\" (UID: \"4db250ca-5c14-4b35-b230-2bf6dd980dac\") " pod="openshift-insights/insights-runtime-extractor-r5bwg"
Jul 31 22:00:48.524192 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.524037    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/65d82f87-e385-44d0-ae72-38856f99b680-image-registry-private-configuration\") pod \"image-registry-8854b8786-5mz8k\" (UID: \"65d82f87-e385-44d0-ae72-38856f99b680\") " pod="openshift-image-registry/image-registry-8854b8786-5mz8k"
Jul 31 22:00:48.524192 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.524125    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4db250ca-5c14-4b35-b230-2bf6dd980dac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r5bwg\" (UID: \"4db250ca-5c14-4b35-b230-2bf6dd980dac\") " pod="openshift-insights/insights-runtime-extractor-r5bwg"
Jul 31 22:00:48.524192 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.524166    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/65d82f87-e385-44d0-ae72-38856f99b680-ca-trust-extracted\") pod \"image-registry-8854b8786-5mz8k\" (UID: \"65d82f87-e385-44d0-ae72-38856f99b680\") " pod="openshift-image-registry/image-registry-8854b8786-5mz8k"
Jul 31 22:00:48.524397 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.524192    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8nsl\" (UniqueName: \"kubernetes.io/projected/86970815-e08d-4724-a775-9dce7783c699-kube-api-access-x8nsl\") pod \"ingress-canary-jfgw6\" (UID: \"86970815-e08d-4724-a775-9dce7783c699\") " pod="openshift-ingress-canary/ingress-canary-jfgw6"
Jul 31 22:00:48.524397 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.524229    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5b7t\" (UniqueName: \"kubernetes.io/projected/65d82f87-e385-44d0-ae72-38856f99b680-kube-api-access-s5b7t\") pod \"image-registry-8854b8786-5mz8k\" (UID: \"65d82f87-e385-44d0-ae72-38856f99b680\") " pod="openshift-image-registry/image-registry-8854b8786-5mz8k"
Jul 31 22:00:48.524397 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.524258    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86970815-e08d-4724-a775-9dce7783c699-cert\") pod \"ingress-canary-jfgw6\" (UID: \"86970815-e08d-4724-a775-9dce7783c699\") " pod="openshift-ingress-canary/ingress-canary-jfgw6"
Jul 31 22:00:48.524397 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.524294    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4db250ca-5c14-4b35-b230-2bf6dd980dac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r5bwg\" (UID: \"4db250ca-5c14-4b35-b230-2bf6dd980dac\") " pod="openshift-insights/insights-runtime-extractor-r5bwg"
Jul 31 22:00:48.524397 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.524348    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/65d82f87-e385-44d0-ae72-38856f99b680-registry-certificates\") pod \"image-registry-8854b8786-5mz8k\" (UID: \"65d82f87-e385-44d0-ae72-38856f99b680\") " pod="openshift-image-registry/image-registry-8854b8786-5mz8k"
Jul 31 22:00:48.524397 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.524383    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65d82f87-e385-44d0-ae72-38856f99b680-bound-sa-token\") pod \"image-registry-8854b8786-5mz8k\" (UID: \"65d82f87-e385-44d0-ae72-38856f99b680\") " pod="openshift-image-registry/image-registry-8854b8786-5mz8k"
Jul 31 22:00:48.524678 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.524409    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwfhw\" (UniqueName: \"kubernetes.io/projected/4db250ca-5c14-4b35-b230-2bf6dd980dac-kube-api-access-fwfhw\") pod \"insights-runtime-extractor-r5bwg\" (UID: \"4db250ca-5c14-4b35-b230-2bf6dd980dac\") " pod="openshift-insights/insights-runtime-extractor-r5bwg"
Jul 31 22:00:48.524678 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.524444    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65d82f87-e385-44d0-ae72-38856f99b680-registry-tls\") pod \"image-registry-8854b8786-5mz8k\" (UID: \"65d82f87-e385-44d0-ae72-38856f99b680\") " pod="openshift-image-registry/image-registry-8854b8786-5mz8k"
Jul 31 22:00:48.524678 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.524467    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/65d82f87-e385-44d0-ae72-38856f99b680-trusted-ca\") pod \"image-registry-8854b8786-5mz8k\" (UID: \"65d82f87-e385-44d0-ae72-38856f99b680\") " pod="openshift-image-registry/image-registry-8854b8786-5mz8k"
Jul 31 22:00:48.524678 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.524489    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc043b76-8ded-42e8-b6b1-98cf73ac6303-tmp-dir\") pod \"dns-default-bdmbh\" (UID: \"cc043b76-8ded-42e8-b6b1-98cf73ac6303\") " pod="openshift-dns/dns-default-bdmbh"
Jul 31 22:00:48.524678 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.524515    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/65d82f87-e385-44d0-ae72-38856f99b680-installation-pull-secrets\") pod \"image-registry-8854b8786-5mz8k\" (UID: \"65d82f87-e385-44d0-ae72-38856f99b680\") " pod="openshift-image-registry/image-registry-8854b8786-5mz8k"
Jul 31 22:00:48.524678 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.524540    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc043b76-8ded-42e8-b6b1-98cf73ac6303-metrics-tls\") pod \"dns-default-bdmbh\" (UID: \"cc043b76-8ded-42e8-b6b1-98cf73ac6303\") " pod="openshift-dns/dns-default-bdmbh"
Jul 31 22:00:48.524678 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.524589    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cc043b76-8ded-42e8-b6b1-98cf73ac6303-config-volume\") pod \"dns-default-bdmbh\" (UID: \"cc043b76-8ded-42e8-b6b1-98cf73ac6303\") " pod="openshift-dns/dns-default-bdmbh"
Jul 31 22:00:48.524678 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.524601    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/65d82f87-e385-44d0-ae72-38856f99b680-ca-trust-extracted\") pod \"image-registry-8854b8786-5mz8k\" (UID: \"65d82f87-e385-44d0-ae72-38856f99b680\") " pod="openshift-image-registry/image-registry-8854b8786-5mz8k"
Jul 31 22:00:48.524983 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.524847    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc043b76-8ded-42e8-b6b1-98cf73ac6303-tmp-dir\") pod \"dns-default-bdmbh\" (UID: \"cc043b76-8ded-42e8-b6b1-98cf73ac6303\") " pod="openshift-dns/dns-default-bdmbh"
Jul 31 22:00:48.525361 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.525235    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/65d82f87-e385-44d0-ae72-38856f99b680-registry-certificates\") pod \"image-registry-8854b8786-5mz8k\" (UID: \"65d82f87-e385-44d0-ae72-38856f99b680\") " pod="openshift-image-registry/image-registry-8854b8786-5mz8k"
Jul 31 22:00:48.525655 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.525634    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/65d82f87-e385-44d0-ae72-38856f99b680-trusted-ca\") pod \"image-registry-8854b8786-5mz8k\" (UID: \"65d82f87-e385-44d0-ae72-38856f99b680\") " pod="openshift-image-registry/image-registry-8854b8786-5mz8k"
Jul 31 22:00:48.528039 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.528013    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc043b76-8ded-42e8-b6b1-98cf73ac6303-metrics-tls\") pod \"dns-default-bdmbh\" (UID: \"cc043b76-8ded-42e8-b6b1-98cf73ac6303\") " pod="openshift-dns/dns-default-bdmbh"
Jul 31 22:00:48.528127 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.528022    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/65d82f87-e385-44d0-ae72-38856f99b680-image-registry-private-configuration\") pod \"image-registry-8854b8786-5mz8k\" (UID: \"65d82f87-e385-44d0-ae72-38856f99b680\") " pod="openshift-image-registry/image-registry-8854b8786-5mz8k"
Jul 31 22:00:48.528166 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.528146    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65d82f87-e385-44d0-ae72-38856f99b680-registry-tls\") pod \"image-registry-8854b8786-5mz8k\" (UID: \"65d82f87-e385-44d0-ae72-38856f99b680\") " pod="openshift-image-registry/image-registry-8854b8786-5mz8k"
Jul 31 22:00:48.528200 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.528173    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86970815-e08d-4724-a775-9dce7783c699-cert\") pod \"ingress-canary-jfgw6\" (UID: \"86970815-e08d-4724-a775-9dce7783c699\") " pod="openshift-ingress-canary/ingress-canary-jfgw6"
Jul 31 22:00:48.528275 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.528254    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/65d82f87-e385-44d0-ae72-38856f99b680-installation-pull-secrets\") pod \"image-registry-8854b8786-5mz8k\" (UID: \"65d82f87-e385-44d0-ae72-38856f99b680\") " pod="openshift-image-registry/image-registry-8854b8786-5mz8k"
Jul 31 22:00:48.534592 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.534546    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg7s7\" (UniqueName: \"kubernetes.io/projected/cc043b76-8ded-42e8-b6b1-98cf73ac6303-kube-api-access-vg7s7\") pod \"dns-default-bdmbh\" (UID: \"cc043b76-8ded-42e8-b6b1-98cf73ac6303\") " pod="openshift-dns/dns-default-bdmbh"
Jul 31 22:00:48.535038 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.535021    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5b7t\" (UniqueName: \"kubernetes.io/projected/65d82f87-e385-44d0-ae72-38856f99b680-kube-api-access-s5b7t\") pod \"image-registry-8854b8786-5mz8k\" (UID: \"65d82f87-e385-44d0-ae72-38856f99b680\") " pod="openshift-image-registry/image-registry-8854b8786-5mz8k"
Jul 31 22:00:48.535595 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.535576    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65d82f87-e385-44d0-ae72-38856f99b680-bound-sa-token\") pod \"image-registry-8854b8786-5mz8k\" (UID: \"65d82f87-e385-44d0-ae72-38856f99b680\") " pod="openshift-image-registry/image-registry-8854b8786-5mz8k"
Jul 31 22:00:48.536099 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.536083    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8nsl\" (UniqueName: \"kubernetes.io/projected/86970815-e08d-4724-a775-9dce7783c699-kube-api-access-x8nsl\") pod \"ingress-canary-jfgw6\" (UID: \"86970815-e08d-4724-a775-9dce7783c699\") " pod="openshift-ingress-canary/ingress-canary-jfgw6"
Jul 31 22:00:48.625110 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.625063    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4db250ca-5c14-4b35-b230-2bf6dd980dac-crio-socket\") pod \"insights-runtime-extractor-r5bwg\" (UID: \"4db250ca-5c14-4b35-b230-2bf6dd980dac\") " pod="openshift-insights/insights-runtime-extractor-r5bwg"
Jul 31 22:00:48.625110 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.625107    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4db250ca-5c14-4b35-b230-2bf6dd980dac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r5bwg\" (UID: \"4db250ca-5c14-4b35-b230-2bf6dd980dac\") " pod="openshift-insights/insights-runtime-extractor-r5bwg"
Jul 31 22:00:48.625235 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.625219    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4db250ca-5c14-4b35-b230-2bf6dd980dac-crio-socket\") pod \"insights-runtime-extractor-r5bwg\" (UID: \"4db250ca-5c14-4b35-b230-2bf6dd980dac\") " pod="openshift-insights/insights-runtime-extractor-r5bwg"
Jul 31 22:00:48.625278 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.625224    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4db250ca-5c14-4b35-b230-2bf6dd980dac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r5bwg\" (UID: \"4db250ca-5c14-4b35-b230-2bf6dd980dac\") " pod="openshift-insights/insights-runtime-extractor-r5bwg"
Jul 31 22:00:48.625278 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.625269    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwfhw\" (UniqueName: \"kubernetes.io/projected/4db250ca-5c14-4b35-b230-2bf6dd980dac-kube-api-access-fwfhw\") pod \"insights-runtime-extractor-r5bwg\" (UID: \"4db250ca-5c14-4b35-b230-2bf6dd980dac\") " pod="openshift-insights/insights-runtime-extractor-r5bwg"
Jul 31 22:00:48.625373 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.625294    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4db250ca-5c14-4b35-b230-2bf6dd980dac-data-volume\") pod \"insights-runtime-extractor-r5bwg\" (UID: \"4db250ca-5c14-4b35-b230-2bf6dd980dac\") " pod="openshift-insights/insights-runtime-extractor-r5bwg"
Jul 31 22:00:48.625536 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.625521    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4db250ca-5c14-4b35-b230-2bf6dd980dac-data-volume\") pod \"insights-runtime-extractor-r5bwg\" (UID: \"4db250ca-5c14-4b35-b230-2bf6dd980dac\") " pod="openshift-insights/insights-runtime-extractor-r5bwg"
Jul 31 22:00:48.625664 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.625648    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4db250ca-5c14-4b35-b230-2bf6dd980dac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r5bwg\" (UID: \"4db250ca-5c14-4b35-b230-2bf6dd980dac\") " pod="openshift-insights/insights-runtime-extractor-r5bwg"
Jul 31 22:00:48.626890 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.626873    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4db250ca-5c14-4b35-b230-2bf6dd980dac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r5bwg\" (UID: \"4db250ca-5c14-4b35-b230-2bf6dd980dac\") " pod="openshift-insights/insights-runtime-extractor-r5bwg"
Jul 31 22:00:48.633035 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.633018    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwfhw\" (UniqueName: \"kubernetes.io/projected/4db250ca-5c14-4b35-b230-2bf6dd980dac-kube-api-access-fwfhw\") pod \"insights-runtime-extractor-r5bwg\" (UID: \"4db250ca-5c14-4b35-b230-2bf6dd980dac\") " pod="openshift-insights/insights-runtime-extractor-r5bwg"
Jul 31 22:00:48.657881 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.657860    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8854b8786-5mz8k"
Jul 31 22:00:48.686346 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.686324    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bdmbh"
Jul 31 22:00:48.691231 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.691213    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jfgw6"
Jul 31 22:00:48.792609 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.792586    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-r5bwg"
Jul 31 22:00:48.813216 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.813147    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8854b8786-5mz8k"]
Jul 31 22:00:48.817420 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:00:48.817391    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65d82f87_e385_44d0_ae72_38856f99b680.slice/crio-2b505d7e57a49618ad2c5da4b3900b14018d9301ddf886045ed98ad74527d910 WatchSource:0}: Error finding container 2b505d7e57a49618ad2c5da4b3900b14018d9301ddf886045ed98ad74527d910: Status 404 returned error can't find the container with id 2b505d7e57a49618ad2c5da4b3900b14018d9301ddf886045ed98ad74527d910
Jul 31 22:00:48.837201 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.837163    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jfgw6"]
Jul 31 22:00:48.846513 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.846491    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bdmbh"]
Jul 31 22:00:48.853347 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:00:48.853257    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86970815_e08d_4724_a775_9dce7783c699.slice/crio-20032d37faeaa1a97157ad68d7f7423379b8f5a638f1948d63302b4087ec5efe WatchSource:0}: Error finding container 20032d37faeaa1a97157ad68d7f7423379b8f5a638f1948d63302b4087ec5efe: Status 404 returned error can't find the container with id 20032d37faeaa1a97157ad68d7f7423379b8f5a638f1948d63302b4087ec5efe
Jul 31 22:00:48.853971 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:00:48.853926    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc043b76_8ded_42e8_b6b1_98cf73ac6303.slice/crio-7e89a41e58ea2f7e6513b64efbbe233fd9be236f11266d1a7f73c9e16395b0be WatchSource:0}: Error finding container 7e89a41e58ea2f7e6513b64efbbe233fd9be236f11266d1a7f73c9e16395b0be: Status 404 returned error can't find the container with id 7e89a41e58ea2f7e6513b64efbbe233fd9be236f11266d1a7f73c9e16395b0be
Jul 31 22:00:48.924201 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:48.924183    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-r5bwg"]
Jul 31 22:00:48.926464 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:00:48.926440    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4db250ca_5c14_4b35_b230_2bf6dd980dac.slice/crio-7fe9cc7a3c91b33472dd0bc68e5964e56f4f84d98e585e7c23c0ba244d86c5cc WatchSource:0}: Error finding container 7fe9cc7a3c91b33472dd0bc68e5964e56f4f84d98e585e7c23c0ba244d86c5cc: Status 404 returned error can't find the container with id 7fe9cc7a3c91b33472dd0bc68e5964e56f4f84d98e585e7c23c0ba244d86c5cc
Jul 31 22:00:49.536417 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:49.536381    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jfgw6" event={"ID":"86970815-e08d-4724-a775-9dce7783c699","Type":"ContainerStarted","Data":"20032d37faeaa1a97157ad68d7f7423379b8f5a638f1948d63302b4087ec5efe"}
Jul 31 22:00:49.537744 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:49.537713    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bdmbh" event={"ID":"cc043b76-8ded-42e8-b6b1-98cf73ac6303","Type":"ContainerStarted","Data":"7e89a41e58ea2f7e6513b64efbbe233fd9be236f11266d1a7f73c9e16395b0be"}
Jul 31 22:00:49.539352 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:49.539326    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r5bwg" event={"ID":"4db250ca-5c14-4b35-b230-2bf6dd980dac","Type":"ContainerStarted","Data":"e7e974c045164d968d2aa225c9b127ca32946a4cb29ada40d7341e5880027b6a"}
Jul 31 22:00:49.539454 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:49.539407    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r5bwg" event={"ID":"4db250ca-5c14-4b35-b230-2bf6dd980dac","Type":"ContainerStarted","Data":"7fe9cc7a3c91b33472dd0bc68e5964e56f4f84d98e585e7c23c0ba244d86c5cc"}
Jul 31 22:00:49.540926 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:49.540903    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8854b8786-5mz8k" event={"ID":"65d82f87-e385-44d0-ae72-38856f99b680","Type":"ContainerStarted","Data":"aa9cacef17434aac23f4cc23dadc3052f0362b869d62ffe3fb091f173ff598ae"}
Jul 31 22:00:49.541011 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:49.540942    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8854b8786-5mz8k" event={"ID":"65d82f87-e385-44d0-ae72-38856f99b680","Type":"ContainerStarted","Data":"2b505d7e57a49618ad2c5da4b3900b14018d9301ddf886045ed98ad74527d910"}
Jul 31 22:00:49.541091 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:49.541073    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8854b8786-5mz8k"
Jul 31 22:00:49.570503 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:49.570461    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8854b8786-5mz8k" podStartSLOduration=2.570447122 podStartE2EDuration="2.570447122s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:00:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:00:49.568993716 +0000 UTC m=+58.664284862" watchObservedRunningTime="2026-07-31 22:00:49.570447122 +0000 UTC m=+58.665738277"
Jul 31 22:00:50.883925 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:50.883895    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-qbtzj"]
Jul 31 22:00:50.902220 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:50.902196    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-qbtzj"]
Jul 31 22:00:50.902436 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:50.902415    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-qbtzj"
Jul 31 22:00:50.906861 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:50.906840    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 31 22:00:50.907947 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:50.907915    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 31 22:00:50.908060 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:50.907976    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 31 22:00:50.908060 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:50.907920    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 31 22:00:50.908060 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:50.907921    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-8qpvf\""
Jul 31 22:00:50.908197 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:50.908110    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 31 22:00:50.943339 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:50.943315    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7939b6d7-b983-45bb-8534-4c10740b9683-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-qbtzj\" (UID: \"7939b6d7-b983-45bb-8534-4c10740b9683\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-qbtzj"
Jul 31 22:00:50.943443 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:50.943397    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7939b6d7-b983-45bb-8534-4c10740b9683-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-qbtzj\" (UID: \"7939b6d7-b983-45bb-8534-4c10740b9683\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-qbtzj"
Jul 31 22:00:50.943443 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:50.943419    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw8dr\" (UniqueName: \"kubernetes.io/projected/7939b6d7-b983-45bb-8534-4c10740b9683-kube-api-access-bw8dr\") pod \"prometheus-operator-758d7cb874-qbtzj\" (UID: \"7939b6d7-b983-45bb-8534-4c10740b9683\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-qbtzj"
Jul 31 22:00:50.943443 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:50.943440    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7939b6d7-b983-45bb-8534-4c10740b9683-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-qbtzj\" (UID: \"7939b6d7-b983-45bb-8534-4c10740b9683\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-qbtzj"
Jul 31 22:00:51.044651 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:51.044631    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7939b6d7-b983-45bb-8534-4c10740b9683-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-qbtzj\" (UID: \"7939b6d7-b983-45bb-8534-4c10740b9683\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-qbtzj"
Jul 31 22:00:51.044743 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:51.044692    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7939b6d7-b983-45bb-8534-4c10740b9683-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-qbtzj\" (UID: \"7939b6d7-b983-45bb-8534-4c10740b9683\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-qbtzj"
Jul 31 22:00:51.044743 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:51.044708    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw8dr\" (UniqueName: \"kubernetes.io/projected/7939b6d7-b983-45bb-8534-4c10740b9683-kube-api-access-bw8dr\") pod \"prometheus-operator-758d7cb874-qbtzj\" (UID: \"7939b6d7-b983-45bb-8534-4c10740b9683\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-qbtzj"
Jul 31 22:00:51.044743 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:51.044727    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7939b6d7-b983-45bb-8534-4c10740b9683-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-qbtzj\" (UID: \"7939b6d7-b983-45bb-8534-4c10740b9683\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-qbtzj"
Jul 31 22:00:51.044898 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:51.044764    2573 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 31 22:00:51.044898 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:51.044842    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7939b6d7-b983-45bb-8534-4c10740b9683-prometheus-operator-tls podName:7939b6d7-b983-45bb-8534-4c10740b9683 nodeName:}" failed. No retries permitted until 2026-07-31 22:00:51.544820979 +0000 UTC m=+60.640112106 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/7939b6d7-b983-45bb-8534-4c10740b9683-prometheus-operator-tls") pod "prometheus-operator-758d7cb874-qbtzj" (UID: "7939b6d7-b983-45bb-8534-4c10740b9683") : secret "prometheus-operator-tls" not found
Jul 31 22:00:51.045330 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:51.045287    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7939b6d7-b983-45bb-8534-4c10740b9683-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-qbtzj\" (UID: \"7939b6d7-b983-45bb-8534-4c10740b9683\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-qbtzj"
Jul 31 22:00:51.046998 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:51.046979    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7939b6d7-b983-45bb-8534-4c10740b9683-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-qbtzj\" (UID: \"7939b6d7-b983-45bb-8534-4c10740b9683\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-qbtzj"
Jul 31 22:00:51.053710 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:51.053681    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw8dr\" (UniqueName: \"kubernetes.io/projected/7939b6d7-b983-45bb-8534-4c10740b9683-kube-api-access-bw8dr\") pod \"prometheus-operator-758d7cb874-qbtzj\" (UID: \"7939b6d7-b983-45bb-8534-4c10740b9683\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-qbtzj"
Jul 31 22:00:51.548906 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:51.548871    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7939b6d7-b983-45bb-8534-4c10740b9683-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-qbtzj\" (UID: \"7939b6d7-b983-45bb-8534-4c10740b9683\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-qbtzj"
Jul 31 22:00:51.551598 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:51.551567    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r5bwg" event={"ID":"4db250ca-5c14-4b35-b230-2bf6dd980dac","Type":"ContainerStarted","Data":"9c32a88cbf3f57112ee5ad6faaf13c4cfa8f5bebf2191134ab52b342f21397af"}
Jul 31 22:00:51.551771 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:51.551747    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7939b6d7-b983-45bb-8534-4c10740b9683-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-qbtzj\" (UID: \"7939b6d7-b983-45bb-8534-4c10740b9683\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-qbtzj"
Jul 31 22:00:51.553784 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:51.553755    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bdmbh" event={"ID":"cc043b76-8ded-42e8-b6b1-98cf73ac6303","Type":"ContainerStarted","Data":"ec3de509ae424e46b536e21fc26afa1244420acd85d1ec6f8ef278c434e035ff"}
Jul 31 22:00:51.553889 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:51.553809    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bdmbh" event={"ID":"cc043b76-8ded-42e8-b6b1-98cf73ac6303","Type":"ContainerStarted","Data":"1929bbb3ee15819220e75dd5b0d0041b3f526b2859089749485c7b79c8562916"}
Jul 31 22:00:51.553889 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:51.553863    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bdmbh"
Jul 31 22:00:51.574366 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:51.574295    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bdmbh" podStartSLOduration=1.411474352 podStartE2EDuration="3.574281249s" totalImagesPullingTime="2.162806897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:00:51.573701248 +0000 UTC m=+60.668992396" watchObservedRunningTime="2026-07-31 22:00:51.574281249 +0000 UTC m=+60.669572394"
Jul 31 22:00:51.816860 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:51.816792    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-8qpvf\""
Jul 31 22:00:51.824375 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:51.824348    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-qbtzj"
Jul 31 22:00:52.207902 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:52.207879    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-qbtzj"]
Jul 31 22:00:52.210681 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:00:52.210652    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7939b6d7_b983_45bb_8534_4c10740b9683.slice/crio-ffa94ae25bfbf99201b17357be95a0fadcdc86b973ec94a6a78c39b132ddd390 WatchSource:0}: Error finding container ffa94ae25bfbf99201b17357be95a0fadcdc86b973ec94a6a78c39b132ddd390: Status 404 returned error can't find the container with id ffa94ae25bfbf99201b17357be95a0fadcdc86b973ec94a6a78c39b132ddd390
Jul 31 22:00:52.480744 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:52.480716    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4ddp8"
Jul 31 22:00:52.560886 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:52.560848    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-qbtzj" event={"ID":"7939b6d7-b983-45bb-8534-4c10740b9683","Type":"ContainerStarted","Data":"ffa94ae25bfbf99201b17357be95a0fadcdc86b973ec94a6a78c39b132ddd390"}
Jul 31 22:00:52.562618 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:52.562589    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jfgw6" event={"ID":"86970815-e08d-4724-a775-9dce7783c699","Type":"ContainerStarted","Data":"d78e04e3377428232b8b0f528af68b8a49eca4c2d656e73cad9fd0fc93816bd8"}
Jul 31 22:00:53.568758 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:53.568725    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r5bwg" event={"ID":"4db250ca-5c14-4b35-b230-2bf6dd980dac","Type":"ContainerStarted","Data":"561f2e5f0e753b5e28b72ded0bccab7303e9fb542160191d6c174d5bfacbb46d"}
Jul 31 22:00:53.594034 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:53.591221    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jfgw6" podStartSLOduration=2.28724607 podStartE2EDuration="5.591202034s" totalImagesPullingTime="3.303955964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:00:52.59550513 +0000 UTC m=+61.690796277" watchObservedRunningTime="2026-07-31 22:00:53.591202034 +0000 UTC m=+62.686493181"
Jul 31 22:00:53.594034 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:53.592355    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-r5bwg" podStartSLOduration=1.687801698 podStartE2EDuration="5.592338727s" totalImagesPullingTime="3.904537029s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 22:00:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:00:53.591102636 +0000 UTC m=+62.686393782" watchObservedRunningTime="2026-07-31 22:00:53.592338727 +0000 UTC m=+62.687629875"
Jul 31 22:00:54.572996 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:54.572961    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-qbtzj" event={"ID":"7939b6d7-b983-45bb-8534-4c10740b9683","Type":"ContainerStarted","Data":"50619715d63a29060ded529adeed86d9b157b6966f30794577a9d14cde1000c7"}
Jul 31 22:00:54.573468 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:54.573038    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-qbtzj" event={"ID":"7939b6d7-b983-45bb-8534-4c10740b9683","Type":"ContainerStarted","Data":"ca11af2e4b431c94becd25d50ee9000bc1a218dfe23df1ef02353e2567d27500"}
Jul 31 22:00:54.591654 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:54.591609    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-758d7cb874-qbtzj" podStartSLOduration=2.895361761 podStartE2EDuration="4.591593303s" totalImagesPullingTime="1.696231542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:00:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:00:54.590852436 +0000 UTC m=+63.686143583" watchObservedRunningTime="2026-07-31 22:00:54.591593303 +0000 UTC m=+63.686884451"
Jul 31 22:00:56.536998 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.536974    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-m25h2"]
Jul 31 22:00:56.541737 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.541719    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-m25h2"
Jul 31 22:00:56.549261 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.549242    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 31 22:00:56.549350 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.549268    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 31 22:00:56.550288 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.550272    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-fqnjh\""
Jul 31 22:00:56.550347 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.550325    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 31 22:00:56.555374 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.555356    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-m25h2"]
Jul 31 22:00:56.584846 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.584823    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/835fe2e4-9be8-46ad-a246-82edf6078d58-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-m25h2\" (UID: \"835fe2e4-9be8-46ad-a246-82edf6078d58\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-m25h2"
Jul 31 22:00:56.584925 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.584856    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/835fe2e4-9be8-46ad-a246-82edf6078d58-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-m25h2\" (UID: \"835fe2e4-9be8-46ad-a246-82edf6078d58\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-m25h2"
Jul 31 22:00:56.584925 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.584889    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/835fe2e4-9be8-46ad-a246-82edf6078d58-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-m25h2\" (UID: \"835fe2e4-9be8-46ad-a246-82edf6078d58\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-m25h2"
Jul 31 22:00:56.585023 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.584941    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/835fe2e4-9be8-46ad-a246-82edf6078d58-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-m25h2\" (UID: \"835fe2e4-9be8-46ad-a246-82edf6078d58\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-m25h2"
Jul 31 22:00:56.585023 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.584964    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/835fe2e4-9be8-46ad-a246-82edf6078d58-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-m25h2\" (UID: \"835fe2e4-9be8-46ad-a246-82edf6078d58\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-m25h2"
Jul 31 22:00:56.585093 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.585043    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q9h7\" (UniqueName: \"kubernetes.io/projected/835fe2e4-9be8-46ad-a246-82edf6078d58-kube-api-access-4q9h7\") pod \"kube-state-metrics-6bd9664c4-m25h2\" (UID: \"835fe2e4-9be8-46ad-a246-82edf6078d58\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-m25h2"
Jul 31 22:00:56.590869 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.590850    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xhrth"]
Jul 31 22:00:56.593976 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.593962    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xhrth"
Jul 31 22:00:56.596328 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.596311    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-c8br7\""
Jul 31 22:00:56.596587 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.596569    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 31 22:00:56.596650 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.596633    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 31 22:00:56.596688 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.596675    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 31 22:00:56.685432 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.685410    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/835fe2e4-9be8-46ad-a246-82edf6078d58-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-m25h2\" (UID: \"835fe2e4-9be8-46ad-a246-82edf6078d58\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-m25h2"
Jul 31 22:00:56.685520 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.685440    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/de085141-f4e0-48b7-8984-bb06048df425-node-exporter-textfile\") pod \"node-exporter-xhrth\" (UID: \"de085141-f4e0-48b7-8984-bb06048df425\") " pod="openshift-monitoring/node-exporter-xhrth"
Jul 31 22:00:56.685520 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.685457    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de085141-f4e0-48b7-8984-bb06048df425-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xhrth\" (UID: \"de085141-f4e0-48b7-8984-bb06048df425\") " pod="openshift-monitoring/node-exporter-xhrth"
Jul 31 22:00:56.685520 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.685475    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/de085141-f4e0-48b7-8984-bb06048df425-root\") pod \"node-exporter-xhrth\" (UID: \"de085141-f4e0-48b7-8984-bb06048df425\") " pod="openshift-monitoring/node-exporter-xhrth"
Jul 31 22:00:56.685520 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.685496    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/835fe2e4-9be8-46ad-a246-82edf6078d58-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-m25h2\" (UID: \"835fe2e4-9be8-46ad-a246-82edf6078d58\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-m25h2"
Jul 31 22:00:56.685672 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.685595    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de085141-f4e0-48b7-8984-bb06048df425-sys\") pod \"node-exporter-xhrth\" (UID: \"de085141-f4e0-48b7-8984-bb06048df425\") " pod="openshift-monitoring/node-exporter-xhrth"
Jul 31 22:00:56.685672 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.685621    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/835fe2e4-9be8-46ad-a246-82edf6078d58-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-m25h2\" (UID: \"835fe2e4-9be8-46ad-a246-82edf6078d58\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-m25h2"
Jul 31 22:00:56.685672 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.685641    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/835fe2e4-9be8-46ad-a246-82edf6078d58-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-m25h2\" (UID: \"835fe2e4-9be8-46ad-a246-82edf6078d58\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-m25h2"
Jul 31 22:00:56.685788 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.685672    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/de085141-f4e0-48b7-8984-bb06048df425-node-exporter-accelerators-collector-config\") pod \"node-exporter-xhrth\" (UID: \"de085141-f4e0-48b7-8984-bb06048df425\") " pod="openshift-monitoring/node-exporter-xhrth"
Jul 31 22:00:56.685788 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.685716    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/de085141-f4e0-48b7-8984-bb06048df425-node-exporter-wtmp\") pod \"node-exporter-xhrth\" (UID: \"de085141-f4e0-48b7-8984-bb06048df425\") " pod="openshift-monitoring/node-exporter-xhrth"
Jul 31 22:00:56.685788 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.685732    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rt4b\" (UniqueName: \"kubernetes.io/projected/de085141-f4e0-48b7-8984-bb06048df425-kube-api-access-7rt4b\") pod \"node-exporter-xhrth\" (UID: \"de085141-f4e0-48b7-8984-bb06048df425\") " pod="openshift-monitoring/node-exporter-xhrth"
Jul 31 22:00:56.685788 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:56.685746    2573 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 31 22:00:56.685788 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.685753    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q9h7\" (UniqueName: \"kubernetes.io/projected/835fe2e4-9be8-46ad-a246-82edf6078d58-kube-api-access-4q9h7\") pod \"kube-state-metrics-6bd9664c4-m25h2\" (UID: \"835fe2e4-9be8-46ad-a246-82edf6078d58\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-m25h2"
Jul 31 22:00:56.685788 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.685785    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/de085141-f4e0-48b7-8984-bb06048df425-node-exporter-tls\") pod \"node-exporter-xhrth\" (UID: \"de085141-f4e0-48b7-8984-bb06048df425\") " pod="openshift-monitoring/node-exporter-xhrth"
Jul 31 22:00:56.686064 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:56.685799    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/835fe2e4-9be8-46ad-a246-82edf6078d58-kube-state-metrics-tls podName:835fe2e4-9be8-46ad-a246-82edf6078d58 nodeName:}" failed. No retries permitted until 2026-07-31 22:00:57.185782088 +0000 UTC m=+66.281073215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/835fe2e4-9be8-46ad-a246-82edf6078d58-kube-state-metrics-tls") pod "kube-state-metrics-6bd9664c4-m25h2" (UID: "835fe2e4-9be8-46ad-a246-82edf6078d58") : secret "kube-state-metrics-tls" not found
Jul 31 22:00:56.686064 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.685852    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de085141-f4e0-48b7-8984-bb06048df425-metrics-client-ca\") pod \"node-exporter-xhrth\" (UID: \"de085141-f4e0-48b7-8984-bb06048df425\") " pod="openshift-monitoring/node-exporter-xhrth"
Jul 31 22:00:56.686064 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.685895    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/835fe2e4-9be8-46ad-a246-82edf6078d58-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-m25h2\" (UID: \"835fe2e4-9be8-46ad-a246-82edf6078d58\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-m25h2"
Jul 31 22:00:56.686222 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.686114    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/835fe2e4-9be8-46ad-a246-82edf6078d58-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-m25h2\" (UID: \"835fe2e4-9be8-46ad-a246-82edf6078d58\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-m25h2"
Jul 31 22:00:56.686275 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.686229    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/835fe2e4-9be8-46ad-a246-82edf6078d58-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-m25h2\" (UID: \"835fe2e4-9be8-46ad-a246-82edf6078d58\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-m25h2"
Jul 31 22:00:56.686342 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.686295    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/835fe2e4-9be8-46ad-a246-82edf6078d58-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-m25h2\" (UID: \"835fe2e4-9be8-46ad-a246-82edf6078d58\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-m25h2"
Jul 31 22:00:56.687757 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.687741    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/835fe2e4-9be8-46ad-a246-82edf6078d58-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-m25h2\" (UID: \"835fe2e4-9be8-46ad-a246-82edf6078d58\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-m25h2"
Jul 31 22:00:56.696807 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.696785    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q9h7\" (UniqueName: \"kubernetes.io/projected/835fe2e4-9be8-46ad-a246-82edf6078d58-kube-api-access-4q9h7\") pod \"kube-state-metrics-6bd9664c4-m25h2\" (UID: \"835fe2e4-9be8-46ad-a246-82edf6078d58\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-m25h2"
Jul 31 22:00:56.786451 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.786430    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/de085141-f4e0-48b7-8984-bb06048df425-node-exporter-wtmp\") pod \"node-exporter-xhrth\" (UID: \"de085141-f4e0-48b7-8984-bb06048df425\") " pod="openshift-monitoring/node-exporter-xhrth"
Jul 31 22:00:56.786544 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.786455    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rt4b\" (UniqueName: \"kubernetes.io/projected/de085141-f4e0-48b7-8984-bb06048df425-kube-api-access-7rt4b\") pod \"node-exporter-xhrth\" (UID: \"de085141-f4e0-48b7-8984-bb06048df425\") " pod="openshift-monitoring/node-exporter-xhrth"
Jul 31 22:00:56.786544 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.786474    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/de085141-f4e0-48b7-8984-bb06048df425-node-exporter-tls\") pod \"node-exporter-xhrth\" (UID: \"de085141-f4e0-48b7-8984-bb06048df425\") " pod="openshift-monitoring/node-exporter-xhrth"
Jul 31 22:00:56.786544 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.786489    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de085141-f4e0-48b7-8984-bb06048df425-metrics-client-ca\") pod \"node-exporter-xhrth\" (UID: \"de085141-f4e0-48b7-8984-bb06048df425\") " pod="openshift-monitoring/node-exporter-xhrth"
Jul 31 22:00:56.786544 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.786510    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/de085141-f4e0-48b7-8984-bb06048df425-node-exporter-textfile\") pod \"node-exporter-xhrth\" (UID: \"de085141-f4e0-48b7-8984-bb06048df425\") " pod="openshift-monitoring/node-exporter-xhrth"
Jul 31 22:00:56.786544 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.786524    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de085141-f4e0-48b7-8984-bb06048df425-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xhrth\" (UID: \"de085141-f4e0-48b7-8984-bb06048df425\") " pod="openshift-monitoring/node-exporter-xhrth"
Jul 31 22:00:56.786775 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.786549    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/de085141-f4e0-48b7-8984-bb06048df425-root\") pod \"node-exporter-xhrth\" (UID: \"de085141-f4e0-48b7-8984-bb06048df425\") " pod="openshift-monitoring/node-exporter-xhrth"
Jul 31 22:00:56.786775 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.786586    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de085141-f4e0-48b7-8984-bb06048df425-sys\") pod \"node-exporter-xhrth\" (UID: \"de085141-f4e0-48b7-8984-bb06048df425\") " pod="openshift-monitoring/node-exporter-xhrth"
Jul 31 22:00:56.786775 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:56.786601    2573 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 31 22:00:56.786775 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.786629    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/de085141-f4e0-48b7-8984-bb06048df425-node-exporter-wtmp\") pod \"node-exporter-xhrth\" (UID: \"de085141-f4e0-48b7-8984-bb06048df425\") " pod="openshift-monitoring/node-exporter-xhrth"
Jul 31 22:00:56.786775 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.786645    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/de085141-f4e0-48b7-8984-bb06048df425-node-exporter-accelerators-collector-config\") pod \"node-exporter-xhrth\" (UID: \"de085141-f4e0-48b7-8984-bb06048df425\") " pod="openshift-monitoring/node-exporter-xhrth"
Jul 31 22:00:56.786775 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:00:56.786656    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de085141-f4e0-48b7-8984-bb06048df425-node-exporter-tls podName:de085141-f4e0-48b7-8984-bb06048df425 nodeName:}" failed. No retries permitted until 2026-07-31 22:00:57.286641238 +0000 UTC m=+66.381932390 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/de085141-f4e0-48b7-8984-bb06048df425-node-exporter-tls") pod "node-exporter-xhrth" (UID: "de085141-f4e0-48b7-8984-bb06048df425") : secret "node-exporter-tls" not found
Jul 31 22:00:56.786775 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.786656    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/de085141-f4e0-48b7-8984-bb06048df425-root\") pod \"node-exporter-xhrth\" (UID: \"de085141-f4e0-48b7-8984-bb06048df425\") " pod="openshift-monitoring/node-exporter-xhrth"
Jul 31 22:00:56.786775 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.786686    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de085141-f4e0-48b7-8984-bb06048df425-sys\") pod \"node-exporter-xhrth\" (UID: \"de085141-f4e0-48b7-8984-bb06048df425\") " pod="openshift-monitoring/node-exporter-xhrth"
Jul 31 22:00:56.787060 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.786854    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/de085141-f4e0-48b7-8984-bb06048df425-node-exporter-textfile\") pod \"node-exporter-xhrth\" (UID: \"de085141-f4e0-48b7-8984-bb06048df425\") " pod="openshift-monitoring/node-exporter-xhrth"
Jul 31 22:00:56.787145 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.787129    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/de085141-f4e0-48b7-8984-bb06048df425-node-exporter-accelerators-collector-config\") pod \"node-exporter-xhrth\" (UID: \"de085141-f4e0-48b7-8984-bb06048df425\") " pod="openshift-monitoring/node-exporter-xhrth"
Jul 31 22:00:56.787198 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.787184    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de085141-f4e0-48b7-8984-bb06048df425-metrics-client-ca\") pod \"node-exporter-xhrth\" (UID: \"de085141-f4e0-48b7-8984-bb06048df425\") " pod="openshift-monitoring/node-exporter-xhrth"
Jul 31 22:00:56.788550 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.788529    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de085141-f4e0-48b7-8984-bb06048df425-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xhrth\" (UID: \"de085141-f4e0-48b7-8984-bb06048df425\") " pod="openshift-monitoring/node-exporter-xhrth"
Jul 31 22:00:56.795050 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.795032    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rt4b\" (UniqueName: \"kubernetes.io/projected/de085141-f4e0-48b7-8984-bb06048df425-kube-api-access-7rt4b\") pod \"node-exporter-xhrth\" (UID: \"de085141-f4e0-48b7-8984-bb06048df425\") " pod="openshift-monitoring/node-exporter-xhrth"
Jul 31 22:00:56.987976 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.987949    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cd860f1-df9a-4df3-9bea-45d697a20f92-metrics-certs\") pod \"network-metrics-daemon-dpcw4\" (UID: \"5cd860f1-df9a-4df3-9bea-45d697a20f92\") " pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 22:00:56.990631 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:56.990611    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 31 22:00:57.000125 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:57.000110    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cd860f1-df9a-4df3-9bea-45d697a20f92-metrics-certs\") pod \"network-metrics-daemon-dpcw4\" (UID: \"5cd860f1-df9a-4df3-9bea-45d697a20f92\") " pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 22:00:57.052703 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:57.052647    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sb6cn\""
Jul 31 22:00:57.060757 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:57.060737    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpcw4"
Jul 31 22:00:57.088318 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:57.088283    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8pqf\" (UniqueName: \"kubernetes.io/projected/bac49c41-6245-48dd-b89d-5e799e544e08-kube-api-access-p8pqf\") pod \"network-check-target-5sf9m\" (UID: \"bac49c41-6245-48dd-b89d-5e799e544e08\") " pod="openshift-network-diagnostics/network-check-target-5sf9m"
Jul 31 22:00:57.088422 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:57.088329    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4fbb48e0-0e3e-4864-a018-acb5bb48e0a8-original-pull-secret\") pod \"global-pull-secret-syncer-422sp\" (UID: \"4fbb48e0-0e3e-4864-a018-acb5bb48e0a8\") " pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 22:00:57.091595 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:57.091318    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 31 22:00:57.091595 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:57.091337    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 31 22:00:57.100658 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:57.100637    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4fbb48e0-0e3e-4864-a018-acb5bb48e0a8-original-pull-secret\") pod \"global-pull-secret-syncer-422sp\" (UID: \"4fbb48e0-0e3e-4864-a018-acb5bb48e0a8\") " pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 22:00:57.100765 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:57.100710    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 31 22:00:57.111718 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:57.111615    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8pqf\" (UniqueName: \"kubernetes.io/projected/bac49c41-6245-48dd-b89d-5e799e544e08-kube-api-access-p8pqf\") pod \"network-check-target-5sf9m\" (UID: \"bac49c41-6245-48dd-b89d-5e799e544e08\") " pod="openshift-network-diagnostics/network-check-target-5sf9m"
Jul 31 22:00:57.182602 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:57.182563    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dpcw4"]
Jul 31 22:00:57.184910 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:00:57.184882    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cd860f1_df9a_4df3_9bea_45d697a20f92.slice/crio-02d4759b782f40002b9304f81a9c51d1f2b825e1d5f364d58376cc1bd987f27c WatchSource:0}: Error finding container 02d4759b782f40002b9304f81a9c51d1f2b825e1d5f364d58376cc1bd987f27c: Status 404 returned error can't find the container with id 02d4759b782f40002b9304f81a9c51d1f2b825e1d5f364d58376cc1bd987f27c
Jul 31 22:00:57.189592 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:57.189556    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/835fe2e4-9be8-46ad-a246-82edf6078d58-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-m25h2\" (UID: \"835fe2e4-9be8-46ad-a246-82edf6078d58\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-m25h2"
Jul 31 22:00:57.191684 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:57.191662    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/835fe2e4-9be8-46ad-a246-82edf6078d58-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-m25h2\" (UID: \"835fe2e4-9be8-46ad-a246-82edf6078d58\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-m25h2"
Jul 31 22:00:57.290518 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:57.290491    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/de085141-f4e0-48b7-8984-bb06048df425-node-exporter-tls\") pod \"node-exporter-xhrth\" (UID: \"de085141-f4e0-48b7-8984-bb06048df425\") " pod="openshift-monitoring/node-exporter-xhrth"
Jul 31 22:00:57.292513 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:57.292494    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/de085141-f4e0-48b7-8984-bb06048df425-node-exporter-tls\") pod \"node-exporter-xhrth\" (UID: \"de085141-f4e0-48b7-8984-bb06048df425\") " pod="openshift-monitoring/node-exporter-xhrth"
Jul 31 22:00:57.341945 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:57.341900    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nslhh\""
Jul 31 22:00:57.345849 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:57.345825    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-422sp"
Jul 31 22:00:57.349887 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:57.349868    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sf9m"
Jul 31 22:00:57.450181 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:57.450055    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-m25h2"
Jul 31 22:00:57.481189 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:57.481159    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-422sp"]
Jul 31 22:00:57.484379 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:00:57.484330    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fbb48e0_0e3e_4864_a018_acb5bb48e0a8.slice/crio-974e35a138c2284daa2a6d7061dccb04987ebfc3e9567386fe9ea298ae2e2fea WatchSource:0}: Error finding container 974e35a138c2284daa2a6d7061dccb04987ebfc3e9567386fe9ea298ae2e2fea: Status 404 returned error can't find the container with id 974e35a138c2284daa2a6d7061dccb04987ebfc3e9567386fe9ea298ae2e2fea
Jul 31 22:00:57.498071 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:57.498038    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5sf9m"]
Jul 31 22:00:57.501008 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:00:57.500982    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbac49c41_6245_48dd_b89d_5e799e544e08.slice/crio-12edaed32d1d9d96d7d05e536ef5ba107d6c0271909ae08a375ef7ebc94a0a40 WatchSource:0}: Error finding container 12edaed32d1d9d96d7d05e536ef5ba107d6c0271909ae08a375ef7ebc94a0a40: Status 404 returned error can't find the container with id 12edaed32d1d9d96d7d05e536ef5ba107d6c0271909ae08a375ef7ebc94a0a40
Jul 31 22:00:57.502331 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:57.502210    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xhrth"
Jul 31 22:00:57.518250 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:00:57.518226    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde085141_f4e0_48b7_8984_bb06048df425.slice/crio-ce89ee71b66ddd05ba5cf09b275c5235840089ab9ac24e8b0f982cded249ac87 WatchSource:0}: Error finding container ce89ee71b66ddd05ba5cf09b275c5235840089ab9ac24e8b0f982cded249ac87: Status 404 returned error can't find the container with id ce89ee71b66ddd05ba5cf09b275c5235840089ab9ac24e8b0f982cded249ac87
Jul 31 22:00:57.584089 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:57.584053    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xhrth" event={"ID":"de085141-f4e0-48b7-8984-bb06048df425","Type":"ContainerStarted","Data":"ce89ee71b66ddd05ba5cf09b275c5235840089ab9ac24e8b0f982cded249ac87"}
Jul 31 22:00:57.585330 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:57.585289    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-m25h2"]
Jul 31 22:00:57.585534 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:57.585500    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5sf9m" event={"ID":"bac49c41-6245-48dd-b89d-5e799e544e08","Type":"ContainerStarted","Data":"12edaed32d1d9d96d7d05e536ef5ba107d6c0271909ae08a375ef7ebc94a0a40"}
Jul 31 22:00:57.586719 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:57.586696    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-422sp" event={"ID":"4fbb48e0-0e3e-4864-a018-acb5bb48e0a8","Type":"ContainerStarted","Data":"974e35a138c2284daa2a6d7061dccb04987ebfc3e9567386fe9ea298ae2e2fea"}
Jul 31 22:00:57.587898 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:57.587874    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dpcw4" event={"ID":"5cd860f1-df9a-4df3-9bea-45d697a20f92","Type":"ContainerStarted","Data":"02d4759b782f40002b9304f81a9c51d1f2b825e1d5f364d58376cc1bd987f27c"}
Jul 31 22:00:57.588282 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:00:57.588262    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod835fe2e4_9be8_46ad_a246_82edf6078d58.slice/crio-bed81795d2d4ed2e00368b4be95650f2da1fc64f63a4f3c2944256d0d0b50b71 WatchSource:0}: Error finding container bed81795d2d4ed2e00368b4be95650f2da1fc64f63a4f3c2944256d0d0b50b71: Status 404 returned error can't find the container with id bed81795d2d4ed2e00368b4be95650f2da1fc64f63a4f3c2944256d0d0b50b71
Jul 31 22:00:58.593262 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:58.593222    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-m25h2" event={"ID":"835fe2e4-9be8-46ad-a246-82edf6078d58","Type":"ContainerStarted","Data":"bed81795d2d4ed2e00368b4be95650f2da1fc64f63a4f3c2944256d0d0b50b71"}
Jul 31 22:00:59.603310 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:00:59.603270    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dpcw4" event={"ID":"5cd860f1-df9a-4df3-9bea-45d697a20f92","Type":"ContainerStarted","Data":"0dd6cdc41b41ab1e2ddb2540848175300f8c24a108653e0ac088507388f9e44b"}
Jul 31 22:01:00.554423 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:00.554391    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7867fc7f9b-b992l"]
Jul 31 22:01:00.557424 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:00.557386    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7867fc7f9b-b992l"
Jul 31 22:01:00.559971 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:00.559929    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 31 22:01:00.559971 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:00.559953    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 31 22:01:00.560764 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:00.560744    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 31 22:01:00.560857 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:00.560781    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 31 22:01:00.560857 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:00.560793    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-prjdv\""
Jul 31 22:01:00.560951 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:00.560894    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 31 22:01:00.561914 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:00.561542    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 31 22:01:00.561914 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:00.561728    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 31 22:01:00.568333 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:00.568312    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 31 22:01:00.569515 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:00.569494    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7867fc7f9b-b992l"]
Jul 31 22:01:00.609808 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:00.609778    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-m25h2" event={"ID":"835fe2e4-9be8-46ad-a246-82edf6078d58","Type":"ContainerStarted","Data":"f9bb2cd75be5b613fecdd134c6098375a2bab65ad6bc62b5d46983d511bff34e"}
Jul 31 22:01:00.610177 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:00.609828    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-m25h2" event={"ID":"835fe2e4-9be8-46ad-a246-82edf6078d58","Type":"ContainerStarted","Data":"b61e7136601940c6cbeaab25c4eb161cc6bc6ed9415da80e00481e6262849c35"}
Jul 31 22:01:00.610177 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:00.609857    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-m25h2" event={"ID":"835fe2e4-9be8-46ad-a246-82edf6078d58","Type":"ContainerStarted","Data":"5f7c79e1bc35c52dcecfb94b3992ca9e9427dfcbba10b8f6f1555906d4cb9e7a"}
Jul 31 22:01:00.611655 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:00.611632    2573 generic.go:356] "Generic (PLEG): container finished" podID="de085141-f4e0-48b7-8984-bb06048df425" containerID="87bb14e8e2234d43be4e582b33ce424a5fad06e83c7a14b0862089a8516c8aa4" exitCode=0
Jul 31 22:01:00.611757 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:00.611719    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xhrth" event={"ID":"de085141-f4e0-48b7-8984-bb06048df425","Type":"ContainerDied","Data":"87bb14e8e2234d43be4e582b33ce424a5fad06e83c7a14b0862089a8516c8aa4"}
Jul 31 22:01:00.613803 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:00.613780    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dpcw4" event={"ID":"5cd860f1-df9a-4df3-9bea-45d697a20f92","Type":"ContainerStarted","Data":"a31393d6418de0171dfb4496f02076415318c73769b476d05de57410e8860ee5"}
Jul 31 22:01:00.618061 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:00.618039    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0dea759e-4881-4874-b7f3-85ca2e933973-service-ca\") pod \"console-7867fc7f9b-b992l\" (UID: \"0dea759e-4881-4874-b7f3-85ca2e933973\") " pod="openshift-console/console-7867fc7f9b-b992l"
Jul 31 22:01:00.618154 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:00.618084    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0dea759e-4881-4874-b7f3-85ca2e933973-console-serving-cert\") pod \"console-7867fc7f9b-b992l\" (UID: \"0dea759e-4881-4874-b7f3-85ca2e933973\") " pod="openshift-console/console-7867fc7f9b-b992l"
Jul 31 22:01:00.618211 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:00.618147    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0dea759e-4881-4874-b7f3-85ca2e933973-oauth-serving-cert\") pod \"console-7867fc7f9b-b992l\" (UID: \"0dea759e-4881-4874-b7f3-85ca2e933973\") " pod="openshift-console/console-7867fc7f9b-b992l"
Jul 31 22:01:00.618211 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:00.618179    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0dea759e-4881-4874-b7f3-85ca2e933973-console-config\") pod \"console-7867fc7f9b-b992l\" (UID: \"0dea759e-4881-4874-b7f3-85ca2e933973\") " pod="openshift-console/console-7867fc7f9b-b992l"
Jul 31 22:01:00.618211 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:00.618204    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfv96\" (UniqueName: \"kubernetes.io/projected/0dea759e-4881-4874-b7f3-85ca2e933973-kube-api-access-tfv96\") pod \"console-7867fc7f9b-b992l\" (UID: \"0dea759e-4881-4874-b7f3-85ca2e933973\") " pod="openshift-console/console-7867fc7f9b-b992l"
Jul 31 22:01:00.618389 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:00.618236    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0dea759e-4881-4874-b7f3-85ca2e933973-trusted-ca-bundle\") pod \"console-7867fc7f9b-b992l\" (UID: \"0dea759e-4881-4874-b7f3-85ca2e933973\") " pod="openshift-console/console-7867fc7f9b-b992l"
Jul 31 22:01:00.618389 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:00.618268    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0dea759e-4881-4874-b7f3-85ca2e933973-console-oauth-config\") pod \"console-7867fc7f9b-b992l\" (UID: \"0dea759e-4881-4874-b7f3-85ca2e933973\") " pod="openshift-console/console-7867fc7f9b-b992l"
Jul 31 22:01:00.629695 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:00.629608    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-m25h2" podStartSLOduration=2.335156817 podStartE2EDuration="4.629592512s" totalImagesPullingTime="2.294435695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:00:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:01:00.628625287 +0000 UTC m=+69.723916434" watchObservedRunningTime="2026-07-31 22:01:00.629592512 +0000 UTC m=+69.724883659"
Jul 31 22:01:00.647804 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:00.647761    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dpcw4" podStartSLOduration=67.690189817 podStartE2EDuration="1m9.647747242s" totalImagesPullingTime="1.957557425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:59:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:01:00.646577017 +0000 UTC m=+69.741868185" watchObservedRunningTime="2026-07-31 22:01:00.647747242 +0000 UTC m=+69.743038388"
Jul 31 22:01:00.719597 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:00.719571    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0dea759e-4881-4874-b7f3-85ca2e933973-console-serving-cert\") pod \"console-7867fc7f9b-b992l\" (UID: \"0dea759e-4881-4874-b7f3-85ca2e933973\") " pod="openshift-console/console-7867fc7f9b-b992l"
Jul 31 22:01:00.719706 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:00.719634    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0dea759e-4881-4874-b7f3-85ca2e933973-oauth-serving-cert\") pod \"console-7867fc7f9b-b992l\" (UID: \"0dea759e-4881-4874-b7f3-85ca2e933973\") " pod="openshift-console/console-7867fc7f9b-b992l"
Jul 31 22:01:00.719706 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:00.719696    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0dea759e-4881-4874-b7f3-85ca2e933973-console-config\") pod \"console-7867fc7f9b-b992l\" (UID: \"0dea759e-4881-4874-b7f3-85ca2e933973\") " pod="openshift-console/console-7867fc7f9b-b992l"
Jul 31 22:01:00.719813 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:00.719721    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfv96\" (UniqueName: \"kubernetes.io/projected/0dea759e-4881-4874-b7f3-85ca2e933973-kube-api-access-tfv96\") pod \"console-7867fc7f9b-b992l\" (UID: \"0dea759e-4881-4874-b7f3-85ca2e933973\") " pod="openshift-console/console-7867fc7f9b-b992l"
Jul 31 22:01:00.719813 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:00.719751    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0dea759e-4881-4874-b7f3-85ca2e933973-trusted-ca-bundle\") pod \"console-7867fc7f9b-b992l\" (UID: \"0dea759e-4881-4874-b7f3-85ca2e933973\") " pod="openshift-console/console-7867fc7f9b-b992l"
Jul 31 22:01:00.719907 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:00.719851    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0dea759e-4881-4874-b7f3-85ca2e933973-console-oauth-config\") pod \"console-7867fc7f9b-b992l\" (UID: \"0dea759e-4881-4874-b7f3-85ca2e933973\") " pod="openshift-console/console-7867fc7f9b-b992l"
Jul 31 22:01:00.720398 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:00.720365    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0dea759e-4881-4874-b7f3-85ca2e933973-service-ca\") pod \"console-7867fc7f9b-b992l\" (UID: \"0dea759e-4881-4874-b7f3-85ca2e933973\") " pod="openshift-console/console-7867fc7f9b-b992l"
Jul 31 22:01:00.720490 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:00.720455    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0dea759e-4881-4874-b7f3-85ca2e933973-oauth-serving-cert\") pod \"console-7867fc7f9b-b992l\" (UID: \"0dea759e-4881-4874-b7f3-85ca2e933973\") " pod="openshift-console/console-7867fc7f9b-b992l"
Jul 31 22:01:00.721368 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:00.721342    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0dea759e-4881-4874-b7f3-85ca2e933973-console-config\") pod \"console-7867fc7f9b-b992l\" (UID: \"0dea759e-4881-4874-b7f3-85ca2e933973\") " pod="openshift-console/console-7867fc7f9b-b992l"
Jul 31 22:01:00.721533 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:00.721491    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0dea759e-4881-4874-b7f3-85ca2e933973-trusted-ca-bundle\") pod \"console-7867fc7f9b-b992l\" (UID: \"0dea759e-4881-4874-b7f3-85ca2e933973\") " pod="openshift-console/console-7867fc7f9b-b992l"
Jul 31 22:01:00.721930 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:00.721905    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0dea759e-4881-4874-b7f3-85ca2e933973-service-ca\") pod \"console-7867fc7f9b-b992l\" (UID: \"0dea759e-4881-4874-b7f3-85ca2e933973\") " pod="openshift-console/console-7867fc7f9b-b992l"
Jul 31 22:01:00.722410 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:00.722387    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0dea759e-4881-4874-b7f3-85ca2e933973-console-serving-cert\") pod \"console-7867fc7f9b-b992l\" (UID: \"0dea759e-4881-4874-b7f3-85ca2e933973\") " pod="openshift-console/console-7867fc7f9b-b992l"
Jul 31 22:01:00.722498 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:00.722468    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0dea759e-4881-4874-b7f3-85ca2e933973-console-oauth-config\") pod \"console-7867fc7f9b-b992l\" (UID: \"0dea759e-4881-4874-b7f3-85ca2e933973\") " pod="openshift-console/console-7867fc7f9b-b992l"
Jul 31 22:01:00.730021 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:00.729998    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfv96\" (UniqueName: \"kubernetes.io/projected/0dea759e-4881-4874-b7f3-85ca2e933973-kube-api-access-tfv96\") pod \"console-7867fc7f9b-b992l\" (UID: \"0dea759e-4881-4874-b7f3-85ca2e933973\") " pod="openshift-console/console-7867fc7f9b-b992l"
Jul 31 22:01:00.871822 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:00.871742    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7867fc7f9b-b992l"
Jul 31 22:01:01.564849 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:01.564814    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bdmbh"
Jul 31 22:01:02.720668 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.720632    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 31 22:01:02.725833 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.725809    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.729922 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.729902    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hc85z\""
Jul 31 22:01:02.730159 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.730136    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 31 22:01:02.730271 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.730220    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 31 22:01:02.730372 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.730356    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 31 22:01:02.730481 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.730462    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 31 22:01:02.730730 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.730713    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 31 22:01:02.731004 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.730985    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 31 22:01:02.733554 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.733531    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 31 22:01:02.733554 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.733546    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 31 22:01:02.733878 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.733860    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 31 22:01:02.733948 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.733934    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ec64dldd1pohu\""
Jul 31 22:01:02.734033 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.734016    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 31 22:01:02.734186 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.734133    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 31 22:01:02.734514 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.734377    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 31 22:01:02.734514 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.734409    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 31 22:01:02.734688 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.734638    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 31 22:01:02.736208 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.736105    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 31 22:01:02.745002 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.744883    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 31 22:01:02.836611 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.836567    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.836791 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.836611    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.836791 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.836646    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/70c15479-1a99-4d76-a00f-b349880af732-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.836791 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.836675    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-config\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.836791 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.836696    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/70c15479-1a99-4d76-a00f-b349880af732-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.836791 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.836718    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5wcn\" (UniqueName: \"kubernetes.io/projected/70c15479-1a99-4d76-a00f-b349880af732-kube-api-access-b5wcn\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.836791 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.836746    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.836791 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.836773    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70c15479-1a99-4d76-a00f-b349880af732-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.836791 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.836795    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70c15479-1a99-4d76-a00f-b349880af732-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.837958 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.836844    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.837958 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.836879    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70c15479-1a99-4d76-a00f-b349880af732-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.837958 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.836965    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/70c15479-1a99-4d76-a00f-b349880af732-config-out\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.839168 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.838870    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-web-config\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.839168 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.838914    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.839168 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.838943    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.839168 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.838968    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/70c15479-1a99-4d76-a00f-b349880af732-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.839168 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.839000    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70c15479-1a99-4d76-a00f-b349880af732-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.839168 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.839033    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/70c15479-1a99-4d76-a00f-b349880af732-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.839168 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.839075    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.839168 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.839092    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/70c15479-1a99-4d76-a00f-b349880af732-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.941190 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.941156    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70c15479-1a99-4d76-a00f-b349880af732-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.941340 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.941198    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70c15479-1a99-4d76-a00f-b349880af732-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.941340 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.941225    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.941340 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.941248    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70c15479-1a99-4d76-a00f-b349880af732-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.941340 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.941273    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/70c15479-1a99-4d76-a00f-b349880af732-config-out\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.941340 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.941323    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-web-config\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.941612 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.941349    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.941612 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.941374    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.941612 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.941403    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/70c15479-1a99-4d76-a00f-b349880af732-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.941612 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.941429    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70c15479-1a99-4d76-a00f-b349880af732-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.941612 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.941456    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/70c15479-1a99-4d76-a00f-b349880af732-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.941612 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.941495    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.941612 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.941522    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/70c15479-1a99-4d76-a00f-b349880af732-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.941612 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.941546    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.941612 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.941569    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.941612 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.941596    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/70c15479-1a99-4d76-a00f-b349880af732-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.942156 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.941627    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-config\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.942156 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.941648    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/70c15479-1a99-4d76-a00f-b349880af732-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.942156 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.941673    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5wcn\" (UniqueName: \"kubernetes.io/projected/70c15479-1a99-4d76-a00f-b349880af732-kube-api-access-b5wcn\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.942156 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.941727    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.942721 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.942698    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70c15479-1a99-4d76-a00f-b349880af732-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.942879 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.942856    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70c15479-1a99-4d76-a00f-b349880af732-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.943227 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.943203    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/70c15479-1a99-4d76-a00f-b349880af732-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.943345 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.943236    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70c15479-1a99-4d76-a00f-b349880af732-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.944885 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.944354    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/70c15479-1a99-4d76-a00f-b349880af732-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.945043 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.944903    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70c15479-1a99-4d76-a00f-b349880af732-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.946548 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.946525    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.946707 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.946647    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/70c15479-1a99-4d76-a00f-b349880af732-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.948707 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.948484    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/70c15479-1a99-4d76-a00f-b349880af732-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.948707 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.948671    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/70c15479-1a99-4d76-a00f-b349880af732-config-out\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.948985 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.948954    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.949903 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.949862    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.950410 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.950392    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-web-config\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.951626 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.951481    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.951626 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.951584    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/70c15479-1a99-4d76-a00f-b349880af732-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.953049 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.951933    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.953049 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.952412    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.953049 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.952838    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-config\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.953342 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.953312    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.954474 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.954430    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5wcn\" (UniqueName: \"kubernetes.io/projected/70c15479-1a99-4d76-a00f-b349880af732-kube-api-access-b5wcn\") pod \"prometheus-k8s-0\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:02.981271 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:02.981241    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7867fc7f9b-b992l"]
Jul 31 22:01:02.984529 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:01:02.984505    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dea759e_4881_4874_b7f3_85ca2e933973.slice/crio-7ff4f406d37575b4f75cb047a58cdfb62a7c007a0998199282b79bc5869969a4 WatchSource:0}: Error finding container 7ff4f406d37575b4f75cb047a58cdfb62a7c007a0998199282b79bc5869969a4: Status 404 returned error can't find the container with id 7ff4f406d37575b4f75cb047a58cdfb62a7c007a0998199282b79bc5869969a4
Jul 31 22:01:03.043466 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:03.043434    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:03.217462 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:03.217433    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 31 22:01:03.221518 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:01:03.221464    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70c15479_1a99_4d76_a00f_b349880af732.slice/crio-5f003d035179256848462bf0240a9e1b8e9ff002640e01ce6eeea2cdf67260f8 WatchSource:0}: Error finding container 5f003d035179256848462bf0240a9e1b8e9ff002640e01ce6eeea2cdf67260f8: Status 404 returned error can't find the container with id 5f003d035179256848462bf0240a9e1b8e9ff002640e01ce6eeea2cdf67260f8
Jul 31 22:01:03.626554 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:03.626458    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-422sp" event={"ID":"4fbb48e0-0e3e-4864-a018-acb5bb48e0a8","Type":"ContainerStarted","Data":"0735d0db0835166a6f73a6d8b3361d1f44be833aa6d42ce5f604e1baf85caa22"}
Jul 31 22:01:03.629682 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:03.629639    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70c15479-1a99-4d76-a00f-b349880af732","Type":"ContainerStarted","Data":"5f003d035179256848462bf0240a9e1b8e9ff002640e01ce6eeea2cdf67260f8"}
Jul 31 22:01:03.631072 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:03.631033    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7867fc7f9b-b992l" event={"ID":"0dea759e-4881-4874-b7f3-85ca2e933973","Type":"ContainerStarted","Data":"7ff4f406d37575b4f75cb047a58cdfb62a7c007a0998199282b79bc5869969a4"}
Jul 31 22:01:03.633263 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:03.633240    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xhrth" event={"ID":"de085141-f4e0-48b7-8984-bb06048df425","Type":"ContainerStarted","Data":"25db60ee2c9347bf4d2fd5c4b7752dec82140b5a90f74f8119fa99402f4132c1"}
Jul 31 22:01:03.633394 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:03.633278    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xhrth" event={"ID":"de085141-f4e0-48b7-8984-bb06048df425","Type":"ContainerStarted","Data":"e8ce1f755318169bfeee57f94271e323a318df0da8d430f1f7158b6919296e1d"}
Jul 31 22:01:03.634679 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:03.634658    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5sf9m" event={"ID":"bac49c41-6245-48dd-b89d-5e799e544e08","Type":"ContainerStarted","Data":"750facf6058b5fefb075e474b82359007030098c68d17c4fcd35c2f7b37bb595"}
Jul 31 22:01:03.634800 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:03.634784    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5sf9m"
Jul 31 22:01:03.642590 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:03.642529    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-422sp" podStartSLOduration=67.292385199 podStartE2EDuration="1m12.642512444s" totalImagesPullingTime="5.350127245s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:59:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:01:03.642283986 +0000 UTC m=+72.737575145" watchObservedRunningTime="2026-07-31 22:01:03.642512444 +0000 UTC m=+72.737803591"
Jul 31 22:01:03.661984 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:03.661946    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xhrth" podStartSLOduration=5.258467113 podStartE2EDuration="7.661935122s" totalImagesPullingTime="2.314447137s" totalInitContainerRuntime="89.020872ms" isStatefulPod=true podCreationTimestamp="2026-07-31 22:00:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:01:03.661291315 +0000 UTC m=+72.756582461" watchObservedRunningTime="2026-07-31 22:01:03.661935122 +0000 UTC m=+72.757226268"
Jul 31 22:01:03.679802 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:03.679766    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5sf9m" podStartSLOduration=67.34799159 podStartE2EDuration="1m12.679753931s" totalImagesPullingTime="5.331762341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:59:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:01:03.679119599 +0000 UTC m=+72.774410745" watchObservedRunningTime="2026-07-31 22:01:03.679753931 +0000 UTC m=+72.775045088"
Jul 31 22:01:05.583993 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:05.583959    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7867fc7f9b-b992l"]
Jul 31 22:01:05.645401 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:05.645350    2573 generic.go:356] "Generic (PLEG): container finished" podID="70c15479-1a99-4d76-a00f-b349880af732" containerID="dd291469775a306888dfc14d3b094d1158137794003f438aa4ec07dcb8442140" exitCode=0
Jul 31 22:01:05.645610 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:05.645425    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70c15479-1a99-4d76-a00f-b349880af732","Type":"ContainerDied","Data":"dd291469775a306888dfc14d3b094d1158137794003f438aa4ec07dcb8442140"}
Jul 31 22:01:06.651345 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:06.651247    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7867fc7f9b-b992l" event={"ID":"0dea759e-4881-4874-b7f3-85ca2e933973","Type":"ContainerStarted","Data":"87a9656509f697141b2a8520cff14761acc140bab2ce209f4cbbe66159a0d0c3"}
Jul 31 22:01:06.687984 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:06.687938    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7867fc7f9b-b992l" podStartSLOduration=3.442424741 podStartE2EDuration="6.687922013s" totalImagesPullingTime="3.245497272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:01:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:01:06.687198317 +0000 UTC m=+75.782489464" watchObservedRunningTime="2026-07-31 22:01:06.687922013 +0000 UTC m=+75.783213158"
Jul 31 22:01:09.668954 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:09.668913    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70c15479-1a99-4d76-a00f-b349880af732","Type":"ContainerStarted","Data":"01ae1fd7944572decc1dcddaba9a15bc03000f0fb576fdbcd2671b0dccc0d7fb"}
Jul 31 22:01:09.669377 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:09.669004    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70c15479-1a99-4d76-a00f-b349880af732","Type":"ContainerStarted","Data":"66ff09157060caf0db7007e3486b8c9698bf84c15d1030f963f6e74f26d3060e"}
Jul 31 22:01:10.549909 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:10.549876    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8854b8786-5mz8k"
Jul 31 22:01:10.871904 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:10.871879    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7867fc7f9b-b992l"
Jul 31 22:01:11.678875 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:11.678845    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70c15479-1a99-4d76-a00f-b349880af732","Type":"ContainerStarted","Data":"7aab3dae951d46c8f8f0df3145d83d86f0500aa4c1f14d8ae784d6e4f0295e24"}
Jul 31 22:01:11.679008 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:11.678926    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70c15479-1a99-4d76-a00f-b349880af732","Type":"ContainerStarted","Data":"3f8f06308952b8ac7f29c1668020c556249a78e35816e375d32bff3218142ac5"}
Jul 31 22:01:11.679008 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:11.678952    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70c15479-1a99-4d76-a00f-b349880af732","Type":"ContainerStarted","Data":"442ff56eb121771747ab08f62658a039ddaccfd9498305bc858754f509838564"}
Jul 31 22:01:11.679008 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:11.678981    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70c15479-1a99-4d76-a00f-b349880af732","Type":"ContainerStarted","Data":"ef672c1cded50d55c6f28201abe26e4d9fab06f8244d5a8993a4ce3d9bb2f7b4"}
Jul 31 22:01:13.044142 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:13.044113    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:01:31.675692 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:31.675656    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7867fc7f9b-b992l" podUID="0dea759e-4881-4874-b7f3-85ca2e933973" containerName="console" containerID="cri-o://87a9656509f697141b2a8520cff14761acc140bab2ce209f4cbbe66159a0d0c3" gracePeriod=15
Jul 31 22:01:31.920764 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:31.920738    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7867fc7f9b-b992l"
Jul 31 22:01:31.942807 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:31.942725    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=23.217889435 podStartE2EDuration="29.942709434s" totalImagesPullingTime="6.699903184s" totalInitContainerRuntime="24.916815ms" isStatefulPod=false podCreationTimestamp="2026-07-31 22:01:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:01:11.719380375 +0000 UTC m=+80.814671523" watchObservedRunningTime="2026-07-31 22:01:31.942709434 +0000 UTC m=+101.038000579"
Jul 31 22:01:32.056240 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:32.056221    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0dea759e-4881-4874-b7f3-85ca2e933973-service-ca\") pod \"0dea759e-4881-4874-b7f3-85ca2e933973\" (UID: \"0dea759e-4881-4874-b7f3-85ca2e933973\") "
Jul 31 22:01:32.056378 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:32.056250    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0dea759e-4881-4874-b7f3-85ca2e933973-oauth-serving-cert\") pod \"0dea759e-4881-4874-b7f3-85ca2e933973\" (UID: \"0dea759e-4881-4874-b7f3-85ca2e933973\") "
Jul 31 22:01:32.056378 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:32.056270    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0dea759e-4881-4874-b7f3-85ca2e933973-console-oauth-config\") pod \"0dea759e-4881-4874-b7f3-85ca2e933973\" (UID: \"0dea759e-4881-4874-b7f3-85ca2e933973\") "
Jul 31 22:01:32.056378 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:32.056288    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0dea759e-4881-4874-b7f3-85ca2e933973-trusted-ca-bundle\") pod \"0dea759e-4881-4874-b7f3-85ca2e933973\" (UID: \"0dea759e-4881-4874-b7f3-85ca2e933973\") "
Jul 31 22:01:32.056378 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:32.056326    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfv96\" (UniqueName: \"kubernetes.io/projected/0dea759e-4881-4874-b7f3-85ca2e933973-kube-api-access-tfv96\") pod \"0dea759e-4881-4874-b7f3-85ca2e933973\" (UID: \"0dea759e-4881-4874-b7f3-85ca2e933973\") "
Jul 31 22:01:32.056378 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:32.056370    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0dea759e-4881-4874-b7f3-85ca2e933973-console-config\") pod \"0dea759e-4881-4874-b7f3-85ca2e933973\" (UID: \"0dea759e-4881-4874-b7f3-85ca2e933973\") "
Jul 31 22:01:32.056615 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:32.056395    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0dea759e-4881-4874-b7f3-85ca2e933973-console-serving-cert\") pod \"0dea759e-4881-4874-b7f3-85ca2e933973\" (UID: \"0dea759e-4881-4874-b7f3-85ca2e933973\") "
Jul 31 22:01:32.057337 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:32.057243    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0dea759e-4881-4874-b7f3-85ca2e933973-console-config" (OuterVolumeSpecName: "console-config") pod "0dea759e-4881-4874-b7f3-85ca2e933973" (UID: "0dea759e-4881-4874-b7f3-85ca2e933973"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:01:32.057337 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:32.057268    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0dea759e-4881-4874-b7f3-85ca2e933973-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0dea759e-4881-4874-b7f3-85ca2e933973" (UID: "0dea759e-4881-4874-b7f3-85ca2e933973"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:01:32.057337 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:32.057254    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0dea759e-4881-4874-b7f3-85ca2e933973-service-ca" (OuterVolumeSpecName: "service-ca") pod "0dea759e-4881-4874-b7f3-85ca2e933973" (UID: "0dea759e-4881-4874-b7f3-85ca2e933973"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:01:32.057337 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:32.057263    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0dea759e-4881-4874-b7f3-85ca2e933973-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0dea759e-4881-4874-b7f3-85ca2e933973" (UID: "0dea759e-4881-4874-b7f3-85ca2e933973"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:01:32.061375 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:32.059409    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0dea759e-4881-4874-b7f3-85ca2e933973-kube-api-access-tfv96" (OuterVolumeSpecName: "kube-api-access-tfv96") pod "0dea759e-4881-4874-b7f3-85ca2e933973" (UID: "0dea759e-4881-4874-b7f3-85ca2e933973"). InnerVolumeSpecName "kube-api-access-tfv96". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:01:32.061375 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:32.059425    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0dea759e-4881-4874-b7f3-85ca2e933973-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0dea759e-4881-4874-b7f3-85ca2e933973" (UID: "0dea759e-4881-4874-b7f3-85ca2e933973"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:01:32.061375 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:32.059496    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0dea759e-4881-4874-b7f3-85ca2e933973-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0dea759e-4881-4874-b7f3-85ca2e933973" (UID: "0dea759e-4881-4874-b7f3-85ca2e933973"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:01:32.157588 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:32.157567    2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0dea759e-4881-4874-b7f3-85ca2e933973-service-ca\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:01:32.157588 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:32.157587    2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0dea759e-4881-4874-b7f3-85ca2e933973-oauth-serving-cert\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:01:32.157704 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:32.157597    2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0dea759e-4881-4874-b7f3-85ca2e933973-console-oauth-config\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:01:32.157704 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:32.157606    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0dea759e-4881-4874-b7f3-85ca2e933973-trusted-ca-bundle\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:01:32.157704 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:32.157614    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfv96\" (UniqueName: \"kubernetes.io/projected/0dea759e-4881-4874-b7f3-85ca2e933973-kube-api-access-tfv96\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:01:32.157704 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:32.157623    2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0dea759e-4881-4874-b7f3-85ca2e933973-console-config\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:01:32.157704 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:32.157631    2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0dea759e-4881-4874-b7f3-85ca2e933973-console-serving-cert\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:01:32.754008 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:32.753980    2573 generic.go:356] "Generic (PLEG): container finished" podID="0dea759e-4881-4874-b7f3-85ca2e933973" containerID="87a9656509f697141b2a8520cff14761acc140bab2ce209f4cbbe66159a0d0c3" exitCode=0
Jul 31 22:01:32.754330 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:32.754042    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7867fc7f9b-b992l"
Jul 31 22:01:32.754330 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:32.754064    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7867fc7f9b-b992l" event={"ID":"0dea759e-4881-4874-b7f3-85ca2e933973","Type":"ContainerDied","Data":"87a9656509f697141b2a8520cff14761acc140bab2ce209f4cbbe66159a0d0c3"}
Jul 31 22:01:32.754330 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:32.754111    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7867fc7f9b-b992l" event={"ID":"0dea759e-4881-4874-b7f3-85ca2e933973","Type":"ContainerDied","Data":"7ff4f406d37575b4f75cb047a58cdfb62a7c007a0998199282b79bc5869969a4"}
Jul 31 22:01:32.754330 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:32.754131    2573 scope.go:117] "RemoveContainer" containerID="87a9656509f697141b2a8520cff14761acc140bab2ce209f4cbbe66159a0d0c3"
Jul 31 22:01:32.762219 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:32.762205    2573 scope.go:117] "RemoveContainer" containerID="87a9656509f697141b2a8520cff14761acc140bab2ce209f4cbbe66159a0d0c3"
Jul 31 22:01:32.762494 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:01:32.762474    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87a9656509f697141b2a8520cff14761acc140bab2ce209f4cbbe66159a0d0c3\": container with ID starting with 87a9656509f697141b2a8520cff14761acc140bab2ce209f4cbbe66159a0d0c3 not found: ID does not exist" containerID="87a9656509f697141b2a8520cff14761acc140bab2ce209f4cbbe66159a0d0c3"
Jul 31 22:01:32.762547 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:32.762501    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87a9656509f697141b2a8520cff14761acc140bab2ce209f4cbbe66159a0d0c3"} err="failed to get container status \"87a9656509f697141b2a8520cff14761acc140bab2ce209f4cbbe66159a0d0c3\": rpc error: code = NotFound desc = could not find container \"87a9656509f697141b2a8520cff14761acc140bab2ce209f4cbbe66159a0d0c3\": container with ID starting with 87a9656509f697141b2a8520cff14761acc140bab2ce209f4cbbe66159a0d0c3 not found: ID does not exist"
Jul 31 22:01:32.775012 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:32.774995    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7867fc7f9b-b992l"]
Jul 31 22:01:32.779639 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:32.779618    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7867fc7f9b-b992l"]
Jul 31 22:01:33.332961 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:33.332930    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0dea759e-4881-4874-b7f3-85ca2e933973" path="/var/lib/kubelet/pods/0dea759e-4881-4874-b7f3-85ca2e933973/volumes"
Jul 31 22:01:34.642683 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:01:34.642658    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5sf9m"
Jul 31 22:02:03.044602 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:03.044563    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:03.070213 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:03.070182    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:03.879873 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:03.879843    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:21.098451 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:21.098415    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 31 22:02:21.098923 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:21.098857    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="70c15479-1a99-4d76-a00f-b349880af732" containerName="prometheus" containerID="cri-o://66ff09157060caf0db7007e3486b8c9698bf84c15d1030f963f6e74f26d3060e" gracePeriod=600
Jul 31 22:02:21.098923 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:21.098870    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="70c15479-1a99-4d76-a00f-b349880af732" containerName="thanos-sidecar" containerID="cri-o://ef672c1cded50d55c6f28201abe26e4d9fab06f8244d5a8993a4ce3d9bb2f7b4" gracePeriod=600
Jul 31 22:02:21.099041 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:21.098868    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="70c15479-1a99-4d76-a00f-b349880af732" containerName="kube-rbac-proxy-thanos" containerID="cri-o://7aab3dae951d46c8f8f0df3145d83d86f0500aa4c1f14d8ae784d6e4f0295e24" gracePeriod=600
Jul 31 22:02:21.099041 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:21.098937    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="70c15479-1a99-4d76-a00f-b349880af732" containerName="kube-rbac-proxy" containerID="cri-o://3f8f06308952b8ac7f29c1668020c556249a78e35816e375d32bff3218142ac5" gracePeriod=600
Jul 31 22:02:21.099041 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:21.098880    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="70c15479-1a99-4d76-a00f-b349880af732" containerName="kube-rbac-proxy-web" containerID="cri-o://442ff56eb121771747ab08f62658a039ddaccfd9498305bc858754f509838564" gracePeriod=600
Jul 31 22:02:21.099041 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:21.098879    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="70c15479-1a99-4d76-a00f-b349880af732" containerName="config-reloader" containerID="cri-o://01ae1fd7944572decc1dcddaba9a15bc03000f0fb576fdbcd2671b0dccc0d7fb" gracePeriod=600
Jul 31 22:02:21.931243 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:21.931206    2573 generic.go:356] "Generic (PLEG): container finished" podID="70c15479-1a99-4d76-a00f-b349880af732" containerID="7aab3dae951d46c8f8f0df3145d83d86f0500aa4c1f14d8ae784d6e4f0295e24" exitCode=0
Jul 31 22:02:21.931243 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:21.931229    2573 generic.go:356] "Generic (PLEG): container finished" podID="70c15479-1a99-4d76-a00f-b349880af732" containerID="3f8f06308952b8ac7f29c1668020c556249a78e35816e375d32bff3218142ac5" exitCode=0
Jul 31 22:02:21.931243 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:21.931236    2573 generic.go:356] "Generic (PLEG): container finished" podID="70c15479-1a99-4d76-a00f-b349880af732" containerID="ef672c1cded50d55c6f28201abe26e4d9fab06f8244d5a8993a4ce3d9bb2f7b4" exitCode=0
Jul 31 22:02:21.931243 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:21.931242    2573 generic.go:356] "Generic (PLEG): container finished" podID="70c15479-1a99-4d76-a00f-b349880af732" containerID="01ae1fd7944572decc1dcddaba9a15bc03000f0fb576fdbcd2671b0dccc0d7fb" exitCode=0
Jul 31 22:02:21.931243 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:21.931246    2573 generic.go:356] "Generic (PLEG): container finished" podID="70c15479-1a99-4d76-a00f-b349880af732" containerID="66ff09157060caf0db7007e3486b8c9698bf84c15d1030f963f6e74f26d3060e" exitCode=0
Jul 31 22:02:21.931680 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:21.931277    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70c15479-1a99-4d76-a00f-b349880af732","Type":"ContainerDied","Data":"7aab3dae951d46c8f8f0df3145d83d86f0500aa4c1f14d8ae784d6e4f0295e24"}
Jul 31 22:02:21.931680 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:21.931373    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70c15479-1a99-4d76-a00f-b349880af732","Type":"ContainerDied","Data":"3f8f06308952b8ac7f29c1668020c556249a78e35816e375d32bff3218142ac5"}
Jul 31 22:02:21.931680 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:21.931417    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70c15479-1a99-4d76-a00f-b349880af732","Type":"ContainerDied","Data":"ef672c1cded50d55c6f28201abe26e4d9fab06f8244d5a8993a4ce3d9bb2f7b4"}
Jul 31 22:02:21.931680 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:21.931457    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70c15479-1a99-4d76-a00f-b349880af732","Type":"ContainerDied","Data":"01ae1fd7944572decc1dcddaba9a15bc03000f0fb576fdbcd2671b0dccc0d7fb"}
Jul 31 22:02:21.931680 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:21.931498    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70c15479-1a99-4d76-a00f-b349880af732","Type":"ContainerDied","Data":"66ff09157060caf0db7007e3486b8c9698bf84c15d1030f963f6e74f26d3060e"}
Jul 31 22:02:22.343977 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.343951    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:22.399986 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.399960    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-secret-grpc-tls\") pod \"70c15479-1a99-4d76-a00f-b349880af732\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") "
Jul 31 22:02:22.400142 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.400007    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"70c15479-1a99-4d76-a00f-b349880af732\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") "
Jul 31 22:02:22.400142 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.400029    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/70c15479-1a99-4d76-a00f-b349880af732-prometheus-k8s-rulefiles-0\") pod \"70c15479-1a99-4d76-a00f-b349880af732\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") "
Jul 31 22:02:22.400142 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.400051    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-secret-metrics-client-certs\") pod \"70c15479-1a99-4d76-a00f-b349880af732\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") "
Jul 31 22:02:22.400142 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.400068    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70c15479-1a99-4d76-a00f-b349880af732-configmap-metrics-client-ca\") pod \"70c15479-1a99-4d76-a00f-b349880af732\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") "
Jul 31 22:02:22.400142 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.400095    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-config\") pod \"70c15479-1a99-4d76-a00f-b349880af732\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") "
Jul 31 22:02:22.400142 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.400111    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70c15479-1a99-4d76-a00f-b349880af732-prometheus-trusted-ca-bundle\") pod \"70c15479-1a99-4d76-a00f-b349880af732\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") "
Jul 31 22:02:22.400142 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.400132    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/70c15479-1a99-4d76-a00f-b349880af732-prometheus-k8s-db\") pod \"70c15479-1a99-4d76-a00f-b349880af732\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") "
Jul 31 22:02:22.400529 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.400169    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/70c15479-1a99-4d76-a00f-b349880af732-tls-assets\") pod \"70c15479-1a99-4d76-a00f-b349880af732\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") "
Jul 31 22:02:22.400529 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.400193    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5wcn\" (UniqueName: \"kubernetes.io/projected/70c15479-1a99-4d76-a00f-b349880af732-kube-api-access-b5wcn\") pod \"70c15479-1a99-4d76-a00f-b349880af732\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") "
Jul 31 22:02:22.400529 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.400222    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"70c15479-1a99-4d76-a00f-b349880af732\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") "
Jul 31 22:02:22.400529 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.400251    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-secret-prometheus-k8s-tls\") pod \"70c15479-1a99-4d76-a00f-b349880af732\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") "
Jul 31 22:02:22.400529 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.400276    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/70c15479-1a99-4d76-a00f-b349880af732-prometheus-k8s-rulefiles-1\") pod \"70c15479-1a99-4d76-a00f-b349880af732\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") "
Jul 31 22:02:22.400529 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.400321    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/70c15479-1a99-4d76-a00f-b349880af732-prometheus-k8s-rulefiles-2\") pod \"70c15479-1a99-4d76-a00f-b349880af732\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") "
Jul 31 22:02:22.400529 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.400351    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70c15479-1a99-4d76-a00f-b349880af732-configmap-serving-certs-ca-bundle\") pod \"70c15479-1a99-4d76-a00f-b349880af732\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") "
Jul 31 22:02:22.400529 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.400384    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-secret-kube-rbac-proxy\") pod \"70c15479-1a99-4d76-a00f-b349880af732\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") "
Jul 31 22:02:22.400529 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.400416    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-web-config\") pod \"70c15479-1a99-4d76-a00f-b349880af732\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") "
Jul 31 22:02:22.400529 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.400449    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-thanos-prometheus-http-client-file\") pod \"70c15479-1a99-4d76-a00f-b349880af732\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") "
Jul 31 22:02:22.400529 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.400485    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70c15479-1a99-4d76-a00f-b349880af732-configmap-kubelet-serving-ca-bundle\") pod \"70c15479-1a99-4d76-a00f-b349880af732\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") "
Jul 31 22:02:22.400529 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.400515    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/70c15479-1a99-4d76-a00f-b349880af732-config-out\") pod \"70c15479-1a99-4d76-a00f-b349880af732\" (UID: \"70c15479-1a99-4d76-a00f-b349880af732\") "
Jul 31 22:02:22.401415 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.401353    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70c15479-1a99-4d76-a00f-b349880af732-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "70c15479-1a99-4d76-a00f-b349880af732" (UID: "70c15479-1a99-4d76-a00f-b349880af732"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:02:22.401529 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.401455    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70c15479-1a99-4d76-a00f-b349880af732-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "70c15479-1a99-4d76-a00f-b349880af732" (UID: "70c15479-1a99-4d76-a00f-b349880af732"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:02:22.401632 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.401604    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70c15479-1a99-4d76-a00f-b349880af732-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "70c15479-1a99-4d76-a00f-b349880af732" (UID: "70c15479-1a99-4d76-a00f-b349880af732"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:02:22.403009 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.402591    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70c15479-1a99-4d76-a00f-b349880af732-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "70c15479-1a99-4d76-a00f-b349880af732" (UID: "70c15479-1a99-4d76-a00f-b349880af732"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:02:22.403687 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.403523    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70c15479-1a99-4d76-a00f-b349880af732-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "70c15479-1a99-4d76-a00f-b349880af732" (UID: "70c15479-1a99-4d76-a00f-b349880af732"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:02:22.403687 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.403573    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70c15479-1a99-4d76-a00f-b349880af732-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "70c15479-1a99-4d76-a00f-b349880af732" (UID: "70c15479-1a99-4d76-a00f-b349880af732"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:02:22.405797 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.403829    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70c15479-1a99-4d76-a00f-b349880af732-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "70c15479-1a99-4d76-a00f-b349880af732" (UID: "70c15479-1a99-4d76-a00f-b349880af732"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:02:22.405797 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.403933    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "70c15479-1a99-4d76-a00f-b349880af732" (UID: "70c15479-1a99-4d76-a00f-b349880af732"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:02:22.405797 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.404189    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "70c15479-1a99-4d76-a00f-b349880af732" (UID: "70c15479-1a99-4d76-a00f-b349880af732"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:02:22.405797 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.404205    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70c15479-1a99-4d76-a00f-b349880af732-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "70c15479-1a99-4d76-a00f-b349880af732" (UID: "70c15479-1a99-4d76-a00f-b349880af732"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:02:22.405797 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.404376    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "70c15479-1a99-4d76-a00f-b349880af732" (UID: "70c15479-1a99-4d76-a00f-b349880af732"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:02:22.405797 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.405703    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "70c15479-1a99-4d76-a00f-b349880af732" (UID: "70c15479-1a99-4d76-a00f-b349880af732"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:02:22.406284 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.406246    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "70c15479-1a99-4d76-a00f-b349880af732" (UID: "70c15479-1a99-4d76-a00f-b349880af732"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:02:22.406491 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.406447    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "70c15479-1a99-4d76-a00f-b349880af732" (UID: "70c15479-1a99-4d76-a00f-b349880af732"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:02:22.406565 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.406540    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70c15479-1a99-4d76-a00f-b349880af732-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "70c15479-1a99-4d76-a00f-b349880af732" (UID: "70c15479-1a99-4d76-a00f-b349880af732"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:02:22.406565 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.406549    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70c15479-1a99-4d76-a00f-b349880af732-config-out" (OuterVolumeSpecName: "config-out") pod "70c15479-1a99-4d76-a00f-b349880af732" (UID: "70c15479-1a99-4d76-a00f-b349880af732"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:02:22.406783 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.406757    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-config" (OuterVolumeSpecName: "config") pod "70c15479-1a99-4d76-a00f-b349880af732" (UID: "70c15479-1a99-4d76-a00f-b349880af732"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:02:22.406890 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.406817    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "70c15479-1a99-4d76-a00f-b349880af732" (UID: "70c15479-1a99-4d76-a00f-b349880af732"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:02:22.407485 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.407449    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70c15479-1a99-4d76-a00f-b349880af732-kube-api-access-b5wcn" (OuterVolumeSpecName: "kube-api-access-b5wcn") pod "70c15479-1a99-4d76-a00f-b349880af732" (UID: "70c15479-1a99-4d76-a00f-b349880af732"). InnerVolumeSpecName "kube-api-access-b5wcn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:02:22.416337 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.416291    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-web-config" (OuterVolumeSpecName: "web-config") pod "70c15479-1a99-4d76-a00f-b349880af732" (UID: "70c15479-1a99-4d76-a00f-b349880af732"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:02:22.502069 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.502010    2573 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-web-config\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:02:22.502069 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.502042    2573 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:02:22.502069 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.502052    2573 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70c15479-1a99-4d76-a00f-b349880af732-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:02:22.502069 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.502061    2573 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/70c15479-1a99-4d76-a00f-b349880af732-config-out\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:02:22.502069 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.502070    2573 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-secret-grpc-tls\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:02:22.502069 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.502078    2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:02:22.502333 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.502087    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/70c15479-1a99-4d76-a00f-b349880af732-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:02:22.502333 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.502097    2573 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-secret-metrics-client-certs\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:02:22.502333 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.502105    2573 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70c15479-1a99-4d76-a00f-b349880af732-configmap-metrics-client-ca\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:02:22.502333 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.502114    2573 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-config\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:02:22.502333 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.502122    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70c15479-1a99-4d76-a00f-b349880af732-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:02:22.502333 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.502130    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/70c15479-1a99-4d76-a00f-b349880af732-prometheus-k8s-db\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:02:22.502333 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.502138    2573 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/70c15479-1a99-4d76-a00f-b349880af732-tls-assets\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:02:22.502333 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.502146    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5wcn\" (UniqueName: \"kubernetes.io/projected/70c15479-1a99-4d76-a00f-b349880af732-kube-api-access-b5wcn\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:02:22.502333 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.502155    2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:02:22.502333 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.502163    2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:02:22.502333 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.502170    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/70c15479-1a99-4d76-a00f-b349880af732-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:02:22.502333 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.502178    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/70c15479-1a99-4d76-a00f-b349880af732-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:02:22.502333 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.502185    2573 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70c15479-1a99-4d76-a00f-b349880af732-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:02:22.502333 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.502193    2573 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/70c15479-1a99-4d76-a00f-b349880af732-secret-kube-rbac-proxy\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:02:22.937486 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.937462    2573 generic.go:356] "Generic (PLEG): container finished" podID="70c15479-1a99-4d76-a00f-b349880af732" containerID="442ff56eb121771747ab08f62658a039ddaccfd9498305bc858754f509838564" exitCode=0
Jul 31 22:02:22.937588 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.937534    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:22.937588 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.937535    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70c15479-1a99-4d76-a00f-b349880af732","Type":"ContainerDied","Data":"442ff56eb121771747ab08f62658a039ddaccfd9498305bc858754f509838564"}
Jul 31 22:02:22.937676 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.937601    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"70c15479-1a99-4d76-a00f-b349880af732","Type":"ContainerDied","Data":"5f003d035179256848462bf0240a9e1b8e9ff002640e01ce6eeea2cdf67260f8"}
Jul 31 22:02:22.937676 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.937635    2573 scope.go:117] "RemoveContainer" containerID="7aab3dae951d46c8f8f0df3145d83d86f0500aa4c1f14d8ae784d6e4f0295e24"
Jul 31 22:02:22.945581 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.945567    2573 scope.go:117] "RemoveContainer" containerID="3f8f06308952b8ac7f29c1668020c556249a78e35816e375d32bff3218142ac5"
Jul 31 22:02:22.953652 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.953628    2573 scope.go:117] "RemoveContainer" containerID="442ff56eb121771747ab08f62658a039ddaccfd9498305bc858754f509838564"
Jul 31 22:02:22.959659 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.959640    2573 scope.go:117] "RemoveContainer" containerID="ef672c1cded50d55c6f28201abe26e4d9fab06f8244d5a8993a4ce3d9bb2f7b4"
Jul 31 22:02:22.961393 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.961372    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 31 22:02:22.966520 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.966489    2573 scope.go:117] "RemoveContainer" containerID="01ae1fd7944572decc1dcddaba9a15bc03000f0fb576fdbcd2671b0dccc0d7fb"
Jul 31 22:02:22.968065 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.968047    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 31 22:02:22.972667 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.972654    2573 scope.go:117] "RemoveContainer" containerID="66ff09157060caf0db7007e3486b8c9698bf84c15d1030f963f6e74f26d3060e"
Jul 31 22:02:22.979519 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.979504    2573 scope.go:117] "RemoveContainer" containerID="dd291469775a306888dfc14d3b094d1158137794003f438aa4ec07dcb8442140"
Jul 31 22:02:22.986096 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.986079    2573 scope.go:117] "RemoveContainer" containerID="7aab3dae951d46c8f8f0df3145d83d86f0500aa4c1f14d8ae784d6e4f0295e24"
Jul 31 22:02:22.986370 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:02:22.986351    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7aab3dae951d46c8f8f0df3145d83d86f0500aa4c1f14d8ae784d6e4f0295e24\": container with ID starting with 7aab3dae951d46c8f8f0df3145d83d86f0500aa4c1f14d8ae784d6e4f0295e24 not found: ID does not exist" containerID="7aab3dae951d46c8f8f0df3145d83d86f0500aa4c1f14d8ae784d6e4f0295e24"
Jul 31 22:02:22.986452 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.986382    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7aab3dae951d46c8f8f0df3145d83d86f0500aa4c1f14d8ae784d6e4f0295e24"} err="failed to get container status \"7aab3dae951d46c8f8f0df3145d83d86f0500aa4c1f14d8ae784d6e4f0295e24\": rpc error: code = NotFound desc = could not find container \"7aab3dae951d46c8f8f0df3145d83d86f0500aa4c1f14d8ae784d6e4f0295e24\": container with ID starting with 7aab3dae951d46c8f8f0df3145d83d86f0500aa4c1f14d8ae784d6e4f0295e24 not found: ID does not exist"
Jul 31 22:02:22.986452 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.986405    2573 scope.go:117] "RemoveContainer" containerID="3f8f06308952b8ac7f29c1668020c556249a78e35816e375d32bff3218142ac5"
Jul 31 22:02:22.986667 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:02:22.986651    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f8f06308952b8ac7f29c1668020c556249a78e35816e375d32bff3218142ac5\": container with ID starting with 3f8f06308952b8ac7f29c1668020c556249a78e35816e375d32bff3218142ac5 not found: ID does not exist" containerID="3f8f06308952b8ac7f29c1668020c556249a78e35816e375d32bff3218142ac5"
Jul 31 22:02:22.986706 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.986674    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f8f06308952b8ac7f29c1668020c556249a78e35816e375d32bff3218142ac5"} err="failed to get container status \"3f8f06308952b8ac7f29c1668020c556249a78e35816e375d32bff3218142ac5\": rpc error: code = NotFound desc = could not find container \"3f8f06308952b8ac7f29c1668020c556249a78e35816e375d32bff3218142ac5\": container with ID starting with 3f8f06308952b8ac7f29c1668020c556249a78e35816e375d32bff3218142ac5 not found: ID does not exist"
Jul 31 22:02:22.986706 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.986690    2573 scope.go:117] "RemoveContainer" containerID="442ff56eb121771747ab08f62658a039ddaccfd9498305bc858754f509838564"
Jul 31 22:02:22.986942 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:02:22.986924    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"442ff56eb121771747ab08f62658a039ddaccfd9498305bc858754f509838564\": container with ID starting with 442ff56eb121771747ab08f62658a039ddaccfd9498305bc858754f509838564 not found: ID does not exist" containerID="442ff56eb121771747ab08f62658a039ddaccfd9498305bc858754f509838564"
Jul 31 22:02:22.986984 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.986954    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"442ff56eb121771747ab08f62658a039ddaccfd9498305bc858754f509838564"} err="failed to get container status \"442ff56eb121771747ab08f62658a039ddaccfd9498305bc858754f509838564\": rpc error: code = NotFound desc = could not find container \"442ff56eb121771747ab08f62658a039ddaccfd9498305bc858754f509838564\": container with ID starting with 442ff56eb121771747ab08f62658a039ddaccfd9498305bc858754f509838564 not found: ID does not exist"
Jul 31 22:02:22.986984 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.986969    2573 scope.go:117] "RemoveContainer" containerID="ef672c1cded50d55c6f28201abe26e4d9fab06f8244d5a8993a4ce3d9bb2f7b4"
Jul 31 22:02:22.987193 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:02:22.987175    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef672c1cded50d55c6f28201abe26e4d9fab06f8244d5a8993a4ce3d9bb2f7b4\": container with ID starting with ef672c1cded50d55c6f28201abe26e4d9fab06f8244d5a8993a4ce3d9bb2f7b4 not found: ID does not exist" containerID="ef672c1cded50d55c6f28201abe26e4d9fab06f8244d5a8993a4ce3d9bb2f7b4"
Jul 31 22:02:22.987253 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.987199    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef672c1cded50d55c6f28201abe26e4d9fab06f8244d5a8993a4ce3d9bb2f7b4"} err="failed to get container status \"ef672c1cded50d55c6f28201abe26e4d9fab06f8244d5a8993a4ce3d9bb2f7b4\": rpc error: code = NotFound desc = could not find container \"ef672c1cded50d55c6f28201abe26e4d9fab06f8244d5a8993a4ce3d9bb2f7b4\": container with ID starting with ef672c1cded50d55c6f28201abe26e4d9fab06f8244d5a8993a4ce3d9bb2f7b4 not found: ID does not exist"
Jul 31 22:02:22.987253 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.987218    2573 scope.go:117] "RemoveContainer" containerID="01ae1fd7944572decc1dcddaba9a15bc03000f0fb576fdbcd2671b0dccc0d7fb"
Jul 31 22:02:22.987479 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:02:22.987463    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01ae1fd7944572decc1dcddaba9a15bc03000f0fb576fdbcd2671b0dccc0d7fb\": container with ID starting with 01ae1fd7944572decc1dcddaba9a15bc03000f0fb576fdbcd2671b0dccc0d7fb not found: ID does not exist" containerID="01ae1fd7944572decc1dcddaba9a15bc03000f0fb576fdbcd2671b0dccc0d7fb"
Jul 31 22:02:22.987516 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.987481    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01ae1fd7944572decc1dcddaba9a15bc03000f0fb576fdbcd2671b0dccc0d7fb"} err="failed to get container status \"01ae1fd7944572decc1dcddaba9a15bc03000f0fb576fdbcd2671b0dccc0d7fb\": rpc error: code = NotFound desc = could not find container \"01ae1fd7944572decc1dcddaba9a15bc03000f0fb576fdbcd2671b0dccc0d7fb\": container with ID starting with 01ae1fd7944572decc1dcddaba9a15bc03000f0fb576fdbcd2671b0dccc0d7fb not found: ID does not exist"
Jul 31 22:02:22.987516 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.987493    2573 scope.go:117] "RemoveContainer" containerID="66ff09157060caf0db7007e3486b8c9698bf84c15d1030f963f6e74f26d3060e"
Jul 31 22:02:22.987725 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:02:22.987710    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66ff09157060caf0db7007e3486b8c9698bf84c15d1030f963f6e74f26d3060e\": container with ID starting with 66ff09157060caf0db7007e3486b8c9698bf84c15d1030f963f6e74f26d3060e not found: ID does not exist" containerID="66ff09157060caf0db7007e3486b8c9698bf84c15d1030f963f6e74f26d3060e"
Jul 31 22:02:22.987768 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.987729    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66ff09157060caf0db7007e3486b8c9698bf84c15d1030f963f6e74f26d3060e"} err="failed to get container status \"66ff09157060caf0db7007e3486b8c9698bf84c15d1030f963f6e74f26d3060e\": rpc error: code = NotFound desc = could not find container \"66ff09157060caf0db7007e3486b8c9698bf84c15d1030f963f6e74f26d3060e\": container with ID starting with 66ff09157060caf0db7007e3486b8c9698bf84c15d1030f963f6e74f26d3060e not found: ID does not exist"
Jul 31 22:02:22.987768 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.987742    2573 scope.go:117] "RemoveContainer" containerID="dd291469775a306888dfc14d3b094d1158137794003f438aa4ec07dcb8442140"
Jul 31 22:02:22.987933 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:02:22.987918    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd291469775a306888dfc14d3b094d1158137794003f438aa4ec07dcb8442140\": container with ID starting with dd291469775a306888dfc14d3b094d1158137794003f438aa4ec07dcb8442140 not found: ID does not exist" containerID="dd291469775a306888dfc14d3b094d1158137794003f438aa4ec07dcb8442140"
Jul 31 22:02:22.987969 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.987937    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd291469775a306888dfc14d3b094d1158137794003f438aa4ec07dcb8442140"} err="failed to get container status \"dd291469775a306888dfc14d3b094d1158137794003f438aa4ec07dcb8442140\": rpc error: code = NotFound desc = could not find container \"dd291469775a306888dfc14d3b094d1158137794003f438aa4ec07dcb8442140\": container with ID starting with dd291469775a306888dfc14d3b094d1158137794003f438aa4ec07dcb8442140 not found: ID does not exist"
Jul 31 22:02:23.000536 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.998804    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 31 22:02:23.000536 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.999459    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70c15479-1a99-4d76-a00f-b349880af732" containerName="kube-rbac-proxy-thanos"
Jul 31 22:02:23.000536 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.999478    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="70c15479-1a99-4d76-a00f-b349880af732" containerName="kube-rbac-proxy-thanos"
Jul 31 22:02:23.000536 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.999500    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70c15479-1a99-4d76-a00f-b349880af732" containerName="init-config-reloader"
Jul 31 22:02:23.000536 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.999510    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="70c15479-1a99-4d76-a00f-b349880af732" containerName="init-config-reloader"
Jul 31 22:02:23.000536 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.999520    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dea759e-4881-4874-b7f3-85ca2e933973" containerName="console"
Jul 31 22:02:23.000536 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.999529    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dea759e-4881-4874-b7f3-85ca2e933973" containerName="console"
Jul 31 22:02:23.000536 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.999538    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70c15479-1a99-4d76-a00f-b349880af732" containerName="config-reloader"
Jul 31 22:02:23.000536 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.999554    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="70c15479-1a99-4d76-a00f-b349880af732" containerName="config-reloader"
Jul 31 22:02:23.000536 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.999565    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70c15479-1a99-4d76-a00f-b349880af732" containerName="kube-rbac-proxy-web"
Jul 31 22:02:23.000536 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.999574    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="70c15479-1a99-4d76-a00f-b349880af732" containerName="kube-rbac-proxy-web"
Jul 31 22:02:23.000536 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.999594    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70c15479-1a99-4d76-a00f-b349880af732" containerName="prometheus"
Jul 31 22:02:23.000536 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.999602    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="70c15479-1a99-4d76-a00f-b349880af732" containerName="prometheus"
Jul 31 22:02:23.000536 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.999617    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70c15479-1a99-4d76-a00f-b349880af732" containerName="thanos-sidecar"
Jul 31 22:02:23.000536 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.999625    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="70c15479-1a99-4d76-a00f-b349880af732" containerName="thanos-sidecar"
Jul 31 22:02:23.000536 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.999644    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70c15479-1a99-4d76-a00f-b349880af732" containerName="kube-rbac-proxy"
Jul 31 22:02:23.000536 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.999653    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="70c15479-1a99-4d76-a00f-b349880af732" containerName="kube-rbac-proxy"
Jul 31 22:02:23.000536 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.999769    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="70c15479-1a99-4d76-a00f-b349880af732" containerName="thanos-sidecar"
Jul 31 22:02:23.000536 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.999785    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="70c15479-1a99-4d76-a00f-b349880af732" containerName="kube-rbac-proxy-thanos"
Jul 31 22:02:23.000536 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.999796    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="70c15479-1a99-4d76-a00f-b349880af732" containerName="kube-rbac-proxy"
Jul 31 22:02:23.000536 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.999812    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0dea759e-4881-4874-b7f3-85ca2e933973" containerName="console"
Jul 31 22:02:23.000536 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.999821    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="70c15479-1a99-4d76-a00f-b349880af732" containerName="config-reloader"
Jul 31 22:02:23.000536 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.999837    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="70c15479-1a99-4d76-a00f-b349880af732" containerName="prometheus"
Jul 31 22:02:23.000536 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:22.999846    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="70c15479-1a99-4d76-a00f-b349880af732" containerName="kube-rbac-proxy-web"
Jul 31 22:02:23.005753 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.005730    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.008345 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.008323    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 31 22:02:23.008561 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.008544    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 31 22:02:23.008626 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.008544    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 31 22:02:23.008687 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.008662    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hc85z\""
Jul 31 22:02:23.008747 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.008734    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 31 22:02:23.008797 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.008768    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 31 22:02:23.008948 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.008880    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ec64dldd1pohu\""
Jul 31 22:02:23.009110 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.009055    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 31 22:02:23.009110 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.009061    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 31 22:02:23.009389 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.009341    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 31 22:02:23.009651 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.009610    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 31 22:02:23.009751 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.009737    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 31 22:02:23.009933 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.009852    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 31 22:02:23.009933 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.009856    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 31 22:02:23.009933 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.009902    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 31 22:02:23.011717 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.011697    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 31 22:02:23.015488 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.015470    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 31 22:02:23.016792 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.016772    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 31 22:02:23.107051 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.107026    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a88dbe81-c916-46e9-be56-37a95a3cd5dd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.107051 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.107049    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a88dbe81-c916-46e9-be56-37a95a3cd5dd-config-out\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.107222 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.107067    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a88dbe81-c916-46e9-be56-37a95a3cd5dd-config\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.107222 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.107082    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a88dbe81-c916-46e9-be56-37a95a3cd5dd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.107222 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.107099    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a88dbe81-c916-46e9-be56-37a95a3cd5dd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.107222 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.107132    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxdl8\" (UniqueName: \"kubernetes.io/projected/a88dbe81-c916-46e9-be56-37a95a3cd5dd-kube-api-access-nxdl8\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.107222 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.107170    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a88dbe81-c916-46e9-be56-37a95a3cd5dd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.107222 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.107206    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a88dbe81-c916-46e9-be56-37a95a3cd5dd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.107485 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.107236    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a88dbe81-c916-46e9-be56-37a95a3cd5dd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.107485 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.107284    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a88dbe81-c916-46e9-be56-37a95a3cd5dd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.107485 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.107337    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a88dbe81-c916-46e9-be56-37a95a3cd5dd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.107485 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.107356    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a88dbe81-c916-46e9-be56-37a95a3cd5dd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.107485 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.107377    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a88dbe81-c916-46e9-be56-37a95a3cd5dd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.107485 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.107398    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a88dbe81-c916-46e9-be56-37a95a3cd5dd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.107485 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.107416    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a88dbe81-c916-46e9-be56-37a95a3cd5dd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.107485 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.107429    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a88dbe81-c916-46e9-be56-37a95a3cd5dd-web-config\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.107485 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.107446    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a88dbe81-c916-46e9-be56-37a95a3cd5dd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.107485 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.107461    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a88dbe81-c916-46e9-be56-37a95a3cd5dd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.107778 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.107492    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a88dbe81-c916-46e9-be56-37a95a3cd5dd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.107778 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.107529    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a88dbe81-c916-46e9-be56-37a95a3cd5dd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.208533 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.208478    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a88dbe81-c916-46e9-be56-37a95a3cd5dd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.208533 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.208513    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a88dbe81-c916-46e9-be56-37a95a3cd5dd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.208672 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.208538    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a88dbe81-c916-46e9-be56-37a95a3cd5dd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.208672 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.208651    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a88dbe81-c916-46e9-be56-37a95a3cd5dd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.208744 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.208679    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a88dbe81-c916-46e9-be56-37a95a3cd5dd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.208744 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.208707    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a88dbe81-c916-46e9-be56-37a95a3cd5dd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.208744 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.208735    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a88dbe81-c916-46e9-be56-37a95a3cd5dd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.208888 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.208764    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a88dbe81-c916-46e9-be56-37a95a3cd5dd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.208888 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.208790    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a88dbe81-c916-46e9-be56-37a95a3cd5dd-web-config\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.208888 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.208820    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a88dbe81-c916-46e9-be56-37a95a3cd5dd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.208888 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.208844    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a88dbe81-c916-46e9-be56-37a95a3cd5dd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.208888 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.208870    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a88dbe81-c916-46e9-be56-37a95a3cd5dd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.208888 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.208880    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a88dbe81-c916-46e9-be56-37a95a3cd5dd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.209179 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.208895    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a88dbe81-c916-46e9-be56-37a95a3cd5dd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.209179 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.208926    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a88dbe81-c916-46e9-be56-37a95a3cd5dd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.209179 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.208950    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a88dbe81-c916-46e9-be56-37a95a3cd5dd-config-out\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.209179 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.208975    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a88dbe81-c916-46e9-be56-37a95a3cd5dd-config\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.209179 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.209001    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a88dbe81-c916-46e9-be56-37a95a3cd5dd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.209179 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.209025    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a88dbe81-c916-46e9-be56-37a95a3cd5dd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.209179 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.209047    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxdl8\" (UniqueName: \"kubernetes.io/projected/a88dbe81-c916-46e9-be56-37a95a3cd5dd-kube-api-access-nxdl8\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.209179 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.209079    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a88dbe81-c916-46e9-be56-37a95a3cd5dd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.209599 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.209198    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a88dbe81-c916-46e9-be56-37a95a3cd5dd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.209599 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.209253    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a88dbe81-c916-46e9-be56-37a95a3cd5dd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.209599 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.209529    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a88dbe81-c916-46e9-be56-37a95a3cd5dd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.209599 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.209593    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a88dbe81-c916-46e9-be56-37a95a3cd5dd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.210554 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.210486    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a88dbe81-c916-46e9-be56-37a95a3cd5dd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.211689 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.211645    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a88dbe81-c916-46e9-be56-37a95a3cd5dd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.211904 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.211880    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a88dbe81-c916-46e9-be56-37a95a3cd5dd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.212189 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.212167    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a88dbe81-c916-46e9-be56-37a95a3cd5dd-config-out\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.212268 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.212205    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a88dbe81-c916-46e9-be56-37a95a3cd5dd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.212886 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.212845    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a88dbe81-c916-46e9-be56-37a95a3cd5dd-web-config\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.213209 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.213184    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a88dbe81-c916-46e9-be56-37a95a3cd5dd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.213505 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.213478    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a88dbe81-c916-46e9-be56-37a95a3cd5dd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.214058 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.213999    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a88dbe81-c916-46e9-be56-37a95a3cd5dd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.214157 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.214142    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a88dbe81-c916-46e9-be56-37a95a3cd5dd-config\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.214214 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.214169    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a88dbe81-c916-46e9-be56-37a95a3cd5dd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.214254 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.214225    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a88dbe81-c916-46e9-be56-37a95a3cd5dd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.214592 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.214570    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a88dbe81-c916-46e9-be56-37a95a3cd5dd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.215244 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.215220    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a88dbe81-c916-46e9-be56-37a95a3cd5dd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.219117 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.219100    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxdl8\" (UniqueName: \"kubernetes.io/projected/a88dbe81-c916-46e9-be56-37a95a3cd5dd-kube-api-access-nxdl8\") pod \"prometheus-k8s-0\" (UID: \"a88dbe81-c916-46e9-be56-37a95a3cd5dd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.315369 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.315349    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:02:23.334130 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.334104    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70c15479-1a99-4d76-a00f-b349880af732" path="/var/lib/kubelet/pods/70c15479-1a99-4d76-a00f-b349880af732/volumes"
Jul 31 22:02:23.448032 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.448002    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 31 22:02:23.451111 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:02:23.451084    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda88dbe81_c916_46e9_be56_37a95a3cd5dd.slice/crio-9d91edf059becade1f584f1716c5abce88f46288b1aef4a49180e2731f5faac3 WatchSource:0}: Error finding container 9d91edf059becade1f584f1716c5abce88f46288b1aef4a49180e2731f5faac3: Status 404 returned error can't find the container with id 9d91edf059becade1f584f1716c5abce88f46288b1aef4a49180e2731f5faac3
Jul 31 22:02:23.943516 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.943481    2573 generic.go:356] "Generic (PLEG): container finished" podID="a88dbe81-c916-46e9-be56-37a95a3cd5dd" containerID="9e9b2348f36ca5feffb73e3ef840dd8126313f5f92c6ab607baea5186a716a57" exitCode=0
Jul 31 22:02:23.943708 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.943574    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a88dbe81-c916-46e9-be56-37a95a3cd5dd","Type":"ContainerDied","Data":"9e9b2348f36ca5feffb73e3ef840dd8126313f5f92c6ab607baea5186a716a57"}
Jul 31 22:02:23.943708 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:23.943655    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a88dbe81-c916-46e9-be56-37a95a3cd5dd","Type":"ContainerStarted","Data":"9d91edf059becade1f584f1716c5abce88f46288b1aef4a49180e2731f5faac3"}
Jul 31 22:02:24.950535 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:24.950505    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a88dbe81-c916-46e9-be56-37a95a3cd5dd","Type":"ContainerStarted","Data":"0ef5a2aa655faed429a59bff039ac82b6783d648c56a0c8c1e2136f0b9c6e373"}
Jul 31 22:02:24.950883 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:24.950567    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a88dbe81-c916-46e9-be56-37a95a3cd5dd","Type":"ContainerStarted","Data":"e4e2d4580d659ac9b413dd35577446de2de30c8af1be5a9546384f80c7e1768b"}
Jul 31 22:02:24.950883 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:24.950594    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a88dbe81-c916-46e9-be56-37a95a3cd5dd","Type":"ContainerStarted","Data":"5cdeac95ce3c30264662e5fc532bf15fb8abf6e2b67307fa66722a54f55ba23c"}
Jul 31 22:02:24.950883 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:24.950619    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a88dbe81-c916-46e9-be56-37a95a3cd5dd","Type":"ContainerStarted","Data":"64b0343b43069c3b5c36c79061ddc7bd61fa0d3b9bdc9abffcbef175f69de084"}
Jul 31 22:02:24.950883 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:24.950645    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a88dbe81-c916-46e9-be56-37a95a3cd5dd","Type":"ContainerStarted","Data":"52fd5c35154848d57014cd16a301a96d1a56c641ac8e4fe4f62275c41d6a47cb"}
Jul 31 22:02:24.950883 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:24.950668    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a88dbe81-c916-46e9-be56-37a95a3cd5dd","Type":"ContainerStarted","Data":"c4848b5d77336c87964126bea64445ee28fd308602604f7dd1bbd963d2f1bd77"}
Jul 31 22:02:24.985105 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:24.985037    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.966494009 podStartE2EDuration="2.985017357s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.523348ms" isStatefulPod=false podCreationTimestamp="2026-07-31 22:02:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:02:24.984076994 +0000 UTC m=+154.079368191" watchObservedRunningTime="2026-07-31 22:02:24.985017357 +0000 UTC m=+154.080308503"
Jul 31 22:02:28.315897 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:02:28.315857    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:03:23.315739 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:03:23.315706    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:03:23.334051 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:03:23.334027    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:03:24.175381 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:03:24.175343    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 31 22:04:11.667233 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:11.667191    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7tz7n"]
Jul 31 22:04:11.670372 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:11.670354    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7tz7n"
Jul 31 22:04:11.674633 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:11.674602    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-kxmhc\""
Jul 31 22:04:11.674762 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:11.674662    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 31 22:04:11.674762 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:11.674688    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 31 22:04:11.681885 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:11.681863    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7tz7n"]
Jul 31 22:04:11.733404 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:11.733358    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30f5af08-d570-4886-a8f4-c55ee22231dd-tmp\") pod \"openshift-lws-operator-fd8ccff4c-7tz7n\" (UID: \"30f5af08-d570-4886-a8f4-c55ee22231dd\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7tz7n"
Jul 31 22:04:11.733588 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:11.733413    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlmvf\" (UniqueName: \"kubernetes.io/projected/30f5af08-d570-4886-a8f4-c55ee22231dd-kube-api-access-nlmvf\") pod \"openshift-lws-operator-fd8ccff4c-7tz7n\" (UID: \"30f5af08-d570-4886-a8f4-c55ee22231dd\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7tz7n"
Jul 31 22:04:11.834029 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:11.833983    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30f5af08-d570-4886-a8f4-c55ee22231dd-tmp\") pod \"openshift-lws-operator-fd8ccff4c-7tz7n\" (UID: \"30f5af08-d570-4886-a8f4-c55ee22231dd\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7tz7n"
Jul 31 22:04:11.834205 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:11.834062    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlmvf\" (UniqueName: \"kubernetes.io/projected/30f5af08-d570-4886-a8f4-c55ee22231dd-kube-api-access-nlmvf\") pod \"openshift-lws-operator-fd8ccff4c-7tz7n\" (UID: \"30f5af08-d570-4886-a8f4-c55ee22231dd\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7tz7n"
Jul 31 22:04:11.834326 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:11.834276    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30f5af08-d570-4886-a8f4-c55ee22231dd-tmp\") pod \"openshift-lws-operator-fd8ccff4c-7tz7n\" (UID: \"30f5af08-d570-4886-a8f4-c55ee22231dd\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7tz7n"
Jul 31 22:04:11.844474 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:11.844447    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlmvf\" (UniqueName: \"kubernetes.io/projected/30f5af08-d570-4886-a8f4-c55ee22231dd-kube-api-access-nlmvf\") pod \"openshift-lws-operator-fd8ccff4c-7tz7n\" (UID: \"30f5af08-d570-4886-a8f4-c55ee22231dd\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7tz7n"
Jul 31 22:04:11.991294 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:11.991205    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7tz7n"
Jul 31 22:04:12.137540 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:12.137499    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7tz7n"]
Jul 31 22:04:12.144090 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:04:12.144056    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30f5af08_d570_4886_a8f4_c55ee22231dd.slice/crio-5fae443554a66ae250ae8fdd88aada927c53f889631cd928500bc885b742bf6a WatchSource:0}: Error finding container 5fae443554a66ae250ae8fdd88aada927c53f889631cd928500bc885b742bf6a: Status 404 returned error can't find the container with id 5fae443554a66ae250ae8fdd88aada927c53f889631cd928500bc885b742bf6a
Jul 31 22:04:12.327292 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:12.327205    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7tz7n" event={"ID":"30f5af08-d570-4886-a8f4-c55ee22231dd","Type":"ContainerStarted","Data":"5fae443554a66ae250ae8fdd88aada927c53f889631cd928500bc885b742bf6a"}
Jul 31 22:04:15.341524 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:15.341484    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7tz7n" event={"ID":"30f5af08-d570-4886-a8f4-c55ee22231dd","Type":"ContainerStarted","Data":"892da76a2d62324f63fe6f3160261eea90e18055f5a04b7a13ada2444c6d4944"}
Jul 31 22:04:15.358526 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:15.358485    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7tz7n" podStartSLOduration=1.69789524 podStartE2EDuration="4.358470094s" totalImagesPullingTime="2.660574854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:04:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:04:15.357325299 +0000 UTC m=+264.452616444" watchObservedRunningTime="2026-07-31 22:04:15.358470094 +0000 UTC m=+264.453761240"
Jul 31 22:04:31.010419 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:31.010375    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79bdc6db47-pcb8j"]
Jul 31 22:04:31.013820 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:31.013803    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-pcb8j"
Jul 31 22:04:31.017152 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:31.017124    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 31 22:04:31.017659 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:31.017639    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 31 22:04:31.018202 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:31.018188    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 31 22:04:31.018411 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:31.018397    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 31 22:04:31.018411 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:31.018401    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wczhl\""
Jul 31 22:04:31.037081 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:31.037052    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79bdc6db47-pcb8j"]
Jul 31 22:04:31.193163 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:31.193123    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqw5v\" (UniqueName: \"kubernetes.io/projected/9a15bb41-44e8-4b01-b6a6-074fae8016ff-kube-api-access-fqw5v\") pod \"opendatahub-operator-controller-manager-79bdc6db47-pcb8j\" (UID: \"9a15bb41-44e8-4b01-b6a6-074fae8016ff\") " pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-pcb8j"
Jul 31 22:04:31.193163 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:31.193162    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9a15bb41-44e8-4b01-b6a6-074fae8016ff-webhook-cert\") pod \"opendatahub-operator-controller-manager-79bdc6db47-pcb8j\" (UID: \"9a15bb41-44e8-4b01-b6a6-074fae8016ff\") " pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-pcb8j"
Jul 31 22:04:31.193421 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:31.193196    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9a15bb41-44e8-4b01-b6a6-074fae8016ff-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79bdc6db47-pcb8j\" (UID: \"9a15bb41-44e8-4b01-b6a6-074fae8016ff\") " pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-pcb8j"
Jul 31 22:04:31.193421 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:31.193261    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9a15bb41-44e8-4b01-b6a6-074fae8016ff-manifests\") pod \"opendatahub-operator-controller-manager-79bdc6db47-pcb8j\" (UID: \"9a15bb41-44e8-4b01-b6a6-074fae8016ff\") " pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-pcb8j"
Jul 31 22:04:31.193421 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:31.193356    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a15bb41-44e8-4b01-b6a6-074fae8016ff-tmp\") pod \"opendatahub-operator-controller-manager-79bdc6db47-pcb8j\" (UID: \"9a15bb41-44e8-4b01-b6a6-074fae8016ff\") " pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-pcb8j"
Jul 31 22:04:31.294057 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:31.293967    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqw5v\" (UniqueName: \"kubernetes.io/projected/9a15bb41-44e8-4b01-b6a6-074fae8016ff-kube-api-access-fqw5v\") pod \"opendatahub-operator-controller-manager-79bdc6db47-pcb8j\" (UID: \"9a15bb41-44e8-4b01-b6a6-074fae8016ff\") " pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-pcb8j"
Jul 31 22:04:31.294057 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:31.294003    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9a15bb41-44e8-4b01-b6a6-074fae8016ff-webhook-cert\") pod \"opendatahub-operator-controller-manager-79bdc6db47-pcb8j\" (UID: \"9a15bb41-44e8-4b01-b6a6-074fae8016ff\") " pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-pcb8j"
Jul 31 22:04:31.294057 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:31.294035    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9a15bb41-44e8-4b01-b6a6-074fae8016ff-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79bdc6db47-pcb8j\" (UID: \"9a15bb41-44e8-4b01-b6a6-074fae8016ff\") " pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-pcb8j"
Jul 31 22:04:31.294057 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:31.294056    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9a15bb41-44e8-4b01-b6a6-074fae8016ff-manifests\") pod \"opendatahub-operator-controller-manager-79bdc6db47-pcb8j\" (UID: \"9a15bb41-44e8-4b01-b6a6-074fae8016ff\") " pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-pcb8j"
Jul 31 22:04:31.294426 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:31.294076    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a15bb41-44e8-4b01-b6a6-074fae8016ff-tmp\") pod \"opendatahub-operator-controller-manager-79bdc6db47-pcb8j\" (UID: \"9a15bb41-44e8-4b01-b6a6-074fae8016ff\") " pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-pcb8j"
Jul 31 22:04:31.294586 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:31.294561    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9a15bb41-44e8-4b01-b6a6-074fae8016ff-manifests\") pod \"opendatahub-operator-controller-manager-79bdc6db47-pcb8j\" (UID: \"9a15bb41-44e8-4b01-b6a6-074fae8016ff\") " pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-pcb8j"
Jul 31 22:04:31.296400 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:31.296379    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a15bb41-44e8-4b01-b6a6-074fae8016ff-tmp\") pod \"opendatahub-operator-controller-manager-79bdc6db47-pcb8j\" (UID: \"9a15bb41-44e8-4b01-b6a6-074fae8016ff\") " pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-pcb8j"
Jul 31 22:04:31.296527 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:31.296510    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9a15bb41-44e8-4b01-b6a6-074fae8016ff-webhook-cert\") pod \"opendatahub-operator-controller-manager-79bdc6db47-pcb8j\" (UID: \"9a15bb41-44e8-4b01-b6a6-074fae8016ff\") " pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-pcb8j"
Jul 31 22:04:31.296569 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:31.296552    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9a15bb41-44e8-4b01-b6a6-074fae8016ff-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79bdc6db47-pcb8j\" (UID: \"9a15bb41-44e8-4b01-b6a6-074fae8016ff\") " pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-pcb8j"
Jul 31 22:04:31.302441 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:31.302422    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqw5v\" (UniqueName: \"kubernetes.io/projected/9a15bb41-44e8-4b01-b6a6-074fae8016ff-kube-api-access-fqw5v\") pod \"opendatahub-operator-controller-manager-79bdc6db47-pcb8j\" (UID: \"9a15bb41-44e8-4b01-b6a6-074fae8016ff\") " pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-pcb8j"
Jul 31 22:04:31.324408 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:31.324375    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-pcb8j"
Jul 31 22:04:31.468782 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:31.468758    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79bdc6db47-pcb8j"]
Jul 31 22:04:31.471394 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:04:31.471358    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a15bb41_44e8_4b01_b6a6_074fae8016ff.slice/crio-b9cc1d01d8d4e68609dd11a004bf4922fdaf2f470a1b6d3b81a3c742a531189c WatchSource:0}: Error finding container b9cc1d01d8d4e68609dd11a004bf4922fdaf2f470a1b6d3b81a3c742a531189c: Status 404 returned error can't find the container with id b9cc1d01d8d4e68609dd11a004bf4922fdaf2f470a1b6d3b81a3c742a531189c
Jul 31 22:04:32.409239 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:32.409200    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-pcb8j" event={"ID":"9a15bb41-44e8-4b01-b6a6-074fae8016ff","Type":"ContainerStarted","Data":"b9cc1d01d8d4e68609dd11a004bf4922fdaf2f470a1b6d3b81a3c742a531189c"}
Jul 31 22:04:35.422319 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:35.422264    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-pcb8j" event={"ID":"9a15bb41-44e8-4b01-b6a6-074fae8016ff","Type":"ContainerStarted","Data":"b46c3e5f7ad6dc745022fc14e1861af1e87fff61b00e405265a2f143fdabde1c"}
Jul 31 22:04:36.427259 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:36.427223    2573 generic.go:356] "Generic (PLEG): container finished" podID="9a15bb41-44e8-4b01-b6a6-074fae8016ff" containerID="b46c3e5f7ad6dc745022fc14e1861af1e87fff61b00e405265a2f143fdabde1c" exitCode=0
Jul 31 22:04:36.427860 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:36.427834    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-pcb8j" event={"ID":"9a15bb41-44e8-4b01-b6a6-074fae8016ff","Type":"ContainerDied","Data":"b46c3e5f7ad6dc745022fc14e1861af1e87fff61b00e405265a2f143fdabde1c"}
Jul 31 22:04:37.433290 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:37.433254    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-pcb8j" event={"ID":"9a15bb41-44e8-4b01-b6a6-074fae8016ff","Type":"ContainerStarted","Data":"8e55eccc1927642e45ede58080a92ec613c1706546f844d077fb1170e1091cfe"}
Jul 31 22:04:37.433686 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:37.433432    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-pcb8j"
Jul 31 22:04:37.461650 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:37.461603    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-pcb8j" podStartSLOduration=3.090697452 podStartE2EDuration="7.461586831s" totalImagesPullingTime="3.27973338s" totalInitContainerRuntime="1.091155999s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:04:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:04:37.461410962 +0000 UTC m=+286.556702126" watchObservedRunningTime="2026-07-31 22:04:37.461586831 +0000 UTC m=+286.556877977"
Jul 31 22:04:48.439449 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:48.439423    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79bdc6db47-pcb8j"
Jul 31 22:04:51.209285 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:51.209249    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ddp8_79e15037-4ffd-47f1-b983-34f06895b2a3/ovn-acl-logging/0.log"
Jul 31 22:04:51.212076 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:51.212055    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ddp8_79e15037-4ffd-47f1-b983-34f06895b2a3/ovn-acl-logging/0.log"
Jul 31 22:04:51.217673 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:51.217656    2573 kubelet.go:1648] "Image garbage collection succeeded"
Jul 31 22:04:51.661389 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:51.661320    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5587bd887b-jtdvw"]
Jul 31 22:04:51.664534 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:51.664519    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5587bd887b-jtdvw"
Jul 31 22:04:51.672425 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:51.672406    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 31 22:04:51.672548 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:51.672437    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 31 22:04:51.672548 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:51.672449    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 31 22:04:51.672548 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:51.672437    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-g5ssw\""
Jul 31 22:04:51.683321 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:51.683280    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5587bd887b-jtdvw"]
Jul 31 22:04:51.752410 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:51.752389    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp5fw\" (UniqueName: \"kubernetes.io/projected/9a49c172-dced-4faf-ada5-c50bded18d89-kube-api-access-bp5fw\") pod \"lws-controller-manager-5587bd887b-jtdvw\" (UID: \"9a49c172-dced-4faf-ada5-c50bded18d89\") " pod="openshift-lws-operator/lws-controller-manager-5587bd887b-jtdvw"
Jul 31 22:04:51.752526 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:51.752509    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a49c172-dced-4faf-ada5-c50bded18d89-metrics-cert\") pod \"lws-controller-manager-5587bd887b-jtdvw\" (UID: \"9a49c172-dced-4faf-ada5-c50bded18d89\") " pod="openshift-lws-operator/lws-controller-manager-5587bd887b-jtdvw"
Jul 31 22:04:51.752583 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:51.752541    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9a49c172-dced-4faf-ada5-c50bded18d89-manager-config\") pod \"lws-controller-manager-5587bd887b-jtdvw\" (UID: \"9a49c172-dced-4faf-ada5-c50bded18d89\") " pod="openshift-lws-operator/lws-controller-manager-5587bd887b-jtdvw"
Jul 31 22:04:51.752583 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:51.752560    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a49c172-dced-4faf-ada5-c50bded18d89-cert\") pod \"lws-controller-manager-5587bd887b-jtdvw\" (UID: \"9a49c172-dced-4faf-ada5-c50bded18d89\") " pod="openshift-lws-operator/lws-controller-manager-5587bd887b-jtdvw"
Jul 31 22:04:51.853681 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:51.853657    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a49c172-dced-4faf-ada5-c50bded18d89-metrics-cert\") pod \"lws-controller-manager-5587bd887b-jtdvw\" (UID: \"9a49c172-dced-4faf-ada5-c50bded18d89\") " pod="openshift-lws-operator/lws-controller-manager-5587bd887b-jtdvw"
Jul 31 22:04:51.853786 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:51.853692    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9a49c172-dced-4faf-ada5-c50bded18d89-manager-config\") pod \"lws-controller-manager-5587bd887b-jtdvw\" (UID: \"9a49c172-dced-4faf-ada5-c50bded18d89\") " pod="openshift-lws-operator/lws-controller-manager-5587bd887b-jtdvw"
Jul 31 22:04:51.853786 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:51.853717    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a49c172-dced-4faf-ada5-c50bded18d89-cert\") pod \"lws-controller-manager-5587bd887b-jtdvw\" (UID: \"9a49c172-dced-4faf-ada5-c50bded18d89\") " pod="openshift-lws-operator/lws-controller-manager-5587bd887b-jtdvw"
Jul 31 22:04:51.853786 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:51.853758    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp5fw\" (UniqueName: \"kubernetes.io/projected/9a49c172-dced-4faf-ada5-c50bded18d89-kube-api-access-bp5fw\") pod \"lws-controller-manager-5587bd887b-jtdvw\" (UID: \"9a49c172-dced-4faf-ada5-c50bded18d89\") " pod="openshift-lws-operator/lws-controller-manager-5587bd887b-jtdvw"
Jul 31 22:04:51.854415 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:51.854396    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9a49c172-dced-4faf-ada5-c50bded18d89-manager-config\") pod \"lws-controller-manager-5587bd887b-jtdvw\" (UID: \"9a49c172-dced-4faf-ada5-c50bded18d89\") " pod="openshift-lws-operator/lws-controller-manager-5587bd887b-jtdvw"
Jul 31 22:04:51.855991 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:51.855972    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9a49c172-dced-4faf-ada5-c50bded18d89-metrics-cert\") pod \"lws-controller-manager-5587bd887b-jtdvw\" (UID: \"9a49c172-dced-4faf-ada5-c50bded18d89\") " pod="openshift-lws-operator/lws-controller-manager-5587bd887b-jtdvw"
Jul 31 22:04:51.856061 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:51.856030    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a49c172-dced-4faf-ada5-c50bded18d89-cert\") pod \"lws-controller-manager-5587bd887b-jtdvw\" (UID: \"9a49c172-dced-4faf-ada5-c50bded18d89\") " pod="openshift-lws-operator/lws-controller-manager-5587bd887b-jtdvw"
Jul 31 22:04:51.893557 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:51.893536    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp5fw\" (UniqueName: \"kubernetes.io/projected/9a49c172-dced-4faf-ada5-c50bded18d89-kube-api-access-bp5fw\") pod \"lws-controller-manager-5587bd887b-jtdvw\" (UID: \"9a49c172-dced-4faf-ada5-c50bded18d89\") " pod="openshift-lws-operator/lws-controller-manager-5587bd887b-jtdvw"
Jul 31 22:04:51.973559 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:51.973537    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5587bd887b-jtdvw"
Jul 31 22:04:52.156628 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:04:52.156597    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a49c172_dced_4faf_ada5_c50bded18d89.slice/crio-cf94de50c76fee1d84a1cd78a1e6a44bfc5bd0308384e272fadbe0240806575a WatchSource:0}: Error finding container cf94de50c76fee1d84a1cd78a1e6a44bfc5bd0308384e272fadbe0240806575a: Status 404 returned error can't find the container with id cf94de50c76fee1d84a1cd78a1e6a44bfc5bd0308384e272fadbe0240806575a
Jul 31 22:04:52.157793 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:52.157764    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5587bd887b-jtdvw"]
Jul 31 22:04:52.487325 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:52.487287    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5587bd887b-jtdvw" event={"ID":"9a49c172-dced-4faf-ada5-c50bded18d89","Type":"ContainerStarted","Data":"cf94de50c76fee1d84a1cd78a1e6a44bfc5bd0308384e272fadbe0240806575a"}
Jul 31 22:04:54.496426 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:54.496392    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5587bd887b-jtdvw" event={"ID":"9a49c172-dced-4faf-ada5-c50bded18d89","Type":"ContainerStarted","Data":"78e2a504e1e776d9bbb72137c33141daafc321a81d749704e9caefe866607484"}
Jul 31 22:04:54.496805 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:54.496516    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5587bd887b-jtdvw"
Jul 31 22:04:54.516119 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:04:54.516075    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5587bd887b-jtdvw" podStartSLOduration=2.005374812 podStartE2EDuration="3.51605884s" totalImagesPullingTime="1.510684028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:04:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:04:54.51387905 +0000 UTC m=+303.609170196" watchObservedRunningTime="2026-07-31 22:04:54.51605884 +0000 UTC m=+303.611349987"
Jul 31 22:05:02.560778 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:05:02.560745    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7c56dfbf59-9vjlz"]
Jul 31 22:05:02.563985 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:05:02.563969    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c56dfbf59-9vjlz"
Jul 31 22:05:02.573114 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:05:02.573093    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 31 22:05:02.573911 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:05:02.573894    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 31 22:05:02.573998 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:05:02.573924    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-jb2st\""
Jul 31 22:05:02.573998 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:05:02.573939    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 31 22:05:02.577950 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:05:02.577934    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 31 22:05:02.590450 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:05:02.590431    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c56dfbf59-9vjlz"]
Jul 31 22:05:02.631474 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:05:02.631455    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b0abd6f-4fd6-4507-8122-18555489341a-tls-certs\") pod \"kube-auth-proxy-7c56dfbf59-9vjlz\" (UID: \"0b0abd6f-4fd6-4507-8122-18555489341a\") " pod="openshift-ingress/kube-auth-proxy-7c56dfbf59-9vjlz"
Jul 31 22:05:02.631557 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:05:02.631482    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b0abd6f-4fd6-4507-8122-18555489341a-tmp\") pod \"kube-auth-proxy-7c56dfbf59-9vjlz\" (UID: \"0b0abd6f-4fd6-4507-8122-18555489341a\") " pod="openshift-ingress/kube-auth-proxy-7c56dfbf59-9vjlz"
Jul 31 22:05:02.631557 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:05:02.631511    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdncp\" (UniqueName: \"kubernetes.io/projected/0b0abd6f-4fd6-4507-8122-18555489341a-kube-api-access-pdncp\") pod \"kube-auth-proxy-7c56dfbf59-9vjlz\" (UID: \"0b0abd6f-4fd6-4507-8122-18555489341a\") " pod="openshift-ingress/kube-auth-proxy-7c56dfbf59-9vjlz"
Jul 31 22:05:02.731890 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:05:02.731867    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdncp\" (UniqueName: \"kubernetes.io/projected/0b0abd6f-4fd6-4507-8122-18555489341a-kube-api-access-pdncp\") pod \"kube-auth-proxy-7c56dfbf59-9vjlz\" (UID: \"0b0abd6f-4fd6-4507-8122-18555489341a\") " pod="openshift-ingress/kube-auth-proxy-7c56dfbf59-9vjlz"
Jul 31 22:05:02.731982 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:05:02.731916    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b0abd6f-4fd6-4507-8122-18555489341a-tls-certs\") pod \"kube-auth-proxy-7c56dfbf59-9vjlz\" (UID: \"0b0abd6f-4fd6-4507-8122-18555489341a\") " pod="openshift-ingress/kube-auth-proxy-7c56dfbf59-9vjlz"
Jul 31 22:05:02.731982 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:05:02.731940    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b0abd6f-4fd6-4507-8122-18555489341a-tmp\") pod \"kube-auth-proxy-7c56dfbf59-9vjlz\" (UID: \"0b0abd6f-4fd6-4507-8122-18555489341a\") " pod="openshift-ingress/kube-auth-proxy-7c56dfbf59-9vjlz"
Jul 31 22:05:02.732068 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:05:02.732008    2573 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 31 22:05:02.732068 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:05:02.732061    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b0abd6f-4fd6-4507-8122-18555489341a-tls-certs podName:0b0abd6f-4fd6-4507-8122-18555489341a nodeName:}" failed. No retries permitted until 2026-07-31 22:05:03.232043128 +0000 UTC m=+312.327334262 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/0b0abd6f-4fd6-4507-8122-18555489341a-tls-certs") pod "kube-auth-proxy-7c56dfbf59-9vjlz" (UID: "0b0abd6f-4fd6-4507-8122-18555489341a") : secret "kube-auth-proxy-tls" not found
Jul 31 22:05:02.733991 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:05:02.733968    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b0abd6f-4fd6-4507-8122-18555489341a-tmp\") pod \"kube-auth-proxy-7c56dfbf59-9vjlz\" (UID: \"0b0abd6f-4fd6-4507-8122-18555489341a\") " pod="openshift-ingress/kube-auth-proxy-7c56dfbf59-9vjlz"
Jul 31 22:05:02.748401 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:05:02.748375    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdncp\" (UniqueName: \"kubernetes.io/projected/0b0abd6f-4fd6-4507-8122-18555489341a-kube-api-access-pdncp\") pod \"kube-auth-proxy-7c56dfbf59-9vjlz\" (UID: \"0b0abd6f-4fd6-4507-8122-18555489341a\") " pod="openshift-ingress/kube-auth-proxy-7c56dfbf59-9vjlz"
Jul 31 22:05:03.236451 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:05:03.236393    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b0abd6f-4fd6-4507-8122-18555489341a-tls-certs\") pod \"kube-auth-proxy-7c56dfbf59-9vjlz\" (UID: \"0b0abd6f-4fd6-4507-8122-18555489341a\") " pod="openshift-ingress/kube-auth-proxy-7c56dfbf59-9vjlz"
Jul 31 22:05:03.238622 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:05:03.238596    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b0abd6f-4fd6-4507-8122-18555489341a-tls-certs\") pod \"kube-auth-proxy-7c56dfbf59-9vjlz\" (UID: \"0b0abd6f-4fd6-4507-8122-18555489341a\") " pod="openshift-ingress/kube-auth-proxy-7c56dfbf59-9vjlz"
Jul 31 22:05:03.472396 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:05:03.472367    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c56dfbf59-9vjlz"
Jul 31 22:05:03.597124 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:05:03.597101    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c56dfbf59-9vjlz"]
Jul 31 22:05:03.599604 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:05:03.599580    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b0abd6f_4fd6_4507_8122_18555489341a.slice/crio-be1c71113659aa9656e2bf26564b6d3589c973c82df451638d6e26b604665e15 WatchSource:0}: Error finding container be1c71113659aa9656e2bf26564b6d3589c973c82df451638d6e26b604665e15: Status 404 returned error can't find the container with id be1c71113659aa9656e2bf26564b6d3589c973c82df451638d6e26b604665e15
Jul 31 22:05:03.601269 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:05:03.601254    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 22:05:04.535843 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:05:04.535804    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c56dfbf59-9vjlz" event={"ID":"0b0abd6f-4fd6-4507-8122-18555489341a","Type":"ContainerStarted","Data":"be1c71113659aa9656e2bf26564b6d3589c973c82df451638d6e26b604665e15"}
Jul 31 22:05:05.503355 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:05:05.503289    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5587bd887b-jtdvw"
Jul 31 22:05:07.550050 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:05:07.550015    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c56dfbf59-9vjlz" event={"ID":"0b0abd6f-4fd6-4507-8122-18555489341a","Type":"ContainerStarted","Data":"8d624c50689337746b1329dc30d4ea42dfe783cf0c196955a8194726fe9032fa"}
Jul 31 22:05:07.568050 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:05:07.567999    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7c56dfbf59-9vjlz" podStartSLOduration=2.667795909 podStartE2EDuration="5.567983915s" totalImagesPullingTime="2.900188006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:05:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:05:07.56632155 +0000 UTC m=+316.661612686" watchObservedRunningTime="2026-07-31 22:05:07.567983915 +0000 UTC m=+316.663275060"
Jul 31 22:06:14.943687 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:14.943654    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-r9ntg"]
Jul 31 22:06:14.946772 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:14.946756    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-r9ntg"
Jul 31 22:06:14.950536 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:14.950514    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 31 22:06:14.950671 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:14.950577    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 31 22:06:14.950730 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:14.950679    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 31 22:06:14.951400 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:14.951384    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-nph42\""
Jul 31 22:06:14.959101 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:14.959079    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-r9ntg"]
Jul 31 22:06:15.030933 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:15.030911    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z4fc\" (UniqueName: \"kubernetes.io/projected/e4432794-a562-4700-94ef-ba19be9eac7b-kube-api-access-4z4fc\") pod \"dns-operator-controller-manager-5985564776-r9ntg\" (UID: \"e4432794-a562-4700-94ef-ba19be9eac7b\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-r9ntg"
Jul 31 22:06:15.131262 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:15.131227    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z4fc\" (UniqueName: \"kubernetes.io/projected/e4432794-a562-4700-94ef-ba19be9eac7b-kube-api-access-4z4fc\") pod \"dns-operator-controller-manager-5985564776-r9ntg\" (UID: \"e4432794-a562-4700-94ef-ba19be9eac7b\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-r9ntg"
Jul 31 22:06:15.142354 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:15.142331    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z4fc\" (UniqueName: \"kubernetes.io/projected/e4432794-a562-4700-94ef-ba19be9eac7b-kube-api-access-4z4fc\") pod \"dns-operator-controller-manager-5985564776-r9ntg\" (UID: \"e4432794-a562-4700-94ef-ba19be9eac7b\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-r9ntg"
Jul 31 22:06:15.256387 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:15.256294    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-r9ntg"
Jul 31 22:06:15.392472 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:15.392446    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-r9ntg"]
Jul 31 22:06:15.395411 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:06:15.395385    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4432794_a562_4700_94ef_ba19be9eac7b.slice/crio-b24540f4b860267d321ce2fce71de56620adaf07bbf4fe319b80d86f1db814f8 WatchSource:0}: Error finding container b24540f4b860267d321ce2fce71de56620adaf07bbf4fe319b80d86f1db814f8: Status 404 returned error can't find the container with id b24540f4b860267d321ce2fce71de56620adaf07bbf4fe319b80d86f1db814f8
Jul 31 22:06:15.780983 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:15.780937    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-r9ntg" event={"ID":"e4432794-a562-4700-94ef-ba19be9eac7b","Type":"ContainerStarted","Data":"b24540f4b860267d321ce2fce71de56620adaf07bbf4fe319b80d86f1db814f8"}
Jul 31 22:06:15.897660 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:15.897635    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c796bbf97-5mxxq"]
Jul 31 22:06:15.902124 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:15.902104    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c796bbf97-5mxxq"
Jul 31 22:06:15.906180 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:15.906158    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 31 22:06:15.906484 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:15.906471    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 31 22:06:15.906724 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:15.906710    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 31 22:06:15.906808 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:15.906790    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 31 22:06:15.907527 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:15.907496    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 31 22:06:15.907527 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:15.907496    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-prjdv\""
Jul 31 22:06:15.907696 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:15.907517    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 31 22:06:15.908925 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:15.908909    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 31 22:06:15.913017 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:15.912995    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 31 22:06:15.925135 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:15.925116    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c796bbf97-5mxxq"]
Jul 31 22:06:15.936603 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:15.936582    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11f29361-5a98-40d8-b399-fde5bf3c294e-trusted-ca-bundle\") pod \"console-7c796bbf97-5mxxq\" (UID: \"11f29361-5a98-40d8-b399-fde5bf3c294e\") " pod="openshift-console/console-7c796bbf97-5mxxq"
Jul 31 22:06:15.936713 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:15.936625    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sszbv\" (UniqueName: \"kubernetes.io/projected/11f29361-5a98-40d8-b399-fde5bf3c294e-kube-api-access-sszbv\") pod \"console-7c796bbf97-5mxxq\" (UID: \"11f29361-5a98-40d8-b399-fde5bf3c294e\") " pod="openshift-console/console-7c796bbf97-5mxxq"
Jul 31 22:06:15.936713 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:15.936696    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11f29361-5a98-40d8-b399-fde5bf3c294e-console-config\") pod \"console-7c796bbf97-5mxxq\" (UID: \"11f29361-5a98-40d8-b399-fde5bf3c294e\") " pod="openshift-console/console-7c796bbf97-5mxxq"
Jul 31 22:06:15.936828 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:15.936730    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11f29361-5a98-40d8-b399-fde5bf3c294e-service-ca\") pod \"console-7c796bbf97-5mxxq\" (UID: \"11f29361-5a98-40d8-b399-fde5bf3c294e\") " pod="openshift-console/console-7c796bbf97-5mxxq"
Jul 31 22:06:15.936828 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:15.936767    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11f29361-5a98-40d8-b399-fde5bf3c294e-console-oauth-config\") pod \"console-7c796bbf97-5mxxq\" (UID: \"11f29361-5a98-40d8-b399-fde5bf3c294e\") " pod="openshift-console/console-7c796bbf97-5mxxq"
Jul 31 22:06:15.936929 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:15.936850    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11f29361-5a98-40d8-b399-fde5bf3c294e-console-serving-cert\") pod \"console-7c796bbf97-5mxxq\" (UID: \"11f29361-5a98-40d8-b399-fde5bf3c294e\") " pod="openshift-console/console-7c796bbf97-5mxxq"
Jul 31 22:06:15.936929 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:15.936874    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11f29361-5a98-40d8-b399-fde5bf3c294e-oauth-serving-cert\") pod \"console-7c796bbf97-5mxxq\" (UID: \"11f29361-5a98-40d8-b399-fde5bf3c294e\") " pod="openshift-console/console-7c796bbf97-5mxxq"
Jul 31 22:06:16.037417 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:16.037372    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11f29361-5a98-40d8-b399-fde5bf3c294e-console-serving-cert\") pod \"console-7c796bbf97-5mxxq\" (UID: \"11f29361-5a98-40d8-b399-fde5bf3c294e\") " pod="openshift-console/console-7c796bbf97-5mxxq"
Jul 31 22:06:16.037417 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:16.037396    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11f29361-5a98-40d8-b399-fde5bf3c294e-oauth-serving-cert\") pod \"console-7c796bbf97-5mxxq\" (UID: \"11f29361-5a98-40d8-b399-fde5bf3c294e\") " pod="openshift-console/console-7c796bbf97-5mxxq"
Jul 31 22:06:16.037824 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:16.037418    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11f29361-5a98-40d8-b399-fde5bf3c294e-trusted-ca-bundle\") pod \"console-7c796bbf97-5mxxq\" (UID: \"11f29361-5a98-40d8-b399-fde5bf3c294e\") " pod="openshift-console/console-7c796bbf97-5mxxq"
Jul 31 22:06:16.037824 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:16.037436    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sszbv\" (UniqueName: \"kubernetes.io/projected/11f29361-5a98-40d8-b399-fde5bf3c294e-kube-api-access-sszbv\") pod \"console-7c796bbf97-5mxxq\" (UID: \"11f29361-5a98-40d8-b399-fde5bf3c294e\") " pod="openshift-console/console-7c796bbf97-5mxxq"
Jul 31 22:06:16.037824 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:16.037472    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11f29361-5a98-40d8-b399-fde5bf3c294e-console-config\") pod \"console-7c796bbf97-5mxxq\" (UID: \"11f29361-5a98-40d8-b399-fde5bf3c294e\") " pod="openshift-console/console-7c796bbf97-5mxxq"
Jul 31 22:06:16.037824 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:16.037490    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11f29361-5a98-40d8-b399-fde5bf3c294e-service-ca\") pod \"console-7c796bbf97-5mxxq\" (UID: \"11f29361-5a98-40d8-b399-fde5bf3c294e\") " pod="openshift-console/console-7c796bbf97-5mxxq"
Jul 31 22:06:16.037824 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:16.037707    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11f29361-5a98-40d8-b399-fde5bf3c294e-console-oauth-config\") pod \"console-7c796bbf97-5mxxq\" (UID: \"11f29361-5a98-40d8-b399-fde5bf3c294e\") " pod="openshift-console/console-7c796bbf97-5mxxq"
Jul 31 22:06:16.038201 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:16.038151    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11f29361-5a98-40d8-b399-fde5bf3c294e-oauth-serving-cert\") pod \"console-7c796bbf97-5mxxq\" (UID: \"11f29361-5a98-40d8-b399-fde5bf3c294e\") " pod="openshift-console/console-7c796bbf97-5mxxq"
Jul 31 22:06:16.038201 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:16.038176    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11f29361-5a98-40d8-b399-fde5bf3c294e-service-ca\") pod \"console-7c796bbf97-5mxxq\" (UID: \"11f29361-5a98-40d8-b399-fde5bf3c294e\") " pod="openshift-console/console-7c796bbf97-5mxxq"
Jul 31 22:06:16.038296 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:16.038233    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11f29361-5a98-40d8-b399-fde5bf3c294e-console-config\") pod \"console-7c796bbf97-5mxxq\" (UID: \"11f29361-5a98-40d8-b399-fde5bf3c294e\") " pod="openshift-console/console-7c796bbf97-5mxxq"
Jul 31 22:06:16.038550 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:16.038530    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11f29361-5a98-40d8-b399-fde5bf3c294e-trusted-ca-bundle\") pod \"console-7c796bbf97-5mxxq\" (UID: \"11f29361-5a98-40d8-b399-fde5bf3c294e\") " pod="openshift-console/console-7c796bbf97-5mxxq"
Jul 31 22:06:16.039911 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:16.039889    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11f29361-5a98-40d8-b399-fde5bf3c294e-console-serving-cert\") pod \"console-7c796bbf97-5mxxq\" (UID: \"11f29361-5a98-40d8-b399-fde5bf3c294e\") " pod="openshift-console/console-7c796bbf97-5mxxq"
Jul 31 22:06:16.040067 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:16.040047    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11f29361-5a98-40d8-b399-fde5bf3c294e-console-oauth-config\") pod \"console-7c796bbf97-5mxxq\" (UID: \"11f29361-5a98-40d8-b399-fde5bf3c294e\") " pod="openshift-console/console-7c796bbf97-5mxxq"
Jul 31 22:06:16.046800 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:16.046782    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sszbv\" (UniqueName: \"kubernetes.io/projected/11f29361-5a98-40d8-b399-fde5bf3c294e-kube-api-access-sszbv\") pod \"console-7c796bbf97-5mxxq\" (UID: \"11f29361-5a98-40d8-b399-fde5bf3c294e\") " pod="openshift-console/console-7c796bbf97-5mxxq"
Jul 31 22:06:16.211848 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:16.211826    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c796bbf97-5mxxq"
Jul 31 22:06:16.345557 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:16.345531    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c796bbf97-5mxxq"]
Jul 31 22:06:16.348515 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:06:16.348485    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11f29361_5a98_40d8_b399_fde5bf3c294e.slice/crio-e4dedefa88932962e6b2b77a59d7d104b3d1cabfdbe2ae488684d6f9a61696ea WatchSource:0}: Error finding container e4dedefa88932962e6b2b77a59d7d104b3d1cabfdbe2ae488684d6f9a61696ea: Status 404 returned error can't find the container with id e4dedefa88932962e6b2b77a59d7d104b3d1cabfdbe2ae488684d6f9a61696ea
Jul 31 22:06:16.786776 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:16.786741    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c796bbf97-5mxxq" event={"ID":"11f29361-5a98-40d8-b399-fde5bf3c294e","Type":"ContainerStarted","Data":"17f97fde89d4bac548ac2ae128840bd36c2991d2923b0e0389f5a1b8fd854352"}
Jul 31 22:06:16.786939 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:16.786795    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c796bbf97-5mxxq" event={"ID":"11f29361-5a98-40d8-b399-fde5bf3c294e","Type":"ContainerStarted","Data":"e4dedefa88932962e6b2b77a59d7d104b3d1cabfdbe2ae488684d6f9a61696ea"}
Jul 31 22:06:16.815682 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:16.815629    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c796bbf97-5mxxq" podStartSLOduration=1.8156084749999999 podStartE2EDuration="1.815608475s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:06:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:06:16.813629598 +0000 UTC m=+385.908920745" watchObservedRunningTime="2026-07-31 22:06:16.815608475 +0000 UTC m=+385.910899621"
Jul 31 22:06:17.273168 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:17.273138    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-nq8kc"]
Jul 31 22:06:17.288980 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:17.288954    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-nq8kc"
Jul 31 22:06:17.290540 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:17.290513    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-nq8kc"]
Jul 31 22:06:17.293127 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:17.293102    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-hbglt\""
Jul 31 22:06:17.347948 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:17.347920    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm8lr\" (UniqueName: \"kubernetes.io/projected/3ff4297a-0732-4d67-9cfa-17dddf6fd031-kube-api-access-dm8lr\") pod \"limitador-operator-controller-manager-6c549b6d85-nq8kc\" (UID: \"3ff4297a-0732-4d67-9cfa-17dddf6fd031\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-nq8kc"
Jul 31 22:06:17.449295 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:17.449256    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm8lr\" (UniqueName: \"kubernetes.io/projected/3ff4297a-0732-4d67-9cfa-17dddf6fd031-kube-api-access-dm8lr\") pod \"limitador-operator-controller-manager-6c549b6d85-nq8kc\" (UID: \"3ff4297a-0732-4d67-9cfa-17dddf6fd031\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-nq8kc"
Jul 31 22:06:17.459150 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:17.459127    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm8lr\" (UniqueName: \"kubernetes.io/projected/3ff4297a-0732-4d67-9cfa-17dddf6fd031-kube-api-access-dm8lr\") pod \"limitador-operator-controller-manager-6c549b6d85-nq8kc\" (UID: \"3ff4297a-0732-4d67-9cfa-17dddf6fd031\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-nq8kc"
Jul 31 22:06:17.601060 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:17.600990    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-nq8kc"
Jul 31 22:06:18.038752 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:18.037216    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-6jzb9"]
Jul 31 22:06:18.043567 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:18.043544    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-6jzb9"
Jul 31 22:06:18.046615 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:18.046590    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 31 22:06:18.046615 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:18.046611    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8wdfd\""
Jul 31 22:06:18.047546 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:18.047496    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 31 22:06:18.055873 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:18.055850    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-6jzb9"]
Jul 31 22:06:18.056286 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:18.055521    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4e3a8daf-65c1-4830-9a80-456b21b9c59b-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-6jzb9\" (UID: \"4e3a8daf-65c1-4830-9a80-456b21b9c59b\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-6jzb9"
Jul 31 22:06:18.056286 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:18.056132    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct687\" (UniqueName: \"kubernetes.io/projected/4e3a8daf-65c1-4830-9a80-456b21b9c59b-kube-api-access-ct687\") pod \"kuadrant-console-plugin-598f86468b-6jzb9\" (UID: \"4e3a8daf-65c1-4830-9a80-456b21b9c59b\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-6jzb9"
Jul 31 22:06:18.056286 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:18.056185    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e3a8daf-65c1-4830-9a80-456b21b9c59b-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-6jzb9\" (UID: \"4e3a8daf-65c1-4830-9a80-456b21b9c59b\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-6jzb9"
Jul 31 22:06:18.090209 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:18.090178    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-nq8kc"]
Jul 31 22:06:18.094719 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:06:18.094688    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ff4297a_0732_4d67_9cfa_17dddf6fd031.slice/crio-427c2a52825b9dc303f18078db434bd16ae395ce8293955a561e2b76c612f4e5 WatchSource:0}: Error finding container 427c2a52825b9dc303f18078db434bd16ae395ce8293955a561e2b76c612f4e5: Status 404 returned error can't find the container with id 427c2a52825b9dc303f18078db434bd16ae395ce8293955a561e2b76c612f4e5
Jul 31 22:06:18.159917 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:18.159854    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4e3a8daf-65c1-4830-9a80-456b21b9c59b-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-6jzb9\" (UID: \"4e3a8daf-65c1-4830-9a80-456b21b9c59b\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-6jzb9"
Jul 31 22:06:18.160041 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:18.159919    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct687\" (UniqueName: \"kubernetes.io/projected/4e3a8daf-65c1-4830-9a80-456b21b9c59b-kube-api-access-ct687\") pod \"kuadrant-console-plugin-598f86468b-6jzb9\" (UID: \"4e3a8daf-65c1-4830-9a80-456b21b9c59b\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-6jzb9"
Jul 31 22:06:18.160041 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:18.159961    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e3a8daf-65c1-4830-9a80-456b21b9c59b-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-6jzb9\" (UID: \"4e3a8daf-65c1-4830-9a80-456b21b9c59b\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-6jzb9"
Jul 31 22:06:18.160154 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:06:18.160072    2573 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 31 22:06:18.160154 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:06:18.160134    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e3a8daf-65c1-4830-9a80-456b21b9c59b-plugin-serving-cert podName:4e3a8daf-65c1-4830-9a80-456b21b9c59b nodeName:}" failed. No retries permitted until 2026-07-31 22:06:18.660113367 +0000 UTC m=+387.755404490 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/4e3a8daf-65c1-4830-9a80-456b21b9c59b-plugin-serving-cert") pod "kuadrant-console-plugin-598f86468b-6jzb9" (UID: "4e3a8daf-65c1-4830-9a80-456b21b9c59b") : secret "plugin-serving-cert" not found
Jul 31 22:06:18.160574 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:18.160551    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4e3a8daf-65c1-4830-9a80-456b21b9c59b-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-6jzb9\" (UID: \"4e3a8daf-65c1-4830-9a80-456b21b9c59b\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-6jzb9"
Jul 31 22:06:18.170544 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:18.170513    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct687\" (UniqueName: \"kubernetes.io/projected/4e3a8daf-65c1-4830-9a80-456b21b9c59b-kube-api-access-ct687\") pod \"kuadrant-console-plugin-598f86468b-6jzb9\" (UID: \"4e3a8daf-65c1-4830-9a80-456b21b9c59b\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-6jzb9"
Jul 31 22:06:18.665383 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:18.665356    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e3a8daf-65c1-4830-9a80-456b21b9c59b-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-6jzb9\" (UID: \"4e3a8daf-65c1-4830-9a80-456b21b9c59b\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-6jzb9"
Jul 31 22:06:18.667456 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:18.667437    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e3a8daf-65c1-4830-9a80-456b21b9c59b-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-6jzb9\" (UID: \"4e3a8daf-65c1-4830-9a80-456b21b9c59b\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-6jzb9"
Jul 31 22:06:18.718674 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:18.718649    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-6jzb9"
Jul 31 22:06:18.800208 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:18.799954    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-r9ntg" event={"ID":"e4432794-a562-4700-94ef-ba19be9eac7b","Type":"ContainerStarted","Data":"0b9961b91ce245271e73316e91c005a312375bbb71a6b845f4a7870eb1585fb8"}
Jul 31 22:06:18.800208 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:18.800067    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-r9ntg"
Jul 31 22:06:18.801447 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:18.801411    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-nq8kc" event={"ID":"3ff4297a-0732-4d67-9cfa-17dddf6fd031","Type":"ContainerStarted","Data":"427c2a52825b9dc303f18078db434bd16ae395ce8293955a561e2b76c612f4e5"}
Jul 31 22:06:18.844811 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:18.844764    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-5985564776-r9ntg" podStartSLOduration=2.225444531 podStartE2EDuration="4.844748081s" totalImagesPullingTime="2.61930355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:06:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:06:18.843996372 +0000 UTC m=+387.939287518" watchObservedRunningTime="2026-07-31 22:06:18.844748081 +0000 UTC m=+387.940039225"
Jul 31 22:06:18.859035 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:18.859013    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-6jzb9"]
Jul 31 22:06:18.861944 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:06:18.861923    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4e3a8daf_65c1_4830_9a80_456b21b9c59b.slice/crio-f403026cd64001cb0443e756118328459aae46b1ea08abc19095ed1a27d1119c WatchSource:0}: Error finding container f403026cd64001cb0443e756118328459aae46b1ea08abc19095ed1a27d1119c: Status 404 returned error can't find the container with id f403026cd64001cb0443e756118328459aae46b1ea08abc19095ed1a27d1119c
Jul 31 22:06:19.811659 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:19.811597    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-6jzb9" event={"ID":"4e3a8daf-65c1-4830-9a80-456b21b9c59b","Type":"ContainerStarted","Data":"f403026cd64001cb0443e756118328459aae46b1ea08abc19095ed1a27d1119c"}
Jul 31 22:06:20.818683 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:20.818641    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-nq8kc" event={"ID":"3ff4297a-0732-4d67-9cfa-17dddf6fd031","Type":"ContainerStarted","Data":"5667074e2606096354c81f2fedc0492f25eafc6141459e4ba61135f098fd39e2"}
Jul 31 22:06:20.819135 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:20.818763    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-nq8kc"
Jul 31 22:06:20.852157 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:20.852115    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-nq8kc" podStartSLOduration=1.958290517 podStartE2EDuration="3.852101148s" totalImagesPullingTime="1.893810631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:06:20.849040507 +0000 UTC m=+389.944331652" watchObservedRunningTime="2026-07-31 22:06:20.852101148 +0000 UTC m=+389.947392283"
Jul 31 22:06:23.836498 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:23.836466    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-6jzb9" event={"ID":"4e3a8daf-65c1-4830-9a80-456b21b9c59b","Type":"ContainerStarted","Data":"62bf28bfbe918df1afc7acba0df01cb2e90e16a0ac2d1d3dd3d630ff6c426969"}
Jul 31 22:06:23.862276 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:23.862235    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-6jzb9" podStartSLOduration=1.480656543 podStartE2EDuration="5.862219598s" totalImagesPullingTime="4.381563055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:06:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:06:23.860638168 +0000 UTC m=+392.955929312" watchObservedRunningTime="2026-07-31 22:06:23.862219598 +0000 UTC m=+392.957510743"
Jul 31 22:06:26.212377 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:26.212346    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c796bbf97-5mxxq"
Jul 31 22:06:26.212716 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:26.212415    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c796bbf97-5mxxq"
Jul 31 22:06:26.216640 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:26.216621    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c796bbf97-5mxxq"
Jul 31 22:06:26.853143 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:26.853117    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c796bbf97-5mxxq"
Jul 31 22:06:28.703028 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:28.702999    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-nq8kc"]
Jul 31 22:06:28.703489 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:28.703232    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-nq8kc" podUID="3ff4297a-0732-4d67-9cfa-17dddf6fd031" containerName="manager" containerID="cri-o://5667074e2606096354c81f2fedc0492f25eafc6141459e4ba61135f098fd39e2" gracePeriod=2
Jul 31 22:06:28.705575 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:28.705551    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-nq8kc"
Jul 31 22:06:28.716972 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:28.716919    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-nq8kc"]
Jul 31 22:06:28.761070 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:28.761018    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-t5jvz"]
Jul 31 22:06:28.761423 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:28.761405    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ff4297a-0732-4d67-9cfa-17dddf6fd031" containerName="manager"
Jul 31 22:06:28.761525 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:28.761426    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ff4297a-0732-4d67-9cfa-17dddf6fd031" containerName="manager"
Jul 31 22:06:28.761581 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:28.761538    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ff4297a-0732-4d67-9cfa-17dddf6fd031" containerName="manager"
Jul 31 22:06:28.764279 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:28.764261    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-t5jvz"
Jul 31 22:06:28.768683 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:06:28.768656    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-nq8kc\" is forbidden: User \"system:node:ip-10-0-130-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-191.ec2.internal' and this object" podUID="3ff4297a-0732-4d67-9cfa-17dddf6fd031" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-nq8kc"
Jul 31 22:06:28.783470 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:28.783450    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-t5jvz"]
Jul 31 22:06:28.846628 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:28.846600    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtdd2\" (UniqueName: \"kubernetes.io/projected/ff26f818-97e3-4f3c-b350-a7e83857b998-kube-api-access-xtdd2\") pod \"limitador-operator-controller-manager-6c549b6d85-t5jvz\" (UID: \"ff26f818-97e3-4f3c-b350-a7e83857b998\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-t5jvz"
Jul 31 22:06:28.861627 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:28.861601    2573 generic.go:356] "Generic (PLEG): container finished" podID="3ff4297a-0732-4d67-9cfa-17dddf6fd031" containerID="5667074e2606096354c81f2fedc0492f25eafc6141459e4ba61135f098fd39e2" exitCode=0
Jul 31 22:06:28.932392 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:28.932373    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-nq8kc"
Jul 31 22:06:28.934929 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:06:28.934903    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-nq8kc\" is forbidden: User \"system:node:ip-10-0-130-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-191.ec2.internal' and this object" podUID="3ff4297a-0732-4d67-9cfa-17dddf6fd031" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-nq8kc"
Jul 31 22:06:28.947271 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:28.947251    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtdd2\" (UniqueName: \"kubernetes.io/projected/ff26f818-97e3-4f3c-b350-a7e83857b998-kube-api-access-xtdd2\") pod \"limitador-operator-controller-manager-6c549b6d85-t5jvz\" (UID: \"ff26f818-97e3-4f3c-b350-a7e83857b998\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-t5jvz"
Jul 31 22:06:28.958140 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:28.958085    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtdd2\" (UniqueName: \"kubernetes.io/projected/ff26f818-97e3-4f3c-b350-a7e83857b998-kube-api-access-xtdd2\") pod \"limitador-operator-controller-manager-6c549b6d85-t5jvz\" (UID: \"ff26f818-97e3-4f3c-b350-a7e83857b998\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-t5jvz"
Jul 31 22:06:29.048254 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:29.048235    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dm8lr\" (UniqueName: \"kubernetes.io/projected/3ff4297a-0732-4d67-9cfa-17dddf6fd031-kube-api-access-dm8lr\") pod \"3ff4297a-0732-4d67-9cfa-17dddf6fd031\" (UID: \"3ff4297a-0732-4d67-9cfa-17dddf6fd031\") "
Jul 31 22:06:29.050088 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:29.050064    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ff4297a-0732-4d67-9cfa-17dddf6fd031-kube-api-access-dm8lr" (OuterVolumeSpecName: "kube-api-access-dm8lr") pod "3ff4297a-0732-4d67-9cfa-17dddf6fd031" (UID: "3ff4297a-0732-4d67-9cfa-17dddf6fd031"). InnerVolumeSpecName "kube-api-access-dm8lr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:06:29.078209 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:29.078188    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-t5jvz"
Jul 31 22:06:29.149485 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:29.149462    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dm8lr\" (UniqueName: \"kubernetes.io/projected/3ff4297a-0732-4d67-9cfa-17dddf6fd031-kube-api-access-dm8lr\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:06:29.202192 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:29.202166    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-t5jvz"]
Jul 31 22:06:29.204972 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:06:29.204950    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff26f818_97e3_4f3c_b350_a7e83857b998.slice/crio-cc56384f62f9e9838267a92a783cb22c0d019de3fdac9859a556dad4e1c737f9 WatchSource:0}: Error finding container cc56384f62f9e9838267a92a783cb22c0d019de3fdac9859a556dad4e1c737f9: Status 404 returned error can't find the container with id cc56384f62f9e9838267a92a783cb22c0d019de3fdac9859a556dad4e1c737f9
Jul 31 22:06:29.334697 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:29.334665    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ff4297a-0732-4d67-9cfa-17dddf6fd031" path="/var/lib/kubelet/pods/3ff4297a-0732-4d67-9cfa-17dddf6fd031/volumes"
Jul 31 22:06:29.813853 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:29.813825    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-r9ntg"
Jul 31 22:06:29.868053 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:29.868025    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-t5jvz" event={"ID":"ff26f818-97e3-4f3c-b350-a7e83857b998","Type":"ContainerStarted","Data":"05281455ded2b418d6dfef0c95d7e87919374e1c7149b406dc83e04165d09b41"}
Jul 31 22:06:29.868204 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:29.868073    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-t5jvz" event={"ID":"ff26f818-97e3-4f3c-b350-a7e83857b998","Type":"ContainerStarted","Data":"cc56384f62f9e9838267a92a783cb22c0d019de3fdac9859a556dad4e1c737f9"}
Jul 31 22:06:29.868204 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:29.868152    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-t5jvz"
Jul 31 22:06:29.869663 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:29.869642    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-nq8kc"
Jul 31 22:06:29.869796 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:29.869674    2573 scope.go:117] "RemoveContainer" containerID="5667074e2606096354c81f2fedc0492f25eafc6141459e4ba61135f098fd39e2"
Jul 31 22:06:29.914523 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:29.914473    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-t5jvz" podStartSLOduration=1.9144598560000001 podStartE2EDuration="1.914459856s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:06:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:06:29.913669911 +0000 UTC m=+399.008961078" watchObservedRunningTime="2026-07-31 22:06:29.914459856 +0000 UTC m=+399.009751002"
Jul 31 22:06:40.876354 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:06:40.876323    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-t5jvz"
Jul 31 22:07:01.898484 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:01.898452    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b54df94b4-bm2hd"]
Jul 31 22:07:01.922451 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:01.922425    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-bm2hd"]
Jul 31 22:07:01.922593 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:01.922508    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-bm2hd"
Jul 31 22:07:01.925618 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:01.925596    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-bxqgr\""
Jul 31 22:07:02.010292 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:02.010268    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c548b5d7d-zrj62"]
Jul 31 22:07:02.013439 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:02.013423    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-zrj62"
Jul 31 22:07:02.020057 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:02.020034    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvk89\" (UniqueName: \"kubernetes.io/projected/99be3645-c27e-4506-8935-e20f5e9bd071-kube-api-access-lvk89\") pod \"authorino-b54df94b4-bm2hd\" (UID: \"99be3645-c27e-4506-8935-e20f5e9bd071\") " pod="kuadrant-system/authorino-b54df94b4-bm2hd"
Jul 31 22:07:02.021004 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:02.020985    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-zrj62"]
Jul 31 22:07:02.120772 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:02.120747    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvk89\" (UniqueName: \"kubernetes.io/projected/99be3645-c27e-4506-8935-e20f5e9bd071-kube-api-access-lvk89\") pod \"authorino-b54df94b4-bm2hd\" (UID: \"99be3645-c27e-4506-8935-e20f5e9bd071\") " pod="kuadrant-system/authorino-b54df94b4-bm2hd"
Jul 31 22:07:02.120931 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:02.120794    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brm2j\" (UniqueName: \"kubernetes.io/projected/17253080-e033-4ecd-aebc-ed9d2ad0520f-kube-api-access-brm2j\") pod \"authorino-c548b5d7d-zrj62\" (UID: \"17253080-e033-4ecd-aebc-ed9d2ad0520f\") " pod="kuadrant-system/authorino-c548b5d7d-zrj62"
Jul 31 22:07:02.129522 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:02.129490    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvk89\" (UniqueName: \"kubernetes.io/projected/99be3645-c27e-4506-8935-e20f5e9bd071-kube-api-access-lvk89\") pod \"authorino-b54df94b4-bm2hd\" (UID: \"99be3645-c27e-4506-8935-e20f5e9bd071\") " pod="kuadrant-system/authorino-b54df94b4-bm2hd"
Jul 31 22:07:02.221198 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:02.221173    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brm2j\" (UniqueName: \"kubernetes.io/projected/17253080-e033-4ecd-aebc-ed9d2ad0520f-kube-api-access-brm2j\") pod \"authorino-c548b5d7d-zrj62\" (UID: \"17253080-e033-4ecd-aebc-ed9d2ad0520f\") " pod="kuadrant-system/authorino-c548b5d7d-zrj62"
Jul 31 22:07:02.230285 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:02.230265    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brm2j\" (UniqueName: \"kubernetes.io/projected/17253080-e033-4ecd-aebc-ed9d2ad0520f-kube-api-access-brm2j\") pod \"authorino-c548b5d7d-zrj62\" (UID: \"17253080-e033-4ecd-aebc-ed9d2ad0520f\") " pod="kuadrant-system/authorino-c548b5d7d-zrj62"
Jul 31 22:07:02.231011 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:02.230993    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-bm2hd"
Jul 31 22:07:02.321699 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:02.321671    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-zrj62"
Jul 31 22:07:02.383761 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:02.383732    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-bm2hd"]
Jul 31 22:07:02.387395 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:07:02.387371    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod99be3645_c27e_4506_8935_e20f5e9bd071.slice/crio-dd781fdaeb3207052e48a97a469f6cefa61fc71782e5ca81350bae1b57048981 WatchSource:0}: Error finding container dd781fdaeb3207052e48a97a469f6cefa61fc71782e5ca81350bae1b57048981: Status 404 returned error can't find the container with id dd781fdaeb3207052e48a97a469f6cefa61fc71782e5ca81350bae1b57048981
Jul 31 22:07:02.450269 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:07:02.449511    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod17253080_e033_4ecd_aebc_ed9d2ad0520f.slice/crio-29cb1858498578f2132a30901590cc2a9f1408f0c7dfd197e2ff2c78a60a6499 WatchSource:0}: Error finding container 29cb1858498578f2132a30901590cc2a9f1408f0c7dfd197e2ff2c78a60a6499: Status 404 returned error can't find the container with id 29cb1858498578f2132a30901590cc2a9f1408f0c7dfd197e2ff2c78a60a6499
Jul 31 22:07:02.450473 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:02.450431    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-zrj62"]
Jul 31 22:07:03.003964 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:03.003926    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-bm2hd" event={"ID":"99be3645-c27e-4506-8935-e20f5e9bd071","Type":"ContainerStarted","Data":"dd781fdaeb3207052e48a97a469f6cefa61fc71782e5ca81350bae1b57048981"}
Jul 31 22:07:03.004939 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:03.004920    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-zrj62" event={"ID":"17253080-e033-4ecd-aebc-ed9d2ad0520f","Type":"ContainerStarted","Data":"29cb1858498578f2132a30901590cc2a9f1408f0c7dfd197e2ff2c78a60a6499"}
Jul 31 22:07:05.016394 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:05.016354    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-zrj62" event={"ID":"17253080-e033-4ecd-aebc-ed9d2ad0520f","Type":"ContainerStarted","Data":"1fc8844c49f29fc7762c456b1da1e93703b53a426b172ab5775ba05865e31d90"}
Jul 31 22:07:05.017739 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:05.017716    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-bm2hd" event={"ID":"99be3645-c27e-4506-8935-e20f5e9bd071","Type":"ContainerStarted","Data":"c5d7e56aae47469040f4e8b614b902fa377df77ff0f9ddbd2d7094ef1c1ccb74"}
Jul 31 22:07:05.031092 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:05.031050    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c548b5d7d-zrj62" podStartSLOduration=1.988430606 podStartE2EDuration="4.031036505s" totalImagesPullingTime="2.042605899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:07:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:07:05.030474972 +0000 UTC m=+434.125766119" watchObservedRunningTime="2026-07-31 22:07:05.031036505 +0000 UTC m=+434.126327650"
Jul 31 22:07:05.046194 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:05.046144    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b54df94b4-bm2hd" podStartSLOduration=1.9530082370000001 podStartE2EDuration="4.04612971s" totalImagesPullingTime="2.093121473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:07:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:07:05.044042981 +0000 UTC m=+434.139334129" watchObservedRunningTime="2026-07-31 22:07:05.04612971 +0000 UTC m=+434.141420856"
Jul 31 22:07:05.072932 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:05.072906    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-bm2hd"]
Jul 31 22:07:07.025862 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:07.025817    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b54df94b4-bm2hd" podUID="99be3645-c27e-4506-8935-e20f5e9bd071" containerName="authorino" containerID="cri-o://c5d7e56aae47469040f4e8b614b902fa377df77ff0f9ddbd2d7094ef1c1ccb74" gracePeriod=30
Jul 31 22:07:07.268412 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:07.268386    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-bm2hd"
Jul 31 22:07:07.467382 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:07.467359    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvk89\" (UniqueName: \"kubernetes.io/projected/99be3645-c27e-4506-8935-e20f5e9bd071-kube-api-access-lvk89\") pod \"99be3645-c27e-4506-8935-e20f5e9bd071\" (UID: \"99be3645-c27e-4506-8935-e20f5e9bd071\") "
Jul 31 22:07:07.469375 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:07.469350    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99be3645-c27e-4506-8935-e20f5e9bd071-kube-api-access-lvk89" (OuterVolumeSpecName: "kube-api-access-lvk89") pod "99be3645-c27e-4506-8935-e20f5e9bd071" (UID: "99be3645-c27e-4506-8935-e20f5e9bd071"). InnerVolumeSpecName "kube-api-access-lvk89". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:07:07.568383 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:07.568357    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvk89\" (UniqueName: \"kubernetes.io/projected/99be3645-c27e-4506-8935-e20f5e9bd071-kube-api-access-lvk89\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:07:08.031146 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:08.031113    2573 generic.go:356] "Generic (PLEG): container finished" podID="99be3645-c27e-4506-8935-e20f5e9bd071" containerID="c5d7e56aae47469040f4e8b614b902fa377df77ff0f9ddbd2d7094ef1c1ccb74" exitCode=0
Jul 31 22:07:08.031561 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:08.031156    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-bm2hd"
Jul 31 22:07:08.031561 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:08.031201    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-bm2hd" event={"ID":"99be3645-c27e-4506-8935-e20f5e9bd071","Type":"ContainerDied","Data":"c5d7e56aae47469040f4e8b614b902fa377df77ff0f9ddbd2d7094ef1c1ccb74"}
Jul 31 22:07:08.031561 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:08.031242    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-bm2hd" event={"ID":"99be3645-c27e-4506-8935-e20f5e9bd071","Type":"ContainerDied","Data":"dd781fdaeb3207052e48a97a469f6cefa61fc71782e5ca81350bae1b57048981"}
Jul 31 22:07:08.031561 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:08.031258    2573 scope.go:117] "RemoveContainer" containerID="c5d7e56aae47469040f4e8b614b902fa377df77ff0f9ddbd2d7094ef1c1ccb74"
Jul 31 22:07:08.045377 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:08.045356    2573 scope.go:117] "RemoveContainer" containerID="c5d7e56aae47469040f4e8b614b902fa377df77ff0f9ddbd2d7094ef1c1ccb74"
Jul 31 22:07:08.045656 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:07:08.045636    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5d7e56aae47469040f4e8b614b902fa377df77ff0f9ddbd2d7094ef1c1ccb74\": container with ID starting with c5d7e56aae47469040f4e8b614b902fa377df77ff0f9ddbd2d7094ef1c1ccb74 not found: ID does not exist" containerID="c5d7e56aae47469040f4e8b614b902fa377df77ff0f9ddbd2d7094ef1c1ccb74"
Jul 31 22:07:08.045722 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:08.045668    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5d7e56aae47469040f4e8b614b902fa377df77ff0f9ddbd2d7094ef1c1ccb74"} err="failed to get container status \"c5d7e56aae47469040f4e8b614b902fa377df77ff0f9ddbd2d7094ef1c1ccb74\": rpc error: code = NotFound desc = could not find container \"c5d7e56aae47469040f4e8b614b902fa377df77ff0f9ddbd2d7094ef1c1ccb74\": container with ID starting with c5d7e56aae47469040f4e8b614b902fa377df77ff0f9ddbd2d7094ef1c1ccb74 not found: ID does not exist"
Jul 31 22:07:08.060796 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:08.060770    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-bm2hd"]
Jul 31 22:07:08.062894 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:08.062874    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b54df94b4-bm2hd"]
Jul 31 22:07:09.334549 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:09.334520    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99be3645-c27e-4506-8935-e20f5e9bd071" path="/var/lib/kubelet/pods/99be3645-c27e-4506-8935-e20f5e9bd071/volumes"
Jul 31 22:07:30.298077 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:30.298039    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-cq9s6"]
Jul 31 22:07:30.298517 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:30.298370    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99be3645-c27e-4506-8935-e20f5e9bd071" containerName="authorino"
Jul 31 22:07:30.298517 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:30.298382    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="99be3645-c27e-4506-8935-e20f5e9bd071" containerName="authorino"
Jul 31 22:07:30.298517 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:30.298436    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="99be3645-c27e-4506-8935-e20f5e9bd071" containerName="authorino"
Jul 31 22:07:30.301549 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:30.301529    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-cq9s6"
Jul 31 22:07:30.311128 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:30.311102    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-cq9s6"]
Jul 31 22:07:30.350773 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:30.350744    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpg7v\" (UniqueName: \"kubernetes.io/projected/f15a8165-a2da-4123-8f97-2db67b3d0158-kube-api-access-qpg7v\") pod \"authorino-5dc7ccb5f-cq9s6\" (UID: \"f15a8165-a2da-4123-8f97-2db67b3d0158\") " pod="kuadrant-system/authorino-5dc7ccb5f-cq9s6"
Jul 31 22:07:30.451579 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:30.451542    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpg7v\" (UniqueName: \"kubernetes.io/projected/f15a8165-a2da-4123-8f97-2db67b3d0158-kube-api-access-qpg7v\") pod \"authorino-5dc7ccb5f-cq9s6\" (UID: \"f15a8165-a2da-4123-8f97-2db67b3d0158\") " pod="kuadrant-system/authorino-5dc7ccb5f-cq9s6"
Jul 31 22:07:30.460101 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:30.460071    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpg7v\" (UniqueName: \"kubernetes.io/projected/f15a8165-a2da-4123-8f97-2db67b3d0158-kube-api-access-qpg7v\") pod \"authorino-5dc7ccb5f-cq9s6\" (UID: \"f15a8165-a2da-4123-8f97-2db67b3d0158\") " pod="kuadrant-system/authorino-5dc7ccb5f-cq9s6"
Jul 31 22:07:30.534528 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:30.534494    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-cq9s6"]
Jul 31 22:07:30.534758 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:30.534746    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-cq9s6"
Jul 31 22:07:30.645231 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:30.645201    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5949bb94d7-qvvbg"]
Jul 31 22:07:30.649571 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:30.649549    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5949bb94d7-qvvbg"
Jul 31 22:07:30.652034 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:30.652015    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 31 22:07:30.658469 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:30.658444    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5949bb94d7-qvvbg"]
Jul 31 22:07:30.677221 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:30.677188    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-cq9s6"]
Jul 31 22:07:30.680478 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:07:30.680451    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf15a8165_a2da_4123_8f97_2db67b3d0158.slice/crio-fd14e0a65d7056be6233370d539c78097794c0c8b0ba857bccf0d6d76c725819 WatchSource:0}: Error finding container fd14e0a65d7056be6233370d539c78097794c0c8b0ba857bccf0d6d76c725819: Status 404 returned error can't find the container with id fd14e0a65d7056be6233370d539c78097794c0c8b0ba857bccf0d6d76c725819
Jul 31 22:07:30.755109 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:30.755078    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/57b0e7a1-71dc-42bc-b232-8cc352a5a1c1-tls-cert\") pod \"authorino-5949bb94d7-qvvbg\" (UID: \"57b0e7a1-71dc-42bc-b232-8cc352a5a1c1\") " pod="kuadrant-system/authorino-5949bb94d7-qvvbg"
Jul 31 22:07:30.755276 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:30.755131    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t84sl\" (UniqueName: \"kubernetes.io/projected/57b0e7a1-71dc-42bc-b232-8cc352a5a1c1-kube-api-access-t84sl\") pod \"authorino-5949bb94d7-qvvbg\" (UID: \"57b0e7a1-71dc-42bc-b232-8cc352a5a1c1\") " pod="kuadrant-system/authorino-5949bb94d7-qvvbg"
Jul 31 22:07:30.856486 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:30.856403    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t84sl\" (UniqueName: \"kubernetes.io/projected/57b0e7a1-71dc-42bc-b232-8cc352a5a1c1-kube-api-access-t84sl\") pod \"authorino-5949bb94d7-qvvbg\" (UID: \"57b0e7a1-71dc-42bc-b232-8cc352a5a1c1\") " pod="kuadrant-system/authorino-5949bb94d7-qvvbg"
Jul 31 22:07:30.856486 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:30.856464    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/57b0e7a1-71dc-42bc-b232-8cc352a5a1c1-tls-cert\") pod \"authorino-5949bb94d7-qvvbg\" (UID: \"57b0e7a1-71dc-42bc-b232-8cc352a5a1c1\") " pod="kuadrant-system/authorino-5949bb94d7-qvvbg"
Jul 31 22:07:30.859010 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:30.858986    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/57b0e7a1-71dc-42bc-b232-8cc352a5a1c1-tls-cert\") pod \"authorino-5949bb94d7-qvvbg\" (UID: \"57b0e7a1-71dc-42bc-b232-8cc352a5a1c1\") " pod="kuadrant-system/authorino-5949bb94d7-qvvbg"
Jul 31 22:07:30.864674 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:30.864650    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t84sl\" (UniqueName: \"kubernetes.io/projected/57b0e7a1-71dc-42bc-b232-8cc352a5a1c1-kube-api-access-t84sl\") pod \"authorino-5949bb94d7-qvvbg\" (UID: \"57b0e7a1-71dc-42bc-b232-8cc352a5a1c1\") " pod="kuadrant-system/authorino-5949bb94d7-qvvbg"
Jul 31 22:07:30.959952 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:30.959924    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5949bb94d7-qvvbg"
Jul 31 22:07:31.091324 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:31.091285    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5949bb94d7-qvvbg"]
Jul 31 22:07:31.093878 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:07:31.093851    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57b0e7a1_71dc_42bc_b232_8cc352a5a1c1.slice/crio-5e7aaef76d96a2dd1eac9a15a49b181625b6c856b32f6eb83264490043b2d0b3 WatchSource:0}: Error finding container 5e7aaef76d96a2dd1eac9a15a49b181625b6c856b32f6eb83264490043b2d0b3: Status 404 returned error can't find the container with id 5e7aaef76d96a2dd1eac9a15a49b181625b6c856b32f6eb83264490043b2d0b3
Jul 31 22:07:31.134870 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:31.134841    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5949bb94d7-qvvbg" event={"ID":"57b0e7a1-71dc-42bc-b232-8cc352a5a1c1","Type":"ContainerStarted","Data":"5e7aaef76d96a2dd1eac9a15a49b181625b6c856b32f6eb83264490043b2d0b3"}
Jul 31 22:07:31.135941 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:31.135916    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-cq9s6" event={"ID":"f15a8165-a2da-4123-8f97-2db67b3d0158","Type":"ContainerStarted","Data":"fd14e0a65d7056be6233370d539c78097794c0c8b0ba857bccf0d6d76c725819"}
Jul 31 22:07:32.143037 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:32.143002    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5949bb94d7-qvvbg" event={"ID":"57b0e7a1-71dc-42bc-b232-8cc352a5a1c1","Type":"ContainerStarted","Data":"64aca0dfa8464b06c2b4c25bf8263c1d9e73fd847d75c14b780971e80d509c6d"}
Jul 31 22:07:32.144483 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:32.144457    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-cq9s6" event={"ID":"f15a8165-a2da-4123-8f97-2db67b3d0158","Type":"ContainerStarted","Data":"eb7c0fa328cc2a90c9124bb657240dc8cb91aaa50984fdd1576cde91e4095491"}
Jul 31 22:07:32.144592 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:32.144561    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5dc7ccb5f-cq9s6" podUID="f15a8165-a2da-4123-8f97-2db67b3d0158" containerName="authorino" containerID="cri-o://eb7c0fa328cc2a90c9124bb657240dc8cb91aaa50984fdd1576cde91e4095491" gracePeriod=30
Jul 31 22:07:32.164592 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:32.164545    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5949bb94d7-qvvbg" podStartSLOduration=1.715228727 podStartE2EDuration="2.164528644s" totalImagesPullingTime="449.299917ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:07:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:07:32.163613023 +0000 UTC m=+461.258904170" watchObservedRunningTime="2026-07-31 22:07:32.164528644 +0000 UTC m=+461.259819790"
Jul 31 22:07:32.190021 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:32.189974    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5dc7ccb5f-cq9s6" podStartSLOduration=1.78016453 podStartE2EDuration="2.189957827s" totalImagesPullingTime="409.793297ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:07:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:07:32.188580245 +0000 UTC m=+461.283871389" watchObservedRunningTime="2026-07-31 22:07:32.189957827 +0000 UTC m=+461.285248973"
Jul 31 22:07:32.199827 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:32.199790    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-zrj62"]
Jul 31 22:07:32.200011 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:32.199986    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-c548b5d7d-zrj62" podUID="17253080-e033-4ecd-aebc-ed9d2ad0520f" containerName="authorino" containerID="cri-o://1fc8844c49f29fc7762c456b1da1e93703b53a426b172ab5775ba05865e31d90" gracePeriod=30
Jul 31 22:07:32.450933 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:32.450903    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-cq9s6"
Jul 31 22:07:32.458031 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:32.458013    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-zrj62"
Jul 31 22:07:32.570865 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:32.570829    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brm2j\" (UniqueName: \"kubernetes.io/projected/17253080-e033-4ecd-aebc-ed9d2ad0520f-kube-api-access-brm2j\") pod \"17253080-e033-4ecd-aebc-ed9d2ad0520f\" (UID: \"17253080-e033-4ecd-aebc-ed9d2ad0520f\") "
Jul 31 22:07:32.571026 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:32.570911    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qpg7v\" (UniqueName: \"kubernetes.io/projected/f15a8165-a2da-4123-8f97-2db67b3d0158-kube-api-access-qpg7v\") pod \"f15a8165-a2da-4123-8f97-2db67b3d0158\" (UID: \"f15a8165-a2da-4123-8f97-2db67b3d0158\") "
Jul 31 22:07:32.572975 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:32.572940    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f15a8165-a2da-4123-8f97-2db67b3d0158-kube-api-access-qpg7v" (OuterVolumeSpecName: "kube-api-access-qpg7v") pod "f15a8165-a2da-4123-8f97-2db67b3d0158" (UID: "f15a8165-a2da-4123-8f97-2db67b3d0158"). InnerVolumeSpecName "kube-api-access-qpg7v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:07:32.572975 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:32.572968    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17253080-e033-4ecd-aebc-ed9d2ad0520f-kube-api-access-brm2j" (OuterVolumeSpecName: "kube-api-access-brm2j") pod "17253080-e033-4ecd-aebc-ed9d2ad0520f" (UID: "17253080-e033-4ecd-aebc-ed9d2ad0520f"). InnerVolumeSpecName "kube-api-access-brm2j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:07:32.672457 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:32.672435    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brm2j\" (UniqueName: \"kubernetes.io/projected/17253080-e033-4ecd-aebc-ed9d2ad0520f-kube-api-access-brm2j\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:07:32.672457 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:32.672458    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpg7v\" (UniqueName: \"kubernetes.io/projected/f15a8165-a2da-4123-8f97-2db67b3d0158-kube-api-access-qpg7v\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:07:33.152829 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:33.152693    2573 generic.go:356] "Generic (PLEG): container finished" podID="17253080-e033-4ecd-aebc-ed9d2ad0520f" containerID="1fc8844c49f29fc7762c456b1da1e93703b53a426b172ab5775ba05865e31d90" exitCode=0
Jul 31 22:07:33.152829 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:33.152756    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-zrj62"
Jul 31 22:07:33.153479 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:33.152854    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-zrj62" event={"ID":"17253080-e033-4ecd-aebc-ed9d2ad0520f","Type":"ContainerDied","Data":"1fc8844c49f29fc7762c456b1da1e93703b53a426b172ab5775ba05865e31d90"}
Jul 31 22:07:33.153479 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:33.152903    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-zrj62" event={"ID":"17253080-e033-4ecd-aebc-ed9d2ad0520f","Type":"ContainerDied","Data":"29cb1858498578f2132a30901590cc2a9f1408f0c7dfd197e2ff2c78a60a6499"}
Jul 31 22:07:33.153479 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:33.152926    2573 scope.go:117] "RemoveContainer" containerID="1fc8844c49f29fc7762c456b1da1e93703b53a426b172ab5775ba05865e31d90"
Jul 31 22:07:33.154739 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:33.154716    2573 generic.go:356] "Generic (PLEG): container finished" podID="f15a8165-a2da-4123-8f97-2db67b3d0158" containerID="eb7c0fa328cc2a90c9124bb657240dc8cb91aaa50984fdd1576cde91e4095491" exitCode=0
Jul 31 22:07:33.154851 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:33.154777    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-cq9s6"
Jul 31 22:07:33.154904 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:33.154818    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-cq9s6" event={"ID":"f15a8165-a2da-4123-8f97-2db67b3d0158","Type":"ContainerDied","Data":"eb7c0fa328cc2a90c9124bb657240dc8cb91aaa50984fdd1576cde91e4095491"}
Jul 31 22:07:33.154942 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:33.154905    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-cq9s6" event={"ID":"f15a8165-a2da-4123-8f97-2db67b3d0158","Type":"ContainerDied","Data":"fd14e0a65d7056be6233370d539c78097794c0c8b0ba857bccf0d6d76c725819"}
Jul 31 22:07:33.164636 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:33.164421    2573 scope.go:117] "RemoveContainer" containerID="1fc8844c49f29fc7762c456b1da1e93703b53a426b172ab5775ba05865e31d90"
Jul 31 22:07:33.166127 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:07:33.164770    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fc8844c49f29fc7762c456b1da1e93703b53a426b172ab5775ba05865e31d90\": container with ID starting with 1fc8844c49f29fc7762c456b1da1e93703b53a426b172ab5775ba05865e31d90 not found: ID does not exist" containerID="1fc8844c49f29fc7762c456b1da1e93703b53a426b172ab5775ba05865e31d90"
Jul 31 22:07:33.166127 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:33.164829    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fc8844c49f29fc7762c456b1da1e93703b53a426b172ab5775ba05865e31d90"} err="failed to get container status \"1fc8844c49f29fc7762c456b1da1e93703b53a426b172ab5775ba05865e31d90\": rpc error: code = NotFound desc = could not find container \"1fc8844c49f29fc7762c456b1da1e93703b53a426b172ab5775ba05865e31d90\": container with ID starting with 1fc8844c49f29fc7762c456b1da1e93703b53a426b172ab5775ba05865e31d90 not found: ID does not exist"
Jul 31 22:07:33.166127 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:33.164870    2573 scope.go:117] "RemoveContainer" containerID="eb7c0fa328cc2a90c9124bb657240dc8cb91aaa50984fdd1576cde91e4095491"
Jul 31 22:07:33.179402 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:33.179263    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-zrj62"]
Jul 31 22:07:33.182812 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:33.182785    2573 scope.go:117] "RemoveContainer" containerID="eb7c0fa328cc2a90c9124bb657240dc8cb91aaa50984fdd1576cde91e4095491"
Jul 31 22:07:33.183189 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:07:33.183163    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb7c0fa328cc2a90c9124bb657240dc8cb91aaa50984fdd1576cde91e4095491\": container with ID starting with eb7c0fa328cc2a90c9124bb657240dc8cb91aaa50984fdd1576cde91e4095491 not found: ID does not exist" containerID="eb7c0fa328cc2a90c9124bb657240dc8cb91aaa50984fdd1576cde91e4095491"
Jul 31 22:07:33.183286 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:33.183199    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb7c0fa328cc2a90c9124bb657240dc8cb91aaa50984fdd1576cde91e4095491"} err="failed to get container status \"eb7c0fa328cc2a90c9124bb657240dc8cb91aaa50984fdd1576cde91e4095491\": rpc error: code = NotFound desc = could not find container \"eb7c0fa328cc2a90c9124bb657240dc8cb91aaa50984fdd1576cde91e4095491\": container with ID starting with eb7c0fa328cc2a90c9124bb657240dc8cb91aaa50984fdd1576cde91e4095491 not found: ID does not exist"
Jul 31 22:07:33.185647 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:33.185625    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-zrj62"]
Jul 31 22:07:33.196309 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:33.196280    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-cq9s6"]
Jul 31 22:07:33.200171 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:33.200149    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-cq9s6"]
Jul 31 22:07:33.335743 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:33.335707    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17253080-e033-4ecd-aebc-ed9d2ad0520f" path="/var/lib/kubelet/pods/17253080-e033-4ecd-aebc-ed9d2ad0520f/volumes"
Jul 31 22:07:33.336018 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:07:33.336005    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f15a8165-a2da-4123-8f97-2db67b3d0158" path="/var/lib/kubelet/pods/f15a8165-a2da-4123-8f97-2db67b3d0158/volumes"
Jul 31 22:08:53.644494 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:08:53.644407    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-kkv8m"]
Jul 31 22:08:53.645224 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:08:53.644845    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f15a8165-a2da-4123-8f97-2db67b3d0158" containerName="authorino"
Jul 31 22:08:53.645224 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:08:53.644862    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f15a8165-a2da-4123-8f97-2db67b3d0158" containerName="authorino"
Jul 31 22:08:53.645224 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:08:53.644905    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17253080-e033-4ecd-aebc-ed9d2ad0520f" containerName="authorino"
Jul 31 22:08:53.645224 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:08:53.644913    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="17253080-e033-4ecd-aebc-ed9d2ad0520f" containerName="authorino"
Jul 31 22:08:53.645224 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:08:53.644986    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="17253080-e033-4ecd-aebc-ed9d2ad0520f" containerName="authorino"
Jul 31 22:08:53.645224 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:08:53.644997    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f15a8165-a2da-4123-8f97-2db67b3d0158" containerName="authorino"
Jul 31 22:08:53.648011 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:08:53.647989    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kkv8m"
Jul 31 22:08:53.650811 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:08:53.650791    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 31 22:08:53.650939 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:08:53.650833    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 31 22:08:53.651690 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:08:53.651667    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 31 22:08:53.652003 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:08:53.651981    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8hckp\""
Jul 31 22:08:53.655723 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:08:53.655703    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31b6b38a-3c48-4757-acf2-546476cb5990-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kkv8m\" (UID: \"31b6b38a-3c48-4757-acf2-546476cb5990\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kkv8m"
Jul 31 22:08:53.655830 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:08:53.655735    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31b6b38a-3c48-4757-acf2-546476cb5990-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kkv8m\" (UID: \"31b6b38a-3c48-4757-acf2-546476cb5990\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kkv8m"
Jul 31 22:08:53.655830 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:08:53.655756    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwpkk\" (UniqueName: \"kubernetes.io/projected/31b6b38a-3c48-4757-acf2-546476cb5990-kube-api-access-gwpkk\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kkv8m\" (UID: \"31b6b38a-3c48-4757-acf2-546476cb5990\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kkv8m"
Jul 31 22:08:53.655940 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:08:53.655854    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31b6b38a-3c48-4757-acf2-546476cb5990-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kkv8m\" (UID: \"31b6b38a-3c48-4757-acf2-546476cb5990\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kkv8m"
Jul 31 22:08:53.655940 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:08:53.655897    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31b6b38a-3c48-4757-acf2-546476cb5990-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kkv8m\" (UID: \"31b6b38a-3c48-4757-acf2-546476cb5990\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kkv8m"
Jul 31 22:08:53.655940 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:08:53.655927    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31b6b38a-3c48-4757-acf2-546476cb5990-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kkv8m\" (UID: \"31b6b38a-3c48-4757-acf2-546476cb5990\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kkv8m"
Jul 31 22:08:53.667107 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:08:53.667082    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-kkv8m"]
Jul 31 22:08:53.756230 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:08:53.756198    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31b6b38a-3c48-4757-acf2-546476cb5990-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kkv8m\" (UID: \"31b6b38a-3c48-4757-acf2-546476cb5990\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kkv8m"
Jul 31 22:08:53.756230 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:08:53.756230    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31b6b38a-3c48-4757-acf2-546476cb5990-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kkv8m\" (UID: \"31b6b38a-3c48-4757-acf2-546476cb5990\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kkv8m"
Jul 31 22:08:53.756441 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:08:53.756334    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31b6b38a-3c48-4757-acf2-546476cb5990-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kkv8m\" (UID: \"31b6b38a-3c48-4757-acf2-546476cb5990\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kkv8m"
Jul 31 22:08:53.756441 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:08:53.756385    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31b6b38a-3c48-4757-acf2-546476cb5990-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kkv8m\" (UID: \"31b6b38a-3c48-4757-acf2-546476cb5990\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kkv8m"
Jul 31 22:08:53.756441 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:08:53.756420    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwpkk\" (UniqueName: \"kubernetes.io/projected/31b6b38a-3c48-4757-acf2-546476cb5990-kube-api-access-gwpkk\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kkv8m\" (UID: \"31b6b38a-3c48-4757-acf2-546476cb5990\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kkv8m"
Jul 31 22:08:53.756590 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:08:53.756479    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31b6b38a-3c48-4757-acf2-546476cb5990-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kkv8m\" (UID: \"31b6b38a-3c48-4757-acf2-546476cb5990\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kkv8m"
Jul 31 22:08:53.756682 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:08:53.756649    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31b6b38a-3c48-4757-acf2-546476cb5990-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kkv8m\" (UID: \"31b6b38a-3c48-4757-acf2-546476cb5990\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kkv8m"
Jul 31 22:08:53.756682 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:08:53.756664    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31b6b38a-3c48-4757-acf2-546476cb5990-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kkv8m\" (UID: \"31b6b38a-3c48-4757-acf2-546476cb5990\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kkv8m"
Jul 31 22:08:53.756872 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:08:53.756789    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31b6b38a-3c48-4757-acf2-546476cb5990-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kkv8m\" (UID: \"31b6b38a-3c48-4757-acf2-546476cb5990\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kkv8m"
Jul 31 22:08:53.758564 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:08:53.758541    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31b6b38a-3c48-4757-acf2-546476cb5990-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kkv8m\" (UID: \"31b6b38a-3c48-4757-acf2-546476cb5990\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kkv8m"
Jul 31 22:08:53.758878 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:08:53.758862    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31b6b38a-3c48-4757-acf2-546476cb5990-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kkv8m\" (UID: \"31b6b38a-3c48-4757-acf2-546476cb5990\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kkv8m"
Jul 31 22:08:53.765261 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:08:53.765238    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwpkk\" (UniqueName: \"kubernetes.io/projected/31b6b38a-3c48-4757-acf2-546476cb5990-kube-api-access-gwpkk\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kkv8m\" (UID: \"31b6b38a-3c48-4757-acf2-546476cb5990\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kkv8m"
Jul 31 22:08:53.958712 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:08:53.958662    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kkv8m"
Jul 31 22:08:54.092074 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:08:54.092050    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-kkv8m"]
Jul 31 22:08:54.094154 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:08:54.094111    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31b6b38a_3c48_4757_acf2_546476cb5990.slice/crio-b2832b2282d10d57ed7c11e5615b178256ee9aa5caae4eba8e2abd6ad6478aed WatchSource:0}: Error finding container b2832b2282d10d57ed7c11e5615b178256ee9aa5caae4eba8e2abd6ad6478aed: Status 404 returned error can't find the container with id b2832b2282d10d57ed7c11e5615b178256ee9aa5caae4eba8e2abd6ad6478aed
Jul 31 22:08:54.499220 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:08:54.499102    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kkv8m" event={"ID":"31b6b38a-3c48-4757-acf2-546476cb5990","Type":"ContainerStarted","Data":"b2832b2282d10d57ed7c11e5615b178256ee9aa5caae4eba8e2abd6ad6478aed"}
Jul 31 22:08:56.509249 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:08:56.509215    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kkv8m" event={"ID":"31b6b38a-3c48-4757-acf2-546476cb5990","Type":"ContainerStarted","Data":"16d5e6423c8af87723d2e683f8cd50824da401ada44d548d57c28f365d3bd6d0"}
Jul 31 22:08:56.529013 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:08:56.528966    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kkv8m" podStartSLOduration=1.901139337 podStartE2EDuration="3.528949203s" totalImagesPullingTime="1.627809866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:08:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:08:56.528474042 +0000 UTC m=+545.623765188" watchObservedRunningTime="2026-07-31 22:08:56.528949203 +0000 UTC m=+545.624240348"
Jul 31 22:09:03.959376 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:09:03.959341    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kkv8m"
Jul 31 22:09:03.959913 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:09:03.959422    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kkv8m"
Jul 31 22:09:03.972023 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:09:03.971995    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kkv8m"
Jul 31 22:09:04.563106 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:09:04.563078    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kkv8m"
Jul 31 22:09:23.040269 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:09:23.040239    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-t5znf"]
Jul 31 22:09:23.043681 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:09:23.043662    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t5znf"
Jul 31 22:09:23.046128 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:09:23.046108    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 31 22:09:23.054796 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:09:23.054776    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-t5znf"]
Jul 31 22:09:23.101733 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:09:23.101700    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5fc03870-b0a0-4ece-b4dd-861294624e7a-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-t5znf\" (UID: \"5fc03870-b0a0-4ece-b4dd-861294624e7a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t5znf"
Jul 31 22:09:23.101889 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:09:23.101797    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5fc03870-b0a0-4ece-b4dd-861294624e7a-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-t5znf\" (UID: \"5fc03870-b0a0-4ece-b4dd-861294624e7a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t5znf"
Jul 31 22:09:23.101889 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:09:23.101835    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5fc03870-b0a0-4ece-b4dd-861294624e7a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-t5znf\" (UID: \"5fc03870-b0a0-4ece-b4dd-861294624e7a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t5znf"
Jul 31 22:09:23.101889 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:09:23.101858    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb8n2\" (UniqueName: \"kubernetes.io/projected/5fc03870-b0a0-4ece-b4dd-861294624e7a-kube-api-access-bb8n2\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-t5znf\" (UID: \"5fc03870-b0a0-4ece-b4dd-861294624e7a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t5znf"
Jul 31 22:09:23.102009 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:09:23.101904    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fc03870-b0a0-4ece-b4dd-861294624e7a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-t5znf\" (UID: \"5fc03870-b0a0-4ece-b4dd-861294624e7a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t5znf"
Jul 31 22:09:23.102009 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:09:23.101941    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fc03870-b0a0-4ece-b4dd-861294624e7a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-t5znf\" (UID: \"5fc03870-b0a0-4ece-b4dd-861294624e7a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t5znf"
Jul 31 22:09:23.203316 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:09:23.203269    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5fc03870-b0a0-4ece-b4dd-861294624e7a-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-t5znf\" (UID: \"5fc03870-b0a0-4ece-b4dd-861294624e7a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t5znf"
Jul 31 22:09:23.203484 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:09:23.203324    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5fc03870-b0a0-4ece-b4dd-861294624e7a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-t5znf\" (UID: \"5fc03870-b0a0-4ece-b4dd-861294624e7a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t5znf"
Jul 31 22:09:23.203484 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:09:23.203352    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb8n2\" (UniqueName: \"kubernetes.io/projected/5fc03870-b0a0-4ece-b4dd-861294624e7a-kube-api-access-bb8n2\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-t5znf\" (UID: \"5fc03870-b0a0-4ece-b4dd-861294624e7a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t5znf"
Jul 31 22:09:23.203484 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:09:23.203392    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fc03870-b0a0-4ece-b4dd-861294624e7a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-t5znf\" (UID: \"5fc03870-b0a0-4ece-b4dd-861294624e7a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t5znf"
Jul 31 22:09:23.203484 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:09:23.203444    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fc03870-b0a0-4ece-b4dd-861294624e7a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-t5znf\" (UID: \"5fc03870-b0a0-4ece-b4dd-861294624e7a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t5znf"
Jul 31 22:09:23.203703 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:09:23.203490    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5fc03870-b0a0-4ece-b4dd-861294624e7a-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-t5znf\" (UID: \"5fc03870-b0a0-4ece-b4dd-861294624e7a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t5znf"
Jul 31 22:09:23.203703 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:09:23.203661    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5fc03870-b0a0-4ece-b4dd-861294624e7a-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-t5znf\" (UID: \"5fc03870-b0a0-4ece-b4dd-861294624e7a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t5znf"
Jul 31 22:09:23.203807 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:09:23.203715    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5fc03870-b0a0-4ece-b4dd-861294624e7a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-t5znf\" (UID: \"5fc03870-b0a0-4ece-b4dd-861294624e7a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t5znf"
Jul 31 22:09:23.203807 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:09:23.203762    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fc03870-b0a0-4ece-b4dd-861294624e7a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-t5znf\" (UID: \"5fc03870-b0a0-4ece-b4dd-861294624e7a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t5znf"
Jul 31 22:09:23.205649 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:09:23.205627    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5fc03870-b0a0-4ece-b4dd-861294624e7a-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-t5znf\" (UID: \"5fc03870-b0a0-4ece-b4dd-861294624e7a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t5znf"
Jul 31 22:09:23.206023 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:09:23.205893    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fc03870-b0a0-4ece-b4dd-861294624e7a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-t5znf\" (UID: \"5fc03870-b0a0-4ece-b4dd-861294624e7a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t5znf"
Jul 31 22:09:23.214230 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:09:23.214203    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb8n2\" (UniqueName: \"kubernetes.io/projected/5fc03870-b0a0-4ece-b4dd-861294624e7a-kube-api-access-bb8n2\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-t5znf\" (UID: \"5fc03870-b0a0-4ece-b4dd-861294624e7a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t5znf"
Jul 31 22:09:23.352445 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:09:23.352374    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t5znf"
Jul 31 22:09:23.489573 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:09:23.489546    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-t5znf"]
Jul 31 22:09:23.491431 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:09:23.491406    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5fc03870_b0a0_4ece_b4dd_861294624e7a.slice/crio-66cb80d9c0d2f1061c3dba7fefb453a1f2321b4d8de8431254202594d9ec4f82 WatchSource:0}: Error finding container 66cb80d9c0d2f1061c3dba7fefb453a1f2321b4d8de8431254202594d9ec4f82: Status 404 returned error can't find the container with id 66cb80d9c0d2f1061c3dba7fefb453a1f2321b4d8de8431254202594d9ec4f82
Jul 31 22:09:23.635279 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:09:23.635203    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t5znf" event={"ID":"5fc03870-b0a0-4ece-b4dd-861294624e7a","Type":"ContainerStarted","Data":"66cb80d9c0d2f1061c3dba7fefb453a1f2321b4d8de8431254202594d9ec4f82"}
Jul 31 22:09:24.641349 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:09:24.641288    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t5znf" event={"ID":"5fc03870-b0a0-4ece-b4dd-861294624e7a","Type":"ContainerStarted","Data":"7b44fd229924864af9abdd0ee4243baf1ab95f69c5db8e3f16f64152e38845fe"}
Jul 31 22:09:24.659545 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:09:24.659492    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t5znf" podStartSLOduration=1.479265341 podStartE2EDuration="1.659476415s" totalImagesPullingTime="180.211074ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:09:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:09:24.65834534 +0000 UTC m=+573.753636486" watchObservedRunningTime="2026-07-31 22:09:24.659476415 +0000 UTC m=+573.754767561"
Jul 31 22:09:33.353171 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:09:33.353092    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t5znf"
Jul 31 22:09:33.353548 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:09:33.353195    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t5znf"
Jul 31 22:09:33.365651 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:09:33.365625    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t5znf"
Jul 31 22:09:33.692824 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:09:33.692798    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-t5znf"
Jul 31 22:09:51.239378 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:09:51.239353    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ddp8_79e15037-4ffd-47f1-b983-34f06895b2a3/ovn-acl-logging/0.log"
Jul 31 22:09:51.239882 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:09:51.239756    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ddp8_79e15037-4ffd-47f1-b983-34f06895b2a3/ovn-acl-logging/0.log"
Jul 31 22:10:48.025440 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:10:48.025406    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-744697ddf8-n9frj"]
Jul 31 22:10:48.028722 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:10:48.028703    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-744697ddf8-n9frj"
Jul 31 22:10:48.046295 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:10:48.046272    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-744697ddf8-n9frj"]
Jul 31 22:10:48.111766 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:10:48.111737    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6qz4\" (UniqueName: \"kubernetes.io/projected/ca5506b3-5a71-491a-b47a-ab87715a6a3c-kube-api-access-j6qz4\") pod \"authorino-744697ddf8-n9frj\" (UID: \"ca5506b3-5a71-491a-b47a-ab87715a6a3c\") " pod="kuadrant-system/authorino-744697ddf8-n9frj"
Jul 31 22:10:48.111895 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:10:48.111776    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ca5506b3-5a71-491a-b47a-ab87715a6a3c-tls-cert\") pod \"authorino-744697ddf8-n9frj\" (UID: \"ca5506b3-5a71-491a-b47a-ab87715a6a3c\") " pod="kuadrant-system/authorino-744697ddf8-n9frj"
Jul 31 22:10:48.212362 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:10:48.212332    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6qz4\" (UniqueName: \"kubernetes.io/projected/ca5506b3-5a71-491a-b47a-ab87715a6a3c-kube-api-access-j6qz4\") pod \"authorino-744697ddf8-n9frj\" (UID: \"ca5506b3-5a71-491a-b47a-ab87715a6a3c\") " pod="kuadrant-system/authorino-744697ddf8-n9frj"
Jul 31 22:10:48.212510 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:10:48.212372    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ca5506b3-5a71-491a-b47a-ab87715a6a3c-tls-cert\") pod \"authorino-744697ddf8-n9frj\" (UID: \"ca5506b3-5a71-491a-b47a-ab87715a6a3c\") " pod="kuadrant-system/authorino-744697ddf8-n9frj"
Jul 31 22:10:48.214881 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:10:48.214856    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ca5506b3-5a71-491a-b47a-ab87715a6a3c-tls-cert\") pod \"authorino-744697ddf8-n9frj\" (UID: \"ca5506b3-5a71-491a-b47a-ab87715a6a3c\") " pod="kuadrant-system/authorino-744697ddf8-n9frj"
Jul 31 22:10:48.220628 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:10:48.220600    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6qz4\" (UniqueName: \"kubernetes.io/projected/ca5506b3-5a71-491a-b47a-ab87715a6a3c-kube-api-access-j6qz4\") pod \"authorino-744697ddf8-n9frj\" (UID: \"ca5506b3-5a71-491a-b47a-ab87715a6a3c\") " pod="kuadrant-system/authorino-744697ddf8-n9frj"
Jul 31 22:10:48.337623 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:10:48.337553    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-744697ddf8-n9frj"
Jul 31 22:10:48.464501 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:10:48.464464    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-744697ddf8-n9frj"]
Jul 31 22:10:48.466681 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:10:48.466654    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podca5506b3_5a71_491a_b47a_ab87715a6a3c.slice/crio-86b21e2f293f9cff652f51d6aa1070253d3b818d717ab6ff1ef779fcec3dd5ef WatchSource:0}: Error finding container 86b21e2f293f9cff652f51d6aa1070253d3b818d717ab6ff1ef779fcec3dd5ef: Status 404 returned error can't find the container with id 86b21e2f293f9cff652f51d6aa1070253d3b818d717ab6ff1ef779fcec3dd5ef
Jul 31 22:10:48.467925 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:10:48.467908    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 22:10:49.001559 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:10:49.001528    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-744697ddf8-n9frj" event={"ID":"ca5506b3-5a71-491a-b47a-ab87715a6a3c","Type":"ContainerStarted","Data":"86b21e2f293f9cff652f51d6aa1070253d3b818d717ab6ff1ef779fcec3dd5ef"}
Jul 31 22:10:50.009174 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:10:50.009091    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-744697ddf8-n9frj" event={"ID":"ca5506b3-5a71-491a-b47a-ab87715a6a3c","Type":"ContainerStarted","Data":"7e46491b59099e57d81eacbb019a3e92846fb634c9a278cd47559e38efb734e2"}
Jul 31 22:10:50.028854 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:10:50.028798    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-744697ddf8-n9frj" podStartSLOduration=1.3982842770000001 podStartE2EDuration="2.02878252s" totalImagesPullingTime="630.498243ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:10:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:10:50.027880792 +0000 UTC m=+659.123171938" watchObservedRunningTime="2026-07-31 22:10:50.02878252 +0000 UTC m=+659.124073671"
Jul 31 22:10:50.071088 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:10:50.071037    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5949bb94d7-qvvbg"]
Jul 31 22:10:50.071322 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:10:50.071270    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5949bb94d7-qvvbg" podUID="57b0e7a1-71dc-42bc-b232-8cc352a5a1c1" containerName="authorino" containerID="cri-o://64aca0dfa8464b06c2b4c25bf8263c1d9e73fd847d75c14b780971e80d509c6d" gracePeriod=30
Jul 31 22:10:50.325854 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:10:50.325825    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5949bb94d7-qvvbg"
Jul 31 22:10:50.433813 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:10:50.433774    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/57b0e7a1-71dc-42bc-b232-8cc352a5a1c1-tls-cert\") pod \"57b0e7a1-71dc-42bc-b232-8cc352a5a1c1\" (UID: \"57b0e7a1-71dc-42bc-b232-8cc352a5a1c1\") "
Jul 31 22:10:50.433998 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:10:50.433840    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t84sl\" (UniqueName: \"kubernetes.io/projected/57b0e7a1-71dc-42bc-b232-8cc352a5a1c1-kube-api-access-t84sl\") pod \"57b0e7a1-71dc-42bc-b232-8cc352a5a1c1\" (UID: \"57b0e7a1-71dc-42bc-b232-8cc352a5a1c1\") "
Jul 31 22:10:50.435896 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:10:50.435871    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57b0e7a1-71dc-42bc-b232-8cc352a5a1c1-kube-api-access-t84sl" (OuterVolumeSpecName: "kube-api-access-t84sl") pod "57b0e7a1-71dc-42bc-b232-8cc352a5a1c1" (UID: "57b0e7a1-71dc-42bc-b232-8cc352a5a1c1"). InnerVolumeSpecName "kube-api-access-t84sl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:10:50.443217 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:10:50.443187    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57b0e7a1-71dc-42bc-b232-8cc352a5a1c1-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "57b0e7a1-71dc-42bc-b232-8cc352a5a1c1" (UID: "57b0e7a1-71dc-42bc-b232-8cc352a5a1c1"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:10:50.534851 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:10:50.534819    2573 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/57b0e7a1-71dc-42bc-b232-8cc352a5a1c1-tls-cert\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:10:50.534851 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:10:50.534845    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t84sl\" (UniqueName: \"kubernetes.io/projected/57b0e7a1-71dc-42bc-b232-8cc352a5a1c1-kube-api-access-t84sl\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:10:51.014884 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:10:51.014848    2573 generic.go:356] "Generic (PLEG): container finished" podID="57b0e7a1-71dc-42bc-b232-8cc352a5a1c1" containerID="64aca0dfa8464b06c2b4c25bf8263c1d9e73fd847d75c14b780971e80d509c6d" exitCode=0
Jul 31 22:10:51.015364 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:10:51.014900    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5949bb94d7-qvvbg"
Jul 31 22:10:51.015364 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:10:51.014910    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5949bb94d7-qvvbg" event={"ID":"57b0e7a1-71dc-42bc-b232-8cc352a5a1c1","Type":"ContainerDied","Data":"64aca0dfa8464b06c2b4c25bf8263c1d9e73fd847d75c14b780971e80d509c6d"}
Jul 31 22:10:51.015364 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:10:51.014963    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5949bb94d7-qvvbg" event={"ID":"57b0e7a1-71dc-42bc-b232-8cc352a5a1c1","Type":"ContainerDied","Data":"5e7aaef76d96a2dd1eac9a15a49b181625b6c856b32f6eb83264490043b2d0b3"}
Jul 31 22:10:51.015364 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:10:51.014990    2573 scope.go:117] "RemoveContainer" containerID="64aca0dfa8464b06c2b4c25bf8263c1d9e73fd847d75c14b780971e80d509c6d"
Jul 31 22:10:51.026001 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:10:51.025981    2573 scope.go:117] "RemoveContainer" containerID="64aca0dfa8464b06c2b4c25bf8263c1d9e73fd847d75c14b780971e80d509c6d"
Jul 31 22:10:51.026287 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:10:51.026268    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64aca0dfa8464b06c2b4c25bf8263c1d9e73fd847d75c14b780971e80d509c6d\": container with ID starting with 64aca0dfa8464b06c2b4c25bf8263c1d9e73fd847d75c14b780971e80d509c6d not found: ID does not exist" containerID="64aca0dfa8464b06c2b4c25bf8263c1d9e73fd847d75c14b780971e80d509c6d"
Jul 31 22:10:51.026389 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:10:51.026334    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64aca0dfa8464b06c2b4c25bf8263c1d9e73fd847d75c14b780971e80d509c6d"} err="failed to get container status \"64aca0dfa8464b06c2b4c25bf8263c1d9e73fd847d75c14b780971e80d509c6d\": rpc error: code = NotFound desc = could not find container \"64aca0dfa8464b06c2b4c25bf8263c1d9e73fd847d75c14b780971e80d509c6d\": container with ID starting with 64aca0dfa8464b06c2b4c25bf8263c1d9e73fd847d75c14b780971e80d509c6d not found: ID does not exist"
Jul 31 22:10:51.036128 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:10:51.036101    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5949bb94d7-qvvbg"]
Jul 31 22:10:51.041078 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:10:51.041058    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5949bb94d7-qvvbg"]
Jul 31 22:10:51.335268 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:10:51.335241    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57b0e7a1-71dc-42bc-b232-8cc352a5a1c1" path="/var/lib/kubelet/pods/57b0e7a1-71dc-42bc-b232-8cc352a5a1c1/volumes"
Jul 31 22:14:51.266220 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:14:51.266132    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ddp8_79e15037-4ffd-47f1-b983-34f06895b2a3/ovn-acl-logging/0.log"
Jul 31 22:14:51.268292 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:14:51.268264    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ddp8_79e15037-4ffd-47f1-b983-34f06895b2a3/ovn-acl-logging/0.log"
Jul 31 22:19:51.291715 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:19:51.291686    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ddp8_79e15037-4ffd-47f1-b983-34f06895b2a3/ovn-acl-logging/0.log"
Jul 31 22:19:51.293399 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:19:51.293371    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ddp8_79e15037-4ffd-47f1-b983-34f06895b2a3/ovn-acl-logging/0.log"
Jul 31 22:24:51.321828 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:24:51.321798    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ddp8_79e15037-4ffd-47f1-b983-34f06895b2a3/ovn-acl-logging/0.log"
Jul 31 22:24:51.322771 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:24:51.322747    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ddp8_79e15037-4ffd-47f1-b983-34f06895b2a3/ovn-acl-logging/0.log"
Jul 31 22:28:35.300623 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:28:35.300584    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-48fa749f-9x8nj"]
Jul 31 22:28:35.301077 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:28:35.300907    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57b0e7a1-71dc-42bc-b232-8cc352a5a1c1" containerName="authorino"
Jul 31 22:28:35.301077 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:28:35.300918    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="57b0e7a1-71dc-42bc-b232-8cc352a5a1c1" containerName="authorino"
Jul 31 22:28:35.301077 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:28:35.300981    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="57b0e7a1-71dc-42bc-b232-8cc352a5a1c1" containerName="authorino"
Jul 31 22:28:35.304010 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:28:35.303993    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-48fa749f-9x8nj"
Jul 31 22:28:35.306189 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:28:35.306165    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 31 22:28:35.306360 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:28:35.306286    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lgfz6\""
Jul 31 22:28:35.310921 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:28:35.310897    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-48fa749f-9x8nj"]
Jul 31 22:28:35.337424 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:28:35.337381    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f25142d-1c5a-4291-a519-2ea7b8355c17-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-48fa749f-9x8nj\" (UID: \"4f25142d-1c5a-4291-a519-2ea7b8355c17\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-48fa749f-9x8nj"
Jul 31 22:28:35.438460 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:28:35.438415    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f25142d-1c5a-4291-a519-2ea7b8355c17-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-48fa749f-9x8nj\" (UID: \"4f25142d-1c5a-4291-a519-2ea7b8355c17\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-48fa749f-9x8nj"
Jul 31 22:28:35.439054 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:28:35.439033    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f25142d-1c5a-4291-a519-2ea7b8355c17-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-48fa749f-9x8nj\" (UID: \"4f25142d-1c5a-4291-a519-2ea7b8355c17\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-48fa749f-9x8nj"
Jul 31 22:28:35.616008 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:28:35.615918    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-48fa749f-9x8nj"
Jul 31 22:28:35.748212 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:28:35.748073    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-48fa749f-9x8nj"]
Jul 31 22:28:35.751128 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:28:35.751097    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f25142d_1c5a_4291_a519_2ea7b8355c17.slice/crio-44339dfc19cc052eb1fd4f0b9413b105c0da2691650b1271a045957ee46efe15 WatchSource:0}: Error finding container 44339dfc19cc052eb1fd4f0b9413b105c0da2691650b1271a045957ee46efe15: Status 404 returned error can't find the container with id 44339dfc19cc052eb1fd4f0b9413b105c0da2691650b1271a045957ee46efe15
Jul 31 22:28:35.753496 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:28:35.753474    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 22:28:35.860889 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:28:35.860852    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-48fa749f-9x8nj" event={"ID":"4f25142d-1c5a-4291-a519-2ea7b8355c17","Type":"ContainerStarted","Data":"44339dfc19cc052eb1fd4f0b9413b105c0da2691650b1271a045957ee46efe15"}
Jul 31 22:28:38.876348 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:28:38.876230    2573 generic.go:356] "Generic (PLEG): container finished" podID="4f25142d-1c5a-4291-a519-2ea7b8355c17" containerID="5bb207610ec019d91c1d792b53275a4eb02694f1853153891e14e3c76ca6b932" exitCode=0
Jul 31 22:28:38.876348 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:28:38.876288    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-48fa749f-9x8nj" event={"ID":"4f25142d-1c5a-4291-a519-2ea7b8355c17","Type":"ContainerDied","Data":"5bb207610ec019d91c1d792b53275a4eb02694f1853153891e14e3c76ca6b932"}
Jul 31 22:28:40.014177 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:28:40.014149    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-48fa749f-9x8nj"
Jul 31 22:28:40.077632 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:28:40.077597    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f25142d-1c5a-4291-a519-2ea7b8355c17-maas-api-service-ca\") pod \"4f25142d-1c5a-4291-a519-2ea7b8355c17\" (UID: \"4f25142d-1c5a-4291-a519-2ea7b8355c17\") "
Jul 31 22:28:40.077971 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:28:40.077946    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f25142d-1c5a-4291-a519-2ea7b8355c17-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4f25142d-1c5a-4291-a519-2ea7b8355c17" (UID: "4f25142d-1c5a-4291-a519-2ea7b8355c17"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:28:40.179351 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:28:40.179286    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f25142d-1c5a-4291-a519-2ea7b8355c17-maas-api-service-ca\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:28:40.886197 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:28:40.886168    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-48fa749f-9x8nj"
Jul 31 22:28:40.886197 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:28:40.886195    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-48fa749f-9x8nj" event={"ID":"4f25142d-1c5a-4291-a519-2ea7b8355c17","Type":"ContainerDied","Data":"44339dfc19cc052eb1fd4f0b9413b105c0da2691650b1271a045957ee46efe15"}
Jul 31 22:28:40.886458 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:28:40.886239    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="44339dfc19cc052eb1fd4f0b9413b105c0da2691650b1271a045957ee46efe15"
Jul 31 22:28:51.613316 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:28:51.613268    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-48fa749f-9x8nj"]
Jul 31 22:28:51.617506 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:28:51.617473    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-48fa749f-9x8nj"]
Jul 31 22:28:53.334207 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:28:53.334174    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f25142d-1c5a-4291-a519-2ea7b8355c17" path="/var/lib/kubelet/pods/4f25142d-1c5a-4291-a519-2ea7b8355c17/volumes"
Jul 31 22:29:20.101159 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:20.101122    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-048b8d6f-v6xw9"]
Jul 31 22:29:20.101646 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:20.101469    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f25142d-1c5a-4291-a519-2ea7b8355c17" containerName="revoke-keys"
Jul 31 22:29:20.101646 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:20.101489    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f25142d-1c5a-4291-a519-2ea7b8355c17" containerName="revoke-keys"
Jul 31 22:29:20.101646 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:20.101546    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f25142d-1c5a-4291-a519-2ea7b8355c17" containerName="revoke-keys"
Jul 31 22:29:20.112079 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:20.112027    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-048b8d6f-v6xw9"
Jul 31 22:29:20.112371 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:20.112344    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-048b8d6f-v6xw9"]
Jul 31 22:29:20.114631 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:20.114601    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 31 22:29:20.114755 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:20.114673    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lgfz6\""
Jul 31 22:29:20.238020 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:20.237981    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a476f239-90ae-4a21-8e2e-49e49b9dcec5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-048b8d6f-v6xw9\" (UID: \"a476f239-90ae-4a21-8e2e-49e49b9dcec5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-048b8d6f-v6xw9"
Jul 31 22:29:20.338508 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:20.338462    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a476f239-90ae-4a21-8e2e-49e49b9dcec5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-048b8d6f-v6xw9\" (UID: \"a476f239-90ae-4a21-8e2e-49e49b9dcec5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-048b8d6f-v6xw9"
Jul 31 22:29:20.339111 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:20.339092    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a476f239-90ae-4a21-8e2e-49e49b9dcec5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-048b8d6f-v6xw9\" (UID: \"a476f239-90ae-4a21-8e2e-49e49b9dcec5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-048b8d6f-v6xw9"
Jul 31 22:29:20.422814 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:20.422773    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-048b8d6f-v6xw9"
Jul 31 22:29:20.569665 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:20.569638    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-048b8d6f-v6xw9"]
Jul 31 22:29:20.572292 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:29:20.572258    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda476f239_90ae_4a21_8e2e_49e49b9dcec5.slice/crio-32c9fcdb8d83c2b185de70685c94219d1226f42dbae82ce9478379c6214a1a7f WatchSource:0}: Error finding container 32c9fcdb8d83c2b185de70685c94219d1226f42dbae82ce9478379c6214a1a7f: Status 404 returned error can't find the container with id 32c9fcdb8d83c2b185de70685c94219d1226f42dbae82ce9478379c6214a1a7f
Jul 31 22:29:21.067219 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:21.067121    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-048b8d6f-v6xw9" event={"ID":"a476f239-90ae-4a21-8e2e-49e49b9dcec5","Type":"ContainerStarted","Data":"f71a4cae5aec86bffab2e91266a6b5ad687641d8a32cef82e871d799f7a5908e"}
Jul 31 22:29:21.067219 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:21.067177    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-048b8d6f-v6xw9" event={"ID":"a476f239-90ae-4a21-8e2e-49e49b9dcec5","Type":"ContainerStarted","Data":"32c9fcdb8d83c2b185de70685c94219d1226f42dbae82ce9478379c6214a1a7f"}
Jul 31 22:29:21.083467 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:21.083407    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-048b8d6f-v6xw9" podStartSLOduration=1.08338851 podStartE2EDuration="1.08338851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:29:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:29:21.081858503 +0000 UTC m=+1770.177149648" watchObservedRunningTime="2026-07-31 22:29:21.08338851 +0000 UTC m=+1770.178679656"
Jul 31 22:29:22.073660 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:22.073626    2573 generic.go:356] "Generic (PLEG): container finished" podID="a476f239-90ae-4a21-8e2e-49e49b9dcec5" containerID="f71a4cae5aec86bffab2e91266a6b5ad687641d8a32cef82e871d799f7a5908e" exitCode=0
Jul 31 22:29:22.074094 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:22.073708    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-048b8d6f-v6xw9" event={"ID":"a476f239-90ae-4a21-8e2e-49e49b9dcec5","Type":"ContainerDied","Data":"f71a4cae5aec86bffab2e91266a6b5ad687641d8a32cef82e871d799f7a5908e"}
Jul 31 22:29:23.207128 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:23.207099    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-048b8d6f-v6xw9"
Jul 31 22:29:23.267599 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:23.267557    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a476f239-90ae-4a21-8e2e-49e49b9dcec5-maas-api-service-ca\") pod \"a476f239-90ae-4a21-8e2e-49e49b9dcec5\" (UID: \"a476f239-90ae-4a21-8e2e-49e49b9dcec5\") "
Jul 31 22:29:23.267947 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:23.267927    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a476f239-90ae-4a21-8e2e-49e49b9dcec5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a476f239-90ae-4a21-8e2e-49e49b9dcec5" (UID: "a476f239-90ae-4a21-8e2e-49e49b9dcec5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:29:23.369323 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:23.369277    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a476f239-90ae-4a21-8e2e-49e49b9dcec5-maas-api-service-ca\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:29:24.083321 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:24.083283    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-048b8d6f-v6xw9"
Jul 31 22:29:24.083507 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:24.083328    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-048b8d6f-v6xw9" event={"ID":"a476f239-90ae-4a21-8e2e-49e49b9dcec5","Type":"ContainerDied","Data":"32c9fcdb8d83c2b185de70685c94219d1226f42dbae82ce9478379c6214a1a7f"}
Jul 31 22:29:24.083507 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:24.083377    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="32c9fcdb8d83c2b185de70685c94219d1226f42dbae82ce9478379c6214a1a7f"
Jul 31 22:29:26.773920 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:26.773883    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-048b8d6f-v6xw9"]
Jul 31 22:29:26.777224 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:26.777197    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-048b8d6f-v6xw9"]
Jul 31 22:29:27.334364 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:27.334326    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a476f239-90ae-4a21-8e2e-49e49b9dcec5" path="/var/lib/kubelet/pods/a476f239-90ae-4a21-8e2e-49e49b9dcec5/volumes"
Jul 31 22:29:51.352864 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:51.352830    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ddp8_79e15037-4ffd-47f1-b983-34f06895b2a3/ovn-acl-logging/0.log"
Jul 31 22:29:51.357009 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:51.356985    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ddp8_79e15037-4ffd-47f1-b983-34f06895b2a3/ovn-acl-logging/0.log"
Jul 31 22:29:56.017659 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:56.017614    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0efd1d71-6m5kl"]
Jul 31 22:29:56.018173 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:56.017986    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a476f239-90ae-4a21-8e2e-49e49b9dcec5" containerName="revoke-keys"
Jul 31 22:29:56.018173 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:56.018002    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a476f239-90ae-4a21-8e2e-49e49b9dcec5" containerName="revoke-keys"
Jul 31 22:29:56.018173 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:56.018063    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a476f239-90ae-4a21-8e2e-49e49b9dcec5" containerName="revoke-keys"
Jul 31 22:29:56.021067 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:56.021047    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0efd1d71-6m5kl"
Jul 31 22:29:56.023378 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:56.023355    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lgfz6\""
Jul 31 22:29:56.023493 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:56.023383    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 31 22:29:56.026655 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:56.026625    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0efd1d71-6m5kl"]
Jul 31 22:29:56.064596 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:56.064547    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43a1be88-8b26-4e4c-a268-a3b4e1c438bc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0efd1d71-6m5kl\" (UID: \"43a1be88-8b26-4e4c-a268-a3b4e1c438bc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0efd1d71-6m5kl"
Jul 31 22:29:56.165951 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:56.165905    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43a1be88-8b26-4e4c-a268-a3b4e1c438bc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0efd1d71-6m5kl\" (UID: \"43a1be88-8b26-4e4c-a268-a3b4e1c438bc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0efd1d71-6m5kl"
Jul 31 22:29:56.166560 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:56.166538    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43a1be88-8b26-4e4c-a268-a3b4e1c438bc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0efd1d71-6m5kl\" (UID: \"43a1be88-8b26-4e4c-a268-a3b4e1c438bc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0efd1d71-6m5kl"
Jul 31 22:29:56.332908 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:56.332801    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0efd1d71-6m5kl"
Jul 31 22:29:56.464271 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:56.464247    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0efd1d71-6m5kl"]
Jul 31 22:29:56.466857 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:29:56.466822    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43a1be88_8b26_4e4c_a268_a3b4e1c438bc.slice/crio-5b78e1e75be05869ceb01650b99fb438048aefff53593310d7bd187def9e032f WatchSource:0}: Error finding container 5b78e1e75be05869ceb01650b99fb438048aefff53593310d7bd187def9e032f: Status 404 returned error can't find the container with id 5b78e1e75be05869ceb01650b99fb438048aefff53593310d7bd187def9e032f
Jul 31 22:29:57.234239 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:57.234191    2573 generic.go:356] "Generic (PLEG): container finished" podID="43a1be88-8b26-4e4c-a268-a3b4e1c438bc" containerID="8e415d166373be3db58903d3a8ea82845359f6d148e1b2bffff0f3be66684c73" exitCode=0
Jul 31 22:29:57.234644 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:57.234262    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0efd1d71-6m5kl" event={"ID":"43a1be88-8b26-4e4c-a268-a3b4e1c438bc","Type":"ContainerDied","Data":"8e415d166373be3db58903d3a8ea82845359f6d148e1b2bffff0f3be66684c73"}
Jul 31 22:29:57.234644 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:57.234347    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0efd1d71-6m5kl" event={"ID":"43a1be88-8b26-4e4c-a268-a3b4e1c438bc","Type":"ContainerStarted","Data":"5b78e1e75be05869ceb01650b99fb438048aefff53593310d7bd187def9e032f"}
Jul 31 22:29:58.385562 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:58.385535    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0efd1d71-6m5kl"
Jul 31 22:29:58.483093 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:58.483055    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43a1be88-8b26-4e4c-a268-a3b4e1c438bc-maas-api-service-ca\") pod \"43a1be88-8b26-4e4c-a268-a3b4e1c438bc\" (UID: \"43a1be88-8b26-4e4c-a268-a3b4e1c438bc\") "
Jul 31 22:29:58.483481 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:58.483454    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43a1be88-8b26-4e4c-a268-a3b4e1c438bc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "43a1be88-8b26-4e4c-a268-a3b4e1c438bc" (UID: "43a1be88-8b26-4e4c-a268-a3b4e1c438bc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:29:58.583682 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:58.583589    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43a1be88-8b26-4e4c-a268-a3b4e1c438bc-maas-api-service-ca\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:29:59.243701 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:59.243661    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0efd1d71-6m5kl" event={"ID":"43a1be88-8b26-4e4c-a268-a3b4e1c438bc","Type":"ContainerDied","Data":"5b78e1e75be05869ceb01650b99fb438048aefff53593310d7bd187def9e032f"}
Jul 31 22:29:59.243701 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:59.243690    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0efd1d71-6m5kl"
Jul 31 22:29:59.243920 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:29:59.243750    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5b78e1e75be05869ceb01650b99fb438048aefff53593310d7bd187def9e032f"
Jul 31 22:30:00.136275 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:00.136238    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29758950-86zgn"]
Jul 31 22:30:00.136733 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:00.136715    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43a1be88-8b26-4e4c-a268-a3b4e1c438bc" containerName="revoke-keys"
Jul 31 22:30:00.136777 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:00.136737    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="43a1be88-8b26-4e4c-a268-a3b4e1c438bc" containerName="revoke-keys"
Jul 31 22:30:00.136852 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:00.136840    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="43a1be88-8b26-4e4c-a268-a3b4e1c438bc" containerName="revoke-keys"
Jul 31 22:30:00.140108 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:00.140088    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-0efd1d71-29758950-zqtvc"]
Jul 31 22:30:00.140237 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:00.140217    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758950-86zgn"
Jul 31 22:30:00.142415 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:00.142397    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lgfz6\""
Jul 31 22:30:00.143324 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:00.143282    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-0efd1d71-29758950-zqtvc"
Jul 31 22:30:00.146073 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:00.146039    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-0efd1d71-29758950-zqtvc"]
Jul 31 22:30:00.149106 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:00.149037    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29758950-86zgn"]
Jul 31 22:30:00.154119 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:00.154096    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758950-86zgn"
Jul 31 22:30:00.161899 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:00.161875    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-0efd1d71-29758950-zqtvc"
Jul 31 22:30:00.300416 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:00.300336    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29758950-86zgn"]
Jul 31 22:30:00.303336 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:30:00.303287    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00ed80a3_29bb_43f4_bad8_fa3a5219e0d5.slice/crio-2c52346228e185ffdc67528081a9278f039b43c3e59ed37fbde305640b0cfd3d WatchSource:0}: Error finding container 2c52346228e185ffdc67528081a9278f039b43c3e59ed37fbde305640b0cfd3d: Status 404 returned error can't find the container with id 2c52346228e185ffdc67528081a9278f039b43c3e59ed37fbde305640b0cfd3d
Jul 31 22:30:00.324027 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:00.324003    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-0efd1d71-29758950-zqtvc"]
Jul 31 22:30:00.326011 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:30:00.325987    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae791522_49cf_4d51_a8c4_bef7ce6675cb.slice/crio-f9d6b793f73211fac8f7fd55bbf3ba28f0f10250f69038f0a57d21ea47a9edbe WatchSource:0}: Error finding container f9d6b793f73211fac8f7fd55bbf3ba28f0f10250f69038f0a57d21ea47a9edbe: Status 404 returned error can't find the container with id f9d6b793f73211fac8f7fd55bbf3ba28f0f10250f69038f0a57d21ea47a9edbe
Jul 31 22:30:01.256733 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:01.256695    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-0efd1d71-29758950-zqtvc" event={"ID":"ae791522-49cf-4d51-a8c4-bef7ce6675cb","Type":"ContainerStarted","Data":"3bbaffcd6e7ed4a5ddafb84b557ad1666b82eceeeeb32b408e87947d32826132"}
Jul 31 22:30:01.257228 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:01.256763    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-0efd1d71-29758950-zqtvc" event={"ID":"ae791522-49cf-4d51-a8c4-bef7ce6675cb","Type":"ContainerStarted","Data":"f9d6b793f73211fac8f7fd55bbf3ba28f0f10250f69038f0a57d21ea47a9edbe"}
Jul 31 22:30:01.258417 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:01.258388    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758950-86zgn" event={"ID":"00ed80a3-29bb-43f4-bad8-fa3a5219e0d5","Type":"ContainerStarted","Data":"a03321bd33783738daca41710330b3b39a35578ed563e1a5fd2e2e699e59b231"}
Jul 31 22:30:01.258536 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:01.258439    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758950-86zgn" event={"ID":"00ed80a3-29bb-43f4-bad8-fa3a5219e0d5","Type":"ContainerStarted","Data":"2c52346228e185ffdc67528081a9278f039b43c3e59ed37fbde305640b0cfd3d"}
Jul 31 22:30:01.273481 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:01.273425    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-0efd1d71-29758950-zqtvc" podStartSLOduration=1.27340718 podStartE2EDuration="1.27340718s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:30:01.27183274 +0000 UTC m=+1810.367123888" watchObservedRunningTime="2026-07-31 22:30:01.27340718 +0000 UTC m=+1810.368698325"
Jul 31 22:30:01.285642 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:01.285579    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758950-86zgn" podStartSLOduration=1.2855535169999999 podStartE2EDuration="1.285553517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:30:01.284863371 +0000 UTC m=+1810.380154518" watchObservedRunningTime="2026-07-31 22:30:01.285553517 +0000 UTC m=+1810.380844666"
Jul 31 22:30:01.725568 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:01.725531    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-0efd1d71-29758950-zqtvc"]
Jul 31 22:30:01.904849 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:01.904806    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0efd1d71-6m5kl"]
Jul 31 22:30:01.913233 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:01.913203    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0efd1d71-6m5kl"]
Jul 31 22:30:02.264462 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:02.264426    2573 generic.go:356] "Generic (PLEG): container finished" podID="ae791522-49cf-4d51-a8c4-bef7ce6675cb" containerID="3bbaffcd6e7ed4a5ddafb84b557ad1666b82eceeeeb32b408e87947d32826132" exitCode=0
Jul 31 22:30:02.264895 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:02.264525    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-0efd1d71-29758950-zqtvc" event={"ID":"ae791522-49cf-4d51-a8c4-bef7ce6675cb","Type":"ContainerDied","Data":"3bbaffcd6e7ed4a5ddafb84b557ad1666b82eceeeeb32b408e87947d32826132"}
Jul 31 22:30:02.266087 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:02.266061    2573 generic.go:356] "Generic (PLEG): container finished" podID="00ed80a3-29bb-43f4-bad8-fa3a5219e0d5" containerID="a03321bd33783738daca41710330b3b39a35578ed563e1a5fd2e2e699e59b231" exitCode=0
Jul 31 22:30:02.266212 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:02.266111    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758950-86zgn" event={"ID":"00ed80a3-29bb-43f4-bad8-fa3a5219e0d5","Type":"ContainerDied","Data":"a03321bd33783738daca41710330b3b39a35578ed563e1a5fd2e2e699e59b231"}
Jul 31 22:30:03.338571 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:03.338480    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43a1be88-8b26-4e4c-a268-a3b4e1c438bc" path="/var/lib/kubelet/pods/43a1be88-8b26-4e4c-a268-a3b4e1c438bc/volumes"
Jul 31 22:30:03.434699 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:03.434667    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-0efd1d71-29758950-zqtvc"
Jul 31 22:30:03.437279 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:03.437253    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758950-86zgn"
Jul 31 22:30:04.275970 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:04.275936    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758950-86zgn"
Jul 31 22:30:04.276171 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:04.275982    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758950-86zgn" event={"ID":"00ed80a3-29bb-43f4-bad8-fa3a5219e0d5","Type":"ContainerDied","Data":"2c52346228e185ffdc67528081a9278f039b43c3e59ed37fbde305640b0cfd3d"}
Jul 31 22:30:04.276171 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:04.276043    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c52346228e185ffdc67528081a9278f039b43c3e59ed37fbde305640b0cfd3d"
Jul 31 22:30:04.277378 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:04.277354    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-0efd1d71-29758950-zqtvc" event={"ID":"ae791522-49cf-4d51-a8c4-bef7ce6675cb","Type":"ContainerDied","Data":"f9d6b793f73211fac8f7fd55bbf3ba28f0f10250f69038f0a57d21ea47a9edbe"}
Jul 31 22:30:04.277507 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:04.277386    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-0efd1d71-29758950-zqtvc"
Jul 31 22:30:04.277507 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:04.277404    2573 scope.go:117] "RemoveContainer" containerID="3bbaffcd6e7ed4a5ddafb84b557ad1666b82eceeeeb32b408e87947d32826132"
Jul 31 22:30:04.299992 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:04.299964    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-0efd1d71-29758950-zqtvc"]
Jul 31 22:30:04.307125 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:04.307097    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-0efd1d71-29758950-zqtvc"]
Jul 31 22:30:05.334936 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:05.334901    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae791522-49cf-4d51-a8c4-bef7ce6675cb" path="/var/lib/kubelet/pods/ae791522-49cf-4d51-a8c4-bef7ce6675cb/volumes"
Jul 31 22:30:31.216832 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:31.216795    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a6187704-mldbz"]
Jul 31 22:30:31.217696 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:31.217112    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00ed80a3-29bb-43f4-bad8-fa3a5219e0d5" containerName="cleanup"
Jul 31 22:30:31.217696 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:31.217122    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="00ed80a3-29bb-43f4-bad8-fa3a5219e0d5" containerName="cleanup"
Jul 31 22:30:31.217696 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:31.217138    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae791522-49cf-4d51-a8c4-bef7ce6675cb" containerName="cleanup"
Jul 31 22:30:31.217696 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:31.217145    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae791522-49cf-4d51-a8c4-bef7ce6675cb" containerName="cleanup"
Jul 31 22:30:31.217696 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:31.217197    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="00ed80a3-29bb-43f4-bad8-fa3a5219e0d5" containerName="cleanup"
Jul 31 22:30:31.217696 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:31.217206    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae791522-49cf-4d51-a8c4-bef7ce6675cb" containerName="cleanup"
Jul 31 22:30:31.220248 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:31.220229    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a6187704-mldbz"
Jul 31 22:30:31.222685 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:31.222659    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lgfz6\""
Jul 31 22:30:31.222808 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:31.222741    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 31 22:30:31.227908 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:31.227835    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a6187704-mldbz"]
Jul 31 22:30:31.380701 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:31.380660    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a0b6454-7978-4767-8535-d1d29ed7aa0b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a6187704-mldbz\" (UID: \"4a0b6454-7978-4767-8535-d1d29ed7aa0b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a6187704-mldbz"
Jul 31 22:30:31.481387 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:31.481264    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a0b6454-7978-4767-8535-d1d29ed7aa0b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a6187704-mldbz\" (UID: \"4a0b6454-7978-4767-8535-d1d29ed7aa0b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a6187704-mldbz"
Jul 31 22:30:31.481893 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:31.481873    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a0b6454-7978-4767-8535-d1d29ed7aa0b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a6187704-mldbz\" (UID: \"4a0b6454-7978-4767-8535-d1d29ed7aa0b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a6187704-mldbz"
Jul 31 22:30:31.532386 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:31.532356    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a6187704-mldbz"
Jul 31 22:30:31.677854 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:31.677829    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a6187704-mldbz"]
Jul 31 22:30:31.680041 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:30:31.680013    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a0b6454_7978_4767_8535_d1d29ed7aa0b.slice/crio-ca7292918cefa4518b9d027855b346fc61b66225f205ade675f60ea866326cd7 WatchSource:0}: Error finding container ca7292918cefa4518b9d027855b346fc61b66225f205ade675f60ea866326cd7: Status 404 returned error can't find the container with id ca7292918cefa4518b9d027855b346fc61b66225f205ade675f60ea866326cd7
Jul 31 22:30:32.408370 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:32.408334    2573 generic.go:356] "Generic (PLEG): container finished" podID="4a0b6454-7978-4767-8535-d1d29ed7aa0b" containerID="b044f90c2116e4182123fc03a95662375d0b735d4c213fa6be655cab504aed22" exitCode=0
Jul 31 22:30:32.408807 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:32.408403    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a6187704-mldbz" event={"ID":"4a0b6454-7978-4767-8535-d1d29ed7aa0b","Type":"ContainerDied","Data":"b044f90c2116e4182123fc03a95662375d0b735d4c213fa6be655cab504aed22"}
Jul 31 22:30:32.408807 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:32.408444    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a6187704-mldbz" event={"ID":"4a0b6454-7978-4767-8535-d1d29ed7aa0b","Type":"ContainerStarted","Data":"ca7292918cefa4518b9d027855b346fc61b66225f205ade675f60ea866326cd7"}
Jul 31 22:30:33.544479 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:33.544448    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a6187704-mldbz"
Jul 31 22:30:33.699997 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:33.699964    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a0b6454-7978-4767-8535-d1d29ed7aa0b-maas-api-service-ca\") pod \"4a0b6454-7978-4767-8535-d1d29ed7aa0b\" (UID: \"4a0b6454-7978-4767-8535-d1d29ed7aa0b\") "
Jul 31 22:30:33.700361 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:33.700339    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a0b6454-7978-4767-8535-d1d29ed7aa0b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4a0b6454-7978-4767-8535-d1d29ed7aa0b" (UID: "4a0b6454-7978-4767-8535-d1d29ed7aa0b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:30:33.801147 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:33.801101    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a0b6454-7978-4767-8535-d1d29ed7aa0b-maas-api-service-ca\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:30:34.419425 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:34.419381    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a6187704-mldbz" event={"ID":"4a0b6454-7978-4767-8535-d1d29ed7aa0b","Type":"ContainerDied","Data":"ca7292918cefa4518b9d027855b346fc61b66225f205ade675f60ea866326cd7"}
Jul 31 22:30:34.419425 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:34.419420    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a6187704-mldbz"
Jul 31 22:30:34.419646 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:34.419448    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ca7292918cefa4518b9d027855b346fc61b66225f205ade675f60ea866326cd7"
Jul 31 22:30:38.294363 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:38.294279    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a6187704-mldbz"]
Jul 31 22:30:38.297120 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:38.297093    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a6187704-mldbz"]
Jul 31 22:30:39.334725 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:30:39.334684    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a0b6454-7978-4767-8535-d1d29ed7aa0b" path="/var/lib/kubelet/pods/4a0b6454-7978-4767-8535-d1d29ed7aa0b/volumes"
Jul 31 22:33:11.076552 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:33:11.076515    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d8ee576a-l428j"]
Jul 31 22:33:11.076986 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:33:11.076854    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a0b6454-7978-4767-8535-d1d29ed7aa0b" containerName="revoke-keys"
Jul 31 22:33:11.076986 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:33:11.076869    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a0b6454-7978-4767-8535-d1d29ed7aa0b" containerName="revoke-keys"
Jul 31 22:33:11.076986 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:33:11.076939    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a0b6454-7978-4767-8535-d1d29ed7aa0b" containerName="revoke-keys"
Jul 31 22:33:11.080076 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:33:11.080058    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d8ee576a-l428j"
Jul 31 22:33:11.082991 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:33:11.082964    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 31 22:33:11.083131 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:33:11.083096    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lgfz6\""
Jul 31 22:33:11.088278 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:33:11.088236    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d8ee576a-l428j"]
Jul 31 22:33:11.142093 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:33:11.142052    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1cdb7e7-67bb-48c7-8b4a-e32dba75f54a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-d8ee576a-l428j\" (UID: \"c1cdb7e7-67bb-48c7-8b4a-e32dba75f54a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d8ee576a-l428j"
Jul 31 22:33:11.243140 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:33:11.243095    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1cdb7e7-67bb-48c7-8b4a-e32dba75f54a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-d8ee576a-l428j\" (UID: \"c1cdb7e7-67bb-48c7-8b4a-e32dba75f54a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d8ee576a-l428j"
Jul 31 22:33:11.243773 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:33:11.243746    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1cdb7e7-67bb-48c7-8b4a-e32dba75f54a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-d8ee576a-l428j\" (UID: \"c1cdb7e7-67bb-48c7-8b4a-e32dba75f54a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d8ee576a-l428j"
Jul 31 22:33:11.392164 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:33:11.392070    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d8ee576a-l428j"
Jul 31 22:33:11.533735 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:33:11.533711    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d8ee576a-l428j"]
Jul 31 22:33:11.536098 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:33:11.536062    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1cdb7e7_67bb_48c7_8b4a_e32dba75f54a.slice/crio-717c68cd074dada025ba19126dc99434e546f8aea140310ff69c146f0ce9682f WatchSource:0}: Error finding container 717c68cd074dada025ba19126dc99434e546f8aea140310ff69c146f0ce9682f: Status 404 returned error can't find the container with id 717c68cd074dada025ba19126dc99434e546f8aea140310ff69c146f0ce9682f
Jul 31 22:33:12.181313 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:33:12.181262    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d8ee576a-l428j" event={"ID":"c1cdb7e7-67bb-48c7-8b4a-e32dba75f54a","Type":"ContainerStarted","Data":"2d33bd0ed4d11d77ce8e8628cbe45b7915111e72d942218b4abda57780f7af44"}
Jul 31 22:33:12.181732 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:33:12.181337    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d8ee576a-l428j" event={"ID":"c1cdb7e7-67bb-48c7-8b4a-e32dba75f54a","Type":"ContainerStarted","Data":"717c68cd074dada025ba19126dc99434e546f8aea140310ff69c146f0ce9682f"}
Jul 31 22:33:12.196714 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:33:12.196657    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d8ee576a-l428j" podStartSLOduration=1.196639644 podStartE2EDuration="1.196639644s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:33:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:33:12.195954521 +0000 UTC m=+2001.291245668" watchObservedRunningTime="2026-07-31 22:33:12.196639644 +0000 UTC m=+2001.291930803"
Jul 31 22:33:13.187710 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:33:13.187677    2573 generic.go:356] "Generic (PLEG): container finished" podID="c1cdb7e7-67bb-48c7-8b4a-e32dba75f54a" containerID="2d33bd0ed4d11d77ce8e8628cbe45b7915111e72d942218b4abda57780f7af44" exitCode=0
Jul 31 22:33:13.188108 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:33:13.187716    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d8ee576a-l428j" event={"ID":"c1cdb7e7-67bb-48c7-8b4a-e32dba75f54a","Type":"ContainerDied","Data":"2d33bd0ed4d11d77ce8e8628cbe45b7915111e72d942218b4abda57780f7af44"}
Jul 31 22:33:14.321162 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:33:14.321133    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d8ee576a-l428j"
Jul 31 22:33:14.471793 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:33:14.471686    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1cdb7e7-67bb-48c7-8b4a-e32dba75f54a-maas-api-service-ca\") pod \"c1cdb7e7-67bb-48c7-8b4a-e32dba75f54a\" (UID: \"c1cdb7e7-67bb-48c7-8b4a-e32dba75f54a\") "
Jul 31 22:33:14.472066 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:33:14.472041    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1cdb7e7-67bb-48c7-8b4a-e32dba75f54a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c1cdb7e7-67bb-48c7-8b4a-e32dba75f54a" (UID: "c1cdb7e7-67bb-48c7-8b4a-e32dba75f54a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:33:14.572629 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:33:14.572579    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1cdb7e7-67bb-48c7-8b4a-e32dba75f54a-maas-api-service-ca\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:33:15.198170 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:33:15.198142    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d8ee576a-l428j"
Jul 31 22:33:15.198353 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:33:15.198180    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d8ee576a-l428j" event={"ID":"c1cdb7e7-67bb-48c7-8b4a-e32dba75f54a","Type":"ContainerDied","Data":"717c68cd074dada025ba19126dc99434e546f8aea140310ff69c146f0ce9682f"}
Jul 31 22:33:15.198353 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:33:15.198259    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="717c68cd074dada025ba19126dc99434e546f8aea140310ff69c146f0ce9682f"
Jul 31 22:33:21.643899 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:33:21.643865    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d8ee576a-l428j"]
Jul 31 22:33:21.646546 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:33:21.645859    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d8ee576a-l428j"]
Jul 31 22:33:23.335049 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:33:23.335012    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1cdb7e7-67bb-48c7-8b4a-e32dba75f54a" path="/var/lib/kubelet/pods/c1cdb7e7-67bb-48c7-8b4a-e32dba75f54a/volumes"
Jul 31 22:34:51.379221 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:34:51.379194    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ddp8_79e15037-4ffd-47f1-b983-34f06895b2a3/ovn-acl-logging/0.log"
Jul 31 22:34:51.385033 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:34:51.385007    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ddp8_79e15037-4ffd-47f1-b983-34f06895b2a3/ovn-acl-logging/0.log"
Jul 31 22:34:51.436897 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:34:51.436860    2573 scope.go:117] "RemoveContainer" containerID="5bb207610ec019d91c1d792b53275a4eb02694f1853153891e14e3c76ca6b932"
Jul 31 22:35:51.455373 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:35:51.455336    2573 scope.go:117] "RemoveContainer" containerID="f71a4cae5aec86bffab2e91266a6b5ad687641d8a32cef82e871d799f7a5908e"
Jul 31 22:36:41.132381 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:36:41.132347    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9c96e5e7-kzrns"]
Jul 31 22:36:41.132984 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:36:41.132823    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1cdb7e7-67bb-48c7-8b4a-e32dba75f54a" containerName="revoke-keys"
Jul 31 22:36:41.132984 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:36:41.132842    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1cdb7e7-67bb-48c7-8b4a-e32dba75f54a" containerName="revoke-keys"
Jul 31 22:36:41.132984 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:36:41.132945    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1cdb7e7-67bb-48c7-8b4a-e32dba75f54a" containerName="revoke-keys"
Jul 31 22:36:41.135750 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:36:41.135727    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9c96e5e7-kzrns"
Jul 31 22:36:41.137928 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:36:41.137903    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 31 22:36:41.137928 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:36:41.137903    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lgfz6\""
Jul 31 22:36:41.141628 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:36:41.141601    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9c96e5e7-kzrns"]
Jul 31 22:36:41.247715 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:36:41.247674    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e60320ca-12a8-4475-8f36-6f5e92510cb4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9c96e5e7-kzrns\" (UID: \"e60320ca-12a8-4475-8f36-6f5e92510cb4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9c96e5e7-kzrns"
Jul 31 22:36:41.349074 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:36:41.349035    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e60320ca-12a8-4475-8f36-6f5e92510cb4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9c96e5e7-kzrns\" (UID: \"e60320ca-12a8-4475-8f36-6f5e92510cb4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9c96e5e7-kzrns"
Jul 31 22:36:41.349714 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:36:41.349693    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e60320ca-12a8-4475-8f36-6f5e92510cb4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9c96e5e7-kzrns\" (UID: \"e60320ca-12a8-4475-8f36-6f5e92510cb4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9c96e5e7-kzrns"
Jul 31 22:36:41.447032 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:36:41.446995    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9c96e5e7-kzrns"
Jul 31 22:36:41.582563 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:36:41.582532    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9c96e5e7-kzrns"]
Jul 31 22:36:41.584911 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:36:41.584885    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode60320ca_12a8_4475_8f36_6f5e92510cb4.slice/crio-29c1737291102cef9efe5cebf2918b5c9f12cf168878bde22dd1d361ed513e26 WatchSource:0}: Error finding container 29c1737291102cef9efe5cebf2918b5c9f12cf168878bde22dd1d361ed513e26: Status 404 returned error can't find the container with id 29c1737291102cef9efe5cebf2918b5c9f12cf168878bde22dd1d361ed513e26
Jul 31 22:36:42.198531 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:36:42.198500    2573 generic.go:356] "Generic (PLEG): container finished" podID="e60320ca-12a8-4475-8f36-6f5e92510cb4" containerID="9f87fa6470be926462567be82de3bc35f578dc93187f5c36866b4416de7d21c9" exitCode=0
Jul 31 22:36:42.198898 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:36:42.198589    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9c96e5e7-kzrns" event={"ID":"e60320ca-12a8-4475-8f36-6f5e92510cb4","Type":"ContainerDied","Data":"9f87fa6470be926462567be82de3bc35f578dc93187f5c36866b4416de7d21c9"}
Jul 31 22:36:42.198898 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:36:42.198643    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9c96e5e7-kzrns" event={"ID":"e60320ca-12a8-4475-8f36-6f5e92510cb4","Type":"ContainerStarted","Data":"29c1737291102cef9efe5cebf2918b5c9f12cf168878bde22dd1d361ed513e26"}
Jul 31 22:36:43.334394 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:36:43.334290    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9c96e5e7-kzrns"
Jul 31 22:36:43.368038 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:36:43.368004    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e60320ca-12a8-4475-8f36-6f5e92510cb4-maas-api-service-ca\") pod \"e60320ca-12a8-4475-8f36-6f5e92510cb4\" (UID: \"e60320ca-12a8-4475-8f36-6f5e92510cb4\") "
Jul 31 22:36:43.368370 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:36:43.368349    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e60320ca-12a8-4475-8f36-6f5e92510cb4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e60320ca-12a8-4475-8f36-6f5e92510cb4" (UID: "e60320ca-12a8-4475-8f36-6f5e92510cb4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:36:43.469191 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:36:43.469099    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e60320ca-12a8-4475-8f36-6f5e92510cb4-maas-api-service-ca\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:36:44.211510 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:36:44.211481    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9c96e5e7-kzrns"
Jul 31 22:36:44.211510 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:36:44.211501    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9c96e5e7-kzrns" event={"ID":"e60320ca-12a8-4475-8f36-6f5e92510cb4","Type":"ContainerDied","Data":"29c1737291102cef9efe5cebf2918b5c9f12cf168878bde22dd1d361ed513e26"}
Jul 31 22:36:44.211721 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:36:44.211543    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="29c1737291102cef9efe5cebf2918b5c9f12cf168878bde22dd1d361ed513e26"
Jul 31 22:36:51.474842 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:36:51.474791    2573 scope.go:117] "RemoveContainer" containerID="8e415d166373be3db58903d3a8ea82845359f6d148e1b2bffff0f3be66684c73"
Jul 31 22:36:51.483223 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:36:51.483198    2573 scope.go:117] "RemoveContainer" containerID="b044f90c2116e4182123fc03a95662375d0b735d4c213fa6be655cab504aed22"
Jul 31 22:36:56.746090 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:36:56.746051    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9c96e5e7-kzrns"]
Jul 31 22:36:56.748650 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:36:56.748624    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9c96e5e7-kzrns"]
Jul 31 22:36:57.335278 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:36:57.335236    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e60320ca-12a8-4475-8f36-6f5e92510cb4" path="/var/lib/kubelet/pods/e60320ca-12a8-4475-8f36-6f5e92510cb4/volumes"
Jul 31 22:39:51.407337 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:39:51.407291    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ddp8_79e15037-4ffd-47f1-b983-34f06895b2a3/ovn-acl-logging/0.log"
Jul 31 22:39:51.412624 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:39:51.412602    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ddp8_79e15037-4ffd-47f1-b983-34f06895b2a3/ovn-acl-logging/0.log"
Jul 31 22:39:51.521320 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:39:51.521279    2573 scope.go:117] "RemoveContainer" containerID="2d33bd0ed4d11d77ce8e8628cbe45b7915111e72d942218b4abda57780f7af44"
Jul 31 22:40:27.336888 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:27.336805    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-627bf7/test-model-627bf7-kserve-7678dd86f7-82jlg"]
Jul 31 22:40:27.337511 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:27.337114    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e60320ca-12a8-4475-8f36-6f5e92510cb4" containerName="revoke-keys"
Jul 31 22:40:27.337511 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:27.337125    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e60320ca-12a8-4475-8f36-6f5e92510cb4" containerName="revoke-keys"
Jul 31 22:40:27.337511 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:27.337178    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e60320ca-12a8-4475-8f36-6f5e92510cb4" containerName="revoke-keys"
Jul 31 22:40:27.340257 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:27.340235    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-627bf7/test-model-627bf7-kserve-7678dd86f7-82jlg"
Jul 31 22:40:27.343359 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:27.343326    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-627bf7\"/\"test-model-627bf7-kserve-self-signed-certs\""
Jul 31 22:40:27.343359 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:27.343339    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-627bf7\"/\"default-dockercfg-zrh9j\""
Jul 31 22:40:27.343359 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:27.343350    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-627bf7\"/\"kube-root-ca.crt\""
Jul 31 22:40:27.343359 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:27.343357    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-627bf7\"/\"openshift-service-ca.crt\""
Jul 31 22:40:27.349691 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:27.349666    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-627bf7/test-model-627bf7-kserve-7678dd86f7-82jlg"]
Jul 31 22:40:27.401584 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:27.401539    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smlpt\" (UniqueName: \"kubernetes.io/projected/1648ed23-9331-4984-8bcc-126c2debdd3a-kube-api-access-smlpt\") pod \"test-model-627bf7-kserve-7678dd86f7-82jlg\" (UID: \"1648ed23-9331-4984-8bcc-126c2debdd3a\") " pod="ai-tenant-e2e-inf-a-627bf7/test-model-627bf7-kserve-7678dd86f7-82jlg"
Jul 31 22:40:27.401763 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:27.401604    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1648ed23-9331-4984-8bcc-126c2debdd3a-tls-certs\") pod \"test-model-627bf7-kserve-7678dd86f7-82jlg\" (UID: \"1648ed23-9331-4984-8bcc-126c2debdd3a\") " pod="ai-tenant-e2e-inf-a-627bf7/test-model-627bf7-kserve-7678dd86f7-82jlg"
Jul 31 22:40:27.401763 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:27.401640    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1648ed23-9331-4984-8bcc-126c2debdd3a-tmp-dir\") pod \"test-model-627bf7-kserve-7678dd86f7-82jlg\" (UID: \"1648ed23-9331-4984-8bcc-126c2debdd3a\") " pod="ai-tenant-e2e-inf-a-627bf7/test-model-627bf7-kserve-7678dd86f7-82jlg"
Jul 31 22:40:27.401763 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:27.401682    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1648ed23-9331-4984-8bcc-126c2debdd3a-dshm\") pod \"test-model-627bf7-kserve-7678dd86f7-82jlg\" (UID: \"1648ed23-9331-4984-8bcc-126c2debdd3a\") " pod="ai-tenant-e2e-inf-a-627bf7/test-model-627bf7-kserve-7678dd86f7-82jlg"
Jul 31 22:40:27.401763 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:27.401719    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1648ed23-9331-4984-8bcc-126c2debdd3a-home\") pod \"test-model-627bf7-kserve-7678dd86f7-82jlg\" (UID: \"1648ed23-9331-4984-8bcc-126c2debdd3a\") " pod="ai-tenant-e2e-inf-a-627bf7/test-model-627bf7-kserve-7678dd86f7-82jlg"
Jul 31 22:40:27.401763 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:27.401754    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1648ed23-9331-4984-8bcc-126c2debdd3a-model-cache\") pod \"test-model-627bf7-kserve-7678dd86f7-82jlg\" (UID: \"1648ed23-9331-4984-8bcc-126c2debdd3a\") " pod="ai-tenant-e2e-inf-a-627bf7/test-model-627bf7-kserve-7678dd86f7-82jlg"
Jul 31 22:40:27.502402 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:27.502356    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1648ed23-9331-4984-8bcc-126c2debdd3a-tmp-dir\") pod \"test-model-627bf7-kserve-7678dd86f7-82jlg\" (UID: \"1648ed23-9331-4984-8bcc-126c2debdd3a\") " pod="ai-tenant-e2e-inf-a-627bf7/test-model-627bf7-kserve-7678dd86f7-82jlg"
Jul 31 22:40:27.502587 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:27.502421    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1648ed23-9331-4984-8bcc-126c2debdd3a-dshm\") pod \"test-model-627bf7-kserve-7678dd86f7-82jlg\" (UID: \"1648ed23-9331-4984-8bcc-126c2debdd3a\") " pod="ai-tenant-e2e-inf-a-627bf7/test-model-627bf7-kserve-7678dd86f7-82jlg"
Jul 31 22:40:27.502587 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:27.502451    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1648ed23-9331-4984-8bcc-126c2debdd3a-home\") pod \"test-model-627bf7-kserve-7678dd86f7-82jlg\" (UID: \"1648ed23-9331-4984-8bcc-126c2debdd3a\") " pod="ai-tenant-e2e-inf-a-627bf7/test-model-627bf7-kserve-7678dd86f7-82jlg"
Jul 31 22:40:27.502587 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:27.502488    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1648ed23-9331-4984-8bcc-126c2debdd3a-model-cache\") pod \"test-model-627bf7-kserve-7678dd86f7-82jlg\" (UID: \"1648ed23-9331-4984-8bcc-126c2debdd3a\") " pod="ai-tenant-e2e-inf-a-627bf7/test-model-627bf7-kserve-7678dd86f7-82jlg"
Jul 31 22:40:27.502587 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:27.502512    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smlpt\" (UniqueName: \"kubernetes.io/projected/1648ed23-9331-4984-8bcc-126c2debdd3a-kube-api-access-smlpt\") pod \"test-model-627bf7-kserve-7678dd86f7-82jlg\" (UID: \"1648ed23-9331-4984-8bcc-126c2debdd3a\") " pod="ai-tenant-e2e-inf-a-627bf7/test-model-627bf7-kserve-7678dd86f7-82jlg"
Jul 31 22:40:27.502758 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:27.502671    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1648ed23-9331-4984-8bcc-126c2debdd3a-tls-certs\") pod \"test-model-627bf7-kserve-7678dd86f7-82jlg\" (UID: \"1648ed23-9331-4984-8bcc-126c2debdd3a\") " pod="ai-tenant-e2e-inf-a-627bf7/test-model-627bf7-kserve-7678dd86f7-82jlg"
Jul 31 22:40:27.502878 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:27.502857    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1648ed23-9331-4984-8bcc-126c2debdd3a-tmp-dir\") pod \"test-model-627bf7-kserve-7678dd86f7-82jlg\" (UID: \"1648ed23-9331-4984-8bcc-126c2debdd3a\") " pod="ai-tenant-e2e-inf-a-627bf7/test-model-627bf7-kserve-7678dd86f7-82jlg"
Jul 31 22:40:27.502944 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:27.502928    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1648ed23-9331-4984-8bcc-126c2debdd3a-home\") pod \"test-model-627bf7-kserve-7678dd86f7-82jlg\" (UID: \"1648ed23-9331-4984-8bcc-126c2debdd3a\") " pod="ai-tenant-e2e-inf-a-627bf7/test-model-627bf7-kserve-7678dd86f7-82jlg"
Jul 31 22:40:27.503001 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:27.502962    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1648ed23-9331-4984-8bcc-126c2debdd3a-model-cache\") pod \"test-model-627bf7-kserve-7678dd86f7-82jlg\" (UID: \"1648ed23-9331-4984-8bcc-126c2debdd3a\") " pod="ai-tenant-e2e-inf-a-627bf7/test-model-627bf7-kserve-7678dd86f7-82jlg"
Jul 31 22:40:27.504892 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:27.504866    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1648ed23-9331-4984-8bcc-126c2debdd3a-dshm\") pod \"test-model-627bf7-kserve-7678dd86f7-82jlg\" (UID: \"1648ed23-9331-4984-8bcc-126c2debdd3a\") " pod="ai-tenant-e2e-inf-a-627bf7/test-model-627bf7-kserve-7678dd86f7-82jlg"
Jul 31 22:40:27.505138 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:27.505115    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1648ed23-9331-4984-8bcc-126c2debdd3a-tls-certs\") pod \"test-model-627bf7-kserve-7678dd86f7-82jlg\" (UID: \"1648ed23-9331-4984-8bcc-126c2debdd3a\") " pod="ai-tenant-e2e-inf-a-627bf7/test-model-627bf7-kserve-7678dd86f7-82jlg"
Jul 31 22:40:27.512868 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:27.512842    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smlpt\" (UniqueName: \"kubernetes.io/projected/1648ed23-9331-4984-8bcc-126c2debdd3a-kube-api-access-smlpt\") pod \"test-model-627bf7-kserve-7678dd86f7-82jlg\" (UID: \"1648ed23-9331-4984-8bcc-126c2debdd3a\") " pod="ai-tenant-e2e-inf-a-627bf7/test-model-627bf7-kserve-7678dd86f7-82jlg"
Jul 31 22:40:27.651391 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:27.651270    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-627bf7/test-model-627bf7-kserve-7678dd86f7-82jlg"
Jul 31 22:40:27.793620 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:27.793590    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-627bf7/test-model-627bf7-kserve-7678dd86f7-82jlg"]
Jul 31 22:40:27.796164 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:40:27.796136    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1648ed23_9331_4984_8bcc_126c2debdd3a.slice/crio-348f2944c298f72bc1b0944ef6db2a22853649a88f5a1ffdd7ab6ecf1011cb9b WatchSource:0}: Error finding container 348f2944c298f72bc1b0944ef6db2a22853649a88f5a1ffdd7ab6ecf1011cb9b: Status 404 returned error can't find the container with id 348f2944c298f72bc1b0944ef6db2a22853649a88f5a1ffdd7ab6ecf1011cb9b
Jul 31 22:40:28.246243 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:28.246203    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-627bf7/test-model-627bf7-kserve-7678dd86f7-82jlg" event={"ID":"1648ed23-9331-4984-8bcc-126c2debdd3a","Type":"ContainerStarted","Data":"311d8d0f26cdc3d610a37eff51c06ef39e556d70f8f97fc2a2c4a6c282c836b3"}
Jul 31 22:40:28.246447 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:28.246256    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-627bf7/test-model-627bf7-kserve-7678dd86f7-82jlg" event={"ID":"1648ed23-9331-4984-8bcc-126c2debdd3a","Type":"ContainerStarted","Data":"348f2944c298f72bc1b0944ef6db2a22853649a88f5a1ffdd7ab6ecf1011cb9b"}
Jul 31 22:40:28.272609 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:28.272549    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-627bf7/test-model-627bf7-kserve-7678dd86f7-82jlg" podStartSLOduration=1.272529659 podStartE2EDuration="1.272529659s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:40:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:40:28.27138569 +0000 UTC m=+2437.366676839" watchObservedRunningTime="2026-07-31 22:40:28.272529659 +0000 UTC m=+2437.367821029"
Jul 31 22:40:37.651939 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:37.651905    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-627bf7/test-model-627bf7-kserve-7678dd86f7-82jlg"
Jul 31 22:40:37.652429 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:37.651962    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-627bf7/test-model-627bf7-kserve-7678dd86f7-82jlg"
Jul 31 22:40:37.664965 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:37.664940    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-627bf7/test-model-627bf7-kserve-7678dd86f7-82jlg"
Jul 31 22:40:38.307712 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:38.307681    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-627bf7/test-model-627bf7-kserve-7678dd86f7-82jlg"
Jul 31 22:40:54.438840 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:54.438803    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-ae5bab/test-model-ae5bab-kserve-6fcbd8d869-7fr6z"]
Jul 31 22:40:54.442449 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:54.442424    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ae5bab/test-model-ae5bab-kserve-6fcbd8d869-7fr6z"
Jul 31 22:40:54.444922 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:54.444902    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-ae5bab\"/\"kube-root-ca.crt\""
Jul 31 22:40:54.445094 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:54.444902    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-ae5bab\"/\"openshift-service-ca.crt\""
Jul 31 22:40:54.445886 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:54.445866    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-ae5bab\"/\"default-dockercfg-64gsq\""
Jul 31 22:40:54.445946 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:54.445891    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-ae5bab\"/\"test-model-ae5bab-kserve-self-signed-certs\""
Jul 31 22:40:54.452709 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:54.452685    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-ae5bab/test-model-ae5bab-kserve-6fcbd8d869-7fr6z"]
Jul 31 22:40:54.545972 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:54.545932    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a09440b6-ae31-4978-9946-79edb802b075-model-cache\") pod \"test-model-ae5bab-kserve-6fcbd8d869-7fr6z\" (UID: \"a09440b6-ae31-4978-9946-79edb802b075\") " pod="ai-tenant-e2e-inf-b-ae5bab/test-model-ae5bab-kserve-6fcbd8d869-7fr6z"
Jul 31 22:40:54.545972 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:54.545982    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a09440b6-ae31-4978-9946-79edb802b075-dshm\") pod \"test-model-ae5bab-kserve-6fcbd8d869-7fr6z\" (UID: \"a09440b6-ae31-4978-9946-79edb802b075\") " pod="ai-tenant-e2e-inf-b-ae5bab/test-model-ae5bab-kserve-6fcbd8d869-7fr6z"
Jul 31 22:40:54.546235 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:54.546006    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a09440b6-ae31-4978-9946-79edb802b075-tmp-dir\") pod \"test-model-ae5bab-kserve-6fcbd8d869-7fr6z\" (UID: \"a09440b6-ae31-4978-9946-79edb802b075\") " pod="ai-tenant-e2e-inf-b-ae5bab/test-model-ae5bab-kserve-6fcbd8d869-7fr6z"
Jul 31 22:40:54.546235 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:54.546058    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a09440b6-ae31-4978-9946-79edb802b075-tls-certs\") pod \"test-model-ae5bab-kserve-6fcbd8d869-7fr6z\" (UID: \"a09440b6-ae31-4978-9946-79edb802b075\") " pod="ai-tenant-e2e-inf-b-ae5bab/test-model-ae5bab-kserve-6fcbd8d869-7fr6z"
Jul 31 22:40:54.546235 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:54.546159    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a09440b6-ae31-4978-9946-79edb802b075-home\") pod \"test-model-ae5bab-kserve-6fcbd8d869-7fr6z\" (UID: \"a09440b6-ae31-4978-9946-79edb802b075\") " pod="ai-tenant-e2e-inf-b-ae5bab/test-model-ae5bab-kserve-6fcbd8d869-7fr6z"
Jul 31 22:40:54.546235 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:54.546183    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pcb9\" (UniqueName: \"kubernetes.io/projected/a09440b6-ae31-4978-9946-79edb802b075-kube-api-access-4pcb9\") pod \"test-model-ae5bab-kserve-6fcbd8d869-7fr6z\" (UID: \"a09440b6-ae31-4978-9946-79edb802b075\") " pod="ai-tenant-e2e-inf-b-ae5bab/test-model-ae5bab-kserve-6fcbd8d869-7fr6z"
Jul 31 22:40:54.647353 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:54.647315    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a09440b6-ae31-4978-9946-79edb802b075-model-cache\") pod \"test-model-ae5bab-kserve-6fcbd8d869-7fr6z\" (UID: \"a09440b6-ae31-4978-9946-79edb802b075\") " pod="ai-tenant-e2e-inf-b-ae5bab/test-model-ae5bab-kserve-6fcbd8d869-7fr6z"
Jul 31 22:40:54.647561 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:54.647366    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a09440b6-ae31-4978-9946-79edb802b075-dshm\") pod \"test-model-ae5bab-kserve-6fcbd8d869-7fr6z\" (UID: \"a09440b6-ae31-4978-9946-79edb802b075\") " pod="ai-tenant-e2e-inf-b-ae5bab/test-model-ae5bab-kserve-6fcbd8d869-7fr6z"
Jul 31 22:40:54.647561 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:54.647399    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a09440b6-ae31-4978-9946-79edb802b075-tmp-dir\") pod \"test-model-ae5bab-kserve-6fcbd8d869-7fr6z\" (UID: \"a09440b6-ae31-4978-9946-79edb802b075\") " pod="ai-tenant-e2e-inf-b-ae5bab/test-model-ae5bab-kserve-6fcbd8d869-7fr6z"
Jul 31 22:40:54.647561 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:54.647421    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a09440b6-ae31-4978-9946-79edb802b075-tls-certs\") pod \"test-model-ae5bab-kserve-6fcbd8d869-7fr6z\" (UID: \"a09440b6-ae31-4978-9946-79edb802b075\") " pod="ai-tenant-e2e-inf-b-ae5bab/test-model-ae5bab-kserve-6fcbd8d869-7fr6z"
Jul 31 22:40:54.647561 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:54.647470    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a09440b6-ae31-4978-9946-79edb802b075-home\") pod \"test-model-ae5bab-kserve-6fcbd8d869-7fr6z\" (UID: \"a09440b6-ae31-4978-9946-79edb802b075\") " pod="ai-tenant-e2e-inf-b-ae5bab/test-model-ae5bab-kserve-6fcbd8d869-7fr6z"
Jul 31 22:40:54.647561 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:54.647530    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pcb9\" (UniqueName: \"kubernetes.io/projected/a09440b6-ae31-4978-9946-79edb802b075-kube-api-access-4pcb9\") pod \"test-model-ae5bab-kserve-6fcbd8d869-7fr6z\" (UID: \"a09440b6-ae31-4978-9946-79edb802b075\") " pod="ai-tenant-e2e-inf-b-ae5bab/test-model-ae5bab-kserve-6fcbd8d869-7fr6z"
Jul 31 22:40:54.647846 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:54.647759    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a09440b6-ae31-4978-9946-79edb802b075-model-cache\") pod \"test-model-ae5bab-kserve-6fcbd8d869-7fr6z\" (UID: \"a09440b6-ae31-4978-9946-79edb802b075\") " pod="ai-tenant-e2e-inf-b-ae5bab/test-model-ae5bab-kserve-6fcbd8d869-7fr6z"
Jul 31 22:40:54.647846 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:54.647801    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a09440b6-ae31-4978-9946-79edb802b075-home\") pod \"test-model-ae5bab-kserve-6fcbd8d869-7fr6z\" (UID: \"a09440b6-ae31-4978-9946-79edb802b075\") " pod="ai-tenant-e2e-inf-b-ae5bab/test-model-ae5bab-kserve-6fcbd8d869-7fr6z"
Jul 31 22:40:54.647846 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:54.647835    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a09440b6-ae31-4978-9946-79edb802b075-tmp-dir\") pod \"test-model-ae5bab-kserve-6fcbd8d869-7fr6z\" (UID: \"a09440b6-ae31-4978-9946-79edb802b075\") " pod="ai-tenant-e2e-inf-b-ae5bab/test-model-ae5bab-kserve-6fcbd8d869-7fr6z"
Jul 31 22:40:54.649752 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:54.649731    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a09440b6-ae31-4978-9946-79edb802b075-dshm\") pod \"test-model-ae5bab-kserve-6fcbd8d869-7fr6z\" (UID: \"a09440b6-ae31-4978-9946-79edb802b075\") " pod="ai-tenant-e2e-inf-b-ae5bab/test-model-ae5bab-kserve-6fcbd8d869-7fr6z"
Jul 31 22:40:54.650024 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:54.650005    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a09440b6-ae31-4978-9946-79edb802b075-tls-certs\") pod \"test-model-ae5bab-kserve-6fcbd8d869-7fr6z\" (UID: \"a09440b6-ae31-4978-9946-79edb802b075\") " pod="ai-tenant-e2e-inf-b-ae5bab/test-model-ae5bab-kserve-6fcbd8d869-7fr6z"
Jul 31 22:40:54.656116 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:54.656093    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pcb9\" (UniqueName: \"kubernetes.io/projected/a09440b6-ae31-4978-9946-79edb802b075-kube-api-access-4pcb9\") pod \"test-model-ae5bab-kserve-6fcbd8d869-7fr6z\" (UID: \"a09440b6-ae31-4978-9946-79edb802b075\") " pod="ai-tenant-e2e-inf-b-ae5bab/test-model-ae5bab-kserve-6fcbd8d869-7fr6z"
Jul 31 22:40:54.754635 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:54.754525    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ae5bab/test-model-ae5bab-kserve-6fcbd8d869-7fr6z"
Jul 31 22:40:54.890578 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:54.890546    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-ae5bab/test-model-ae5bab-kserve-6fcbd8d869-7fr6z"]
Jul 31 22:40:54.894550 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:40:54.894516    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda09440b6_ae31_4978_9946_79edb802b075.slice/crio-bcb4f3f771e1b6887e5da0698de409f6df0105817945d7e187a0e1b60bb5b0ea WatchSource:0}: Error finding container bcb4f3f771e1b6887e5da0698de409f6df0105817945d7e187a0e1b60bb5b0ea: Status 404 returned error can't find the container with id bcb4f3f771e1b6887e5da0698de409f6df0105817945d7e187a0e1b60bb5b0ea
Jul 31 22:40:55.377571 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:55.377532    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ae5bab/test-model-ae5bab-kserve-6fcbd8d869-7fr6z" event={"ID":"a09440b6-ae31-4978-9946-79edb802b075","Type":"ContainerStarted","Data":"6649a3f763393ad3a58b73c41403bcd4a4336136e6da1b39b78622bf5e481036"}
Jul 31 22:40:55.377571 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:55.377573    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ae5bab/test-model-ae5bab-kserve-6fcbd8d869-7fr6z" event={"ID":"a09440b6-ae31-4978-9946-79edb802b075","Type":"ContainerStarted","Data":"bcb4f3f771e1b6887e5da0698de409f6df0105817945d7e187a0e1b60bb5b0ea"}
Jul 31 22:40:55.395318 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:40:55.395255    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-ae5bab/test-model-ae5bab-kserve-6fcbd8d869-7fr6z" podStartSLOduration=1.395237203 podStartE2EDuration="1.395237203s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:40:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:40:55.394636706 +0000 UTC m=+2464.489927875" watchObservedRunningTime="2026-07-31 22:40:55.395237203 +0000 UTC m=+2464.490528349"
Jul 31 22:41:04.754861 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:04.754818    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-ae5bab/test-model-ae5bab-kserve-6fcbd8d869-7fr6z"
Jul 31 22:41:04.755449 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:04.754901    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-ae5bab/test-model-ae5bab-kserve-6fcbd8d869-7fr6z"
Jul 31 22:41:04.767575 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:04.767548    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-ae5bab/test-model-ae5bab-kserve-6fcbd8d869-7fr6z"
Jul 31 22:41:05.431791 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:05.431753    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-ae5bab/test-model-ae5bab-kserve-6fcbd8d869-7fr6z"
Jul 31 22:41:38.954985 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:38.954952    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-627bf7/test-model-627bf7-kserve-7678dd86f7-82jlg"]
Jul 31 22:41:39.880837 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:39.880797    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-ae5bab/test-model-ae5bab-kserve-6fcbd8d869-7fr6z"]
Jul 31 22:41:40.028161 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:40.028131    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-627bf7-2xhjb"]
Jul 31 22:41:40.031565 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:40.031542    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-627bf7-2xhjb"
Jul 31 22:41:40.033950 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:40.033923    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 31 22:41:40.034093 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:40.033956    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lgfz6\""
Jul 31 22:41:40.040340 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:40.040311    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-627bf7-2xhjb"]
Jul 31 22:41:40.067237 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:40.067199    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1eeb3cca-dd4b-4b28-840c-a7be7268f32d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-627bf7-2xhjb\" (UID: \"1eeb3cca-dd4b-4b28-840c-a7be7268f32d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-627bf7-2xhjb"
Jul 31 22:41:40.168553 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:40.168521    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1eeb3cca-dd4b-4b28-840c-a7be7268f32d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-627bf7-2xhjb\" (UID: \"1eeb3cca-dd4b-4b28-840c-a7be7268f32d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-627bf7-2xhjb"
Jul 31 22:41:40.169177 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:40.169156    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1eeb3cca-dd4b-4b28-840c-a7be7268f32d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-627bf7-2xhjb\" (UID: \"1eeb3cca-dd4b-4b28-840c-a7be7268f32d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-627bf7-2xhjb"
Jul 31 22:41:40.344663 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:40.344617    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-627bf7-2xhjb"
Jul 31 22:41:40.485731 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:40.485703    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-627bf7-2xhjb"]
Jul 31 22:41:40.488551 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:41:40.488516    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1eeb3cca_dd4b_4b28_840c_a7be7268f32d.slice/crio-1c838152e950f19f33eee647a3cb42320ea46dca03f7c3d065c393dcb8d02080 WatchSource:0}: Error finding container 1c838152e950f19f33eee647a3cb42320ea46dca03f7c3d065c393dcb8d02080: Status 404 returned error can't find the container with id 1c838152e950f19f33eee647a3cb42320ea46dca03f7c3d065c393dcb8d02080
Jul 31 22:41:40.588220 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:40.588169    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-627bf7-2xhjb" event={"ID":"1eeb3cca-dd4b-4b28-840c-a7be7268f32d","Type":"ContainerStarted","Data":"1c838152e950f19f33eee647a3cb42320ea46dca03f7c3d065c393dcb8d02080"}
Jul 31 22:41:41.594357 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:41.594249    2573 generic.go:356] "Generic (PLEG): container finished" podID="1eeb3cca-dd4b-4b28-840c-a7be7268f32d" containerID="ef0a4bdea60221cb0037e8158f48249079e92446e85091885f0d584bb3357e27" exitCode=0
Jul 31 22:41:41.594731 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:41.594352    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-627bf7-2xhjb" event={"ID":"1eeb3cca-dd4b-4b28-840c-a7be7268f32d","Type":"ContainerDied","Data":"ef0a4bdea60221cb0037e8158f48249079e92446e85091885f0d584bb3357e27"}
Jul 31 22:41:42.742131 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:42.742101    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-627bf7-2xhjb"
Jul 31 22:41:42.791284 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:42.791245    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1eeb3cca-dd4b-4b28-840c-a7be7268f32d-maas-api-service-ca\") pod \"1eeb3cca-dd4b-4b28-840c-a7be7268f32d\" (UID: \"1eeb3cca-dd4b-4b28-840c-a7be7268f32d\") "
Jul 31 22:41:42.791636 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:42.791613    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1eeb3cca-dd4b-4b28-840c-a7be7268f32d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1eeb3cca-dd4b-4b28-840c-a7be7268f32d" (UID: "1eeb3cca-dd4b-4b28-840c-a7be7268f32d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:41:42.892932 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:42.892843    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1eeb3cca-dd4b-4b28-840c-a7be7268f32d-maas-api-service-ca\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:41:43.604929 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:43.604840    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-627bf7-2xhjb" event={"ID":"1eeb3cca-dd4b-4b28-840c-a7be7268f32d","Type":"ContainerDied","Data":"1c838152e950f19f33eee647a3cb42320ea46dca03f7c3d065c393dcb8d02080"}
Jul 31 22:41:43.604929 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:43.604863    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-627bf7-2xhjb"
Jul 31 22:41:43.604929 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:43.604892    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1c838152e950f19f33eee647a3cb42320ea46dca03f7c3d065c393dcb8d02080"
Jul 31 22:41:50.657242 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:50.657204    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-627bf7-2xhjb"]
Jul 31 22:41:50.660381 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:50.660355    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-627bf7-2xhjb"]
Jul 31 22:41:51.335407 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:51.335373    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1eeb3cca-dd4b-4b28-840c-a7be7268f32d" path="/var/lib/kubelet/pods/1eeb3cca-dd4b-4b28-840c-a7be7268f32d/volumes"
Jul 31 22:41:53.974544 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:53.974495    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-627bf7/test-model-627bf7-kserve-7678dd86f7-82jlg" podUID="1648ed23-9331-4984-8bcc-126c2debdd3a" containerName="main" containerID="cri-o://311d8d0f26cdc3d610a37eff51c06ef39e556d70f8f97fc2a2c4a6c282c836b3" gracePeriod=45
Jul 31 22:41:54.250444 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:54.250414    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-627bf7/test-model-627bf7-kserve-7678dd86f7-82jlg"
Jul 31 22:41:54.303314 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:54.303275    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1648ed23-9331-4984-8bcc-126c2debdd3a-model-cache\") pod \"1648ed23-9331-4984-8bcc-126c2debdd3a\" (UID: \"1648ed23-9331-4984-8bcc-126c2debdd3a\") "
Jul 31 22:41:54.303492 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:54.303371    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1648ed23-9331-4984-8bcc-126c2debdd3a-tmp-dir\") pod \"1648ed23-9331-4984-8bcc-126c2debdd3a\" (UID: \"1648ed23-9331-4984-8bcc-126c2debdd3a\") "
Jul 31 22:41:54.303492 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:54.303400    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1648ed23-9331-4984-8bcc-126c2debdd3a-dshm\") pod \"1648ed23-9331-4984-8bcc-126c2debdd3a\" (UID: \"1648ed23-9331-4984-8bcc-126c2debdd3a\") "
Jul 31 22:41:54.303492 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:54.303417    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1648ed23-9331-4984-8bcc-126c2debdd3a-home\") pod \"1648ed23-9331-4984-8bcc-126c2debdd3a\" (UID: \"1648ed23-9331-4984-8bcc-126c2debdd3a\") "
Jul 31 22:41:54.303492 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:54.303458    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1648ed23-9331-4984-8bcc-126c2debdd3a-tls-certs\") pod \"1648ed23-9331-4984-8bcc-126c2debdd3a\" (UID: \"1648ed23-9331-4984-8bcc-126c2debdd3a\") "
Jul 31 22:41:54.303492 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:54.303482    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smlpt\" (UniqueName: \"kubernetes.io/projected/1648ed23-9331-4984-8bcc-126c2debdd3a-kube-api-access-smlpt\") pod \"1648ed23-9331-4984-8bcc-126c2debdd3a\" (UID: \"1648ed23-9331-4984-8bcc-126c2debdd3a\") "
Jul 31 22:41:54.303726 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:54.303598    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1648ed23-9331-4984-8bcc-126c2debdd3a-model-cache" (OuterVolumeSpecName: "model-cache") pod "1648ed23-9331-4984-8bcc-126c2debdd3a" (UID: "1648ed23-9331-4984-8bcc-126c2debdd3a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:41:54.303788 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:54.303721    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1648ed23-9331-4984-8bcc-126c2debdd3a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1648ed23-9331-4984-8bcc-126c2debdd3a" (UID: "1648ed23-9331-4984-8bcc-126c2debdd3a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:41:54.303846 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:54.303792    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1648ed23-9331-4984-8bcc-126c2debdd3a-model-cache\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:41:54.303846 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:54.303793    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1648ed23-9331-4984-8bcc-126c2debdd3a-home" (OuterVolumeSpecName: "home") pod "1648ed23-9331-4984-8bcc-126c2debdd3a" (UID: "1648ed23-9331-4984-8bcc-126c2debdd3a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:41:54.305953 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:54.305924    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1648ed23-9331-4984-8bcc-126c2debdd3a-dshm" (OuterVolumeSpecName: "dshm") pod "1648ed23-9331-4984-8bcc-126c2debdd3a" (UID: "1648ed23-9331-4984-8bcc-126c2debdd3a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:41:54.306052 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:54.305994    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1648ed23-9331-4984-8bcc-126c2debdd3a-kube-api-access-smlpt" (OuterVolumeSpecName: "kube-api-access-smlpt") pod "1648ed23-9331-4984-8bcc-126c2debdd3a" (UID: "1648ed23-9331-4984-8bcc-126c2debdd3a"). InnerVolumeSpecName "kube-api-access-smlpt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:41:54.306052 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:54.306023    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1648ed23-9331-4984-8bcc-126c2debdd3a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1648ed23-9331-4984-8bcc-126c2debdd3a" (UID: "1648ed23-9331-4984-8bcc-126c2debdd3a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:41:54.404614 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:54.404570    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1648ed23-9331-4984-8bcc-126c2debdd3a-tmp-dir\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:41:54.404614 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:54.404604    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1648ed23-9331-4984-8bcc-126c2debdd3a-dshm\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:41:54.404614 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:54.404613    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1648ed23-9331-4984-8bcc-126c2debdd3a-home\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:41:54.404614 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:54.404621    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1648ed23-9331-4984-8bcc-126c2debdd3a-tls-certs\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:41:54.404893 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:54.404629    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smlpt\" (UniqueName: \"kubernetes.io/projected/1648ed23-9331-4984-8bcc-126c2debdd3a-kube-api-access-smlpt\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:41:54.654692 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:54.654598    2573 generic.go:356] "Generic (PLEG): container finished" podID="1648ed23-9331-4984-8bcc-126c2debdd3a" containerID="311d8d0f26cdc3d610a37eff51c06ef39e556d70f8f97fc2a2c4a6c282c836b3" exitCode=0
Jul 31 22:41:54.654692 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:54.654650    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-627bf7/test-model-627bf7-kserve-7678dd86f7-82jlg"
Jul 31 22:41:54.654692 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:54.654682    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-627bf7/test-model-627bf7-kserve-7678dd86f7-82jlg" event={"ID":"1648ed23-9331-4984-8bcc-126c2debdd3a","Type":"ContainerDied","Data":"311d8d0f26cdc3d610a37eff51c06ef39e556d70f8f97fc2a2c4a6c282c836b3"}
Jul 31 22:41:54.654915 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:54.654730    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-627bf7/test-model-627bf7-kserve-7678dd86f7-82jlg" event={"ID":"1648ed23-9331-4984-8bcc-126c2debdd3a","Type":"ContainerDied","Data":"348f2944c298f72bc1b0944ef6db2a22853649a88f5a1ffdd7ab6ecf1011cb9b"}
Jul 31 22:41:54.654915 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:54.654754    2573 scope.go:117] "RemoveContainer" containerID="311d8d0f26cdc3d610a37eff51c06ef39e556d70f8f97fc2a2c4a6c282c836b3"
Jul 31 22:41:54.663959 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:54.663940    2573 scope.go:117] "RemoveContainer" containerID="311d8d0f26cdc3d610a37eff51c06ef39e556d70f8f97fc2a2c4a6c282c836b3"
Jul 31 22:41:54.664268 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:41:54.664247    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"311d8d0f26cdc3d610a37eff51c06ef39e556d70f8f97fc2a2c4a6c282c836b3\": container with ID starting with 311d8d0f26cdc3d610a37eff51c06ef39e556d70f8f97fc2a2c4a6c282c836b3 not found: ID does not exist" containerID="311d8d0f26cdc3d610a37eff51c06ef39e556d70f8f97fc2a2c4a6c282c836b3"
Jul 31 22:41:54.664359 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:54.664280    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"311d8d0f26cdc3d610a37eff51c06ef39e556d70f8f97fc2a2c4a6c282c836b3"} err="failed to get container status \"311d8d0f26cdc3d610a37eff51c06ef39e556d70f8f97fc2a2c4a6c282c836b3\": rpc error: code = NotFound desc = could not find container \"311d8d0f26cdc3d610a37eff51c06ef39e556d70f8f97fc2a2c4a6c282c836b3\": container with ID starting with 311d8d0f26cdc3d610a37eff51c06ef39e556d70f8f97fc2a2c4a6c282c836b3 not found: ID does not exist"
Jul 31 22:41:54.677118 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:54.677084    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-627bf7/test-model-627bf7-kserve-7678dd86f7-82jlg"]
Jul 31 22:41:54.682852 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:54.682822    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-627bf7/test-model-627bf7-kserve-7678dd86f7-82jlg"]
Jul 31 22:41:54.901145 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:54.901076    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-ae5bab/test-model-ae5bab-kserve-6fcbd8d869-7fr6z" podUID="a09440b6-ae31-4978-9946-79edb802b075" containerName="main" containerID="cri-o://6649a3f763393ad3a58b73c41403bcd4a4336136e6da1b39b78622bf5e481036" gracePeriod=45
Jul 31 22:41:55.160053 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:55.159976    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ae5bab/test-model-ae5bab-kserve-6fcbd8d869-7fr6z"
Jul 31 22:41:55.212758 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:55.212720    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a09440b6-ae31-4978-9946-79edb802b075-model-cache\") pod \"a09440b6-ae31-4978-9946-79edb802b075\" (UID: \"a09440b6-ae31-4978-9946-79edb802b075\") "
Jul 31 22:41:55.212955 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:55.212814    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a09440b6-ae31-4978-9946-79edb802b075-tmp-dir\") pod \"a09440b6-ae31-4978-9946-79edb802b075\" (UID: \"a09440b6-ae31-4978-9946-79edb802b075\") "
Jul 31 22:41:55.212955 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:55.212838    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a09440b6-ae31-4978-9946-79edb802b075-home\") pod \"a09440b6-ae31-4978-9946-79edb802b075\" (UID: \"a09440b6-ae31-4978-9946-79edb802b075\") "
Jul 31 22:41:55.212955 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:55.212865    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4pcb9\" (UniqueName: \"kubernetes.io/projected/a09440b6-ae31-4978-9946-79edb802b075-kube-api-access-4pcb9\") pod \"a09440b6-ae31-4978-9946-79edb802b075\" (UID: \"a09440b6-ae31-4978-9946-79edb802b075\") "
Jul 31 22:41:55.212955 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:55.212924    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a09440b6-ae31-4978-9946-79edb802b075-dshm\") pod \"a09440b6-ae31-4978-9946-79edb802b075\" (UID: \"a09440b6-ae31-4978-9946-79edb802b075\") "
Jul 31 22:41:55.213179 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:55.212979    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a09440b6-ae31-4978-9946-79edb802b075-tls-certs\") pod \"a09440b6-ae31-4978-9946-79edb802b075\" (UID: \"a09440b6-ae31-4978-9946-79edb802b075\") "
Jul 31 22:41:55.213179 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:55.213057    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a09440b6-ae31-4978-9946-79edb802b075-model-cache" (OuterVolumeSpecName: "model-cache") pod "a09440b6-ae31-4978-9946-79edb802b075" (UID: "a09440b6-ae31-4978-9946-79edb802b075"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:41:55.213179 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:55.213146    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a09440b6-ae31-4978-9946-79edb802b075-home" (OuterVolumeSpecName: "home") pod "a09440b6-ae31-4978-9946-79edb802b075" (UID: "a09440b6-ae31-4978-9946-79edb802b075"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:41:55.213341 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:55.213178    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a09440b6-ae31-4978-9946-79edb802b075-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a09440b6-ae31-4978-9946-79edb802b075" (UID: "a09440b6-ae31-4978-9946-79edb802b075"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:41:55.213341 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:55.213278    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a09440b6-ae31-4978-9946-79edb802b075-tmp-dir\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:41:55.213341 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:55.213330    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a09440b6-ae31-4978-9946-79edb802b075-home\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:41:55.213462 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:55.213347    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a09440b6-ae31-4978-9946-79edb802b075-model-cache\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:41:55.215335 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:55.215286    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a09440b6-ae31-4978-9946-79edb802b075-dshm" (OuterVolumeSpecName: "dshm") pod "a09440b6-ae31-4978-9946-79edb802b075" (UID: "a09440b6-ae31-4978-9946-79edb802b075"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:41:55.215452 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:55.215342    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a09440b6-ae31-4978-9946-79edb802b075-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a09440b6-ae31-4978-9946-79edb802b075" (UID: "a09440b6-ae31-4978-9946-79edb802b075"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:41:55.215452 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:55.215366    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a09440b6-ae31-4978-9946-79edb802b075-kube-api-access-4pcb9" (OuterVolumeSpecName: "kube-api-access-4pcb9") pod "a09440b6-ae31-4978-9946-79edb802b075" (UID: "a09440b6-ae31-4978-9946-79edb802b075"). InnerVolumeSpecName "kube-api-access-4pcb9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:41:55.314631 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:55.314590    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pcb9\" (UniqueName: \"kubernetes.io/projected/a09440b6-ae31-4978-9946-79edb802b075-kube-api-access-4pcb9\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:41:55.314631 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:55.314623    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a09440b6-ae31-4978-9946-79edb802b075-dshm\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:41:55.314631 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:55.314632    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a09440b6-ae31-4978-9946-79edb802b075-tls-certs\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:41:55.335175 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:55.335140    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1648ed23-9331-4984-8bcc-126c2debdd3a" path="/var/lib/kubelet/pods/1648ed23-9331-4984-8bcc-126c2debdd3a/volumes"
Jul 31 22:41:55.660351 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:55.660313    2573 generic.go:356] "Generic (PLEG): container finished" podID="a09440b6-ae31-4978-9946-79edb802b075" containerID="6649a3f763393ad3a58b73c41403bcd4a4336136e6da1b39b78622bf5e481036" exitCode=0
Jul 31 22:41:55.660351 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:55.660351    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ae5bab/test-model-ae5bab-kserve-6fcbd8d869-7fr6z"
Jul 31 22:41:55.660605 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:55.660396    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ae5bab/test-model-ae5bab-kserve-6fcbd8d869-7fr6z" event={"ID":"a09440b6-ae31-4978-9946-79edb802b075","Type":"ContainerDied","Data":"6649a3f763393ad3a58b73c41403bcd4a4336136e6da1b39b78622bf5e481036"}
Jul 31 22:41:55.660605 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:55.660444    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ae5bab/test-model-ae5bab-kserve-6fcbd8d869-7fr6z" event={"ID":"a09440b6-ae31-4978-9946-79edb802b075","Type":"ContainerDied","Data":"bcb4f3f771e1b6887e5da0698de409f6df0105817945d7e187a0e1b60bb5b0ea"}
Jul 31 22:41:55.660605 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:55.660468    2573 scope.go:117] "RemoveContainer" containerID="6649a3f763393ad3a58b73c41403bcd4a4336136e6da1b39b78622bf5e481036"
Jul 31 22:41:55.669469 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:55.669451    2573 scope.go:117] "RemoveContainer" containerID="6649a3f763393ad3a58b73c41403bcd4a4336136e6da1b39b78622bf5e481036"
Jul 31 22:41:55.669773 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:41:55.669753    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6649a3f763393ad3a58b73c41403bcd4a4336136e6da1b39b78622bf5e481036\": container with ID starting with 6649a3f763393ad3a58b73c41403bcd4a4336136e6da1b39b78622bf5e481036 not found: ID does not exist" containerID="6649a3f763393ad3a58b73c41403bcd4a4336136e6da1b39b78622bf5e481036"
Jul 31 22:41:55.669821 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:55.669783    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6649a3f763393ad3a58b73c41403bcd4a4336136e6da1b39b78622bf5e481036"} err="failed to get container status \"6649a3f763393ad3a58b73c41403bcd4a4336136e6da1b39b78622bf5e481036\": rpc error: code = NotFound desc = could not find container \"6649a3f763393ad3a58b73c41403bcd4a4336136e6da1b39b78622bf5e481036\": container with ID starting with 6649a3f763393ad3a58b73c41403bcd4a4336136e6da1b39b78622bf5e481036 not found: ID does not exist"
Jul 31 22:41:55.676426 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:55.676397    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-ae5bab/test-model-ae5bab-kserve-6fcbd8d869-7fr6z"]
Jul 31 22:41:55.680466 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:55.680436    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-ae5bab/test-model-ae5bab-kserve-6fcbd8d869-7fr6z"]
Jul 31 22:41:57.335826 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:57.335789    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a09440b6-ae31-4978-9946-79edb802b075" path="/var/lib/kubelet/pods/a09440b6-ae31-4978-9946-79edb802b075/volumes"
Jul 31 22:41:57.547624 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:57.547591    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ae5bab-mv9np"]
Jul 31 22:41:57.547931 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:57.547919    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a09440b6-ae31-4978-9946-79edb802b075" containerName="main"
Jul 31 22:41:57.547988 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:57.547933    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a09440b6-ae31-4978-9946-79edb802b075" containerName="main"
Jul 31 22:41:57.547988 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:57.547956    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1648ed23-9331-4984-8bcc-126c2debdd3a" containerName="main"
Jul 31 22:41:57.547988 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:57.547962    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1648ed23-9331-4984-8bcc-126c2debdd3a" containerName="main"
Jul 31 22:41:57.547988 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:57.547968    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1eeb3cca-dd4b-4b28-840c-a7be7268f32d" containerName="revoke-keys"
Jul 31 22:41:57.547988 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:57.547973    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1eeb3cca-dd4b-4b28-840c-a7be7268f32d" containerName="revoke-keys"
Jul 31 22:41:57.548145 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:57.548035    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1648ed23-9331-4984-8bcc-126c2debdd3a" containerName="main"
Jul 31 22:41:57.548145 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:57.548045    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a09440b6-ae31-4978-9946-79edb802b075" containerName="main"
Jul 31 22:41:57.548145 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:57.548052    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1eeb3cca-dd4b-4b28-840c-a7be7268f32d" containerName="revoke-keys"
Jul 31 22:41:57.552396 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:57.552375    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ae5bab-mv9np"
Jul 31 22:41:57.555188 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:57.555162    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 31 22:41:57.555188 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:57.555174    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lgfz6\""
Jul 31 22:41:57.558992 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:57.558955    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ae5bab-mv9np"]
Jul 31 22:41:57.638031 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:57.637931    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a3319cc-6fc3-471e-9b6d-84dcc6ce4b07-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-ae5bab-mv9np\" (UID: \"7a3319cc-6fc3-471e-9b6d-84dcc6ce4b07\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ae5bab-mv9np"
Jul 31 22:41:57.738589 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:57.738545    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a3319cc-6fc3-471e-9b6d-84dcc6ce4b07-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-ae5bab-mv9np\" (UID: \"7a3319cc-6fc3-471e-9b6d-84dcc6ce4b07\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ae5bab-mv9np"
Jul 31 22:41:57.739196 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:57.739175    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a3319cc-6fc3-471e-9b6d-84dcc6ce4b07-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-ae5bab-mv9np\" (UID: \"7a3319cc-6fc3-471e-9b6d-84dcc6ce4b07\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ae5bab-mv9np"
Jul 31 22:41:57.864527 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:57.864475    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ae5bab-mv9np"
Jul 31 22:41:58.011724 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:58.011673    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ae5bab-mv9np"]
Jul 31 22:41:58.014288 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:41:58.014261    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a3319cc_6fc3_471e_9b6d_84dcc6ce4b07.slice/crio-376a6215fb632c61546850fcad20243d445283f8469dbed1d12077e1b9f778d5 WatchSource:0}: Error finding container 376a6215fb632c61546850fcad20243d445283f8469dbed1d12077e1b9f778d5: Status 404 returned error can't find the container with id 376a6215fb632c61546850fcad20243d445283f8469dbed1d12077e1b9f778d5
Jul 31 22:41:58.679194 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:58.679164    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ae5bab-mv9np" event={"ID":"7a3319cc-6fc3-471e-9b6d-84dcc6ce4b07","Type":"ContainerStarted","Data":"d9da9fbb5fc7a3265a103008191057e40adc5120855b7c6306258d470397c6d0"}
Jul 31 22:41:58.679649 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:58.679212    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ae5bab-mv9np" event={"ID":"7a3319cc-6fc3-471e-9b6d-84dcc6ce4b07","Type":"ContainerStarted","Data":"376a6215fb632c61546850fcad20243d445283f8469dbed1d12077e1b9f778d5"}
Jul 31 22:41:59.685564 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:59.685531    2573 generic.go:356] "Generic (PLEG): container finished" podID="7a3319cc-6fc3-471e-9b6d-84dcc6ce4b07" containerID="d9da9fbb5fc7a3265a103008191057e40adc5120855b7c6306258d470397c6d0" exitCode=0
Jul 31 22:41:59.685978 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:59.685600    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ae5bab-mv9np" event={"ID":"7a3319cc-6fc3-471e-9b6d-84dcc6ce4b07","Type":"ContainerDied","Data":"d9da9fbb5fc7a3265a103008191057e40adc5120855b7c6306258d470397c6d0"}
Jul 31 22:41:59.822792 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:59.822756    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ae5bab-mv9np"
Jul 31 22:41:59.959374 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:59.959257    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a3319cc-6fc3-471e-9b6d-84dcc6ce4b07-maas-api-service-ca\") pod \"7a3319cc-6fc3-471e-9b6d-84dcc6ce4b07\" (UID: \"7a3319cc-6fc3-471e-9b6d-84dcc6ce4b07\") "
Jul 31 22:41:59.959685 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:41:59.959660    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a3319cc-6fc3-471e-9b6d-84dcc6ce4b07-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7a3319cc-6fc3-471e-9b6d-84dcc6ce4b07" (UID: "7a3319cc-6fc3-471e-9b6d-84dcc6ce4b07"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:42:00.060634 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:42:00.060577    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a3319cc-6fc3-471e-9b6d-84dcc6ce4b07-maas-api-service-ca\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:42:00.716002 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:42:00.715963    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ae5bab-mv9np" event={"ID":"7a3319cc-6fc3-471e-9b6d-84dcc6ce4b07","Type":"ContainerDied","Data":"376a6215fb632c61546850fcad20243d445283f8469dbed1d12077e1b9f778d5"}
Jul 31 22:42:00.716586 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:42:00.716566    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="376a6215fb632c61546850fcad20243d445283f8469dbed1d12077e1b9f778d5"
Jul 31 22:42:00.716699 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:42:00.715986    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ae5bab-mv9np"
Jul 31 22:42:01.738792 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:42:01.738753    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ae5bab-mv9np"]
Jul 31 22:42:01.741919 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:42:01.741893    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ae5bab-mv9np"]
Jul 31 22:42:03.334511 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:42:03.334476    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a3319cc-6fc3-471e-9b6d-84dcc6ce4b07" path="/var/lib/kubelet/pods/7a3319cc-6fc3-471e-9b6d-84dcc6ce4b07/volumes"
Jul 31 22:42:51.555943 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:42:51.555911    2573 scope.go:117] "RemoveContainer" containerID="9f87fa6470be926462567be82de3bc35f578dc93187f5c36866b4416de7d21c9"
Jul 31 22:43:09.879773 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:09.879738    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f117f4-vnrkm"]
Jul 31 22:43:09.880152 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:09.880064    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a3319cc-6fc3-471e-9b6d-84dcc6ce4b07" containerName="revoke-keys"
Jul 31 22:43:09.880152 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:09.880075    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a3319cc-6fc3-471e-9b6d-84dcc6ce4b07" containerName="revoke-keys"
Jul 31 22:43:09.880152 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:09.880138    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a3319cc-6fc3-471e-9b6d-84dcc6ce4b07" containerName="revoke-keys"
Jul 31 22:43:09.882987 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:09.882968    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f117f4-vnrkm"
Jul 31 22:43:09.885267 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:09.885244    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 31 22:43:09.885384 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:09.885286    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lgfz6\""
Jul 31 22:43:09.890055 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:09.890024    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f117f4-vnrkm"]
Jul 31 22:43:10.039424 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:10.039386    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/595fca3b-e242-4a21-aa3a-44881dab3a83-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-f117f4-vnrkm\" (UID: \"595fca3b-e242-4a21-aa3a-44881dab3a83\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f117f4-vnrkm"
Jul 31 22:43:10.140742 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:10.140661    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/595fca3b-e242-4a21-aa3a-44881dab3a83-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-f117f4-vnrkm\" (UID: \"595fca3b-e242-4a21-aa3a-44881dab3a83\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f117f4-vnrkm"
Jul 31 22:43:10.141284 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:10.141265    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/595fca3b-e242-4a21-aa3a-44881dab3a83-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-f117f4-vnrkm\" (UID: \"595fca3b-e242-4a21-aa3a-44881dab3a83\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f117f4-vnrkm"
Jul 31 22:43:10.194957 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:10.194929    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f117f4-vnrkm"
Jul 31 22:43:10.321982 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:10.321953    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f117f4-vnrkm"]
Jul 31 22:43:10.324523 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:43:10.324496    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod595fca3b_e242_4a21_aa3a_44881dab3a83.slice/crio-ad5e615a5b74970714e125077a1e2b92c668c65a8c6cd9fb7b95f26fd3ee9e0c WatchSource:0}: Error finding container ad5e615a5b74970714e125077a1e2b92c668c65a8c6cd9fb7b95f26fd3ee9e0c: Status 404 returned error can't find the container with id ad5e615a5b74970714e125077a1e2b92c668c65a8c6cd9fb7b95f26fd3ee9e0c
Jul 31 22:43:11.040258 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:11.040226    2573 generic.go:356] "Generic (PLEG): container finished" podID="595fca3b-e242-4a21-aa3a-44881dab3a83" containerID="96261527b368b71fbfbd7efde7b1d46e013586db2493a234d3f668f0153f7956" exitCode=0
Jul 31 22:43:11.040791 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:11.040268    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f117f4-vnrkm" event={"ID":"595fca3b-e242-4a21-aa3a-44881dab3a83","Type":"ContainerDied","Data":"96261527b368b71fbfbd7efde7b1d46e013586db2493a234d3f668f0153f7956"}
Jul 31 22:43:11.040791 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:11.040327    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f117f4-vnrkm" event={"ID":"595fca3b-e242-4a21-aa3a-44881dab3a83","Type":"ContainerStarted","Data":"ad5e615a5b74970714e125077a1e2b92c668c65a8c6cd9fb7b95f26fd3ee9e0c"}
Jul 31 22:43:12.173942 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:12.173919    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f117f4-vnrkm"
Jul 31 22:43:12.261263 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:12.261238    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/595fca3b-e242-4a21-aa3a-44881dab3a83-maas-api-service-ca\") pod \"595fca3b-e242-4a21-aa3a-44881dab3a83\" (UID: \"595fca3b-e242-4a21-aa3a-44881dab3a83\") "
Jul 31 22:43:12.261596 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:12.261573    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/595fca3b-e242-4a21-aa3a-44881dab3a83-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "595fca3b-e242-4a21-aa3a-44881dab3a83" (UID: "595fca3b-e242-4a21-aa3a-44881dab3a83"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:43:12.362470 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:12.362402    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/595fca3b-e242-4a21-aa3a-44881dab3a83-maas-api-service-ca\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:43:13.050176 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:13.050148    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f117f4-vnrkm"
Jul 31 22:43:13.050379 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:13.050144    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f117f4-vnrkm" event={"ID":"595fca3b-e242-4a21-aa3a-44881dab3a83","Type":"ContainerDied","Data":"ad5e615a5b74970714e125077a1e2b92c668c65a8c6cd9fb7b95f26fd3ee9e0c"}
Jul 31 22:43:13.050379 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:13.050272    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ad5e615a5b74970714e125077a1e2b92c668c65a8c6cd9fb7b95f26fd3ee9e0c"
Jul 31 22:43:25.583006 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:25.582973    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f117f4-vnrkm"]
Jul 31 22:43:25.585694 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:25.585669    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f117f4-vnrkm"]
Jul 31 22:43:27.334602 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:27.334567    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="595fca3b-e242-4a21-aa3a-44881dab3a83" path="/var/lib/kubelet/pods/595fca3b-e242-4a21-aa3a-44881dab3a83/volumes"
Jul 31 22:43:32.511976 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:32.511946    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-84098f-mv4x9"]
Jul 31 22:43:32.512363 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:32.512241    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="595fca3b-e242-4a21-aa3a-44881dab3a83" containerName="revoke-keys"
Jul 31 22:43:32.512363 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:32.512251    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="595fca3b-e242-4a21-aa3a-44881dab3a83" containerName="revoke-keys"
Jul 31 22:43:32.512363 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:32.512330    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="595fca3b-e242-4a21-aa3a-44881dab3a83" containerName="revoke-keys"
Jul 31 22:43:32.515109 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:32.515090    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-84098f-mv4x9"
Jul 31 22:43:32.518496 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:32.518475    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lgfz6\""
Jul 31 22:43:32.518791 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:32.518775    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 31 22:43:32.525272 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:32.525237    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-84098f-mv4x9"]
Jul 31 22:43:32.604962 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:32.604931    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/086ed826-b6c7-448f-a616-3829acdf6248-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-84098f-mv4x9\" (UID: \"086ed826-b6c7-448f-a616-3829acdf6248\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-84098f-mv4x9"
Jul 31 22:43:32.705653 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:32.705621    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/086ed826-b6c7-448f-a616-3829acdf6248-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-84098f-mv4x9\" (UID: \"086ed826-b6c7-448f-a616-3829acdf6248\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-84098f-mv4x9"
Jul 31 22:43:32.706215 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:32.706195    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/086ed826-b6c7-448f-a616-3829acdf6248-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-84098f-mv4x9\" (UID: \"086ed826-b6c7-448f-a616-3829acdf6248\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-84098f-mv4x9"
Jul 31 22:43:32.825879 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:32.825819    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-84098f-mv4x9"
Jul 31 22:43:32.955018 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:32.954987    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-84098f-mv4x9"]
Jul 31 22:43:32.958857 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:43:32.958826    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod086ed826_b6c7_448f_a616_3829acdf6248.slice/crio-6bd40556f1f6e532aa100427a8a0d81c485bbb27001d03c313ee3061e319cbf9 WatchSource:0}: Error finding container 6bd40556f1f6e532aa100427a8a0d81c485bbb27001d03c313ee3061e319cbf9: Status 404 returned error can't find the container with id 6bd40556f1f6e532aa100427a8a0d81c485bbb27001d03c313ee3061e319cbf9
Jul 31 22:43:33.147832 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:33.147754    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-84098f-mv4x9" event={"ID":"086ed826-b6c7-448f-a616-3829acdf6248","Type":"ContainerStarted","Data":"6bd40556f1f6e532aa100427a8a0d81c485bbb27001d03c313ee3061e319cbf9"}
Jul 31 22:43:34.154129 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:34.154055    2573 generic.go:356] "Generic (PLEG): container finished" podID="086ed826-b6c7-448f-a616-3829acdf6248" containerID="beee5d3b65da13a01fc992e0beb4d5d3ef2fade42fcb6bb03cedffb061b79ca8" exitCode=0
Jul 31 22:43:34.154491 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:34.154146    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-84098f-mv4x9" event={"ID":"086ed826-b6c7-448f-a616-3829acdf6248","Type":"ContainerDied","Data":"beee5d3b65da13a01fc992e0beb4d5d3ef2fade42fcb6bb03cedffb061b79ca8"}
Jul 31 22:43:35.282326 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:35.282292    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-84098f-mv4x9"
Jul 31 22:43:35.325257 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:35.325234    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/086ed826-b6c7-448f-a616-3829acdf6248-maas-api-service-ca\") pod \"086ed826-b6c7-448f-a616-3829acdf6248\" (UID: \"086ed826-b6c7-448f-a616-3829acdf6248\") "
Jul 31 22:43:35.325583 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:35.325560    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/086ed826-b6c7-448f-a616-3829acdf6248-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "086ed826-b6c7-448f-a616-3829acdf6248" (UID: "086ed826-b6c7-448f-a616-3829acdf6248"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:43:35.426022 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:35.425992    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/086ed826-b6c7-448f-a616-3829acdf6248-maas-api-service-ca\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:43:36.164321 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:36.164277    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-84098f-mv4x9"
Jul 31 22:43:36.164477 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:36.164266    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-84098f-mv4x9" event={"ID":"086ed826-b6c7-448f-a616-3829acdf6248","Type":"ContainerDied","Data":"6bd40556f1f6e532aa100427a8a0d81c485bbb27001d03c313ee3061e319cbf9"}
Jul 31 22:43:36.164477 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:36.164420    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6bd40556f1f6e532aa100427a8a0d81c485bbb27001d03c313ee3061e319cbf9"
Jul 31 22:43:48.249545 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:48.249490    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-84098f-mv4x9"]
Jul 31 22:43:48.251214 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:48.251192    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-84098f-mv4x9"]
Jul 31 22:43:49.333746 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:43:49.333717    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="086ed826-b6c7-448f-a616-3829acdf6248" path="/var/lib/kubelet/pods/086ed826-b6c7-448f-a616-3829acdf6248/volumes"
Jul 31 22:44:51.432845 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:44:51.432818    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ddp8_79e15037-4ffd-47f1-b983-34f06895b2a3/ovn-acl-logging/0.log"
Jul 31 22:44:51.438988 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:44:51.438967    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ddp8_79e15037-4ffd-47f1-b983-34f06895b2a3/ovn-acl-logging/0.log"
Jul 31 22:45:00.132596 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.132563    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-08271f-29758965-b7fcf"]
Jul 31 22:45:00.132972 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.132897    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="086ed826-b6c7-448f-a616-3829acdf6248" containerName="revoke-keys"
Jul 31 22:45:00.132972 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.132908    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="086ed826-b6c7-448f-a616-3829acdf6248" containerName="revoke-keys"
Jul 31 22:45:00.132972 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.132964    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="086ed826-b6c7-448f-a616-3829acdf6248" containerName="revoke-keys"
Jul 31 22:45:00.136157 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.136137    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3326ad-29758965-7bwff"]
Jul 31 22:45:00.136335 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.136248    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-08271f-29758965-b7fcf"
Jul 31 22:45:00.138754 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.138734    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lgfz6\""
Jul 31 22:45:00.139071 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.139053    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29758965-9gzp8"]
Jul 31 22:45:00.139200 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.139111    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3326ad-29758965-7bwff"
Jul 31 22:45:00.142002 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.141982    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758965-9gzp8"
Jul 31 22:45:00.143203 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.143183    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-08271f-29758965-b7fcf"]
Jul 31 22:45:00.147446 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.147422    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3326ad-29758965-7bwff"]
Jul 31 22:45:00.149580 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.149563    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29758965-9gzp8"]
Jul 31 22:45:00.149786 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.149769    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-08271f-29758965-b7fcf"
Jul 31 22:45:00.159103 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.159083    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3326ad-29758965-7bwff"
Jul 31 22:45:00.191507 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.191485    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758965-9gzp8"
Jul 31 22:45:00.302501 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.301849    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-08271f-29758965-b7fcf"]
Jul 31 22:45:00.305362 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:45:00.305331    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53793e4c_a5fc_4a91_9ab6_4d17931547c7.slice/crio-84c5c7a97dfa5c8b4d87fa7b1211c871b14137625861e5c59ee83e24e3bebf80 WatchSource:0}: Error finding container 84c5c7a97dfa5c8b4d87fa7b1211c871b14137625861e5c59ee83e24e3bebf80: Status 404 returned error can't find the container with id 84c5c7a97dfa5c8b4d87fa7b1211c871b14137625861e5c59ee83e24e3bebf80
Jul 31 22:45:00.339011 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.338972    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-08271f/auth-test-model-08271f-kserve-6455567655-hlvds"]
Jul 31 22:45:00.344366 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.344345    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-08271f/auth-test-model-08271f-kserve-6455567655-hlvds"
Jul 31 22:45:00.347649 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.346962    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-08271f\"/\"openshift-service-ca.crt\""
Jul 31 22:45:00.347649 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.347193    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-08271f\"/\"default-dockercfg-dbldq\""
Jul 31 22:45:00.347649 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.347209    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-08271f\"/\"kube-root-ca.crt\""
Jul 31 22:45:00.348054 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.348027    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-08271f\"/\"auth-test-model-08271f-kserve-self-signed-certs\""
Jul 31 22:45:00.351003 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.350982    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-08271f/auth-test-model-08271f-kserve-6455567655-hlvds"]
Jul 31 22:45:00.360208 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.360188    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29758965-9gzp8"]
Jul 31 22:45:00.363177 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:45:00.363153    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f43d3eb_3296_443c_a3c8_3026f6eec532.slice/crio-80856236b088fb0825a83eeff91c704952d03a23ec86f24ea9c0e41b6ad0fabb WatchSource:0}: Error finding container 80856236b088fb0825a83eeff91c704952d03a23ec86f24ea9c0e41b6ad0fabb: Status 404 returned error can't find the container with id 80856236b088fb0825a83eeff91c704952d03a23ec86f24ea9c0e41b6ad0fabb
Jul 31 22:45:00.382346 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.382322    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd9ebd61-e0fc-4f39-af10-79e66e8be8b7-home\") pod \"auth-test-model-08271f-kserve-6455567655-hlvds\" (UID: \"cd9ebd61-e0fc-4f39-af10-79e66e8be8b7\") " pod="ai-tenant-e2e-shared-a-08271f/auth-test-model-08271f-kserve-6455567655-hlvds"
Jul 31 22:45:00.382432 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.382364    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmb62\" (UniqueName: \"kubernetes.io/projected/cd9ebd61-e0fc-4f39-af10-79e66e8be8b7-kube-api-access-gmb62\") pod \"auth-test-model-08271f-kserve-6455567655-hlvds\" (UID: \"cd9ebd61-e0fc-4f39-af10-79e66e8be8b7\") " pod="ai-tenant-e2e-shared-a-08271f/auth-test-model-08271f-kserve-6455567655-hlvds"
Jul 31 22:45:00.382473 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.382433    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd9ebd61-e0fc-4f39-af10-79e66e8be8b7-tls-certs\") pod \"auth-test-model-08271f-kserve-6455567655-hlvds\" (UID: \"cd9ebd61-e0fc-4f39-af10-79e66e8be8b7\") " pod="ai-tenant-e2e-shared-a-08271f/auth-test-model-08271f-kserve-6455567655-hlvds"
Jul 31 22:45:00.382473 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.382457    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd9ebd61-e0fc-4f39-af10-79e66e8be8b7-dshm\") pod \"auth-test-model-08271f-kserve-6455567655-hlvds\" (UID: \"cd9ebd61-e0fc-4f39-af10-79e66e8be8b7\") " pod="ai-tenant-e2e-shared-a-08271f/auth-test-model-08271f-kserve-6455567655-hlvds"
Jul 31 22:45:00.382543 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.382486    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd9ebd61-e0fc-4f39-af10-79e66e8be8b7-tmp-dir\") pod \"auth-test-model-08271f-kserve-6455567655-hlvds\" (UID: \"cd9ebd61-e0fc-4f39-af10-79e66e8be8b7\") " pod="ai-tenant-e2e-shared-a-08271f/auth-test-model-08271f-kserve-6455567655-hlvds"
Jul 31 22:45:00.382587 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.382566    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd9ebd61-e0fc-4f39-af10-79e66e8be8b7-model-cache\") pod \"auth-test-model-08271f-kserve-6455567655-hlvds\" (UID: \"cd9ebd61-e0fc-4f39-af10-79e66e8be8b7\") " pod="ai-tenant-e2e-shared-a-08271f/auth-test-model-08271f-kserve-6455567655-hlvds"
Jul 31 22:45:00.484028 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.483999    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd9ebd61-e0fc-4f39-af10-79e66e8be8b7-tls-certs\") pod \"auth-test-model-08271f-kserve-6455567655-hlvds\" (UID: \"cd9ebd61-e0fc-4f39-af10-79e66e8be8b7\") " pod="ai-tenant-e2e-shared-a-08271f/auth-test-model-08271f-kserve-6455567655-hlvds"
Jul 31 22:45:00.484028 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.484032    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd9ebd61-e0fc-4f39-af10-79e66e8be8b7-dshm\") pod \"auth-test-model-08271f-kserve-6455567655-hlvds\" (UID: \"cd9ebd61-e0fc-4f39-af10-79e66e8be8b7\") " pod="ai-tenant-e2e-shared-a-08271f/auth-test-model-08271f-kserve-6455567655-hlvds"
Jul 31 22:45:00.484288 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.484055    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd9ebd61-e0fc-4f39-af10-79e66e8be8b7-tmp-dir\") pod \"auth-test-model-08271f-kserve-6455567655-hlvds\" (UID: \"cd9ebd61-e0fc-4f39-af10-79e66e8be8b7\") " pod="ai-tenant-e2e-shared-a-08271f/auth-test-model-08271f-kserve-6455567655-hlvds"
Jul 31 22:45:00.484288 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.484080    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd9ebd61-e0fc-4f39-af10-79e66e8be8b7-model-cache\") pod \"auth-test-model-08271f-kserve-6455567655-hlvds\" (UID: \"cd9ebd61-e0fc-4f39-af10-79e66e8be8b7\") " pod="ai-tenant-e2e-shared-a-08271f/auth-test-model-08271f-kserve-6455567655-hlvds"
Jul 31 22:45:00.484288 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.484115    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd9ebd61-e0fc-4f39-af10-79e66e8be8b7-home\") pod \"auth-test-model-08271f-kserve-6455567655-hlvds\" (UID: \"cd9ebd61-e0fc-4f39-af10-79e66e8be8b7\") " pod="ai-tenant-e2e-shared-a-08271f/auth-test-model-08271f-kserve-6455567655-hlvds"
Jul 31 22:45:00.484288 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.484134    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmb62\" (UniqueName: \"kubernetes.io/projected/cd9ebd61-e0fc-4f39-af10-79e66e8be8b7-kube-api-access-gmb62\") pod \"auth-test-model-08271f-kserve-6455567655-hlvds\" (UID: \"cd9ebd61-e0fc-4f39-af10-79e66e8be8b7\") " pod="ai-tenant-e2e-shared-a-08271f/auth-test-model-08271f-kserve-6455567655-hlvds"
Jul 31 22:45:00.484538 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.484517    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd9ebd61-e0fc-4f39-af10-79e66e8be8b7-tmp-dir\") pod \"auth-test-model-08271f-kserve-6455567655-hlvds\" (UID: \"cd9ebd61-e0fc-4f39-af10-79e66e8be8b7\") " pod="ai-tenant-e2e-shared-a-08271f/auth-test-model-08271f-kserve-6455567655-hlvds"
Jul 31 22:45:00.484632 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.484601    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd9ebd61-e0fc-4f39-af10-79e66e8be8b7-home\") pod \"auth-test-model-08271f-kserve-6455567655-hlvds\" (UID: \"cd9ebd61-e0fc-4f39-af10-79e66e8be8b7\") " pod="ai-tenant-e2e-shared-a-08271f/auth-test-model-08271f-kserve-6455567655-hlvds"
Jul 31 22:45:00.484682 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.484598    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd9ebd61-e0fc-4f39-af10-79e66e8be8b7-model-cache\") pod \"auth-test-model-08271f-kserve-6455567655-hlvds\" (UID: \"cd9ebd61-e0fc-4f39-af10-79e66e8be8b7\") " pod="ai-tenant-e2e-shared-a-08271f/auth-test-model-08271f-kserve-6455567655-hlvds"
Jul 31 22:45:00.486192 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.486173    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd9ebd61-e0fc-4f39-af10-79e66e8be8b7-dshm\") pod \"auth-test-model-08271f-kserve-6455567655-hlvds\" (UID: \"cd9ebd61-e0fc-4f39-af10-79e66e8be8b7\") " pod="ai-tenant-e2e-shared-a-08271f/auth-test-model-08271f-kserve-6455567655-hlvds"
Jul 31 22:45:00.486476 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.486460    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd9ebd61-e0fc-4f39-af10-79e66e8be8b7-tls-certs\") pod \"auth-test-model-08271f-kserve-6455567655-hlvds\" (UID: \"cd9ebd61-e0fc-4f39-af10-79e66e8be8b7\") " pod="ai-tenant-e2e-shared-a-08271f/auth-test-model-08271f-kserve-6455567655-hlvds"
Jul 31 22:45:00.492187 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.492165    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmb62\" (UniqueName: \"kubernetes.io/projected/cd9ebd61-e0fc-4f39-af10-79e66e8be8b7-kube-api-access-gmb62\") pod \"auth-test-model-08271f-kserve-6455567655-hlvds\" (UID: \"cd9ebd61-e0fc-4f39-af10-79e66e8be8b7\") " pod="ai-tenant-e2e-shared-a-08271f/auth-test-model-08271f-kserve-6455567655-hlvds"
Jul 31 22:45:00.530228 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.530202    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3326ad-29758965-7bwff"]
Jul 31 22:45:00.532684 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:45:00.532660    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72d7c938_e3ac_4351_a364_49166a722cf8.slice/crio-cf9cc17bace62a52a34258fe6aa3dae56623a4f59d12d94b9177f592118f808b WatchSource:0}: Error finding container cf9cc17bace62a52a34258fe6aa3dae56623a4f59d12d94b9177f592118f808b: Status 404 returned error can't find the container with id cf9cc17bace62a52a34258fe6aa3dae56623a4f59d12d94b9177f592118f808b
Jul 31 22:45:00.542357 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.542329    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3326ad-29758965-7bwff" event={"ID":"72d7c938-e3ac-4351-a364-49166a722cf8","Type":"ContainerStarted","Data":"cf9cc17bace62a52a34258fe6aa3dae56623a4f59d12d94b9177f592118f808b"}
Jul 31 22:45:00.543495 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.543468    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-08271f-29758965-b7fcf" event={"ID":"53793e4c-a5fc-4a91-9ab6-4d17931547c7","Type":"ContainerStarted","Data":"84c5c7a97dfa5c8b4d87fa7b1211c871b14137625861e5c59ee83e24e3bebf80"}
Jul 31 22:45:00.544590 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.544572    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758965-9gzp8" event={"ID":"7f43d3eb-3296-443c-a3c8-3026f6eec532","Type":"ContainerStarted","Data":"80856236b088fb0825a83eeff91c704952d03a23ec86f24ea9c0e41b6ad0fabb"}
Jul 31 22:45:00.656420 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.656325    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-08271f/auth-test-model-08271f-kserve-6455567655-hlvds"
Jul 31 22:45:00.788294 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:00.788270    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-08271f/auth-test-model-08271f-kserve-6455567655-hlvds"]
Jul 31 22:45:00.789828 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:45:00.789802    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcd9ebd61_e0fc_4f39_af10_79e66e8be8b7.slice/crio-81cb4152f73edea8231fa6535ae97cddb5cc0203265c37928539cc0508c94d45 WatchSource:0}: Error finding container 81cb4152f73edea8231fa6535ae97cddb5cc0203265c37928539cc0508c94d45: Status 404 returned error can't find the container with id 81cb4152f73edea8231fa6535ae97cddb5cc0203265c37928539cc0508c94d45
Jul 31 22:45:01.551030 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:01.550954    2573 generic.go:356] "Generic (PLEG): container finished" podID="72d7c938-e3ac-4351-a364-49166a722cf8" containerID="89425fd2afd579a843b4e5e0a223bb3dae65ffe4de0d6fb1f3f9ab7043c4c4ca" exitCode=0
Jul 31 22:45:01.551030 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:01.551025    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3326ad-29758965-7bwff" event={"ID":"72d7c938-e3ac-4351-a364-49166a722cf8","Type":"ContainerDied","Data":"89425fd2afd579a843b4e5e0a223bb3dae65ffe4de0d6fb1f3f9ab7043c4c4ca"}
Jul 31 22:45:01.552614 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:01.552588    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-08271f/auth-test-model-08271f-kserve-6455567655-hlvds" event={"ID":"cd9ebd61-e0fc-4f39-af10-79e66e8be8b7","Type":"ContainerStarted","Data":"f0135f1e0ed503c3d41039c9ee5cf295cc4fbfadae5eca4b1724ed53a93394fc"}
Jul 31 22:45:01.552744 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:01.552626    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-08271f/auth-test-model-08271f-kserve-6455567655-hlvds" event={"ID":"cd9ebd61-e0fc-4f39-af10-79e66e8be8b7","Type":"ContainerStarted","Data":"81cb4152f73edea8231fa6535ae97cddb5cc0203265c37928539cc0508c94d45"}
Jul 31 22:45:01.554002 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:01.553978    2573 generic.go:356] "Generic (PLEG): container finished" podID="53793e4c-a5fc-4a91-9ab6-4d17931547c7" containerID="3c6194f6c22e3e971a9e39c2dacbef9e8e52947db9eb456e52ce7b4061fd64b7" exitCode=0
Jul 31 22:45:01.554073 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:01.554050    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-08271f-29758965-b7fcf" event={"ID":"53793e4c-a5fc-4a91-9ab6-4d17931547c7","Type":"ContainerDied","Data":"3c6194f6c22e3e971a9e39c2dacbef9e8e52947db9eb456e52ce7b4061fd64b7"}
Jul 31 22:45:01.555409 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:01.555389    2573 generic.go:356] "Generic (PLEG): container finished" podID="7f43d3eb-3296-443c-a3c8-3026f6eec532" containerID="414bece26ff61e1c8385c5cfd360764a2f73d43ada2446701d12cc0066ded314" exitCode=0
Jul 31 22:45:01.555501 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:01.555427    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758965-9gzp8" event={"ID":"7f43d3eb-3296-443c-a3c8-3026f6eec532","Type":"ContainerDied","Data":"414bece26ff61e1c8385c5cfd360764a2f73d43ada2446701d12cc0066ded314"}
Jul 31 22:45:01.583519 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:01.583468    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-08271f/auth-test-model-08271f-kserve-6455567655-hlvds" podStartSLOduration=1.583454414 podStartE2EDuration="1.583454414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:45:01.582579775 +0000 UTC m=+2710.677870942" watchObservedRunningTime="2026-07-31 22:45:01.583454414 +0000 UTC m=+2710.678745559"
Jul 31 22:45:02.706433 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:02.706381    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-08271f-29758965-b7fcf"
Jul 31 22:45:02.734707 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:02.734678    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758965-9gzp8"
Jul 31 22:45:02.737695 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:02.737674    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3326ad-29758965-7bwff"
Jul 31 22:45:03.566096 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:03.566066    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3326ad-29758965-7bwff"
Jul 31 22:45:03.566289 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:03.566109    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3326ad-29758965-7bwff" event={"ID":"72d7c938-e3ac-4351-a364-49166a722cf8","Type":"ContainerDied","Data":"cf9cc17bace62a52a34258fe6aa3dae56623a4f59d12d94b9177f592118f808b"}
Jul 31 22:45:03.566289 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:03.566159    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf9cc17bace62a52a34258fe6aa3dae56623a4f59d12d94b9177f592118f808b"
Jul 31 22:45:03.567405 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:03.567387    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-08271f-29758965-b7fcf"
Jul 31 22:45:03.567405 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:03.567398    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-08271f-29758965-b7fcf" event={"ID":"53793e4c-a5fc-4a91-9ab6-4d17931547c7","Type":"ContainerDied","Data":"84c5c7a97dfa5c8b4d87fa7b1211c871b14137625861e5c59ee83e24e3bebf80"}
Jul 31 22:45:03.567572 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:03.567432    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="84c5c7a97dfa5c8b4d87fa7b1211c871b14137625861e5c59ee83e24e3bebf80"
Jul 31 22:45:03.568809 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:03.568790    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758965-9gzp8" event={"ID":"7f43d3eb-3296-443c-a3c8-3026f6eec532","Type":"ContainerDied","Data":"80856236b088fb0825a83eeff91c704952d03a23ec86f24ea9c0e41b6ad0fabb"}
Jul 31 22:45:03.568898 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:03.568819    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758965-9gzp8"
Jul 31 22:45:03.568943 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:03.568822    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="80856236b088fb0825a83eeff91c704952d03a23ec86f24ea9c0e41b6ad0fabb"
Jul 31 22:45:10.656825 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:10.656790    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-08271f/auth-test-model-08271f-kserve-6455567655-hlvds"
Jul 31 22:45:10.657199 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:10.656838    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-08271f/auth-test-model-08271f-kserve-6455567655-hlvds"
Jul 31 22:45:10.669148 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:10.669121    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-08271f/auth-test-model-08271f-kserve-6455567655-hlvds"
Jul 31 22:45:11.617832 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:11.617805    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-08271f/auth-test-model-08271f-kserve-6455567655-hlvds"
Jul 31 22:45:33.041329 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:33.041283    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-3326ad/auth-test-model-3326ad-kserve-58b464bc95-9kvh8"]
Jul 31 22:45:33.041871 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:33.041699    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53793e4c-a5fc-4a91-9ab6-4d17931547c7" containerName="cleanup"
Jul 31 22:45:33.041871 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:33.041714    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="53793e4c-a5fc-4a91-9ab6-4d17931547c7" containerName="cleanup"
Jul 31 22:45:33.041871 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:33.041725    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72d7c938-e3ac-4351-a364-49166a722cf8" containerName="cleanup"
Jul 31 22:45:33.041871 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:33.041731    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="72d7c938-e3ac-4351-a364-49166a722cf8" containerName="cleanup"
Jul 31 22:45:33.041871 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:33.041750    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f43d3eb-3296-443c-a3c8-3026f6eec532" containerName="cleanup"
Jul 31 22:45:33.041871 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:33.041756    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f43d3eb-3296-443c-a3c8-3026f6eec532" containerName="cleanup"
Jul 31 22:45:33.041871 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:33.041808    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="53793e4c-a5fc-4a91-9ab6-4d17931547c7" containerName="cleanup"
Jul 31 22:45:33.041871 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:33.041816    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f43d3eb-3296-443c-a3c8-3026f6eec532" containerName="cleanup"
Jul 31 22:45:33.041871 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:33.041824    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="72d7c938-e3ac-4351-a364-49166a722cf8" containerName="cleanup"
Jul 31 22:45:33.045028 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:33.045008    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3326ad/auth-test-model-3326ad-kserve-58b464bc95-9kvh8"
Jul 31 22:45:33.048621 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:33.048593    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-3326ad\"/\"auth-test-model-3326ad-kserve-self-signed-certs\""
Jul 31 22:45:33.048758 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:33.048681    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-3326ad\"/\"openshift-service-ca.crt\""
Jul 31 22:45:33.048818 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:33.048777    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-3326ad\"/\"default-dockercfg-2rjkp\""
Jul 31 22:45:33.048818 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:33.048807    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-3326ad\"/\"kube-root-ca.crt\""
Jul 31 22:45:33.055281 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:33.055261    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-3326ad/auth-test-model-3326ad-kserve-58b464bc95-9kvh8"]
Jul 31 22:45:33.149534 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:33.149493    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb68c8c3-bb3c-49dd-9ab4-803538384652-dshm\") pod \"auth-test-model-3326ad-kserve-58b464bc95-9kvh8\" (UID: \"bb68c8c3-bb3c-49dd-9ab4-803538384652\") " pod="ai-tenant-e2e-shared-b-3326ad/auth-test-model-3326ad-kserve-58b464bc95-9kvh8"
Jul 31 22:45:33.149534 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:33.149542    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb68c8c3-bb3c-49dd-9ab4-803538384652-home\") pod \"auth-test-model-3326ad-kserve-58b464bc95-9kvh8\" (UID: \"bb68c8c3-bb3c-49dd-9ab4-803538384652\") " pod="ai-tenant-e2e-shared-b-3326ad/auth-test-model-3326ad-kserve-58b464bc95-9kvh8"
Jul 31 22:45:33.149756 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:33.149564    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb68c8c3-bb3c-49dd-9ab4-803538384652-tmp-dir\") pod \"auth-test-model-3326ad-kserve-58b464bc95-9kvh8\" (UID: \"bb68c8c3-bb3c-49dd-9ab4-803538384652\") " pod="ai-tenant-e2e-shared-b-3326ad/auth-test-model-3326ad-kserve-58b464bc95-9kvh8"
Jul 31 22:45:33.149756 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:33.149580    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9stjx\" (UniqueName: \"kubernetes.io/projected/bb68c8c3-bb3c-49dd-9ab4-803538384652-kube-api-access-9stjx\") pod \"auth-test-model-3326ad-kserve-58b464bc95-9kvh8\" (UID: \"bb68c8c3-bb3c-49dd-9ab4-803538384652\") " pod="ai-tenant-e2e-shared-b-3326ad/auth-test-model-3326ad-kserve-58b464bc95-9kvh8"
Jul 31 22:45:33.149756 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:33.149646    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb68c8c3-bb3c-49dd-9ab4-803538384652-model-cache\") pod \"auth-test-model-3326ad-kserve-58b464bc95-9kvh8\" (UID: \"bb68c8c3-bb3c-49dd-9ab4-803538384652\") " pod="ai-tenant-e2e-shared-b-3326ad/auth-test-model-3326ad-kserve-58b464bc95-9kvh8"
Jul 31 22:45:33.149756 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:33.149679    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb68c8c3-bb3c-49dd-9ab4-803538384652-tls-certs\") pod \"auth-test-model-3326ad-kserve-58b464bc95-9kvh8\" (UID: \"bb68c8c3-bb3c-49dd-9ab4-803538384652\") " pod="ai-tenant-e2e-shared-b-3326ad/auth-test-model-3326ad-kserve-58b464bc95-9kvh8"
Jul 31 22:45:33.250987 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:33.250944    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb68c8c3-bb3c-49dd-9ab4-803538384652-dshm\") pod \"auth-test-model-3326ad-kserve-58b464bc95-9kvh8\" (UID: \"bb68c8c3-bb3c-49dd-9ab4-803538384652\") " pod="ai-tenant-e2e-shared-b-3326ad/auth-test-model-3326ad-kserve-58b464bc95-9kvh8"
Jul 31 22:45:33.250987 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:33.250990    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb68c8c3-bb3c-49dd-9ab4-803538384652-home\") pod \"auth-test-model-3326ad-kserve-58b464bc95-9kvh8\" (UID: \"bb68c8c3-bb3c-49dd-9ab4-803538384652\") " pod="ai-tenant-e2e-shared-b-3326ad/auth-test-model-3326ad-kserve-58b464bc95-9kvh8"
Jul 31 22:45:33.251209 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:33.251015    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb68c8c3-bb3c-49dd-9ab4-803538384652-tmp-dir\") pod \"auth-test-model-3326ad-kserve-58b464bc95-9kvh8\" (UID: \"bb68c8c3-bb3c-49dd-9ab4-803538384652\") " pod="ai-tenant-e2e-shared-b-3326ad/auth-test-model-3326ad-kserve-58b464bc95-9kvh8"
Jul 31 22:45:33.251209 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:33.251037    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9stjx\" (UniqueName: \"kubernetes.io/projected/bb68c8c3-bb3c-49dd-9ab4-803538384652-kube-api-access-9stjx\") pod \"auth-test-model-3326ad-kserve-58b464bc95-9kvh8\" (UID: \"bb68c8c3-bb3c-49dd-9ab4-803538384652\") " pod="ai-tenant-e2e-shared-b-3326ad/auth-test-model-3326ad-kserve-58b464bc95-9kvh8"
Jul 31 22:45:33.251209 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:33.251068    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb68c8c3-bb3c-49dd-9ab4-803538384652-model-cache\") pod \"auth-test-model-3326ad-kserve-58b464bc95-9kvh8\" (UID: \"bb68c8c3-bb3c-49dd-9ab4-803538384652\") " pod="ai-tenant-e2e-shared-b-3326ad/auth-test-model-3326ad-kserve-58b464bc95-9kvh8"
Jul 31 22:45:33.251209 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:33.251097    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb68c8c3-bb3c-49dd-9ab4-803538384652-tls-certs\") pod \"auth-test-model-3326ad-kserve-58b464bc95-9kvh8\" (UID: \"bb68c8c3-bb3c-49dd-9ab4-803538384652\") " pod="ai-tenant-e2e-shared-b-3326ad/auth-test-model-3326ad-kserve-58b464bc95-9kvh8"
Jul 31 22:45:33.251440 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:33.251355    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb68c8c3-bb3c-49dd-9ab4-803538384652-tmp-dir\") pod \"auth-test-model-3326ad-kserve-58b464bc95-9kvh8\" (UID: \"bb68c8c3-bb3c-49dd-9ab4-803538384652\") " pod="ai-tenant-e2e-shared-b-3326ad/auth-test-model-3326ad-kserve-58b464bc95-9kvh8"
Jul 31 22:45:33.251503 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:33.251480    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb68c8c3-bb3c-49dd-9ab4-803538384652-home\") pod \"auth-test-model-3326ad-kserve-58b464bc95-9kvh8\" (UID: \"bb68c8c3-bb3c-49dd-9ab4-803538384652\") " pod="ai-tenant-e2e-shared-b-3326ad/auth-test-model-3326ad-kserve-58b464bc95-9kvh8"
Jul 31 22:45:33.251545 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:33.251521    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb68c8c3-bb3c-49dd-9ab4-803538384652-model-cache\") pod \"auth-test-model-3326ad-kserve-58b464bc95-9kvh8\" (UID: \"bb68c8c3-bb3c-49dd-9ab4-803538384652\") " pod="ai-tenant-e2e-shared-b-3326ad/auth-test-model-3326ad-kserve-58b464bc95-9kvh8"
Jul 31 22:45:33.253216 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:33.253193    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb68c8c3-bb3c-49dd-9ab4-803538384652-dshm\") pod \"auth-test-model-3326ad-kserve-58b464bc95-9kvh8\" (UID: \"bb68c8c3-bb3c-49dd-9ab4-803538384652\") " pod="ai-tenant-e2e-shared-b-3326ad/auth-test-model-3326ad-kserve-58b464bc95-9kvh8"
Jul 31 22:45:33.253380 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:33.253365    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb68c8c3-bb3c-49dd-9ab4-803538384652-tls-certs\") pod \"auth-test-model-3326ad-kserve-58b464bc95-9kvh8\" (UID: \"bb68c8c3-bb3c-49dd-9ab4-803538384652\") " pod="ai-tenant-e2e-shared-b-3326ad/auth-test-model-3326ad-kserve-58b464bc95-9kvh8"
Jul 31 22:45:33.259940 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:33.259907    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9stjx\" (UniqueName: \"kubernetes.io/projected/bb68c8c3-bb3c-49dd-9ab4-803538384652-kube-api-access-9stjx\") pod \"auth-test-model-3326ad-kserve-58b464bc95-9kvh8\" (UID: \"bb68c8c3-bb3c-49dd-9ab4-803538384652\") " pod="ai-tenant-e2e-shared-b-3326ad/auth-test-model-3326ad-kserve-58b464bc95-9kvh8"
Jul 31 22:45:33.355581 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:33.355513    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3326ad/auth-test-model-3326ad-kserve-58b464bc95-9kvh8"
Jul 31 22:45:33.505784 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:33.505758    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-3326ad/auth-test-model-3326ad-kserve-58b464bc95-9kvh8"]
Jul 31 22:45:33.506799 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:45:33.506777    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb68c8c3_bb3c_49dd_9ab4_803538384652.slice/crio-54d77a344b44c268746e655420adc6caf082794efd37098b1fd9d0fce0a54173 WatchSource:0}: Error finding container 54d77a344b44c268746e655420adc6caf082794efd37098b1fd9d0fce0a54173: Status 404 returned error can't find the container with id 54d77a344b44c268746e655420adc6caf082794efd37098b1fd9d0fce0a54173
Jul 31 22:45:33.708357 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:33.708324    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3326ad/auth-test-model-3326ad-kserve-58b464bc95-9kvh8" event={"ID":"bb68c8c3-bb3c-49dd-9ab4-803538384652","Type":"ContainerStarted","Data":"d9abde9d707441e557f490a4a74950ceec33a83c8f19c9252dd54d9a75fc18a6"}
Jul 31 22:45:33.708509 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:33.708364    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3326ad/auth-test-model-3326ad-kserve-58b464bc95-9kvh8" event={"ID":"bb68c8c3-bb3c-49dd-9ab4-803538384652","Type":"ContainerStarted","Data":"54d77a344b44c268746e655420adc6caf082794efd37098b1fd9d0fce0a54173"}
Jul 31 22:45:33.727639 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:33.727597    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-3326ad/auth-test-model-3326ad-kserve-58b464bc95-9kvh8" podStartSLOduration=0.727583608 podStartE2EDuration="727.583608ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:45:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:45:33.726487608 +0000 UTC m=+2742.821778755" watchObservedRunningTime="2026-07-31 22:45:33.727583608 +0000 UTC m=+2742.822874754"
Jul 31 22:45:43.356103 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:43.356065    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-3326ad/auth-test-model-3326ad-kserve-58b464bc95-9kvh8"
Jul 31 22:45:43.356602 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:43.356112    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-3326ad/auth-test-model-3326ad-kserve-58b464bc95-9kvh8"
Jul 31 22:45:43.368411 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:43.368389    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-3326ad/auth-test-model-3326ad-kserve-58b464bc95-9kvh8"
Jul 31 22:45:43.768104 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:45:43.768075    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-3326ad/auth-test-model-3326ad-kserve-58b464bc95-9kvh8"
Jul 31 22:47:51.615885 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:47:51.615819    2573 scope.go:117] "RemoveContainer" containerID="ef0a4bdea60221cb0037e8158f48249079e92446e85091885f0d584bb3357e27"
Jul 31 22:48:51.634854 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:48:51.634820    2573 scope.go:117] "RemoveContainer" containerID="d9da9fbb5fc7a3265a103008191057e40adc5120855b7c6306258d470397c6d0"
Jul 31 22:49:01.546334 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:01.546282    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-08271f/auth-test-model-08271f-kserve-6455567655-hlvds"]
Jul 31 22:49:02.328355 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:02.328324    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-3326ad/auth-test-model-3326ad-kserve-58b464bc95-9kvh8"]
Jul 31 22:49:06.858097 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:06.858063    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-08271f/sub-test-model-08271f-kserve-66758695d7-gvj89"]
Jul 31 22:49:06.861538 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:06.861516    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-08271f/sub-test-model-08271f-kserve-66758695d7-gvj89"
Jul 31 22:49:06.863854 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:06.863835    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-08271f\"/\"sub-test-model-08271f-kserve-self-signed-certs\""
Jul 31 22:49:06.870134 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:06.870114    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-08271f/sub-test-model-08271f-kserve-66758695d7-gvj89"]
Jul 31 22:49:07.036836 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:07.036801    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e30c6d4b-429b-46df-b41d-141d77a0bdaa-tmp-dir\") pod \"sub-test-model-08271f-kserve-66758695d7-gvj89\" (UID: \"e30c6d4b-429b-46df-b41d-141d77a0bdaa\") " pod="ai-tenant-e2e-shared-a-08271f/sub-test-model-08271f-kserve-66758695d7-gvj89"
Jul 31 22:49:07.037022 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:07.036872    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e30c6d4b-429b-46df-b41d-141d77a0bdaa-model-cache\") pod \"sub-test-model-08271f-kserve-66758695d7-gvj89\" (UID: \"e30c6d4b-429b-46df-b41d-141d77a0bdaa\") " pod="ai-tenant-e2e-shared-a-08271f/sub-test-model-08271f-kserve-66758695d7-gvj89"
Jul 31 22:49:07.037022 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:07.036908    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e30c6d4b-429b-46df-b41d-141d77a0bdaa-tls-certs\") pod \"sub-test-model-08271f-kserve-66758695d7-gvj89\" (UID: \"e30c6d4b-429b-46df-b41d-141d77a0bdaa\") " pod="ai-tenant-e2e-shared-a-08271f/sub-test-model-08271f-kserve-66758695d7-gvj89"
Jul 31 22:49:07.037022 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:07.036925    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e30c6d4b-429b-46df-b41d-141d77a0bdaa-home\") pod \"sub-test-model-08271f-kserve-66758695d7-gvj89\" (UID: \"e30c6d4b-429b-46df-b41d-141d77a0bdaa\") " pod="ai-tenant-e2e-shared-a-08271f/sub-test-model-08271f-kserve-66758695d7-gvj89"
Jul 31 22:49:07.037022 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:07.036994    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e30c6d4b-429b-46df-b41d-141d77a0bdaa-dshm\") pod \"sub-test-model-08271f-kserve-66758695d7-gvj89\" (UID: \"e30c6d4b-429b-46df-b41d-141d77a0bdaa\") " pod="ai-tenant-e2e-shared-a-08271f/sub-test-model-08271f-kserve-66758695d7-gvj89"
Jul 31 22:49:07.037163 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:07.037031    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-449cz\" (UniqueName: \"kubernetes.io/projected/e30c6d4b-429b-46df-b41d-141d77a0bdaa-kube-api-access-449cz\") pod \"sub-test-model-08271f-kserve-66758695d7-gvj89\" (UID: \"e30c6d4b-429b-46df-b41d-141d77a0bdaa\") " pod="ai-tenant-e2e-shared-a-08271f/sub-test-model-08271f-kserve-66758695d7-gvj89"
Jul 31 22:49:07.138366 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:07.138266    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e30c6d4b-429b-46df-b41d-141d77a0bdaa-model-cache\") pod \"sub-test-model-08271f-kserve-66758695d7-gvj89\" (UID: \"e30c6d4b-429b-46df-b41d-141d77a0bdaa\") " pod="ai-tenant-e2e-shared-a-08271f/sub-test-model-08271f-kserve-66758695d7-gvj89"
Jul 31 22:49:07.138524 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:07.138430    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e30c6d4b-429b-46df-b41d-141d77a0bdaa-tls-certs\") pod \"sub-test-model-08271f-kserve-66758695d7-gvj89\" (UID: \"e30c6d4b-429b-46df-b41d-141d77a0bdaa\") " pod="ai-tenant-e2e-shared-a-08271f/sub-test-model-08271f-kserve-66758695d7-gvj89"
Jul 31 22:49:07.138524 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:07.138469    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e30c6d4b-429b-46df-b41d-141d77a0bdaa-home\") pod \"sub-test-model-08271f-kserve-66758695d7-gvj89\" (UID: \"e30c6d4b-429b-46df-b41d-141d77a0bdaa\") " pod="ai-tenant-e2e-shared-a-08271f/sub-test-model-08271f-kserve-66758695d7-gvj89"
Jul 31 22:49:07.138524 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:07.138509    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e30c6d4b-429b-46df-b41d-141d77a0bdaa-dshm\") pod \"sub-test-model-08271f-kserve-66758695d7-gvj89\" (UID: \"e30c6d4b-429b-46df-b41d-141d77a0bdaa\") " pod="ai-tenant-e2e-shared-a-08271f/sub-test-model-08271f-kserve-66758695d7-gvj89"
Jul 31 22:49:07.138651 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:07.138534    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-449cz\" (UniqueName: \"kubernetes.io/projected/e30c6d4b-429b-46df-b41d-141d77a0bdaa-kube-api-access-449cz\") pod \"sub-test-model-08271f-kserve-66758695d7-gvj89\" (UID: \"e30c6d4b-429b-46df-b41d-141d77a0bdaa\") " pod="ai-tenant-e2e-shared-a-08271f/sub-test-model-08271f-kserve-66758695d7-gvj89"
Jul 31 22:49:07.138651 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:07.138582    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e30c6d4b-429b-46df-b41d-141d77a0bdaa-tmp-dir\") pod \"sub-test-model-08271f-kserve-66758695d7-gvj89\" (UID: \"e30c6d4b-429b-46df-b41d-141d77a0bdaa\") " pod="ai-tenant-e2e-shared-a-08271f/sub-test-model-08271f-kserve-66758695d7-gvj89"
Jul 31 22:49:07.138753 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:07.138665    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e30c6d4b-429b-46df-b41d-141d77a0bdaa-model-cache\") pod \"sub-test-model-08271f-kserve-66758695d7-gvj89\" (UID: \"e30c6d4b-429b-46df-b41d-141d77a0bdaa\") " pod="ai-tenant-e2e-shared-a-08271f/sub-test-model-08271f-kserve-66758695d7-gvj89"
Jul 31 22:49:07.138838 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:07.138818    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e30c6d4b-429b-46df-b41d-141d77a0bdaa-home\") pod \"sub-test-model-08271f-kserve-66758695d7-gvj89\" (UID: \"e30c6d4b-429b-46df-b41d-141d77a0bdaa\") " pod="ai-tenant-e2e-shared-a-08271f/sub-test-model-08271f-kserve-66758695d7-gvj89"
Jul 31 22:49:07.138964 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:07.138949    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e30c6d4b-429b-46df-b41d-141d77a0bdaa-tmp-dir\") pod \"sub-test-model-08271f-kserve-66758695d7-gvj89\" (UID: \"e30c6d4b-429b-46df-b41d-141d77a0bdaa\") " pod="ai-tenant-e2e-shared-a-08271f/sub-test-model-08271f-kserve-66758695d7-gvj89"
Jul 31 22:49:07.140650 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:07.140628    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e30c6d4b-429b-46df-b41d-141d77a0bdaa-dshm\") pod \"sub-test-model-08271f-kserve-66758695d7-gvj89\" (UID: \"e30c6d4b-429b-46df-b41d-141d77a0bdaa\") " pod="ai-tenant-e2e-shared-a-08271f/sub-test-model-08271f-kserve-66758695d7-gvj89"
Jul 31 22:49:07.140960 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:07.140944    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e30c6d4b-429b-46df-b41d-141d77a0bdaa-tls-certs\") pod \"sub-test-model-08271f-kserve-66758695d7-gvj89\" (UID: \"e30c6d4b-429b-46df-b41d-141d77a0bdaa\") " pod="ai-tenant-e2e-shared-a-08271f/sub-test-model-08271f-kserve-66758695d7-gvj89"
Jul 31 22:49:07.147032 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:07.147007    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-449cz\" (UniqueName: \"kubernetes.io/projected/e30c6d4b-429b-46df-b41d-141d77a0bdaa-kube-api-access-449cz\") pod \"sub-test-model-08271f-kserve-66758695d7-gvj89\" (UID: \"e30c6d4b-429b-46df-b41d-141d77a0bdaa\") " pod="ai-tenant-e2e-shared-a-08271f/sub-test-model-08271f-kserve-66758695d7-gvj89"
Jul 31 22:49:07.171674 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:07.171644    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-08271f/sub-test-model-08271f-kserve-66758695d7-gvj89"
Jul 31 22:49:07.303790 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:07.303767    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-08271f/sub-test-model-08271f-kserve-66758695d7-gvj89"]
Jul 31 22:49:07.305579 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:49:07.305552    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode30c6d4b_429b_46df_b41d_141d77a0bdaa.slice/crio-f51cc1563534115457474adf53f85cc7057a440ba0377462534e257c2f27ca3f WatchSource:0}: Error finding container f51cc1563534115457474adf53f85cc7057a440ba0377462534e257c2f27ca3f: Status 404 returned error can't find the container with id f51cc1563534115457474adf53f85cc7057a440ba0377462534e257c2f27ca3f
Jul 31 22:49:07.716437 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:07.716401    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-08271f/sub-test-model-08271f-kserve-66758695d7-gvj89" event={"ID":"e30c6d4b-429b-46df-b41d-141d77a0bdaa","Type":"ContainerStarted","Data":"d3a318b1e1e31e6426e1b0c91c826561e720f08a7dbb7baed7fad34e2a051c98"}
Jul 31 22:49:07.716656 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:07.716444    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-08271f/sub-test-model-08271f-kserve-66758695d7-gvj89" event={"ID":"e30c6d4b-429b-46df-b41d-141d77a0bdaa","Type":"ContainerStarted","Data":"f51cc1563534115457474adf53f85cc7057a440ba0377462534e257c2f27ca3f"}
Jul 31 22:49:07.735017 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:07.734970    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-08271f/sub-test-model-08271f-kserve-66758695d7-gvj89" podStartSLOduration=1.7349548380000002 podStartE2EDuration="1.734954838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:49:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:49:07.734434538 +0000 UTC m=+2956.829725686" watchObservedRunningTime="2026-07-31 22:49:07.734954838 +0000 UTC m=+2956.830246025"
Jul 31 22:49:16.564625 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:16.564526    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-08271f/auth-test-model-08271f-kserve-6455567655-hlvds" podUID="cd9ebd61-e0fc-4f39-af10-79e66e8be8b7" containerName="main" containerID="cri-o://f0135f1e0ed503c3d41039c9ee5cf295cc4fbfadae5eca4b1724ed53a93394fc" gracePeriod=45
Jul 31 22:49:16.762029 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:16.761998    2573 generic.go:356] "Generic (PLEG): container finished" podID="cd9ebd61-e0fc-4f39-af10-79e66e8be8b7" containerID="f0135f1e0ed503c3d41039c9ee5cf295cc4fbfadae5eca4b1724ed53a93394fc" exitCode=0
Jul 31 22:49:16.762155 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:16.762074    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-08271f/auth-test-model-08271f-kserve-6455567655-hlvds" event={"ID":"cd9ebd61-e0fc-4f39-af10-79e66e8be8b7","Type":"ContainerDied","Data":"f0135f1e0ed503c3d41039c9ee5cf295cc4fbfadae5eca4b1724ed53a93394fc"}
Jul 31 22:49:16.804815 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:16.804786    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-08271f/auth-test-model-08271f-kserve-6455567655-hlvds"
Jul 31 22:49:16.819294 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:16.819232    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmb62\" (UniqueName: \"kubernetes.io/projected/cd9ebd61-e0fc-4f39-af10-79e66e8be8b7-kube-api-access-gmb62\") pod \"cd9ebd61-e0fc-4f39-af10-79e66e8be8b7\" (UID: \"cd9ebd61-e0fc-4f39-af10-79e66e8be8b7\") "
Jul 31 22:49:16.819294 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:16.819269    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd9ebd61-e0fc-4f39-af10-79e66e8be8b7-tls-certs\") pod \"cd9ebd61-e0fc-4f39-af10-79e66e8be8b7\" (UID: \"cd9ebd61-e0fc-4f39-af10-79e66e8be8b7\") "
Jul 31 22:49:16.819492 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:16.819332    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd9ebd61-e0fc-4f39-af10-79e66e8be8b7-home\") pod \"cd9ebd61-e0fc-4f39-af10-79e66e8be8b7\" (UID: \"cd9ebd61-e0fc-4f39-af10-79e66e8be8b7\") "
Jul 31 22:49:16.819492 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:16.819378    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd9ebd61-e0fc-4f39-af10-79e66e8be8b7-dshm\") pod \"cd9ebd61-e0fc-4f39-af10-79e66e8be8b7\" (UID: \"cd9ebd61-e0fc-4f39-af10-79e66e8be8b7\") "
Jul 31 22:49:16.819492 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:16.819402    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd9ebd61-e0fc-4f39-af10-79e66e8be8b7-model-cache\") pod \"cd9ebd61-e0fc-4f39-af10-79e66e8be8b7\" (UID: \"cd9ebd61-e0fc-4f39-af10-79e66e8be8b7\") "
Jul 31 22:49:16.819492 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:16.819425    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd9ebd61-e0fc-4f39-af10-79e66e8be8b7-tmp-dir\") pod \"cd9ebd61-e0fc-4f39-af10-79e66e8be8b7\" (UID: \"cd9ebd61-e0fc-4f39-af10-79e66e8be8b7\") "
Jul 31 22:49:16.819689 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:16.819595    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd9ebd61-e0fc-4f39-af10-79e66e8be8b7-home" (OuterVolumeSpecName: "home") pod "cd9ebd61-e0fc-4f39-af10-79e66e8be8b7" (UID: "cd9ebd61-e0fc-4f39-af10-79e66e8be8b7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:49:16.819744 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:16.819716    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd9ebd61-e0fc-4f39-af10-79e66e8be8b7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cd9ebd61-e0fc-4f39-af10-79e66e8be8b7" (UID: "cd9ebd61-e0fc-4f39-af10-79e66e8be8b7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:49:16.819832 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:16.819794    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd9ebd61-e0fc-4f39-af10-79e66e8be8b7-home\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:49:16.819896 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:16.819828    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd9ebd61-e0fc-4f39-af10-79e66e8be8b7-model-cache" (OuterVolumeSpecName: "model-cache") pod "cd9ebd61-e0fc-4f39-af10-79e66e8be8b7" (UID: "cd9ebd61-e0fc-4f39-af10-79e66e8be8b7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:49:16.822137 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:16.822106    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd9ebd61-e0fc-4f39-af10-79e66e8be8b7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cd9ebd61-e0fc-4f39-af10-79e66e8be8b7" (UID: "cd9ebd61-e0fc-4f39-af10-79e66e8be8b7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:49:16.822264 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:16.822192    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd9ebd61-e0fc-4f39-af10-79e66e8be8b7-kube-api-access-gmb62" (OuterVolumeSpecName: "kube-api-access-gmb62") pod "cd9ebd61-e0fc-4f39-af10-79e66e8be8b7" (UID: "cd9ebd61-e0fc-4f39-af10-79e66e8be8b7"). InnerVolumeSpecName "kube-api-access-gmb62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:49:16.822338 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:16.822268    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd9ebd61-e0fc-4f39-af10-79e66e8be8b7-dshm" (OuterVolumeSpecName: "dshm") pod "cd9ebd61-e0fc-4f39-af10-79e66e8be8b7" (UID: "cd9ebd61-e0fc-4f39-af10-79e66e8be8b7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:49:16.920229 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:16.920200    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmb62\" (UniqueName: \"kubernetes.io/projected/cd9ebd61-e0fc-4f39-af10-79e66e8be8b7-kube-api-access-gmb62\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:49:16.920229 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:16.920224    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd9ebd61-e0fc-4f39-af10-79e66e8be8b7-tls-certs\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:49:16.920229 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:16.920234    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd9ebd61-e0fc-4f39-af10-79e66e8be8b7-dshm\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:49:16.920449 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:16.920243    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd9ebd61-e0fc-4f39-af10-79e66e8be8b7-model-cache\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:49:16.920449 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:16.920250    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd9ebd61-e0fc-4f39-af10-79e66e8be8b7-tmp-dir\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:49:17.172706 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:17.172677    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-08271f/sub-test-model-08271f-kserve-66758695d7-gvj89"
Jul 31 22:49:17.172861 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:17.172725    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-08271f/sub-test-model-08271f-kserve-66758695d7-gvj89"
Jul 31 22:49:17.185201 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:17.185175    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-08271f/sub-test-model-08271f-kserve-66758695d7-gvj89"
Jul 31 22:49:17.346884 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:17.346853    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-3326ad/auth-test-model-3326ad-kserve-58b464bc95-9kvh8" podUID="bb68c8c3-bb3c-49dd-9ab4-803538384652" containerName="main" containerID="cri-o://d9abde9d707441e557f490a4a74950ceec33a83c8f19c9252dd54d9a75fc18a6" gracePeriod=45
Jul 31 22:49:17.585627 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:17.585602    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3326ad/auth-test-model-3326ad-kserve-58b464bc95-9kvh8"
Jul 31 22:49:17.624840 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:17.624815    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb68c8c3-bb3c-49dd-9ab4-803538384652-model-cache\") pod \"bb68c8c3-bb3c-49dd-9ab4-803538384652\" (UID: \"bb68c8c3-bb3c-49dd-9ab4-803538384652\") "
Jul 31 22:49:17.624967 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:17.624852    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb68c8c3-bb3c-49dd-9ab4-803538384652-dshm\") pod \"bb68c8c3-bb3c-49dd-9ab4-803538384652\" (UID: \"bb68c8c3-bb3c-49dd-9ab4-803538384652\") "
Jul 31 22:49:17.624967 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:17.624902    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb68c8c3-bb3c-49dd-9ab4-803538384652-tmp-dir\") pod \"bb68c8c3-bb3c-49dd-9ab4-803538384652\" (UID: \"bb68c8c3-bb3c-49dd-9ab4-803538384652\") "
Jul 31 22:49:17.624967 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:17.624928    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb68c8c3-bb3c-49dd-9ab4-803538384652-home\") pod \"bb68c8c3-bb3c-49dd-9ab4-803538384652\" (UID: \"bb68c8c3-bb3c-49dd-9ab4-803538384652\") "
Jul 31 22:49:17.624967 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:17.624950    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9stjx\" (UniqueName: \"kubernetes.io/projected/bb68c8c3-bb3c-49dd-9ab4-803538384652-kube-api-access-9stjx\") pod \"bb68c8c3-bb3c-49dd-9ab4-803538384652\" (UID: \"bb68c8c3-bb3c-49dd-9ab4-803538384652\") "
Jul 31 22:49:17.625188 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:17.624970    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb68c8c3-bb3c-49dd-9ab4-803538384652-tls-certs\") pod \"bb68c8c3-bb3c-49dd-9ab4-803538384652\" (UID: \"bb68c8c3-bb3c-49dd-9ab4-803538384652\") "
Jul 31 22:49:17.625188 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:17.625099    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb68c8c3-bb3c-49dd-9ab4-803538384652-model-cache" (OuterVolumeSpecName: "model-cache") pod "bb68c8c3-bb3c-49dd-9ab4-803538384652" (UID: "bb68c8c3-bb3c-49dd-9ab4-803538384652"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:49:17.625328 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:17.625209    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb68c8c3-bb3c-49dd-9ab4-803538384652-home" (OuterVolumeSpecName: "home") pod "bb68c8c3-bb3c-49dd-9ab4-803538384652" (UID: "bb68c8c3-bb3c-49dd-9ab4-803538384652"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:49:17.625469 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:17.625328    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb68c8c3-bb3c-49dd-9ab4-803538384652-home\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:49:17.625469 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:17.625349    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb68c8c3-bb3c-49dd-9ab4-803538384652-model-cache\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:49:17.625556 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:17.625502    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb68c8c3-bb3c-49dd-9ab4-803538384652-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bb68c8c3-bb3c-49dd-9ab4-803538384652" (UID: "bb68c8c3-bb3c-49dd-9ab4-803538384652"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:49:17.627248 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:17.627220    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb68c8c3-bb3c-49dd-9ab4-803538384652-dshm" (OuterVolumeSpecName: "dshm") pod "bb68c8c3-bb3c-49dd-9ab4-803538384652" (UID: "bb68c8c3-bb3c-49dd-9ab4-803538384652"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:49:17.627541 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:17.627518    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb68c8c3-bb3c-49dd-9ab4-803538384652-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bb68c8c3-bb3c-49dd-9ab4-803538384652" (UID: "bb68c8c3-bb3c-49dd-9ab4-803538384652"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:49:17.627628 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:17.627532    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb68c8c3-bb3c-49dd-9ab4-803538384652-kube-api-access-9stjx" (OuterVolumeSpecName: "kube-api-access-9stjx") pod "bb68c8c3-bb3c-49dd-9ab4-803538384652" (UID: "bb68c8c3-bb3c-49dd-9ab4-803538384652"). InnerVolumeSpecName "kube-api-access-9stjx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:49:17.726236 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:17.726177    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb68c8c3-bb3c-49dd-9ab4-803538384652-tmp-dir\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:49:17.726236 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:17.726202    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9stjx\" (UniqueName: \"kubernetes.io/projected/bb68c8c3-bb3c-49dd-9ab4-803538384652-kube-api-access-9stjx\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:49:17.726236 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:17.726212    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb68c8c3-bb3c-49dd-9ab4-803538384652-tls-certs\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:49:17.726236 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:17.726222    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb68c8c3-bb3c-49dd-9ab4-803538384652-dshm\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:49:17.768264 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:17.768236    2573 generic.go:356] "Generic (PLEG): container finished" podID="bb68c8c3-bb3c-49dd-9ab4-803538384652" containerID="d9abde9d707441e557f490a4a74950ceec33a83c8f19c9252dd54d9a75fc18a6" exitCode=0
Jul 31 22:49:17.768404 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:17.768272    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3326ad/auth-test-model-3326ad-kserve-58b464bc95-9kvh8"
Jul 31 22:49:17.768404 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:17.768339    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3326ad/auth-test-model-3326ad-kserve-58b464bc95-9kvh8" event={"ID":"bb68c8c3-bb3c-49dd-9ab4-803538384652","Type":"ContainerDied","Data":"d9abde9d707441e557f490a4a74950ceec33a83c8f19c9252dd54d9a75fc18a6"}
Jul 31 22:49:17.768404 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:17.768384    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3326ad/auth-test-model-3326ad-kserve-58b464bc95-9kvh8" event={"ID":"bb68c8c3-bb3c-49dd-9ab4-803538384652","Type":"ContainerDied","Data":"54d77a344b44c268746e655420adc6caf082794efd37098b1fd9d0fce0a54173"}
Jul 31 22:49:17.768570 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:17.768405    2573 scope.go:117] "RemoveContainer" containerID="d9abde9d707441e557f490a4a74950ceec33a83c8f19c9252dd54d9a75fc18a6"
Jul 31 22:49:17.769779 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:17.769754    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-08271f/auth-test-model-08271f-kserve-6455567655-hlvds"
Jul 31 22:49:17.769891 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:17.769813    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-08271f/auth-test-model-08271f-kserve-6455567655-hlvds" event={"ID":"cd9ebd61-e0fc-4f39-af10-79e66e8be8b7","Type":"ContainerDied","Data":"81cb4152f73edea8231fa6535ae97cddb5cc0203265c37928539cc0508c94d45"}
Jul 31 22:49:17.777873 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:17.777858    2573 scope.go:117] "RemoveContainer" containerID="d9abde9d707441e557f490a4a74950ceec33a83c8f19c9252dd54d9a75fc18a6"
Jul 31 22:49:17.778093 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:49:17.778073    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9abde9d707441e557f490a4a74950ceec33a83c8f19c9252dd54d9a75fc18a6\": container with ID starting with d9abde9d707441e557f490a4a74950ceec33a83c8f19c9252dd54d9a75fc18a6 not found: ID does not exist" containerID="d9abde9d707441e557f490a4a74950ceec33a83c8f19c9252dd54d9a75fc18a6"
Jul 31 22:49:17.778150 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:17.778102    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9abde9d707441e557f490a4a74950ceec33a83c8f19c9252dd54d9a75fc18a6"} err="failed to get container status \"d9abde9d707441e557f490a4a74950ceec33a83c8f19c9252dd54d9a75fc18a6\": rpc error: code = NotFound desc = could not find container \"d9abde9d707441e557f490a4a74950ceec33a83c8f19c9252dd54d9a75fc18a6\": container with ID starting with d9abde9d707441e557f490a4a74950ceec33a83c8f19c9252dd54d9a75fc18a6 not found: ID does not exist"
Jul 31 22:49:17.778150 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:17.778123    2573 scope.go:117] "RemoveContainer" containerID="f0135f1e0ed503c3d41039c9ee5cf295cc4fbfadae5eca4b1724ed53a93394fc"
Jul 31 22:49:17.782623 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:17.782606    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-08271f/sub-test-model-08271f-kserve-66758695d7-gvj89"
Jul 31 22:49:17.791770 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:17.790782    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-08271f/auth-test-model-08271f-kserve-6455567655-hlvds"]
Jul 31 22:49:17.794130 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:17.794107    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-08271f/auth-test-model-08271f-kserve-6455567655-hlvds"]
Jul 31 22:49:17.822852 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:17.822831    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-3326ad/auth-test-model-3326ad-kserve-58b464bc95-9kvh8"]
Jul 31 22:49:17.825976 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:17.825955    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-3326ad/auth-test-model-3326ad-kserve-58b464bc95-9kvh8"]
Jul 31 22:49:19.334706 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:19.334667    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb68c8c3-bb3c-49dd-9ab4-803538384652" path="/var/lib/kubelet/pods/bb68c8c3-bb3c-49dd-9ab4-803538384652/volumes"
Jul 31 22:49:19.335223 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:19.335203    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd9ebd61-e0fc-4f39-af10-79e66e8be8b7" path="/var/lib/kubelet/pods/cd9ebd61-e0fc-4f39-af10-79e66e8be8b7/volumes"
Jul 31 22:49:45.143072 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:45.143033    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-3326ad/sub-test-model-3326ad-kserve-55956b8c7-qzwsn"]
Jul 31 22:49:45.143682 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:45.143537    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd9ebd61-e0fc-4f39-af10-79e66e8be8b7" containerName="main"
Jul 31 22:49:45.143682 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:45.143558    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd9ebd61-e0fc-4f39-af10-79e66e8be8b7" containerName="main"
Jul 31 22:49:45.143682 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:45.143578    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb68c8c3-bb3c-49dd-9ab4-803538384652" containerName="main"
Jul 31 22:49:45.143682 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:45.143586    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb68c8c3-bb3c-49dd-9ab4-803538384652" containerName="main"
Jul 31 22:49:45.143682 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:45.143683    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd9ebd61-e0fc-4f39-af10-79e66e8be8b7" containerName="main"
Jul 31 22:49:45.143957 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:45.143696    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb68c8c3-bb3c-49dd-9ab4-803538384652" containerName="main"
Jul 31 22:49:45.146713 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:45.146692    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3326ad/sub-test-model-3326ad-kserve-55956b8c7-qzwsn"
Jul 31 22:49:45.150246 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:45.150223    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-3326ad\"/\"default-dockercfg-2rjkp\""
Jul 31 22:49:45.150392 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:45.150255    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-3326ad\"/\"openshift-service-ca.crt\""
Jul 31 22:49:45.150392 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:45.150314    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-3326ad\"/\"kube-root-ca.crt\""
Jul 31 22:49:45.150510 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:45.150441    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-3326ad\"/\"sub-test-model-3326ad-kserve-self-signed-certs\""
Jul 31 22:49:45.155755 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:45.155735    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-3326ad/sub-test-model-3326ad-kserve-55956b8c7-qzwsn"]
Jul 31 22:49:45.251865 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:45.251830    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ffa19906-c5c2-4a36-9ce5-f5c5927591dd-model-cache\") pod \"sub-test-model-3326ad-kserve-55956b8c7-qzwsn\" (UID: \"ffa19906-c5c2-4a36-9ce5-f5c5927591dd\") " pod="ai-tenant-e2e-shared-b-3326ad/sub-test-model-3326ad-kserve-55956b8c7-qzwsn"
Jul 31 22:49:45.252017 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:45.251869    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ffa19906-c5c2-4a36-9ce5-f5c5927591dd-tls-certs\") pod \"sub-test-model-3326ad-kserve-55956b8c7-qzwsn\" (UID: \"ffa19906-c5c2-4a36-9ce5-f5c5927591dd\") " pod="ai-tenant-e2e-shared-b-3326ad/sub-test-model-3326ad-kserve-55956b8c7-qzwsn"
Jul 31 22:49:45.252017 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:45.251962    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ffa19906-c5c2-4a36-9ce5-f5c5927591dd-home\") pod \"sub-test-model-3326ad-kserve-55956b8c7-qzwsn\" (UID: \"ffa19906-c5c2-4a36-9ce5-f5c5927591dd\") " pod="ai-tenant-e2e-shared-b-3326ad/sub-test-model-3326ad-kserve-55956b8c7-qzwsn"
Jul 31 22:49:45.252100 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:45.252024    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-627sp\" (UniqueName: \"kubernetes.io/projected/ffa19906-c5c2-4a36-9ce5-f5c5927591dd-kube-api-access-627sp\") pod \"sub-test-model-3326ad-kserve-55956b8c7-qzwsn\" (UID: \"ffa19906-c5c2-4a36-9ce5-f5c5927591dd\") " pod="ai-tenant-e2e-shared-b-3326ad/sub-test-model-3326ad-kserve-55956b8c7-qzwsn"
Jul 31 22:49:45.252100 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:45.252060    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffa19906-c5c2-4a36-9ce5-f5c5927591dd-tmp-dir\") pod \"sub-test-model-3326ad-kserve-55956b8c7-qzwsn\" (UID: \"ffa19906-c5c2-4a36-9ce5-f5c5927591dd\") " pod="ai-tenant-e2e-shared-b-3326ad/sub-test-model-3326ad-kserve-55956b8c7-qzwsn"
Jul 31 22:49:45.252165 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:45.252130    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ffa19906-c5c2-4a36-9ce5-f5c5927591dd-dshm\") pod \"sub-test-model-3326ad-kserve-55956b8c7-qzwsn\" (UID: \"ffa19906-c5c2-4a36-9ce5-f5c5927591dd\") " pod="ai-tenant-e2e-shared-b-3326ad/sub-test-model-3326ad-kserve-55956b8c7-qzwsn"
Jul 31 22:49:45.352746 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:45.352719    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ffa19906-c5c2-4a36-9ce5-f5c5927591dd-home\") pod \"sub-test-model-3326ad-kserve-55956b8c7-qzwsn\" (UID: \"ffa19906-c5c2-4a36-9ce5-f5c5927591dd\") " pod="ai-tenant-e2e-shared-b-3326ad/sub-test-model-3326ad-kserve-55956b8c7-qzwsn"
Jul 31 22:49:45.352892 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:45.352761    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-627sp\" (UniqueName: \"kubernetes.io/projected/ffa19906-c5c2-4a36-9ce5-f5c5927591dd-kube-api-access-627sp\") pod \"sub-test-model-3326ad-kserve-55956b8c7-qzwsn\" (UID: \"ffa19906-c5c2-4a36-9ce5-f5c5927591dd\") " pod="ai-tenant-e2e-shared-b-3326ad/sub-test-model-3326ad-kserve-55956b8c7-qzwsn"
Jul 31 22:49:45.352892 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:45.352787    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffa19906-c5c2-4a36-9ce5-f5c5927591dd-tmp-dir\") pod \"sub-test-model-3326ad-kserve-55956b8c7-qzwsn\" (UID: \"ffa19906-c5c2-4a36-9ce5-f5c5927591dd\") " pod="ai-tenant-e2e-shared-b-3326ad/sub-test-model-3326ad-kserve-55956b8c7-qzwsn"
Jul 31 22:49:45.352892 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:45.352819    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ffa19906-c5c2-4a36-9ce5-f5c5927591dd-dshm\") pod \"sub-test-model-3326ad-kserve-55956b8c7-qzwsn\" (UID: \"ffa19906-c5c2-4a36-9ce5-f5c5927591dd\") " pod="ai-tenant-e2e-shared-b-3326ad/sub-test-model-3326ad-kserve-55956b8c7-qzwsn"
Jul 31 22:49:45.352892 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:45.352836    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ffa19906-c5c2-4a36-9ce5-f5c5927591dd-model-cache\") pod \"sub-test-model-3326ad-kserve-55956b8c7-qzwsn\" (UID: \"ffa19906-c5c2-4a36-9ce5-f5c5927591dd\") " pod="ai-tenant-e2e-shared-b-3326ad/sub-test-model-3326ad-kserve-55956b8c7-qzwsn"
Jul 31 22:49:45.352892 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:45.352859    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ffa19906-c5c2-4a36-9ce5-f5c5927591dd-tls-certs\") pod \"sub-test-model-3326ad-kserve-55956b8c7-qzwsn\" (UID: \"ffa19906-c5c2-4a36-9ce5-f5c5927591dd\") " pod="ai-tenant-e2e-shared-b-3326ad/sub-test-model-3326ad-kserve-55956b8c7-qzwsn"
Jul 31 22:49:45.353150 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:45.353105    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ffa19906-c5c2-4a36-9ce5-f5c5927591dd-home\") pod \"sub-test-model-3326ad-kserve-55956b8c7-qzwsn\" (UID: \"ffa19906-c5c2-4a36-9ce5-f5c5927591dd\") " pod="ai-tenant-e2e-shared-b-3326ad/sub-test-model-3326ad-kserve-55956b8c7-qzwsn"
Jul 31 22:49:45.353208 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:45.353177    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffa19906-c5c2-4a36-9ce5-f5c5927591dd-tmp-dir\") pod \"sub-test-model-3326ad-kserve-55956b8c7-qzwsn\" (UID: \"ffa19906-c5c2-4a36-9ce5-f5c5927591dd\") " pod="ai-tenant-e2e-shared-b-3326ad/sub-test-model-3326ad-kserve-55956b8c7-qzwsn"
Jul 31 22:49:45.353208 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:45.353201    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ffa19906-c5c2-4a36-9ce5-f5c5927591dd-model-cache\") pod \"sub-test-model-3326ad-kserve-55956b8c7-qzwsn\" (UID: \"ffa19906-c5c2-4a36-9ce5-f5c5927591dd\") " pod="ai-tenant-e2e-shared-b-3326ad/sub-test-model-3326ad-kserve-55956b8c7-qzwsn"
Jul 31 22:49:45.355113 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:45.355093    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ffa19906-c5c2-4a36-9ce5-f5c5927591dd-dshm\") pod \"sub-test-model-3326ad-kserve-55956b8c7-qzwsn\" (UID: \"ffa19906-c5c2-4a36-9ce5-f5c5927591dd\") " pod="ai-tenant-e2e-shared-b-3326ad/sub-test-model-3326ad-kserve-55956b8c7-qzwsn"
Jul 31 22:49:45.355293 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:45.355275    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ffa19906-c5c2-4a36-9ce5-f5c5927591dd-tls-certs\") pod \"sub-test-model-3326ad-kserve-55956b8c7-qzwsn\" (UID: \"ffa19906-c5c2-4a36-9ce5-f5c5927591dd\") " pod="ai-tenant-e2e-shared-b-3326ad/sub-test-model-3326ad-kserve-55956b8c7-qzwsn"
Jul 31 22:49:45.360758 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:45.360736    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-627sp\" (UniqueName: \"kubernetes.io/projected/ffa19906-c5c2-4a36-9ce5-f5c5927591dd-kube-api-access-627sp\") pod \"sub-test-model-3326ad-kserve-55956b8c7-qzwsn\" (UID: \"ffa19906-c5c2-4a36-9ce5-f5c5927591dd\") " pod="ai-tenant-e2e-shared-b-3326ad/sub-test-model-3326ad-kserve-55956b8c7-qzwsn"
Jul 31 22:49:45.456334 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:45.456291    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3326ad/sub-test-model-3326ad-kserve-55956b8c7-qzwsn"
Jul 31 22:49:45.587531 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:45.587367    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-3326ad/sub-test-model-3326ad-kserve-55956b8c7-qzwsn"]
Jul 31 22:49:45.589746 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:49:45.589722    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podffa19906_c5c2_4a36_9ce5_f5c5927591dd.slice/crio-995c01700e3e5639e5a8d0328f20995549a5d6032abc335e6a4c40533dfb712b WatchSource:0}: Error finding container 995c01700e3e5639e5a8d0328f20995549a5d6032abc335e6a4c40533dfb712b: Status 404 returned error can't find the container with id 995c01700e3e5639e5a8d0328f20995549a5d6032abc335e6a4c40533dfb712b
Jul 31 22:49:45.903776 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:45.903698    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3326ad/sub-test-model-3326ad-kserve-55956b8c7-qzwsn" event={"ID":"ffa19906-c5c2-4a36-9ce5-f5c5927591dd","Type":"ContainerStarted","Data":"87e89ef9ff0d85cd45d8af096bf95d4bf9d9cc4d61b28fdceb71ea397ac83ce5"}
Jul 31 22:49:45.903776 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:45.903744    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3326ad/sub-test-model-3326ad-kserve-55956b8c7-qzwsn" event={"ID":"ffa19906-c5c2-4a36-9ce5-f5c5927591dd","Type":"ContainerStarted","Data":"995c01700e3e5639e5a8d0328f20995549a5d6032abc335e6a4c40533dfb712b"}
Jul 31 22:49:45.924918 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:45.924869    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-3326ad/sub-test-model-3326ad-kserve-55956b8c7-qzwsn" podStartSLOduration=0.924853821 podStartE2EDuration="924.853821ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:49:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:49:45.923366393 +0000 UTC m=+2995.018657540" watchObservedRunningTime="2026-07-31 22:49:45.924853821 +0000 UTC m=+2995.020144966"
Jul 31 22:49:51.461087 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:51.461055    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ddp8_79e15037-4ffd-47f1-b983-34f06895b2a3/ovn-acl-logging/0.log"
Jul 31 22:49:51.466233 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:51.466211    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ddp8_79e15037-4ffd-47f1-b983-34f06895b2a3/ovn-acl-logging/0.log"
Jul 31 22:49:51.653203 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:51.653174    2573 scope.go:117] "RemoveContainer" containerID="beee5d3b65da13a01fc992e0beb4d5d3ef2fade42fcb6bb03cedffb061b79ca8"
Jul 31 22:49:51.661144 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:51.661128    2573 scope.go:117] "RemoveContainer" containerID="96261527b368b71fbfbd7efde7b1d46e013586db2493a234d3f668f0153f7956"
Jul 31 22:49:55.457104 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:55.457076    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-3326ad/sub-test-model-3326ad-kserve-55956b8c7-qzwsn"
Jul 31 22:49:55.457528 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:55.457122    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-3326ad/sub-test-model-3326ad-kserve-55956b8c7-qzwsn"
Jul 31 22:49:55.469518 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:55.469486    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-3326ad/sub-test-model-3326ad-kserve-55956b8c7-qzwsn"
Jul 31 22:49:55.958759 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:49:55.958731    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-3326ad/sub-test-model-3326ad-kserve-55956b8c7-qzwsn"
Jul 31 22:51:09.486161 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:09.486132    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-08271f/sub-test-model-08271f-kserve-66758695d7-gvj89"]
Jul 31 22:51:10.692501 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:10.692465    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-3326ad/sub-test-model-3326ad-kserve-55956b8c7-qzwsn"]
Jul 31 22:51:23.573347 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:23.573316    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-08271f/rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm"]
Jul 31 22:51:23.576716 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:23.576691    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-08271f/rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm"
Jul 31 22:51:23.579863 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:23.579844    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-08271f\"/\"rate-test-model-08271f-kserve-self-signed-certs\""
Jul 31 22:51:23.593191 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:23.593166    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-08271f/rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm"]
Jul 31 22:51:23.672338 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:23.672289    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/638451bb-b011-47a0-9cb5-b863ecf51e00-dshm\") pod \"rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm\" (UID: \"638451bb-b011-47a0-9cb5-b863ecf51e00\") " pod="ai-tenant-e2e-shared-a-08271f/rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm"
Jul 31 22:51:23.672450 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:23.672354    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/638451bb-b011-47a0-9cb5-b863ecf51e00-home\") pod \"rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm\" (UID: \"638451bb-b011-47a0-9cb5-b863ecf51e00\") " pod="ai-tenant-e2e-shared-a-08271f/rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm"
Jul 31 22:51:23.672450 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:23.672426    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/638451bb-b011-47a0-9cb5-b863ecf51e00-tls-certs\") pod \"rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm\" (UID: \"638451bb-b011-47a0-9cb5-b863ecf51e00\") " pod="ai-tenant-e2e-shared-a-08271f/rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm"
Jul 31 22:51:23.672548 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:23.672465    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/638451bb-b011-47a0-9cb5-b863ecf51e00-model-cache\") pod \"rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm\" (UID: \"638451bb-b011-47a0-9cb5-b863ecf51e00\") " pod="ai-tenant-e2e-shared-a-08271f/rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm"
Jul 31 22:51:23.672548 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:23.672488    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/638451bb-b011-47a0-9cb5-b863ecf51e00-tmp-dir\") pod \"rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm\" (UID: \"638451bb-b011-47a0-9cb5-b863ecf51e00\") " pod="ai-tenant-e2e-shared-a-08271f/rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm"
Jul 31 22:51:23.672548 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:23.672541    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57fwj\" (UniqueName: \"kubernetes.io/projected/638451bb-b011-47a0-9cb5-b863ecf51e00-kube-api-access-57fwj\") pod \"rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm\" (UID: \"638451bb-b011-47a0-9cb5-b863ecf51e00\") " pod="ai-tenant-e2e-shared-a-08271f/rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm"
Jul 31 22:51:23.773687 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:23.773660    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/638451bb-b011-47a0-9cb5-b863ecf51e00-tls-certs\") pod \"rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm\" (UID: \"638451bb-b011-47a0-9cb5-b863ecf51e00\") " pod="ai-tenant-e2e-shared-a-08271f/rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm"
Jul 31 22:51:23.773801 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:23.773699    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/638451bb-b011-47a0-9cb5-b863ecf51e00-model-cache\") pod \"rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm\" (UID: \"638451bb-b011-47a0-9cb5-b863ecf51e00\") " pod="ai-tenant-e2e-shared-a-08271f/rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm"
Jul 31 22:51:23.773801 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:23.773718    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/638451bb-b011-47a0-9cb5-b863ecf51e00-tmp-dir\") pod \"rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm\" (UID: \"638451bb-b011-47a0-9cb5-b863ecf51e00\") " pod="ai-tenant-e2e-shared-a-08271f/rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm"
Jul 31 22:51:23.773801 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:23.773741    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57fwj\" (UniqueName: \"kubernetes.io/projected/638451bb-b011-47a0-9cb5-b863ecf51e00-kube-api-access-57fwj\") pod \"rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm\" (UID: \"638451bb-b011-47a0-9cb5-b863ecf51e00\") " pod="ai-tenant-e2e-shared-a-08271f/rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm"
Jul 31 22:51:23.773801 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:23.773778    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/638451bb-b011-47a0-9cb5-b863ecf51e00-dshm\") pod \"rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm\" (UID: \"638451bb-b011-47a0-9cb5-b863ecf51e00\") " pod="ai-tenant-e2e-shared-a-08271f/rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm"
Jul 31 22:51:23.774004 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:23.773806    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/638451bb-b011-47a0-9cb5-b863ecf51e00-home\") pod \"rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm\" (UID: \"638451bb-b011-47a0-9cb5-b863ecf51e00\") " pod="ai-tenant-e2e-shared-a-08271f/rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm"
Jul 31 22:51:23.774128 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:23.774104    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/638451bb-b011-47a0-9cb5-b863ecf51e00-model-cache\") pod \"rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm\" (UID: \"638451bb-b011-47a0-9cb5-b863ecf51e00\") " pod="ai-tenant-e2e-shared-a-08271f/rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm"
Jul 31 22:51:23.774185 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:23.774125    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/638451bb-b011-47a0-9cb5-b863ecf51e00-tmp-dir\") pod \"rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm\" (UID: \"638451bb-b011-47a0-9cb5-b863ecf51e00\") " pod="ai-tenant-e2e-shared-a-08271f/rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm"
Jul 31 22:51:23.774229 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:23.774213    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/638451bb-b011-47a0-9cb5-b863ecf51e00-home\") pod \"rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm\" (UID: \"638451bb-b011-47a0-9cb5-b863ecf51e00\") " pod="ai-tenant-e2e-shared-a-08271f/rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm"
Jul 31 22:51:23.775955 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:23.775939    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/638451bb-b011-47a0-9cb5-b863ecf51e00-dshm\") pod \"rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm\" (UID: \"638451bb-b011-47a0-9cb5-b863ecf51e00\") " pod="ai-tenant-e2e-shared-a-08271f/rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm"
Jul 31 22:51:23.776311 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:23.776284    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/638451bb-b011-47a0-9cb5-b863ecf51e00-tls-certs\") pod \"rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm\" (UID: \"638451bb-b011-47a0-9cb5-b863ecf51e00\") " pod="ai-tenant-e2e-shared-a-08271f/rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm"
Jul 31 22:51:23.786384 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:23.786365    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57fwj\" (UniqueName: \"kubernetes.io/projected/638451bb-b011-47a0-9cb5-b863ecf51e00-kube-api-access-57fwj\") pod \"rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm\" (UID: \"638451bb-b011-47a0-9cb5-b863ecf51e00\") " pod="ai-tenant-e2e-shared-a-08271f/rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm"
Jul 31 22:51:23.885971 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:23.885916    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-08271f/rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm"
Jul 31 22:51:24.033347 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:24.033320    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-08271f/rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm"]
Jul 31 22:51:24.035942 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:51:24.035915    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod638451bb_b011_47a0_9cb5_b863ecf51e00.slice/crio-cd20de4009dac06b26645ec37495bac3d246fce341cefa845bd4548c0fae0c6f WatchSource:0}: Error finding container cd20de4009dac06b26645ec37495bac3d246fce341cefa845bd4548c0fae0c6f: Status 404 returned error can't find the container with id cd20de4009dac06b26645ec37495bac3d246fce341cefa845bd4548c0fae0c6f
Jul 31 22:51:24.351242 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:24.351201    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-08271f/rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm" event={"ID":"638451bb-b011-47a0-9cb5-b863ecf51e00","Type":"ContainerStarted","Data":"1a32599196dab70692cf77942f5390e93f46889a738601bc70b0bfcef88950e1"}
Jul 31 22:51:24.351431 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:24.351250    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-08271f/rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm" event={"ID":"638451bb-b011-47a0-9cb5-b863ecf51e00","Type":"ContainerStarted","Data":"cd20de4009dac06b26645ec37495bac3d246fce341cefa845bd4548c0fae0c6f"}
Jul 31 22:51:24.376483 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:24.376438    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-08271f/rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm" podStartSLOduration=1.376422721 podStartE2EDuration="1.376422721s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:51:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:51:24.375001781 +0000 UTC m=+3093.470292927" watchObservedRunningTime="2026-07-31 22:51:24.376422721 +0000 UTC m=+3093.471713917"
Jul 31 22:51:24.504259 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:24.504223    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-08271f/sub-test-model-08271f-kserve-66758695d7-gvj89" podUID="e30c6d4b-429b-46df-b41d-141d77a0bdaa" containerName="main" containerID="cri-o://d3a318b1e1e31e6426e1b0c91c826561e720f08a7dbb7baed7fad34e2a051c98" gracePeriod=45
Jul 31 22:51:24.735729 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:24.735704    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-08271f/sub-test-model-08271f-kserve-66758695d7-gvj89"
Jul 31 22:51:24.885068 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:24.884988    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e30c6d4b-429b-46df-b41d-141d77a0bdaa-home\") pod \"e30c6d4b-429b-46df-b41d-141d77a0bdaa\" (UID: \"e30c6d4b-429b-46df-b41d-141d77a0bdaa\") "
Jul 31 22:51:24.885068 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:24.885036    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e30c6d4b-429b-46df-b41d-141d77a0bdaa-tmp-dir\") pod \"e30c6d4b-429b-46df-b41d-141d77a0bdaa\" (UID: \"e30c6d4b-429b-46df-b41d-141d77a0bdaa\") "
Jul 31 22:51:24.885290 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:24.885102    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e30c6d4b-429b-46df-b41d-141d77a0bdaa-dshm\") pod \"e30c6d4b-429b-46df-b41d-141d77a0bdaa\" (UID: \"e30c6d4b-429b-46df-b41d-141d77a0bdaa\") "
Jul 31 22:51:24.885290 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:24.885121    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e30c6d4b-429b-46df-b41d-141d77a0bdaa-tls-certs\") pod \"e30c6d4b-429b-46df-b41d-141d77a0bdaa\" (UID: \"e30c6d4b-429b-46df-b41d-141d77a0bdaa\") "
Jul 31 22:51:24.885290 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:24.885139    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e30c6d4b-429b-46df-b41d-141d77a0bdaa-model-cache\") pod \"e30c6d4b-429b-46df-b41d-141d77a0bdaa\" (UID: \"e30c6d4b-429b-46df-b41d-141d77a0bdaa\") "
Jul 31 22:51:24.885290 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:24.885195    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-449cz\" (UniqueName: \"kubernetes.io/projected/e30c6d4b-429b-46df-b41d-141d77a0bdaa-kube-api-access-449cz\") pod \"e30c6d4b-429b-46df-b41d-141d77a0bdaa\" (UID: \"e30c6d4b-429b-46df-b41d-141d77a0bdaa\") "
Jul 31 22:51:24.885517 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:24.885324    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e30c6d4b-429b-46df-b41d-141d77a0bdaa-home" (OuterVolumeSpecName: "home") pod "e30c6d4b-429b-46df-b41d-141d77a0bdaa" (UID: "e30c6d4b-429b-46df-b41d-141d77a0bdaa"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:51:24.885517 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:24.885377    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e30c6d4b-429b-46df-b41d-141d77a0bdaa-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e30c6d4b-429b-46df-b41d-141d77a0bdaa" (UID: "e30c6d4b-429b-46df-b41d-141d77a0bdaa"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:51:24.885517 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:24.885471    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e30c6d4b-429b-46df-b41d-141d77a0bdaa-model-cache" (OuterVolumeSpecName: "model-cache") pod "e30c6d4b-429b-46df-b41d-141d77a0bdaa" (UID: "e30c6d4b-429b-46df-b41d-141d77a0bdaa"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:51:24.885668 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:24.885541    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e30c6d4b-429b-46df-b41d-141d77a0bdaa-home\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:51:24.885668 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:24.885555    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e30c6d4b-429b-46df-b41d-141d77a0bdaa-tmp-dir\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:51:24.887270 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:24.887251    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e30c6d4b-429b-46df-b41d-141d77a0bdaa-dshm" (OuterVolumeSpecName: "dshm") pod "e30c6d4b-429b-46df-b41d-141d77a0bdaa" (UID: "e30c6d4b-429b-46df-b41d-141d77a0bdaa"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:51:24.887362 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:24.887286    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e30c6d4b-429b-46df-b41d-141d77a0bdaa-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e30c6d4b-429b-46df-b41d-141d77a0bdaa" (UID: "e30c6d4b-429b-46df-b41d-141d77a0bdaa"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:51:24.887440 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:24.887416    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e30c6d4b-429b-46df-b41d-141d77a0bdaa-kube-api-access-449cz" (OuterVolumeSpecName: "kube-api-access-449cz") pod "e30c6d4b-429b-46df-b41d-141d77a0bdaa" (UID: "e30c6d4b-429b-46df-b41d-141d77a0bdaa"). InnerVolumeSpecName "kube-api-access-449cz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:51:24.986639 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:24.986615    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e30c6d4b-429b-46df-b41d-141d77a0bdaa-dshm\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:51:24.986639 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:24.986635    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e30c6d4b-429b-46df-b41d-141d77a0bdaa-tls-certs\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:51:24.986762 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:24.986646    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e30c6d4b-429b-46df-b41d-141d77a0bdaa-model-cache\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:51:24.986762 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:24.986654    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-449cz\" (UniqueName: \"kubernetes.io/projected/e30c6d4b-429b-46df-b41d-141d77a0bdaa-kube-api-access-449cz\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:51:25.357997 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:25.357972    2573 generic.go:356] "Generic (PLEG): container finished" podID="e30c6d4b-429b-46df-b41d-141d77a0bdaa" containerID="d3a318b1e1e31e6426e1b0c91c826561e720f08a7dbb7baed7fad34e2a051c98" exitCode=0
Jul 31 22:51:25.358117 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:25.358016    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-08271f/sub-test-model-08271f-kserve-66758695d7-gvj89"
Jul 31 22:51:25.358117 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:25.358060    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-08271f/sub-test-model-08271f-kserve-66758695d7-gvj89" event={"ID":"e30c6d4b-429b-46df-b41d-141d77a0bdaa","Type":"ContainerDied","Data":"d3a318b1e1e31e6426e1b0c91c826561e720f08a7dbb7baed7fad34e2a051c98"}
Jul 31 22:51:25.358117 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:25.358105    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-08271f/sub-test-model-08271f-kserve-66758695d7-gvj89" event={"ID":"e30c6d4b-429b-46df-b41d-141d77a0bdaa","Type":"ContainerDied","Data":"f51cc1563534115457474adf53f85cc7057a440ba0377462534e257c2f27ca3f"}
Jul 31 22:51:25.358241 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:25.358126    2573 scope.go:117] "RemoveContainer" containerID="d3a318b1e1e31e6426e1b0c91c826561e720f08a7dbb7baed7fad34e2a051c98"
Jul 31 22:51:25.366179 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:25.366165    2573 scope.go:117] "RemoveContainer" containerID="d3a318b1e1e31e6426e1b0c91c826561e720f08a7dbb7baed7fad34e2a051c98"
Jul 31 22:51:25.366456 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:51:25.366436    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3a318b1e1e31e6426e1b0c91c826561e720f08a7dbb7baed7fad34e2a051c98\": container with ID starting with d3a318b1e1e31e6426e1b0c91c826561e720f08a7dbb7baed7fad34e2a051c98 not found: ID does not exist" containerID="d3a318b1e1e31e6426e1b0c91c826561e720f08a7dbb7baed7fad34e2a051c98"
Jul 31 22:51:25.366559 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:25.366460    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3a318b1e1e31e6426e1b0c91c826561e720f08a7dbb7baed7fad34e2a051c98"} err="failed to get container status \"d3a318b1e1e31e6426e1b0c91c826561e720f08a7dbb7baed7fad34e2a051c98\": rpc error: code = NotFound desc = could not find container \"d3a318b1e1e31e6426e1b0c91c826561e720f08a7dbb7baed7fad34e2a051c98\": container with ID starting with d3a318b1e1e31e6426e1b0c91c826561e720f08a7dbb7baed7fad34e2a051c98 not found: ID does not exist"
Jul 31 22:51:25.385851 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:25.385829    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-08271f/sub-test-model-08271f-kserve-66758695d7-gvj89"]
Jul 31 22:51:25.391424 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:25.391404    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-08271f/sub-test-model-08271f-kserve-66758695d7-gvj89"]
Jul 31 22:51:25.710848 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:25.710804    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-3326ad/sub-test-model-3326ad-kserve-55956b8c7-qzwsn" podUID="ffa19906-c5c2-4a36-9ce5-f5c5927591dd" containerName="main" containerID="cri-o://87e89ef9ff0d85cd45d8af096bf95d4bf9d9cc4d61b28fdceb71ea397ac83ce5" gracePeriod=45
Jul 31 22:51:25.949540 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:25.949515    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3326ad/sub-test-model-3326ad-kserve-55956b8c7-qzwsn"
Jul 31 22:51:26.101743 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:26.101679    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-627sp\" (UniqueName: \"kubernetes.io/projected/ffa19906-c5c2-4a36-9ce5-f5c5927591dd-kube-api-access-627sp\") pod \"ffa19906-c5c2-4a36-9ce5-f5c5927591dd\" (UID: \"ffa19906-c5c2-4a36-9ce5-f5c5927591dd\") "
Jul 31 22:51:26.101884 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:26.101746    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ffa19906-c5c2-4a36-9ce5-f5c5927591dd-model-cache\") pod \"ffa19906-c5c2-4a36-9ce5-f5c5927591dd\" (UID: \"ffa19906-c5c2-4a36-9ce5-f5c5927591dd\") "
Jul 31 22:51:26.101884 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:26.101782    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ffa19906-c5c2-4a36-9ce5-f5c5927591dd-home\") pod \"ffa19906-c5c2-4a36-9ce5-f5c5927591dd\" (UID: \"ffa19906-c5c2-4a36-9ce5-f5c5927591dd\") "
Jul 31 22:51:26.101884 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:26.101810    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ffa19906-c5c2-4a36-9ce5-f5c5927591dd-dshm\") pod \"ffa19906-c5c2-4a36-9ce5-f5c5927591dd\" (UID: \"ffa19906-c5c2-4a36-9ce5-f5c5927591dd\") "
Jul 31 22:51:26.101884 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:26.101829    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ffa19906-c5c2-4a36-9ce5-f5c5927591dd-tls-certs\") pod \"ffa19906-c5c2-4a36-9ce5-f5c5927591dd\" (UID: \"ffa19906-c5c2-4a36-9ce5-f5c5927591dd\") "
Jul 31 22:51:26.101884 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:26.101856    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffa19906-c5c2-4a36-9ce5-f5c5927591dd-tmp-dir\") pod \"ffa19906-c5c2-4a36-9ce5-f5c5927591dd\" (UID: \"ffa19906-c5c2-4a36-9ce5-f5c5927591dd\") "
Jul 31 22:51:26.102162 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:26.102014    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffa19906-c5c2-4a36-9ce5-f5c5927591dd-model-cache" (OuterVolumeSpecName: "model-cache") pod "ffa19906-c5c2-4a36-9ce5-f5c5927591dd" (UID: "ffa19906-c5c2-4a36-9ce5-f5c5927591dd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:51:26.102162 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:26.102044    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffa19906-c5c2-4a36-9ce5-f5c5927591dd-home" (OuterVolumeSpecName: "home") pod "ffa19906-c5c2-4a36-9ce5-f5c5927591dd" (UID: "ffa19906-c5c2-4a36-9ce5-f5c5927591dd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:51:26.102162 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:26.102103    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ffa19906-c5c2-4a36-9ce5-f5c5927591dd-model-cache\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:51:26.102162 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:26.102131    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffa19906-c5c2-4a36-9ce5-f5c5927591dd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ffa19906-c5c2-4a36-9ce5-f5c5927591dd" (UID: "ffa19906-c5c2-4a36-9ce5-f5c5927591dd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:51:26.103943 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:26.103916    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffa19906-c5c2-4a36-9ce5-f5c5927591dd-dshm" (OuterVolumeSpecName: "dshm") pod "ffa19906-c5c2-4a36-9ce5-f5c5927591dd" (UID: "ffa19906-c5c2-4a36-9ce5-f5c5927591dd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:51:26.104069 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:26.103962    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffa19906-c5c2-4a36-9ce5-f5c5927591dd-kube-api-access-627sp" (OuterVolumeSpecName: "kube-api-access-627sp") pod "ffa19906-c5c2-4a36-9ce5-f5c5927591dd" (UID: "ffa19906-c5c2-4a36-9ce5-f5c5927591dd"). InnerVolumeSpecName "kube-api-access-627sp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:51:26.104069 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:26.103989    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffa19906-c5c2-4a36-9ce5-f5c5927591dd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ffa19906-c5c2-4a36-9ce5-f5c5927591dd" (UID: "ffa19906-c5c2-4a36-9ce5-f5c5927591dd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:51:26.202981 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:26.202957    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ffa19906-c5c2-4a36-9ce5-f5c5927591dd-dshm\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:51:26.202981 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:26.202979    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ffa19906-c5c2-4a36-9ce5-f5c5927591dd-tls-certs\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:51:26.203135 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:26.202990    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffa19906-c5c2-4a36-9ce5-f5c5927591dd-tmp-dir\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:51:26.203135 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:26.203000    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-627sp\" (UniqueName: \"kubernetes.io/projected/ffa19906-c5c2-4a36-9ce5-f5c5927591dd-kube-api-access-627sp\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:51:26.203135 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:26.203010    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ffa19906-c5c2-4a36-9ce5-f5c5927591dd-home\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:51:26.364254 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:26.364189    2573 generic.go:356] "Generic (PLEG): container finished" podID="ffa19906-c5c2-4a36-9ce5-f5c5927591dd" containerID="87e89ef9ff0d85cd45d8af096bf95d4bf9d9cc4d61b28fdceb71ea397ac83ce5" exitCode=0
Jul 31 22:51:26.364254 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:26.364228    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3326ad/sub-test-model-3326ad-kserve-55956b8c7-qzwsn"
Jul 31 22:51:26.364428 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:26.364220    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3326ad/sub-test-model-3326ad-kserve-55956b8c7-qzwsn" event={"ID":"ffa19906-c5c2-4a36-9ce5-f5c5927591dd","Type":"ContainerDied","Data":"87e89ef9ff0d85cd45d8af096bf95d4bf9d9cc4d61b28fdceb71ea397ac83ce5"}
Jul 31 22:51:26.364428 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:26.364339    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3326ad/sub-test-model-3326ad-kserve-55956b8c7-qzwsn" event={"ID":"ffa19906-c5c2-4a36-9ce5-f5c5927591dd","Type":"ContainerDied","Data":"995c01700e3e5639e5a8d0328f20995549a5d6032abc335e6a4c40533dfb712b"}
Jul 31 22:51:26.364428 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:26.364357    2573 scope.go:117] "RemoveContainer" containerID="87e89ef9ff0d85cd45d8af096bf95d4bf9d9cc4d61b28fdceb71ea397ac83ce5"
Jul 31 22:51:26.372870 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:26.372854    2573 scope.go:117] "RemoveContainer" containerID="87e89ef9ff0d85cd45d8af096bf95d4bf9d9cc4d61b28fdceb71ea397ac83ce5"
Jul 31 22:51:26.373110 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:51:26.373090    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87e89ef9ff0d85cd45d8af096bf95d4bf9d9cc4d61b28fdceb71ea397ac83ce5\": container with ID starting with 87e89ef9ff0d85cd45d8af096bf95d4bf9d9cc4d61b28fdceb71ea397ac83ce5 not found: ID does not exist" containerID="87e89ef9ff0d85cd45d8af096bf95d4bf9d9cc4d61b28fdceb71ea397ac83ce5"
Jul 31 22:51:26.373205 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:26.373116    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87e89ef9ff0d85cd45d8af096bf95d4bf9d9cc4d61b28fdceb71ea397ac83ce5"} err="failed to get container status \"87e89ef9ff0d85cd45d8af096bf95d4bf9d9cc4d61b28fdceb71ea397ac83ce5\": rpc error: code = NotFound desc = could not find container \"87e89ef9ff0d85cd45d8af096bf95d4bf9d9cc4d61b28fdceb71ea397ac83ce5\": container with ID starting with 87e89ef9ff0d85cd45d8af096bf95d4bf9d9cc4d61b28fdceb71ea397ac83ce5 not found: ID does not exist"
Jul 31 22:51:26.390630 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:26.390606    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-3326ad/sub-test-model-3326ad-kserve-55956b8c7-qzwsn"]
Jul 31 22:51:26.402770 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:26.402750    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-3326ad/sub-test-model-3326ad-kserve-55956b8c7-qzwsn"]
Jul 31 22:51:27.334994 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:27.334960    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e30c6d4b-429b-46df-b41d-141d77a0bdaa" path="/var/lib/kubelet/pods/e30c6d4b-429b-46df-b41d-141d77a0bdaa/volumes"
Jul 31 22:51:27.335523 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:27.335500    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffa19906-c5c2-4a36-9ce5-f5c5927591dd" path="/var/lib/kubelet/pods/ffa19906-c5c2-4a36-9ce5-f5c5927591dd/volumes"
Jul 31 22:51:33.886840 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:33.886807    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-08271f/rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm"
Jul 31 22:51:33.887227 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:33.887017    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-08271f/rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm"
Jul 31 22:51:33.899209 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:33.899189    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-08271f/rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm"
Jul 31 22:51:34.410112 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:34.410087    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-08271f/rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm"
Jul 31 22:51:42.957081 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:42.957046    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-3326ad/rate-test-model-3326ad-kserve-58dbc57c75-shd9c"]
Jul 31 22:51:42.957596 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:42.957534    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e30c6d4b-429b-46df-b41d-141d77a0bdaa" containerName="main"
Jul 31 22:51:42.957596 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:42.957554    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e30c6d4b-429b-46df-b41d-141d77a0bdaa" containerName="main"
Jul 31 22:51:42.957596 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:42.957584    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffa19906-c5c2-4a36-9ce5-f5c5927591dd" containerName="main"
Jul 31 22:51:42.957596 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:42.957592    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffa19906-c5c2-4a36-9ce5-f5c5927591dd" containerName="main"
Jul 31 22:51:42.957815 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:42.957679    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffa19906-c5c2-4a36-9ce5-f5c5927591dd" containerName="main"
Jul 31 22:51:42.957815 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:42.957693    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e30c6d4b-429b-46df-b41d-141d77a0bdaa" containerName="main"
Jul 31 22:51:42.960911 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:42.960890    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3326ad/rate-test-model-3326ad-kserve-58dbc57c75-shd9c"
Jul 31 22:51:42.963497 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:42.963478    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-3326ad\"/\"openshift-service-ca.crt\""
Jul 31 22:51:42.963615 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:42.963485    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-3326ad\"/\"rate-test-model-3326ad-kserve-self-signed-certs\""
Jul 31 22:51:42.964422 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:42.964399    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-3326ad\"/\"kube-root-ca.crt\""
Jul 31 22:51:42.964541 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:42.964520    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-3326ad\"/\"default-dockercfg-2rjkp\""
Jul 31 22:51:42.971229 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:42.971208    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-3326ad/rate-test-model-3326ad-kserve-58dbc57c75-shd9c"]
Jul 31 22:51:43.133717 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:43.133675    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ce66535-2373-4182-93b7-3a2a786ab79f-tmp-dir\") pod \"rate-test-model-3326ad-kserve-58dbc57c75-shd9c\" (UID: \"8ce66535-2373-4182-93b7-3a2a786ab79f\") " pod="ai-tenant-e2e-shared-b-3326ad/rate-test-model-3326ad-kserve-58dbc57c75-shd9c"
Jul 31 22:51:43.133717 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:43.133718    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ce66535-2373-4182-93b7-3a2a786ab79f-dshm\") pod \"rate-test-model-3326ad-kserve-58dbc57c75-shd9c\" (UID: \"8ce66535-2373-4182-93b7-3a2a786ab79f\") " pod="ai-tenant-e2e-shared-b-3326ad/rate-test-model-3326ad-kserve-58dbc57c75-shd9c"
Jul 31 22:51:43.133908 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:43.133736    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlfqb\" (UniqueName: \"kubernetes.io/projected/8ce66535-2373-4182-93b7-3a2a786ab79f-kube-api-access-wlfqb\") pod \"rate-test-model-3326ad-kserve-58dbc57c75-shd9c\" (UID: \"8ce66535-2373-4182-93b7-3a2a786ab79f\") " pod="ai-tenant-e2e-shared-b-3326ad/rate-test-model-3326ad-kserve-58dbc57c75-shd9c"
Jul 31 22:51:43.133908 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:43.133828    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ce66535-2373-4182-93b7-3a2a786ab79f-home\") pod \"rate-test-model-3326ad-kserve-58dbc57c75-shd9c\" (UID: \"8ce66535-2373-4182-93b7-3a2a786ab79f\") " pod="ai-tenant-e2e-shared-b-3326ad/rate-test-model-3326ad-kserve-58dbc57c75-shd9c"
Jul 31 22:51:43.133908 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:43.133849    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ce66535-2373-4182-93b7-3a2a786ab79f-tls-certs\") pod \"rate-test-model-3326ad-kserve-58dbc57c75-shd9c\" (UID: \"8ce66535-2373-4182-93b7-3a2a786ab79f\") " pod="ai-tenant-e2e-shared-b-3326ad/rate-test-model-3326ad-kserve-58dbc57c75-shd9c"
Jul 31 22:51:43.133908 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:43.133870    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ce66535-2373-4182-93b7-3a2a786ab79f-model-cache\") pod \"rate-test-model-3326ad-kserve-58dbc57c75-shd9c\" (UID: \"8ce66535-2373-4182-93b7-3a2a786ab79f\") " pod="ai-tenant-e2e-shared-b-3326ad/rate-test-model-3326ad-kserve-58dbc57c75-shd9c"
Jul 31 22:51:43.235223 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:43.235158    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ce66535-2373-4182-93b7-3a2a786ab79f-model-cache\") pod \"rate-test-model-3326ad-kserve-58dbc57c75-shd9c\" (UID: \"8ce66535-2373-4182-93b7-3a2a786ab79f\") " pod="ai-tenant-e2e-shared-b-3326ad/rate-test-model-3326ad-kserve-58dbc57c75-shd9c"
Jul 31 22:51:43.235378 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:43.235225    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ce66535-2373-4182-93b7-3a2a786ab79f-tmp-dir\") pod \"rate-test-model-3326ad-kserve-58dbc57c75-shd9c\" (UID: \"8ce66535-2373-4182-93b7-3a2a786ab79f\") " pod="ai-tenant-e2e-shared-b-3326ad/rate-test-model-3326ad-kserve-58dbc57c75-shd9c"
Jul 31 22:51:43.235378 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:43.235251    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ce66535-2373-4182-93b7-3a2a786ab79f-dshm\") pod \"rate-test-model-3326ad-kserve-58dbc57c75-shd9c\" (UID: \"8ce66535-2373-4182-93b7-3a2a786ab79f\") " pod="ai-tenant-e2e-shared-b-3326ad/rate-test-model-3326ad-kserve-58dbc57c75-shd9c"
Jul 31 22:51:43.235378 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:43.235268    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlfqb\" (UniqueName: \"kubernetes.io/projected/8ce66535-2373-4182-93b7-3a2a786ab79f-kube-api-access-wlfqb\") pod \"rate-test-model-3326ad-kserve-58dbc57c75-shd9c\" (UID: \"8ce66535-2373-4182-93b7-3a2a786ab79f\") " pod="ai-tenant-e2e-shared-b-3326ad/rate-test-model-3326ad-kserve-58dbc57c75-shd9c"
Jul 31 22:51:43.235378 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:43.235294    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ce66535-2373-4182-93b7-3a2a786ab79f-home\") pod \"rate-test-model-3326ad-kserve-58dbc57c75-shd9c\" (UID: \"8ce66535-2373-4182-93b7-3a2a786ab79f\") " pod="ai-tenant-e2e-shared-b-3326ad/rate-test-model-3326ad-kserve-58dbc57c75-shd9c"
Jul 31 22:51:43.235378 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:43.235333    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ce66535-2373-4182-93b7-3a2a786ab79f-tls-certs\") pod \"rate-test-model-3326ad-kserve-58dbc57c75-shd9c\" (UID: \"8ce66535-2373-4182-93b7-3a2a786ab79f\") " pod="ai-tenant-e2e-shared-b-3326ad/rate-test-model-3326ad-kserve-58dbc57c75-shd9c"
Jul 31 22:51:43.235646 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:43.235548    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ce66535-2373-4182-93b7-3a2a786ab79f-model-cache\") pod \"rate-test-model-3326ad-kserve-58dbc57c75-shd9c\" (UID: \"8ce66535-2373-4182-93b7-3a2a786ab79f\") " pod="ai-tenant-e2e-shared-b-3326ad/rate-test-model-3326ad-kserve-58dbc57c75-shd9c"
Jul 31 22:51:43.235690 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:43.235635    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ce66535-2373-4182-93b7-3a2a786ab79f-tmp-dir\") pod \"rate-test-model-3326ad-kserve-58dbc57c75-shd9c\" (UID: \"8ce66535-2373-4182-93b7-3a2a786ab79f\") " pod="ai-tenant-e2e-shared-b-3326ad/rate-test-model-3326ad-kserve-58dbc57c75-shd9c"
Jul 31 22:51:43.235731 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:43.235700    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ce66535-2373-4182-93b7-3a2a786ab79f-home\") pod \"rate-test-model-3326ad-kserve-58dbc57c75-shd9c\" (UID: \"8ce66535-2373-4182-93b7-3a2a786ab79f\") " pod="ai-tenant-e2e-shared-b-3326ad/rate-test-model-3326ad-kserve-58dbc57c75-shd9c"
Jul 31 22:51:43.237476 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:43.237458    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ce66535-2373-4182-93b7-3a2a786ab79f-dshm\") pod \"rate-test-model-3326ad-kserve-58dbc57c75-shd9c\" (UID: \"8ce66535-2373-4182-93b7-3a2a786ab79f\") " pod="ai-tenant-e2e-shared-b-3326ad/rate-test-model-3326ad-kserve-58dbc57c75-shd9c"
Jul 31 22:51:43.237736 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:43.237718    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ce66535-2373-4182-93b7-3a2a786ab79f-tls-certs\") pod \"rate-test-model-3326ad-kserve-58dbc57c75-shd9c\" (UID: \"8ce66535-2373-4182-93b7-3a2a786ab79f\") " pod="ai-tenant-e2e-shared-b-3326ad/rate-test-model-3326ad-kserve-58dbc57c75-shd9c"
Jul 31 22:51:43.244468 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:43.244447    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlfqb\" (UniqueName: \"kubernetes.io/projected/8ce66535-2373-4182-93b7-3a2a786ab79f-kube-api-access-wlfqb\") pod \"rate-test-model-3326ad-kserve-58dbc57c75-shd9c\" (UID: \"8ce66535-2373-4182-93b7-3a2a786ab79f\") " pod="ai-tenant-e2e-shared-b-3326ad/rate-test-model-3326ad-kserve-58dbc57c75-shd9c"
Jul 31 22:51:43.270295 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:43.270276    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3326ad/rate-test-model-3326ad-kserve-58dbc57c75-shd9c"
Jul 31 22:51:43.411629 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:43.411607    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-3326ad/rate-test-model-3326ad-kserve-58dbc57c75-shd9c"]
Jul 31 22:51:43.413755 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:51:43.413727    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ce66535_2373_4182_93b7_3a2a786ab79f.slice/crio-17c65ca5451bf796b4e74fca8291e2195a0890983f06b5b0c03db715da1322d3 WatchSource:0}: Error finding container 17c65ca5451bf796b4e74fca8291e2195a0890983f06b5b0c03db715da1322d3: Status 404 returned error can't find the container with id 17c65ca5451bf796b4e74fca8291e2195a0890983f06b5b0c03db715da1322d3
Jul 31 22:51:43.437817 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:43.437790    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3326ad/rate-test-model-3326ad-kserve-58dbc57c75-shd9c" event={"ID":"8ce66535-2373-4182-93b7-3a2a786ab79f","Type":"ContainerStarted","Data":"17c65ca5451bf796b4e74fca8291e2195a0890983f06b5b0c03db715da1322d3"}
Jul 31 22:51:44.443955 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:44.443917    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3326ad/rate-test-model-3326ad-kserve-58dbc57c75-shd9c" event={"ID":"8ce66535-2373-4182-93b7-3a2a786ab79f","Type":"ContainerStarted","Data":"9e1efd2d0b52769bbaa293899b658e208f407a4dcaa513fc159b6132f6f55fa7"}
Jul 31 22:51:44.468371 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:44.468324    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-3326ad/rate-test-model-3326ad-kserve-58dbc57c75-shd9c" podStartSLOduration=2.46829178 podStartE2EDuration="2.46829178s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:51:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:51:44.46647768 +0000 UTC m=+3113.561769025" watchObservedRunningTime="2026-07-31 22:51:44.46829178 +0000 UTC m=+3113.563582926"
Jul 31 22:51:53.271106 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:53.271073    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-3326ad/rate-test-model-3326ad-kserve-58dbc57c75-shd9c"
Jul 31 22:51:53.271553 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:53.271131    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-3326ad/rate-test-model-3326ad-kserve-58dbc57c75-shd9c"
Jul 31 22:51:53.283387 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:53.283367    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-3326ad/rate-test-model-3326ad-kserve-58dbc57c75-shd9c"
Jul 31 22:51:53.497467 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:51:53.497433    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-3326ad/rate-test-model-3326ad-kserve-58dbc57c75-shd9c"
Jul 31 22:52:53.256020 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:52:53.255983    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-08271f/rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm"]
Jul 31 22:52:54.180231 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:52:54.180198    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-3326ad/rate-test-model-3326ad-kserve-58dbc57c75-shd9c"]
Jul 31 22:52:55.179370 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:52:55.179338    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7485-140247624444336"]
Jul 31 22:52:55.182640 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:52:55.182622    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7485-140247624444336"
Jul 31 22:52:55.185073 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:52:55.185052    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-5dbjw\""
Jul 31 22:52:55.189742 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:52:55.189627    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7485-140247624444336"]
Jul 31 22:52:55.221282 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:52:55.221248    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g72fw\" (UniqueName: \"kubernetes.io/projected/38d0db5b-21ee-47cf-a93e-c27909065ee6-kube-api-access-g72fw\") pod \"test-curl-7485-140247624444336\" (UID: \"38d0db5b-21ee-47cf-a93e-c27909065ee6\") " pod="opendatahub/test-curl-7485-140247624444336"
Jul 31 22:52:55.321938 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:52:55.321900    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g72fw\" (UniqueName: \"kubernetes.io/projected/38d0db5b-21ee-47cf-a93e-c27909065ee6-kube-api-access-g72fw\") pod \"test-curl-7485-140247624444336\" (UID: \"38d0db5b-21ee-47cf-a93e-c27909065ee6\") " pod="opendatahub/test-curl-7485-140247624444336"
Jul 31 22:52:55.331551 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:52:55.331528    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g72fw\" (UniqueName: \"kubernetes.io/projected/38d0db5b-21ee-47cf-a93e-c27909065ee6-kube-api-access-g72fw\") pod \"test-curl-7485-140247624444336\" (UID: \"38d0db5b-21ee-47cf-a93e-c27909065ee6\") " pod="opendatahub/test-curl-7485-140247624444336"
Jul 31 22:52:55.492537 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:52:55.492457    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7485-140247624444336"
Jul 31 22:52:55.620900 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:52:55.620870    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7485-140247624444336"]
Jul 31 22:52:55.623626 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:52:55.623595    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod38d0db5b_21ee_47cf_a93e_c27909065ee6.slice/crio-582ef1888c6ffa8f31dc826a5f3190eddc695af25b2311341e50080be8eb801b WatchSource:0}: Error finding container 582ef1888c6ffa8f31dc826a5f3190eddc695af25b2311341e50080be8eb801b: Status 404 returned error can't find the container with id 582ef1888c6ffa8f31dc826a5f3190eddc695af25b2311341e50080be8eb801b
Jul 31 22:52:55.624954 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:52:55.624937    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 22:52:55.759937 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:52:55.759853    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7485-140247624444336" event={"ID":"38d0db5b-21ee-47cf-a93e-c27909065ee6","Type":"ContainerStarted","Data":"582ef1888c6ffa8f31dc826a5f3190eddc695af25b2311341e50080be8eb801b"}
Jul 31 22:52:56.765906 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:52:56.765872    2573 generic.go:356] "Generic (PLEG): container finished" podID="38d0db5b-21ee-47cf-a93e-c27909065ee6" containerID="4cc4483ef4650b5f3fa2fbfc885d3d0007b58e16e788715c3da410808537e211" exitCode=0
Jul 31 22:52:56.766289 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:52:56.765959    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7485-140247624444336" event={"ID":"38d0db5b-21ee-47cf-a93e-c27909065ee6","Type":"ContainerDied","Data":"4cc4483ef4650b5f3fa2fbfc885d3d0007b58e16e788715c3da410808537e211"}
Jul 31 22:52:57.900609 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:52:57.900583    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7485-140247624444336"
Jul 31 22:52:57.941546 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:52:57.941522    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7485-140247624444336_38d0db5b-21ee-47cf-a93e-c27909065ee6/test-curl-7485-140247624444336/0.log"
Jul 31 22:52:57.943764 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:52:57.943744    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g72fw\" (UniqueName: \"kubernetes.io/projected/38d0db5b-21ee-47cf-a93e-c27909065ee6-kube-api-access-g72fw\") pod \"38d0db5b-21ee-47cf-a93e-c27909065ee6\" (UID: \"38d0db5b-21ee-47cf-a93e-c27909065ee6\") "
Jul 31 22:52:57.945811 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:52:57.945789    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38d0db5b-21ee-47cf-a93e-c27909065ee6-kube-api-access-g72fw" (OuterVolumeSpecName: "kube-api-access-g72fw") pod "38d0db5b-21ee-47cf-a93e-c27909065ee6" (UID: "38d0db5b-21ee-47cf-a93e-c27909065ee6"). InnerVolumeSpecName "kube-api-access-g72fw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:52:57.964774 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:52:57.964747    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7485-140247624444336"]
Jul 31 22:52:57.968655 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:52:57.968634    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7485-140247624444336"]
Jul 31 22:52:58.044591 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:52:58.044526    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g72fw\" (UniqueName: \"kubernetes.io/projected/38d0db5b-21ee-47cf-a93e-c27909065ee6-kube-api-access-g72fw\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:52:58.098882 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:52:58.098857    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7485-140247624418096"]
Jul 31 22:52:58.099177 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:52:58.099164    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38d0db5b-21ee-47cf-a93e-c27909065ee6" containerName="test-curl-7485-140247624444336"
Jul 31 22:52:58.099219 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:52:58.099180    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="38d0db5b-21ee-47cf-a93e-c27909065ee6" containerName="test-curl-7485-140247624444336"
Jul 31 22:52:58.099262 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:52:58.099246    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="38d0db5b-21ee-47cf-a93e-c27909065ee6" containerName="test-curl-7485-140247624444336"
Jul 31 22:52:58.102079 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:52:58.102065    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7485-140247624418096"
Jul 31 22:52:58.109989 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:52:58.109967    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7485-140247624418096"]
Jul 31 22:52:58.145068 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:52:58.145040    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl6fp\" (UniqueName: \"kubernetes.io/projected/29f45624-bbe8-48d2-a5fc-425eb46feb0c-kube-api-access-gl6fp\") pod \"test-curl-7485-140247624418096\" (UID: \"29f45624-bbe8-48d2-a5fc-425eb46feb0c\") " pod="opendatahub/test-curl-7485-140247624418096"
Jul 31 22:52:58.245715 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:52:58.245677    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl6fp\" (UniqueName: \"kubernetes.io/projected/29f45624-bbe8-48d2-a5fc-425eb46feb0c-kube-api-access-gl6fp\") pod \"test-curl-7485-140247624418096\" (UID: \"29f45624-bbe8-48d2-a5fc-425eb46feb0c\") " pod="opendatahub/test-curl-7485-140247624418096"
Jul 31 22:52:58.254750 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:52:58.254722    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl6fp\" (UniqueName: \"kubernetes.io/projected/29f45624-bbe8-48d2-a5fc-425eb46feb0c-kube-api-access-gl6fp\") pod \"test-curl-7485-140247624418096\" (UID: \"29f45624-bbe8-48d2-a5fc-425eb46feb0c\") " pod="opendatahub/test-curl-7485-140247624418096"
Jul 31 22:52:58.412076 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:52:58.412002    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7485-140247624418096"
Jul 31 22:52:58.545752 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:52:58.545728    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7485-140247624418096"]
Jul 31 22:52:58.548187 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:52:58.548159    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod29f45624_bbe8_48d2_a5fc_425eb46feb0c.slice/crio-f0e27ecdc9d29f7522ecb02b68407a5ca4cf4ff0af05c42598604c3aa8c08a92 WatchSource:0}: Error finding container f0e27ecdc9d29f7522ecb02b68407a5ca4cf4ff0af05c42598604c3aa8c08a92: Status 404 returned error can't find the container with id f0e27ecdc9d29f7522ecb02b68407a5ca4cf4ff0af05c42598604c3aa8c08a92
Jul 31 22:52:58.776016 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:52:58.775991    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7485-140247624444336"
Jul 31 22:52:58.776016 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:52:58.776006    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="582ef1888c6ffa8f31dc826a5f3190eddc695af25b2311341e50080be8eb801b"
Jul 31 22:52:58.777193 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:52:58.777164    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7485-140247624418096" event={"ID":"29f45624-bbe8-48d2-a5fc-425eb46feb0c","Type":"ContainerStarted","Data":"f0e27ecdc9d29f7522ecb02b68407a5ca4cf4ff0af05c42598604c3aa8c08a92"}
Jul 31 22:52:58.786860 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:52:58.786836    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7485-140247624444336\" is forbidden: User \"system:node:ip-10-0-130-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-191.ec2.internal' and this object" podUID="38d0db5b-21ee-47cf-a93e-c27909065ee6" pod="opendatahub/test-curl-7485-140247624444336"
Jul 31 22:52:59.334686 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:52:59.334653    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38d0db5b-21ee-47cf-a93e-c27909065ee6" path="/var/lib/kubelet/pods/38d0db5b-21ee-47cf-a93e-c27909065ee6/volumes"
Jul 31 22:52:59.782960 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:52:59.782931    2573 generic.go:356] "Generic (PLEG): container finished" podID="29f45624-bbe8-48d2-a5fc-425eb46feb0c" containerID="78b13c35ac163ea908dd3ff957ec31dc117c020966525c28972f2379e0fe0f56" exitCode=0
Jul 31 22:52:59.783117 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:52:59.783029    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7485-140247624418096" event={"ID":"29f45624-bbe8-48d2-a5fc-425eb46feb0c","Type":"ContainerDied","Data":"78b13c35ac163ea908dd3ff957ec31dc117c020966525c28972f2379e0fe0f56"}
Jul 31 22:53:00.916997 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:00.916973    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7485-140247624418096"
Jul 31 22:53:00.936592 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:00.936563    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7485-140247624418096_29f45624-bbe8-48d2-a5fc-425eb46feb0c/test-curl-7485-140247624418096/0.log"
Jul 31 22:53:00.961372 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:00.961343    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7485-140247624418096"]
Jul 31 22:53:00.965313 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:00.965277    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7485-140247624418096"]
Jul 31 22:53:00.968847 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:00.968828    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gl6fp\" (UniqueName: \"kubernetes.io/projected/29f45624-bbe8-48d2-a5fc-425eb46feb0c-kube-api-access-gl6fp\") pod \"29f45624-bbe8-48d2-a5fc-425eb46feb0c\" (UID: \"29f45624-bbe8-48d2-a5fc-425eb46feb0c\") "
Jul 31 22:53:00.970852 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:00.970830    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29f45624-bbe8-48d2-a5fc-425eb46feb0c-kube-api-access-gl6fp" (OuterVolumeSpecName: "kube-api-access-gl6fp") pod "29f45624-bbe8-48d2-a5fc-425eb46feb0c" (UID: "29f45624-bbe8-48d2-a5fc-425eb46feb0c"). InnerVolumeSpecName "kube-api-access-gl6fp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:53:01.069838 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:01.069757    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gl6fp\" (UniqueName: \"kubernetes.io/projected/29f45624-bbe8-48d2-a5fc-425eb46feb0c-kube-api-access-gl6fp\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:53:01.335257 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:01.335168    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29f45624-bbe8-48d2-a5fc-425eb46feb0c" path="/var/lib/kubelet/pods/29f45624-bbe8-48d2-a5fc-425eb46feb0c/volumes"
Jul 31 22:53:01.792847 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:01.792821    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7485-140247624418096"
Jul 31 22:53:01.793017 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:01.792882    2573 scope.go:117] "RemoveContainer" containerID="78b13c35ac163ea908dd3ff957ec31dc117c020966525c28972f2379e0fe0f56"
Jul 31 22:53:04.352429 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:04.352393    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7485-140247624416400"]
Jul 31 22:53:04.352812 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:04.352712    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29f45624-bbe8-48d2-a5fc-425eb46feb0c" containerName="test-curl-7485-140247624418096"
Jul 31 22:53:04.352812 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:04.352724    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="29f45624-bbe8-48d2-a5fc-425eb46feb0c" containerName="test-curl-7485-140247624418096"
Jul 31 22:53:04.352812 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:04.352795    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="29f45624-bbe8-48d2-a5fc-425eb46feb0c" containerName="test-curl-7485-140247624418096"
Jul 31 22:53:04.355676 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:04.355660    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7485-140247624416400"
Jul 31 22:53:04.358582 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:04.358560    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-5dbjw\""
Jul 31 22:53:04.363190 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:04.363170    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7485-140247624416400"]
Jul 31 22:53:04.399633 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:04.399608    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh6h5\" (UniqueName: \"kubernetes.io/projected/6bf6b367-eac2-4327-808b-debbd9b3426f-kube-api-access-gh6h5\") pod \"test-curl-7485-140247624416400\" (UID: \"6bf6b367-eac2-4327-808b-debbd9b3426f\") " pod="opendatahub/test-curl-7485-140247624416400"
Jul 31 22:53:04.501155 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:04.501126    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh6h5\" (UniqueName: \"kubernetes.io/projected/6bf6b367-eac2-4327-808b-debbd9b3426f-kube-api-access-gh6h5\") pod \"test-curl-7485-140247624416400\" (UID: \"6bf6b367-eac2-4327-808b-debbd9b3426f\") " pod="opendatahub/test-curl-7485-140247624416400"
Jul 31 22:53:04.509623 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:04.509597    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh6h5\" (UniqueName: \"kubernetes.io/projected/6bf6b367-eac2-4327-808b-debbd9b3426f-kube-api-access-gh6h5\") pod \"test-curl-7485-140247624416400\" (UID: \"6bf6b367-eac2-4327-808b-debbd9b3426f\") " pod="opendatahub/test-curl-7485-140247624416400"
Jul 31 22:53:04.666087 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:04.665171    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7485-140247624416400"
Jul 31 22:53:04.796980 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:04.796800    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7485-140247624416400"]
Jul 31 22:53:04.799223 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:53:04.799190    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6bf6b367_eac2_4327_808b_debbd9b3426f.slice/crio-7c22d0a4ca5cc10d85ea19558e5e956a9aa02849a68b369ef09bcb28412bf5b0 WatchSource:0}: Error finding container 7c22d0a4ca5cc10d85ea19558e5e956a9aa02849a68b369ef09bcb28412bf5b0: Status 404 returned error can't find the container with id 7c22d0a4ca5cc10d85ea19558e5e956a9aa02849a68b369ef09bcb28412bf5b0
Jul 31 22:53:04.808673 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:04.808647    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7485-140247624416400" event={"ID":"6bf6b367-eac2-4327-808b-debbd9b3426f","Type":"ContainerStarted","Data":"7c22d0a4ca5cc10d85ea19558e5e956a9aa02849a68b369ef09bcb28412bf5b0"}
Jul 31 22:53:05.815084 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:05.815001    2573 generic.go:356] "Generic (PLEG): container finished" podID="6bf6b367-eac2-4327-808b-debbd9b3426f" containerID="21fbbbe7945a783a8c998e8b80d16c69c6d759f6625793dbd32c5293aa24d491" exitCode=0
Jul 31 22:53:05.815454 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:05.815092    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7485-140247624416400" event={"ID":"6bf6b367-eac2-4327-808b-debbd9b3426f","Type":"ContainerDied","Data":"21fbbbe7945a783a8c998e8b80d16c69c6d759f6625793dbd32c5293aa24d491"}
Jul 31 22:53:06.954116 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:06.954086    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7485-140247624416400"
Jul 31 22:53:06.975010 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:06.974982    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7485-140247624416400_6bf6b367-eac2-4327-808b-debbd9b3426f/test-curl-7485-140247624416400/0.log"
Jul 31 22:53:06.998219 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:06.998188    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7485-140247624416400"]
Jul 31 22:53:07.000408 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:07.000385    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7485-140247624416400"]
Jul 31 22:53:07.019994 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:07.019974    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gh6h5\" (UniqueName: \"kubernetes.io/projected/6bf6b367-eac2-4327-808b-debbd9b3426f-kube-api-access-gh6h5\") pod \"6bf6b367-eac2-4327-808b-debbd9b3426f\" (UID: \"6bf6b367-eac2-4327-808b-debbd9b3426f\") "
Jul 31 22:53:07.022150 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:07.022120    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bf6b367-eac2-4327-808b-debbd9b3426f-kube-api-access-gh6h5" (OuterVolumeSpecName: "kube-api-access-gh6h5") pod "6bf6b367-eac2-4327-808b-debbd9b3426f" (UID: "6bf6b367-eac2-4327-808b-debbd9b3426f"). InnerVolumeSpecName "kube-api-access-gh6h5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:53:07.120597 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:07.120521    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gh6h5\" (UniqueName: \"kubernetes.io/projected/6bf6b367-eac2-4327-808b-debbd9b3426f-kube-api-access-gh6h5\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:53:07.127522 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:07.127493    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7485-140247624437808"]
Jul 31 22:53:07.127807 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:07.127795    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bf6b367-eac2-4327-808b-debbd9b3426f" containerName="test-curl-7485-140247624416400"
Jul 31 22:53:07.127850 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:07.127809    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bf6b367-eac2-4327-808b-debbd9b3426f" containerName="test-curl-7485-140247624416400"
Jul 31 22:53:07.127891 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:07.127882    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bf6b367-eac2-4327-808b-debbd9b3426f" containerName="test-curl-7485-140247624416400"
Jul 31 22:53:07.130607 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:07.130589    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7485-140247624437808"
Jul 31 22:53:07.135799 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:07.135780    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7485-140247624437808"]
Jul 31 22:53:07.221732 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:07.221701    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hw95\" (UniqueName: \"kubernetes.io/projected/e7bfdde6-d7eb-4cd7-a5c3-8112e6c75ecc-kube-api-access-8hw95\") pod \"test-curl-7485-140247624437808\" (UID: \"e7bfdde6-d7eb-4cd7-a5c3-8112e6c75ecc\") " pod="opendatahub/test-curl-7485-140247624437808"
Jul 31 22:53:07.322604 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:07.322575    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hw95\" (UniqueName: \"kubernetes.io/projected/e7bfdde6-d7eb-4cd7-a5c3-8112e6c75ecc-kube-api-access-8hw95\") pod \"test-curl-7485-140247624437808\" (UID: \"e7bfdde6-d7eb-4cd7-a5c3-8112e6c75ecc\") " pod="opendatahub/test-curl-7485-140247624437808"
Jul 31 22:53:07.331652 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:07.331625    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hw95\" (UniqueName: \"kubernetes.io/projected/e7bfdde6-d7eb-4cd7-a5c3-8112e6c75ecc-kube-api-access-8hw95\") pod \"test-curl-7485-140247624437808\" (UID: \"e7bfdde6-d7eb-4cd7-a5c3-8112e6c75ecc\") " pod="opendatahub/test-curl-7485-140247624437808"
Jul 31 22:53:07.335157 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:07.335131    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bf6b367-eac2-4327-808b-debbd9b3426f" path="/var/lib/kubelet/pods/6bf6b367-eac2-4327-808b-debbd9b3426f/volumes"
Jul 31 22:53:07.441016 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:07.440992    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7485-140247624437808"
Jul 31 22:53:07.570821 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:07.570745    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7485-140247624437808"]
Jul 31 22:53:07.572991 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:53:07.572969    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7bfdde6_d7eb_4cd7_a5c3_8112e6c75ecc.slice/crio-41b05393873b792a3521acd1c6336f451ae62ae64c3b21efbb3f6d9e1e501dc6 WatchSource:0}: Error finding container 41b05393873b792a3521acd1c6336f451ae62ae64c3b21efbb3f6d9e1e501dc6: Status 404 returned error can't find the container with id 41b05393873b792a3521acd1c6336f451ae62ae64c3b21efbb3f6d9e1e501dc6
Jul 31 22:53:07.826959 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:07.826880    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7485-140247624416400"
Jul 31 22:53:07.826959 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:07.826905    2573 scope.go:117] "RemoveContainer" containerID="21fbbbe7945a783a8c998e8b80d16c69c6d759f6625793dbd32c5293aa24d491"
Jul 31 22:53:07.828220 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:07.828057    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7485-140247624437808" event={"ID":"e7bfdde6-d7eb-4cd7-a5c3-8112e6c75ecc","Type":"ContainerStarted","Data":"41b05393873b792a3521acd1c6336f451ae62ae64c3b21efbb3f6d9e1e501dc6"}
Jul 31 22:53:08.275015 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:08.274983    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-08271f/rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm" podUID="638451bb-b011-47a0-9cb5-b863ecf51e00" containerName="main" containerID="cri-o://1a32599196dab70692cf77942f5390e93f46889a738601bc70b0bfcef88950e1" gracePeriod=45
Jul 31 22:53:08.517021 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:08.516997    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-08271f/rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm"
Jul 31 22:53:08.634646 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:08.634576    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/638451bb-b011-47a0-9cb5-b863ecf51e00-dshm\") pod \"638451bb-b011-47a0-9cb5-b863ecf51e00\" (UID: \"638451bb-b011-47a0-9cb5-b863ecf51e00\") "
Jul 31 22:53:08.634646 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:08.634618    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/638451bb-b011-47a0-9cb5-b863ecf51e00-tls-certs\") pod \"638451bb-b011-47a0-9cb5-b863ecf51e00\" (UID: \"638451bb-b011-47a0-9cb5-b863ecf51e00\") "
Jul 31 22:53:08.634840 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:08.634657    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/638451bb-b011-47a0-9cb5-b863ecf51e00-home\") pod \"638451bb-b011-47a0-9cb5-b863ecf51e00\" (UID: \"638451bb-b011-47a0-9cb5-b863ecf51e00\") "
Jul 31 22:53:08.634840 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:08.634695    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/638451bb-b011-47a0-9cb5-b863ecf51e00-tmp-dir\") pod \"638451bb-b011-47a0-9cb5-b863ecf51e00\" (UID: \"638451bb-b011-47a0-9cb5-b863ecf51e00\") "
Jul 31 22:53:08.634840 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:08.634739    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/638451bb-b011-47a0-9cb5-b863ecf51e00-model-cache\") pod \"638451bb-b011-47a0-9cb5-b863ecf51e00\" (UID: \"638451bb-b011-47a0-9cb5-b863ecf51e00\") "
Jul 31 22:53:08.634840 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:08.634758    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57fwj\" (UniqueName: \"kubernetes.io/projected/638451bb-b011-47a0-9cb5-b863ecf51e00-kube-api-access-57fwj\") pod \"638451bb-b011-47a0-9cb5-b863ecf51e00\" (UID: \"638451bb-b011-47a0-9cb5-b863ecf51e00\") "
Jul 31 22:53:08.635054 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:08.634985    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/638451bb-b011-47a0-9cb5-b863ecf51e00-model-cache" (OuterVolumeSpecName: "model-cache") pod "638451bb-b011-47a0-9cb5-b863ecf51e00" (UID: "638451bb-b011-47a0-9cb5-b863ecf51e00"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:53:08.635054 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:08.635007    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/638451bb-b011-47a0-9cb5-b863ecf51e00-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "638451bb-b011-47a0-9cb5-b863ecf51e00" (UID: "638451bb-b011-47a0-9cb5-b863ecf51e00"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:53:08.635054 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:08.634992    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/638451bb-b011-47a0-9cb5-b863ecf51e00-home" (OuterVolumeSpecName: "home") pod "638451bb-b011-47a0-9cb5-b863ecf51e00" (UID: "638451bb-b011-47a0-9cb5-b863ecf51e00"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:53:08.636914 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:08.636888    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/638451bb-b011-47a0-9cb5-b863ecf51e00-dshm" (OuterVolumeSpecName: "dshm") pod "638451bb-b011-47a0-9cb5-b863ecf51e00" (UID: "638451bb-b011-47a0-9cb5-b863ecf51e00"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:53:08.637019 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:08.636916    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/638451bb-b011-47a0-9cb5-b863ecf51e00-kube-api-access-57fwj" (OuterVolumeSpecName: "kube-api-access-57fwj") pod "638451bb-b011-47a0-9cb5-b863ecf51e00" (UID: "638451bb-b011-47a0-9cb5-b863ecf51e00"). InnerVolumeSpecName "kube-api-access-57fwj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:53:08.637019 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:08.636941    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/638451bb-b011-47a0-9cb5-b863ecf51e00-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "638451bb-b011-47a0-9cb5-b863ecf51e00" (UID: "638451bb-b011-47a0-9cb5-b863ecf51e00"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:53:08.736249 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:08.736219    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/638451bb-b011-47a0-9cb5-b863ecf51e00-dshm\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:53:08.736249 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:08.736241    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/638451bb-b011-47a0-9cb5-b863ecf51e00-tls-certs\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:53:08.736249 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:08.736251    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/638451bb-b011-47a0-9cb5-b863ecf51e00-home\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:53:08.736446 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:08.736259    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/638451bb-b011-47a0-9cb5-b863ecf51e00-tmp-dir\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:53:08.736446 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:08.736267    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/638451bb-b011-47a0-9cb5-b863ecf51e00-model-cache\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:53:08.736446 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:08.736275    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57fwj\" (UniqueName: \"kubernetes.io/projected/638451bb-b011-47a0-9cb5-b863ecf51e00-kube-api-access-57fwj\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:53:08.833949 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:08.833918    2573 generic.go:356] "Generic (PLEG): container finished" podID="638451bb-b011-47a0-9cb5-b863ecf51e00" containerID="1a32599196dab70692cf77942f5390e93f46889a738601bc70b0bfcef88950e1" exitCode=0
Jul 31 22:53:08.834127 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:08.833958    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-08271f/rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm"
Jul 31 22:53:08.834127 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:08.833994    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-08271f/rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm" event={"ID":"638451bb-b011-47a0-9cb5-b863ecf51e00","Type":"ContainerDied","Data":"1a32599196dab70692cf77942f5390e93f46889a738601bc70b0bfcef88950e1"}
Jul 31 22:53:08.834127 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:08.834044    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-08271f/rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm" event={"ID":"638451bb-b011-47a0-9cb5-b863ecf51e00","Type":"ContainerDied","Data":"cd20de4009dac06b26645ec37495bac3d246fce341cefa845bd4548c0fae0c6f"}
Jul 31 22:53:08.834127 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:08.834066    2573 scope.go:117] "RemoveContainer" containerID="1a32599196dab70692cf77942f5390e93f46889a738601bc70b0bfcef88950e1"
Jul 31 22:53:08.835685 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:08.835652    2573 generic.go:356] "Generic (PLEG): container finished" podID="e7bfdde6-d7eb-4cd7-a5c3-8112e6c75ecc" containerID="cae25e9275bd56ddce7f6ce77dbc67e57ca136726da6e20945d0503ea6fa2bce" exitCode=0
Jul 31 22:53:08.835815 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:08.835702    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7485-140247624437808" event={"ID":"e7bfdde6-d7eb-4cd7-a5c3-8112e6c75ecc","Type":"ContainerDied","Data":"cae25e9275bd56ddce7f6ce77dbc67e57ca136726da6e20945d0503ea6fa2bce"}
Jul 31 22:53:08.843097 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:08.843080    2573 scope.go:117] "RemoveContainer" containerID="1a32599196dab70692cf77942f5390e93f46889a738601bc70b0bfcef88950e1"
Jul 31 22:53:08.843360 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:53:08.843341    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a32599196dab70692cf77942f5390e93f46889a738601bc70b0bfcef88950e1\": container with ID starting with 1a32599196dab70692cf77942f5390e93f46889a738601bc70b0bfcef88950e1 not found: ID does not exist" containerID="1a32599196dab70692cf77942f5390e93f46889a738601bc70b0bfcef88950e1"
Jul 31 22:53:08.843427 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:08.843372    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a32599196dab70692cf77942f5390e93f46889a738601bc70b0bfcef88950e1"} err="failed to get container status \"1a32599196dab70692cf77942f5390e93f46889a738601bc70b0bfcef88950e1\": rpc error: code = NotFound desc = could not find container \"1a32599196dab70692cf77942f5390e93f46889a738601bc70b0bfcef88950e1\": container with ID starting with 1a32599196dab70692cf77942f5390e93f46889a738601bc70b0bfcef88950e1 not found: ID does not exist"
Jul 31 22:53:08.869903 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:08.869877    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-08271f/rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm"]
Jul 31 22:53:08.874423 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:08.874390    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-08271f/rate-test-model-08271f-kserve-6f4d6d75d7-g8kjm"]
Jul 31 22:53:09.198753 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:09.198658    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-3326ad/rate-test-model-3326ad-kserve-58dbc57c75-shd9c" podUID="8ce66535-2373-4182-93b7-3a2a786ab79f" containerName="main" containerID="cri-o://9e1efd2d0b52769bbaa293899b658e208f407a4dcaa513fc159b6132f6f55fa7" gracePeriod=45
Jul 31 22:53:09.335190 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:09.335155    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="638451bb-b011-47a0-9cb5-b863ecf51e00" path="/var/lib/kubelet/pods/638451bb-b011-47a0-9cb5-b863ecf51e00/volumes"
Jul 31 22:53:09.449376 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:09.449322    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3326ad/rate-test-model-3326ad-kserve-58dbc57c75-shd9c"
Jul 31 22:53:09.541970 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:09.541939    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ce66535-2373-4182-93b7-3a2a786ab79f-tmp-dir\") pod \"8ce66535-2373-4182-93b7-3a2a786ab79f\" (UID: \"8ce66535-2373-4182-93b7-3a2a786ab79f\") "
Jul 31 22:53:09.542136 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:09.541986    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ce66535-2373-4182-93b7-3a2a786ab79f-home\") pod \"8ce66535-2373-4182-93b7-3a2a786ab79f\" (UID: \"8ce66535-2373-4182-93b7-3a2a786ab79f\") "
Jul 31 22:53:09.542136 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:09.542003    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ce66535-2373-4182-93b7-3a2a786ab79f-tls-certs\") pod \"8ce66535-2373-4182-93b7-3a2a786ab79f\" (UID: \"8ce66535-2373-4182-93b7-3a2a786ab79f\") "
Jul 31 22:53:09.542136 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:09.542042    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wlfqb\" (UniqueName: \"kubernetes.io/projected/8ce66535-2373-4182-93b7-3a2a786ab79f-kube-api-access-wlfqb\") pod \"8ce66535-2373-4182-93b7-3a2a786ab79f\" (UID: \"8ce66535-2373-4182-93b7-3a2a786ab79f\") "
Jul 31 22:53:09.542136 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:09.542064    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ce66535-2373-4182-93b7-3a2a786ab79f-dshm\") pod \"8ce66535-2373-4182-93b7-3a2a786ab79f\" (UID: \"8ce66535-2373-4182-93b7-3a2a786ab79f\") "
Jul 31 22:53:09.542136 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:09.542081    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ce66535-2373-4182-93b7-3a2a786ab79f-model-cache\") pod \"8ce66535-2373-4182-93b7-3a2a786ab79f\" (UID: \"8ce66535-2373-4182-93b7-3a2a786ab79f\") "
Jul 31 22:53:09.542446 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:09.542253    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ce66535-2373-4182-93b7-3a2a786ab79f-home" (OuterVolumeSpecName: "home") pod "8ce66535-2373-4182-93b7-3a2a786ab79f" (UID: "8ce66535-2373-4182-93b7-3a2a786ab79f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:53:09.542446 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:09.542267    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ce66535-2373-4182-93b7-3a2a786ab79f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8ce66535-2373-4182-93b7-3a2a786ab79f" (UID: "8ce66535-2373-4182-93b7-3a2a786ab79f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:53:09.542533 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:09.542457    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ce66535-2373-4182-93b7-3a2a786ab79f-model-cache" (OuterVolumeSpecName: "model-cache") pod "8ce66535-2373-4182-93b7-3a2a786ab79f" (UID: "8ce66535-2373-4182-93b7-3a2a786ab79f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:53:09.544233 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:09.544199    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ce66535-2373-4182-93b7-3a2a786ab79f-kube-api-access-wlfqb" (OuterVolumeSpecName: "kube-api-access-wlfqb") pod "8ce66535-2373-4182-93b7-3a2a786ab79f" (UID: "8ce66535-2373-4182-93b7-3a2a786ab79f"). InnerVolumeSpecName "kube-api-access-wlfqb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:53:09.544357 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:09.544235    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ce66535-2373-4182-93b7-3a2a786ab79f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8ce66535-2373-4182-93b7-3a2a786ab79f" (UID: "8ce66535-2373-4182-93b7-3a2a786ab79f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:53:09.544357 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:09.544241    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ce66535-2373-4182-93b7-3a2a786ab79f-dshm" (OuterVolumeSpecName: "dshm") pod "8ce66535-2373-4182-93b7-3a2a786ab79f" (UID: "8ce66535-2373-4182-93b7-3a2a786ab79f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:53:09.643511 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:09.643478    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ce66535-2373-4182-93b7-3a2a786ab79f-tmp-dir\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:53:09.643511 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:09.643506    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ce66535-2373-4182-93b7-3a2a786ab79f-home\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:53:09.643511 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:09.643515    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ce66535-2373-4182-93b7-3a2a786ab79f-tls-certs\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:53:09.643737 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:09.643525    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wlfqb\" (UniqueName: \"kubernetes.io/projected/8ce66535-2373-4182-93b7-3a2a786ab79f-kube-api-access-wlfqb\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:53:09.643737 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:09.643534    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ce66535-2373-4182-93b7-3a2a786ab79f-dshm\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:53:09.643737 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:09.643542    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ce66535-2373-4182-93b7-3a2a786ab79f-model-cache\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:53:09.843891 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:09.843808    2573 generic.go:356] "Generic (PLEG): container finished" podID="8ce66535-2373-4182-93b7-3a2a786ab79f" containerID="9e1efd2d0b52769bbaa293899b658e208f407a4dcaa513fc159b6132f6f55fa7" exitCode=0
Jul 31 22:53:09.843891 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:09.843850    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3326ad/rate-test-model-3326ad-kserve-58dbc57c75-shd9c"
Jul 31 22:53:09.844102 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:09.843894    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3326ad/rate-test-model-3326ad-kserve-58dbc57c75-shd9c" event={"ID":"8ce66535-2373-4182-93b7-3a2a786ab79f","Type":"ContainerDied","Data":"9e1efd2d0b52769bbaa293899b658e208f407a4dcaa513fc159b6132f6f55fa7"}
Jul 31 22:53:09.844102 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:09.843936    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3326ad/rate-test-model-3326ad-kserve-58dbc57c75-shd9c" event={"ID":"8ce66535-2373-4182-93b7-3a2a786ab79f","Type":"ContainerDied","Data":"17c65ca5451bf796b4e74fca8291e2195a0890983f06b5b0c03db715da1322d3"}
Jul 31 22:53:09.844102 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:09.843960    2573 scope.go:117] "RemoveContainer" containerID="9e1efd2d0b52769bbaa293899b658e208f407a4dcaa513fc159b6132f6f55fa7"
Jul 31 22:53:09.853444 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:09.853415    2573 scope.go:117] "RemoveContainer" containerID="9e1efd2d0b52769bbaa293899b658e208f407a4dcaa513fc159b6132f6f55fa7"
Jul 31 22:53:09.853716 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:53:09.853691    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e1efd2d0b52769bbaa293899b658e208f407a4dcaa513fc159b6132f6f55fa7\": container with ID starting with 9e1efd2d0b52769bbaa293899b658e208f407a4dcaa513fc159b6132f6f55fa7 not found: ID does not exist" containerID="9e1efd2d0b52769bbaa293899b658e208f407a4dcaa513fc159b6132f6f55fa7"
Jul 31 22:53:09.853769 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:09.853727    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e1efd2d0b52769bbaa293899b658e208f407a4dcaa513fc159b6132f6f55fa7"} err="failed to get container status \"9e1efd2d0b52769bbaa293899b658e208f407a4dcaa513fc159b6132f6f55fa7\": rpc error: code = NotFound desc = could not find container \"9e1efd2d0b52769bbaa293899b658e208f407a4dcaa513fc159b6132f6f55fa7\": container with ID starting with 9e1efd2d0b52769bbaa293899b658e208f407a4dcaa513fc159b6132f6f55fa7 not found: ID does not exist"
Jul 31 22:53:09.871270 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:09.871240    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-3326ad/rate-test-model-3326ad-kserve-58dbc57c75-shd9c"]
Jul 31 22:53:09.879530 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:09.879505    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-3326ad/rate-test-model-3326ad-kserve-58dbc57c75-shd9c"]
Jul 31 22:53:09.979864 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:09.979839    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7485-140247624437808"
Jul 31 22:53:10.003637 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:10.003615    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7485-140247624437808_e7bfdde6-d7eb-4cd7-a5c3-8112e6c75ecc/test-curl-7485-140247624437808/0.log"
Jul 31 22:53:10.029631 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:10.029605    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7485-140247624437808"]
Jul 31 22:53:10.032891 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:10.032869    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7485-140247624437808"]
Jul 31 22:53:10.046711 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:10.046684    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hw95\" (UniqueName: \"kubernetes.io/projected/e7bfdde6-d7eb-4cd7-a5c3-8112e6c75ecc-kube-api-access-8hw95\") pod \"e7bfdde6-d7eb-4cd7-a5c3-8112e6c75ecc\" (UID: \"e7bfdde6-d7eb-4cd7-a5c3-8112e6c75ecc\") "
Jul 31 22:53:10.048714 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:10.048687    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7bfdde6-d7eb-4cd7-a5c3-8112e6c75ecc-kube-api-access-8hw95" (OuterVolumeSpecName: "kube-api-access-8hw95") pod "e7bfdde6-d7eb-4cd7-a5c3-8112e6c75ecc" (UID: "e7bfdde6-d7eb-4cd7-a5c3-8112e6c75ecc"). InnerVolumeSpecName "kube-api-access-8hw95". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:53:10.147977 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:10.147893    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hw95\" (UniqueName: \"kubernetes.io/projected/e7bfdde6-d7eb-4cd7-a5c3-8112e6c75ecc-kube-api-access-8hw95\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:53:10.163040 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:10.163006    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7485-140247624437808"]
Jul 31 22:53:10.163364 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:10.163350    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="638451bb-b011-47a0-9cb5-b863ecf51e00" containerName="main"
Jul 31 22:53:10.163405 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:10.163367    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="638451bb-b011-47a0-9cb5-b863ecf51e00" containerName="main"
Jul 31 22:53:10.163405 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:10.163380    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ce66535-2373-4182-93b7-3a2a786ab79f" containerName="main"
Jul 31 22:53:10.163405 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:10.163385    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ce66535-2373-4182-93b7-3a2a786ab79f" containerName="main"
Jul 31 22:53:10.163405 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:10.163404    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7bfdde6-d7eb-4cd7-a5c3-8112e6c75ecc" containerName="test-curl-7485-140247624437808"
Jul 31 22:53:10.163535 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:10.163410    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7bfdde6-d7eb-4cd7-a5c3-8112e6c75ecc" containerName="test-curl-7485-140247624437808"
Jul 31 22:53:10.163535 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:10.163467    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ce66535-2373-4182-93b7-3a2a786ab79f" containerName="main"
Jul 31 22:53:10.163535 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:10.163476    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="638451bb-b011-47a0-9cb5-b863ecf51e00" containerName="main"
Jul 31 22:53:10.163535 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:10.163483    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7bfdde6-d7eb-4cd7-a5c3-8112e6c75ecc" containerName="test-curl-7485-140247624437808"
Jul 31 22:53:10.166324 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:10.166291    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7485-140247624437808"
Jul 31 22:53:10.172179 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:10.172156    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7485-140247624437808"]
Jul 31 22:53:10.248999 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:10.248963    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fxqr\" (UniqueName: \"kubernetes.io/projected/a8d72cd2-9b57-4c05-acd4-0905c6c8d837-kube-api-access-2fxqr\") pod \"test-curl-7485-140247624437808\" (UID: \"a8d72cd2-9b57-4c05-acd4-0905c6c8d837\") " pod="opendatahub/test-curl-7485-140247624437808"
Jul 31 22:53:10.350087 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:10.350038    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fxqr\" (UniqueName: \"kubernetes.io/projected/a8d72cd2-9b57-4c05-acd4-0905c6c8d837-kube-api-access-2fxqr\") pod \"test-curl-7485-140247624437808\" (UID: \"a8d72cd2-9b57-4c05-acd4-0905c6c8d837\") " pod="opendatahub/test-curl-7485-140247624437808"
Jul 31 22:53:10.369965 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:10.369941    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fxqr\" (UniqueName: \"kubernetes.io/projected/a8d72cd2-9b57-4c05-acd4-0905c6c8d837-kube-api-access-2fxqr\") pod \"test-curl-7485-140247624437808\" (UID: \"a8d72cd2-9b57-4c05-acd4-0905c6c8d837\") " pod="opendatahub/test-curl-7485-140247624437808"
Jul 31 22:53:10.477017 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:10.476985    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7485-140247624437808"
Jul 31 22:53:10.606550 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:10.606529    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7485-140247624437808"]
Jul 31 22:53:10.608341 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:53:10.608312    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8d72cd2_9b57_4c05_acd4_0905c6c8d837.slice/crio-24a34dd88edf87907287c27e5b735635cb3ad417a53382d0c31fee479ae62b5c WatchSource:0}: Error finding container 24a34dd88edf87907287c27e5b735635cb3ad417a53382d0c31fee479ae62b5c: Status 404 returned error can't find the container with id 24a34dd88edf87907287c27e5b735635cb3ad417a53382d0c31fee479ae62b5c
Jul 31 22:53:10.857242 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:10.857171    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7485-140247624437808"
Jul 31 22:53:10.857408 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:10.857169    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="41b05393873b792a3521acd1c6336f451ae62ae64c3b21efbb3f6d9e1e501dc6"
Jul 31 22:53:10.858346 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:10.858319    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7485-140247624437808" event={"ID":"a8d72cd2-9b57-4c05-acd4-0905c6c8d837","Type":"ContainerStarted","Data":"24a34dd88edf87907287c27e5b735635cb3ad417a53382d0c31fee479ae62b5c"}
Jul 31 22:53:10.870690 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:10.870661    2573 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7485-140247624437808" oldPodUID="e7bfdde6-d7eb-4cd7-a5c3-8112e6c75ecc" podUID="a8d72cd2-9b57-4c05-acd4-0905c6c8d837"
Jul 31 22:53:11.334966 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:11.334935    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ce66535-2373-4182-93b7-3a2a786ab79f" path="/var/lib/kubelet/pods/8ce66535-2373-4182-93b7-3a2a786ab79f/volumes"
Jul 31 22:53:11.335244 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:11.335232    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7bfdde6-d7eb-4cd7-a5c3-8112e6c75ecc" path="/var/lib/kubelet/pods/e7bfdde6-d7eb-4cd7-a5c3-8112e6c75ecc/volumes"
Jul 31 22:53:11.863998 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:11.863958    2573 generic.go:356] "Generic (PLEG): container finished" podID="a8d72cd2-9b57-4c05-acd4-0905c6c8d837" containerID="2ba58dc9e2bfcfbda44317efc721a192f76237146edb8f180389f206ce4bd22b" exitCode=0
Jul 31 22:53:11.864405 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:11.864035    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7485-140247624437808" event={"ID":"a8d72cd2-9b57-4c05-acd4-0905c6c8d837","Type":"ContainerDied","Data":"2ba58dc9e2bfcfbda44317efc721a192f76237146edb8f180389f206ce4bd22b"}
Jul 31 22:53:13.001767 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:13.001742    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7485-140247624437808"
Jul 31 22:53:13.023487 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:13.023460    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7485-140247624437808_a8d72cd2-9b57-4c05-acd4-0905c6c8d837/test-curl-7485-140247624437808/0.log"
Jul 31 22:53:13.050000 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:13.049966    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7485-140247624437808"]
Jul 31 22:53:13.054642 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:13.054621    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7485-140247624437808"]
Jul 31 22:53:13.071289 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:13.071268    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2fxqr\" (UniqueName: \"kubernetes.io/projected/a8d72cd2-9b57-4c05-acd4-0905c6c8d837-kube-api-access-2fxqr\") pod \"a8d72cd2-9b57-4c05-acd4-0905c6c8d837\" (UID: \"a8d72cd2-9b57-4c05-acd4-0905c6c8d837\") "
Jul 31 22:53:13.073261 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:13.073237    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8d72cd2-9b57-4c05-acd4-0905c6c8d837-kube-api-access-2fxqr" (OuterVolumeSpecName: "kube-api-access-2fxqr") pod "a8d72cd2-9b57-4c05-acd4-0905c6c8d837" (UID: "a8d72cd2-9b57-4c05-acd4-0905c6c8d837"). InnerVolumeSpecName "kube-api-access-2fxqr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:53:13.172693 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:13.172668    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2fxqr\" (UniqueName: \"kubernetes.io/projected/a8d72cd2-9b57-4c05-acd4-0905c6c8d837-kube-api-access-2fxqr\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:53:13.335018 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:13.334992    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8d72cd2-9b57-4c05-acd4-0905c6c8d837" path="/var/lib/kubelet/pods/a8d72cd2-9b57-4c05-acd4-0905c6c8d837/volumes"
Jul 31 22:53:13.874088 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:13.874060    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7485-140247624437808"
Jul 31 22:53:13.874278 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:13.874066    2573 scope.go:117] "RemoveContainer" containerID="2ba58dc9e2bfcfbda44317efc721a192f76237146edb8f180389f206ce4bd22b"
Jul 31 22:53:13.903611 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:13.903583    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"]
Jul 31 22:53:13.903921 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:13.903907    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8d72cd2-9b57-4c05-acd4-0905c6c8d837" containerName="test-curl-7485-140247624437808"
Jul 31 22:53:13.903976 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:13.903923    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8d72cd2-9b57-4c05-acd4-0905c6c8d837" containerName="test-curl-7485-140247624437808"
Jul 31 22:53:13.904015 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:13.903977    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8d72cd2-9b57-4c05-acd4-0905c6c8d837" containerName="test-curl-7485-140247624437808"
Jul 31 22:53:13.908446 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:13.908428    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"
Jul 31 22:53:13.911753 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:13.911732    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-56c69a-openshift-default-dockercfg-wwn7w\""
Jul 31 22:53:13.911871 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:13.911736    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 31 22:53:13.924933 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:13.924911    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"]
Jul 31 22:53:13.979340 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:13.979315    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff525904-25f4-4af7-89fa-e1308280926b-workload-socket\") pod \"e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv\" (UID: \"ff525904-25f4-4af7-89fa-e1308280926b\") " pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"
Jul 31 22:53:13.979506 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:13.979348    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff525904-25f4-4af7-89fa-e1308280926b-istio-data\") pod \"e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv\" (UID: \"ff525904-25f4-4af7-89fa-e1308280926b\") " pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"
Jul 31 22:53:13.979506 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:13.979365    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff525904-25f4-4af7-89fa-e1308280926b-istio-token\") pod \"e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv\" (UID: \"ff525904-25f4-4af7-89fa-e1308280926b\") " pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"
Jul 31 22:53:13.979506 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:13.979386    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff525904-25f4-4af7-89fa-e1308280926b-workload-certs\") pod \"e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv\" (UID: \"ff525904-25f4-4af7-89fa-e1308280926b\") " pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"
Jul 31 22:53:13.979506 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:13.979484    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff525904-25f4-4af7-89fa-e1308280926b-istiod-ca-cert\") pod \"e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv\" (UID: \"ff525904-25f4-4af7-89fa-e1308280926b\") " pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"
Jul 31 22:53:13.979684 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:13.979556    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff525904-25f4-4af7-89fa-e1308280926b-credential-socket\") pod \"e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv\" (UID: \"ff525904-25f4-4af7-89fa-e1308280926b\") " pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"
Jul 31 22:53:13.979684 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:13.979583    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff525904-25f4-4af7-89fa-e1308280926b-istio-podinfo\") pod \"e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv\" (UID: \"ff525904-25f4-4af7-89fa-e1308280926b\") " pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"
Jul 31 22:53:13.979684 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:13.979614    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltq55\" (UniqueName: \"kubernetes.io/projected/ff525904-25f4-4af7-89fa-e1308280926b-kube-api-access-ltq55\") pod \"e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv\" (UID: \"ff525904-25f4-4af7-89fa-e1308280926b\") " pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"
Jul 31 22:53:13.979684 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:13.979648    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff525904-25f4-4af7-89fa-e1308280926b-istio-envoy\") pod \"e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv\" (UID: \"ff525904-25f4-4af7-89fa-e1308280926b\") " pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"
Jul 31 22:53:14.080754 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:14.080718    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff525904-25f4-4af7-89fa-e1308280926b-istiod-ca-cert\") pod \"e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv\" (UID: \"ff525904-25f4-4af7-89fa-e1308280926b\") " pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"
Jul 31 22:53:14.081148 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:14.080770    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff525904-25f4-4af7-89fa-e1308280926b-credential-socket\") pod \"e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv\" (UID: \"ff525904-25f4-4af7-89fa-e1308280926b\") " pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"
Jul 31 22:53:14.081148 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:14.080791    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff525904-25f4-4af7-89fa-e1308280926b-istio-podinfo\") pod \"e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv\" (UID: \"ff525904-25f4-4af7-89fa-e1308280926b\") " pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"
Jul 31 22:53:14.081148 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:14.080827    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltq55\" (UniqueName: \"kubernetes.io/projected/ff525904-25f4-4af7-89fa-e1308280926b-kube-api-access-ltq55\") pod \"e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv\" (UID: \"ff525904-25f4-4af7-89fa-e1308280926b\") " pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"
Jul 31 22:53:14.081148 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:14.080861    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff525904-25f4-4af7-89fa-e1308280926b-istio-envoy\") pod \"e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv\" (UID: \"ff525904-25f4-4af7-89fa-e1308280926b\") " pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"
Jul 31 22:53:14.081148 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:14.080989    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff525904-25f4-4af7-89fa-e1308280926b-workload-socket\") pod \"e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv\" (UID: \"ff525904-25f4-4af7-89fa-e1308280926b\") " pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"
Jul 31 22:53:14.081148 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:14.081021    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff525904-25f4-4af7-89fa-e1308280926b-istio-data\") pod \"e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv\" (UID: \"ff525904-25f4-4af7-89fa-e1308280926b\") " pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"
Jul 31 22:53:14.081148 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:14.081044    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff525904-25f4-4af7-89fa-e1308280926b-istio-token\") pod \"e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv\" (UID: \"ff525904-25f4-4af7-89fa-e1308280926b\") " pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"
Jul 31 22:53:14.081148 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:14.081124    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff525904-25f4-4af7-89fa-e1308280926b-workload-certs\") pod \"e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv\" (UID: \"ff525904-25f4-4af7-89fa-e1308280926b\") " pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"
Jul 31 22:53:14.081148 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:14.081144    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff525904-25f4-4af7-89fa-e1308280926b-credential-socket\") pod \"e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv\" (UID: \"ff525904-25f4-4af7-89fa-e1308280926b\") " pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"
Jul 31 22:53:14.081554 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:14.081376    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff525904-25f4-4af7-89fa-e1308280926b-istio-data\") pod \"e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv\" (UID: \"ff525904-25f4-4af7-89fa-e1308280926b\") " pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"
Jul 31 22:53:14.081554 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:14.081400    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff525904-25f4-4af7-89fa-e1308280926b-workload-certs\") pod \"e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv\" (UID: \"ff525904-25f4-4af7-89fa-e1308280926b\") " pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"
Jul 31 22:53:14.081554 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:14.081476    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff525904-25f4-4af7-89fa-e1308280926b-workload-socket\") pod \"e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv\" (UID: \"ff525904-25f4-4af7-89fa-e1308280926b\") " pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"
Jul 31 22:53:14.081735 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:14.081718    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff525904-25f4-4af7-89fa-e1308280926b-istiod-ca-cert\") pod \"e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv\" (UID: \"ff525904-25f4-4af7-89fa-e1308280926b\") " pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"
Jul 31 22:53:14.083277 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:14.083253    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff525904-25f4-4af7-89fa-e1308280926b-istio-envoy\") pod \"e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv\" (UID: \"ff525904-25f4-4af7-89fa-e1308280926b\") " pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"
Jul 31 22:53:14.083389 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:14.083315    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff525904-25f4-4af7-89fa-e1308280926b-istio-podinfo\") pod \"e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv\" (UID: \"ff525904-25f4-4af7-89fa-e1308280926b\") " pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"
Jul 31 22:53:14.089395 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:14.089369    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff525904-25f4-4af7-89fa-e1308280926b-istio-token\") pod \"e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv\" (UID: \"ff525904-25f4-4af7-89fa-e1308280926b\") " pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"
Jul 31 22:53:14.089491 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:14.089465    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltq55\" (UniqueName: \"kubernetes.io/projected/ff525904-25f4-4af7-89fa-e1308280926b-kube-api-access-ltq55\") pod \"e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv\" (UID: \"ff525904-25f4-4af7-89fa-e1308280926b\") " pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"
Jul 31 22:53:14.218391 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:14.218363    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"
Jul 31 22:53:14.353541 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:14.353517    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"]
Jul 31 22:53:14.355693 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:53:14.355667    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff525904_25f4_4af7_89fa_e1308280926b.slice/crio-93e4fc85b9b3cc5fc8c5fb87e48219b0d4bedad89682ddfd724221e3e5bad4d4 WatchSource:0}: Error finding container 93e4fc85b9b3cc5fc8c5fb87e48219b0d4bedad89682ddfd724221e3e5bad4d4: Status 404 returned error can't find the container with id 93e4fc85b9b3cc5fc8c5fb87e48219b0d4bedad89682ddfd724221e3e5bad4d4
Jul 31 22:53:14.880887 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:14.880852    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv" event={"ID":"ff525904-25f4-4af7-89fa-e1308280926b","Type":"ContainerStarted","Data":"93e4fc85b9b3cc5fc8c5fb87e48219b0d4bedad89682ddfd724221e3e5bad4d4"}
Jul 31 22:53:17.498599 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:17.498559    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 22:53:17.498873 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:17.498650    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 22:53:17.498873 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:17.498680    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 22:53:17.899611 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:17.899518    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv" event={"ID":"ff525904-25f4-4af7-89fa-e1308280926b","Type":"ContainerStarted","Data":"f2e1fdc1f1ce19bc3ffe51794f7562ee3eba6f250d822006f9acc48fe28e5d65"}
Jul 31 22:53:17.924037 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:17.923983    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv" podStartSLOduration=1.783511705 podStartE2EDuration="4.923964048s" totalImagesPullingTime="3.140452343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:53:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:53:17.922384094 +0000 UTC m=+3207.017675243" watchObservedRunningTime="2026-07-31 22:53:17.923964048 +0000 UTC m=+3207.019255196"
Jul 31 22:53:18.219115 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:18.219084    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"
Jul 31 22:53:18.223446 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:18.223423    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"
Jul 31 22:53:18.903734 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:18.903706    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"
Jul 31 22:53:18.904728 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:18.904710    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"
Jul 31 22:53:33.996677 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:33.996273    2573 patch_prober.go:28] interesting pod/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": read tcp 10.133.0.2:54070->10.133.0.59:15021: read: connection reset by peer" start-of-body=
Jul 31 22:53:33.996677 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:33.996460    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv" podUID="ff525904-25f4-4af7-89fa-e1308280926b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": read tcp 10.133.0.2:54070->10.133.0.59:15021: read: connection reset by peer"
Jul 31 22:53:34.984678 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:34.984644    2573 generic.go:356] "Generic (PLEG): container finished" podID="ff525904-25f4-4af7-89fa-e1308280926b" containerID="f2e1fdc1f1ce19bc3ffe51794f7562ee3eba6f250d822006f9acc48fe28e5d65" exitCode=0
Jul 31 22:53:34.984875 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:34.984722    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv" event={"ID":"ff525904-25f4-4af7-89fa-e1308280926b","Type":"ContainerDied","Data":"f2e1fdc1f1ce19bc3ffe51794f7562ee3eba6f250d822006f9acc48fe28e5d65"}
Jul 31 22:53:34.985131 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:34.985114    2573 scope.go:117] "RemoveContainer" containerID="f2e1fdc1f1ce19bc3ffe51794f7562ee3eba6f250d822006f9acc48fe28e5d65"
Jul 31 22:53:34.986155 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:34.986128    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 22:53:34.986229 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:34.986187    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 22:53:34.986229 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:34.986218    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 22:53:35.994973 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:35.994936    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv" event={"ID":"ff525904-25f4-4af7-89fa-e1308280926b","Type":"ContainerStarted","Data":"e4a9469e840eb529240230a98ce1fcf4db625ad3f7551c6e373e1463b1f985a7"}
Jul 31 22:53:36.218513 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:36.218484    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"
Jul 31 22:53:36.218682 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:36.218647    2573 patch_prober.go:28] interesting pod/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 31 22:53:36.218727 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:36.218692    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv" podUID="ff525904-25f4-4af7-89fa-e1308280926b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 31 22:53:37.219539 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:37.219506    2573 patch_prober.go:28] interesting pod/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 31 22:53:37.219930 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:37.219557    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv" podUID="ff525904-25f4-4af7-89fa-e1308280926b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 31 22:53:38.219001 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:38.218962    2573 patch_prober.go:28] interesting pod/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 31 22:53:38.219190 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:38.219020    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv" podUID="ff525904-25f4-4af7-89fa-e1308280926b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 31 22:53:39.218974 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:39.218939    2573 patch_prober.go:28] interesting pod/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 31 22:53:39.219381 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:39.218992    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv" podUID="ff525904-25f4-4af7-89fa-e1308280926b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 31 22:53:40.218696 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:40.218654    2573 patch_prober.go:28] interesting pod/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 31 22:53:40.218882 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:40.218715    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv" podUID="ff525904-25f4-4af7-89fa-e1308280926b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 31 22:53:41.222358 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:41.222326    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"
Jul 31 22:53:41.222768 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:41.222667    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"
Jul 31 22:53:41.223392 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:41.223371    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"
Jul 31 22:53:45.962781 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:45.962699    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"]
Jul 31 22:53:45.966052 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:45.966029    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"
Jul 31 22:53:45.968433 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:45.968414    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-918fe5-openshift-default-dockercfg-kdmww\""
Jul 31 22:53:45.980789 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:45.980762    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"]
Jul 31 22:53:46.064398 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:46.064366    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-istio-envoy\") pod \"e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj\" (UID: \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\") " pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"
Jul 31 22:53:46.064398 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:46.064400    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-istio-data\") pod \"e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj\" (UID: \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\") " pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"
Jul 31 22:53:46.064588 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:46.064426    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-workload-certs\") pod \"e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj\" (UID: \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\") " pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"
Jul 31 22:53:46.064588 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:46.064444    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jtfc\" (UniqueName: \"kubernetes.io/projected/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-kube-api-access-8jtfc\") pod \"e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj\" (UID: \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\") " pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"
Jul 31 22:53:46.064588 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:46.064527    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-credential-socket\") pod \"e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj\" (UID: \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\") " pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"
Jul 31 22:53:46.064588 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:46.064582    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-istiod-ca-cert\") pod \"e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj\" (UID: \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\") " pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"
Jul 31 22:53:46.064732 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:46.064647    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-workload-socket\") pod \"e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj\" (UID: \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\") " pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"
Jul 31 22:53:46.064732 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:46.064687    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-istio-podinfo\") pod \"e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj\" (UID: \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\") " pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"
Jul 31 22:53:46.064732 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:46.064712    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-istio-token\") pod \"e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj\" (UID: \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\") " pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"
Jul 31 22:53:46.165540 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:46.165512    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-istio-envoy\") pod \"e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj\" (UID: \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\") " pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"
Jul 31 22:53:46.165699 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:46.165545    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-istio-data\") pod \"e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj\" (UID: \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\") " pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"
Jul 31 22:53:46.165699 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:46.165572    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-workload-certs\") pod \"e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj\" (UID: \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\") " pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"
Jul 31 22:53:46.165699 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:46.165588    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jtfc\" (UniqueName: \"kubernetes.io/projected/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-kube-api-access-8jtfc\") pod \"e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj\" (UID: \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\") " pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"
Jul 31 22:53:46.165699 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:46.165625    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-credential-socket\") pod \"e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj\" (UID: \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\") " pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"
Jul 31 22:53:46.165699 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:46.165672    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-istiod-ca-cert\") pod \"e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj\" (UID: \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\") " pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"
Jul 31 22:53:46.165968 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:46.165713    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-workload-socket\") pod \"e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj\" (UID: \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\") " pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"
Jul 31 22:53:46.165968 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:46.165827    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-istio-podinfo\") pod \"e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj\" (UID: \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\") " pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"
Jul 31 22:53:46.165968 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:46.165850    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-istio-token\") pod \"e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj\" (UID: \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\") " pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"
Jul 31 22:53:46.165968 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:46.165946    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-istio-data\") pod \"e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj\" (UID: \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\") " pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"
Jul 31 22:53:46.166207 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:46.166186    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-workload-certs\") pod \"e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj\" (UID: \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\") " pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"
Jul 31 22:53:46.166321 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:46.166277    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-credential-socket\") pod \"e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj\" (UID: \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\") " pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"
Jul 31 22:53:46.166382 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:46.166334    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-workload-socket\") pod \"e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj\" (UID: \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\") " pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"
Jul 31 22:53:46.166420 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:46.166388    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-istiod-ca-cert\") pod \"e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj\" (UID: \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\") " pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"
Jul 31 22:53:46.167841 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:46.167822    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-istio-envoy\") pod \"e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj\" (UID: \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\") " pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"
Jul 31 22:53:46.168143 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:46.168125    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-istio-podinfo\") pod \"e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj\" (UID: \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\") " pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"
Jul 31 22:53:46.176076 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:46.176057    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-istio-token\") pod \"e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj\" (UID: \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\") " pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"
Jul 31 22:53:46.176421 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:46.176399    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jtfc\" (UniqueName: \"kubernetes.io/projected/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-kube-api-access-8jtfc\") pod \"e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj\" (UID: \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\") " pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"
Jul 31 22:53:46.276103 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:46.276042    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"
Jul 31 22:53:46.411004 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:46.410981    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"]
Jul 31 22:53:46.413314 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:53:46.413275    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce277f75_a1fa_4256_9aeb_b42aa5adbcdd.slice/crio-18f502699ed4c5bcb670e4054c7f523e35484ae23f6e90452e5864a198b4a982 WatchSource:0}: Error finding container 18f502699ed4c5bcb670e4054c7f523e35484ae23f6e90452e5864a198b4a982: Status 404 returned error can't find the container with id 18f502699ed4c5bcb670e4054c7f523e35484ae23f6e90452e5864a198b4a982
Jul 31 22:53:46.415563 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:46.415531    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 22:53:46.415635 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:46.415619    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 22:53:46.415674 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:46.415648    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 22:53:47.047976 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:47.047941    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj" event={"ID":"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd","Type":"ContainerStarted","Data":"1c2c35894cc2db3c6a818b745c0ac9aa930bd8c940028ade0fe02bdfc15a3433"}
Jul 31 22:53:47.048398 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:47.048020    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj" event={"ID":"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd","Type":"ContainerStarted","Data":"18f502699ed4c5bcb670e4054c7f523e35484ae23f6e90452e5864a198b4a982"}
Jul 31 22:53:47.070618 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:47.070573    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj" podStartSLOduration=2.07055929 podStartE2EDuration="2.07055929s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:53:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:53:47.068753464 +0000 UTC m=+3236.164044600" watchObservedRunningTime="2026-07-31 22:53:47.07055929 +0000 UTC m=+3236.165850436"
Jul 31 22:53:47.276201 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:47.276161    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"
Jul 31 22:53:47.281122 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:47.281066    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"
Jul 31 22:53:48.053019 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:48.052980    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"
Jul 31 22:53:48.054019 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:53:48.053997    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"
Jul 31 22:54:03.902186 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:03.901728    2573 patch_prober.go:28] interesting pod/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": read tcp 10.133.0.2:60898->10.133.0.60:15021: read: connection reset by peer" start-of-body=
Jul 31 22:54:03.902186 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:03.901799    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj" podUID="ce277f75-a1fa-4256-9aeb-b42aa5adbcdd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": read tcp 10.133.0.2:60898->10.133.0.60:15021: read: connection reset by peer"
Jul 31 22:54:04.132189 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:04.132120    2573 generic.go:356] "Generic (PLEG): container finished" podID="ce277f75-a1fa-4256-9aeb-b42aa5adbcdd" containerID="1c2c35894cc2db3c6a818b745c0ac9aa930bd8c940028ade0fe02bdfc15a3433" exitCode=0
Jul 31 22:54:04.132339 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:04.132198    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj" event={"ID":"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd","Type":"ContainerDied","Data":"1c2c35894cc2db3c6a818b745c0ac9aa930bd8c940028ade0fe02bdfc15a3433"}
Jul 31 22:54:04.132656 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:04.132639    2573 scope.go:117] "RemoveContainer" containerID="1c2c35894cc2db3c6a818b745c0ac9aa930bd8c940028ade0fe02bdfc15a3433"
Jul 31 22:54:04.133879 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:04.133853    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 22:54:04.133950 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:04.133930    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 22:54:04.133991 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:04.133967    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 22:54:05.138670 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:05.138635    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj" event={"ID":"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd","Type":"ContainerStarted","Data":"060fe4f9ef1d569972e3e3c4532746df1f035f113e1654466511a7079048582f"}
Jul 31 22:54:05.276506 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:05.276469    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"
Jul 31 22:54:05.276886 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:05.276797    2573 patch_prober.go:28] interesting pod/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 31 22:54:05.277063 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:05.277040    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj" podUID="ce277f75-a1fa-4256-9aeb-b42aa5adbcdd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 31 22:54:06.277031 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:06.276987    2573 patch_prober.go:28] interesting pod/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 31 22:54:06.277555 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:06.277071    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj" podUID="ce277f75-a1fa-4256-9aeb-b42aa5adbcdd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 31 22:54:07.277510 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:07.277468    2573 patch_prober.go:28] interesting pod/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 31 22:54:07.278134 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:07.278102    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj" podUID="ce277f75-a1fa-4256-9aeb-b42aa5adbcdd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 31 22:54:08.277360 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:08.277322    2573 patch_prober.go:28] interesting pod/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 31 22:54:08.277688 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:08.277655    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj" podUID="ce277f75-a1fa-4256-9aeb-b42aa5adbcdd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 31 22:54:09.277352 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:09.277316    2573 patch_prober.go:28] interesting pod/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 31 22:54:09.277663 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:09.277632    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj" podUID="ce277f75-a1fa-4256-9aeb-b42aa5adbcdd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 31 22:54:10.277378 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:10.276888    2573 patch_prober.go:28] interesting pod/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 31 22:54:10.277378 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:10.276976    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj" podUID="ce277f75-a1fa-4256-9aeb-b42aa5adbcdd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 31 22:54:11.280177 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:11.280138    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"
Jul 31 22:54:11.280634 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:11.280384    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"
Jul 31 22:54:11.281123 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:11.281101    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"
Jul 31 22:54:26.252510 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:26.252478    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-56c69a/ipp-route-56c69a-kserve-d8dc878c5-wnhzt"]
Jul 31 22:54:26.256044 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:26.256028    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-56c69a/ipp-route-56c69a-kserve-d8dc878c5-wnhzt"
Jul 31 22:54:26.258697 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:26.258670    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-56c69a\"/\"kube-root-ca.crt\""
Jul 31 22:54:26.259742 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:26.259718    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-56c69a\"/\"openshift-service-ca.crt\""
Jul 31 22:54:26.259853 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:26.259725    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-56c69a\"/\"default-dockercfg-dkz5x\""
Jul 31 22:54:26.259853 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:26.259732    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-56c69a\"/\"ipp-route-56c69a-kserve-self-signed-certs\""
Jul 31 22:54:26.266172 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:26.266149    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-56c69a/ipp-route-56c69a-kserve-d8dc878c5-wnhzt"]
Jul 31 22:54:26.432083 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:26.432053    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65c53d14-3a4d-4ff6-b375-75c257f920a0-dshm\") pod \"ipp-route-56c69a-kserve-d8dc878c5-wnhzt\" (UID: \"65c53d14-3a4d-4ff6-b375-75c257f920a0\") " pod="ai-tenant-e2e-ipp-a-56c69a/ipp-route-56c69a-kserve-d8dc878c5-wnhzt"
Jul 31 22:54:26.432294 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:26.432113    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65c53d14-3a4d-4ff6-b375-75c257f920a0-home\") pod \"ipp-route-56c69a-kserve-d8dc878c5-wnhzt\" (UID: \"65c53d14-3a4d-4ff6-b375-75c257f920a0\") " pod="ai-tenant-e2e-ipp-a-56c69a/ipp-route-56c69a-kserve-d8dc878c5-wnhzt"
Jul 31 22:54:26.432294 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:26.432151    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65c53d14-3a4d-4ff6-b375-75c257f920a0-model-cache\") pod \"ipp-route-56c69a-kserve-d8dc878c5-wnhzt\" (UID: \"65c53d14-3a4d-4ff6-b375-75c257f920a0\") " pod="ai-tenant-e2e-ipp-a-56c69a/ipp-route-56c69a-kserve-d8dc878c5-wnhzt"
Jul 31 22:54:26.432294 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:26.432240    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h2dh\" (UniqueName: \"kubernetes.io/projected/65c53d14-3a4d-4ff6-b375-75c257f920a0-kube-api-access-9h2dh\") pod \"ipp-route-56c69a-kserve-d8dc878c5-wnhzt\" (UID: \"65c53d14-3a4d-4ff6-b375-75c257f920a0\") " pod="ai-tenant-e2e-ipp-a-56c69a/ipp-route-56c69a-kserve-d8dc878c5-wnhzt"
Jul 31 22:54:26.432527 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:26.432370    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65c53d14-3a4d-4ff6-b375-75c257f920a0-tmp-dir\") pod \"ipp-route-56c69a-kserve-d8dc878c5-wnhzt\" (UID: \"65c53d14-3a4d-4ff6-b375-75c257f920a0\") " pod="ai-tenant-e2e-ipp-a-56c69a/ipp-route-56c69a-kserve-d8dc878c5-wnhzt"
Jul 31 22:54:26.432527 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:26.432511    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65c53d14-3a4d-4ff6-b375-75c257f920a0-tls-certs\") pod \"ipp-route-56c69a-kserve-d8dc878c5-wnhzt\" (UID: \"65c53d14-3a4d-4ff6-b375-75c257f920a0\") " pod="ai-tenant-e2e-ipp-a-56c69a/ipp-route-56c69a-kserve-d8dc878c5-wnhzt"
Jul 31 22:54:26.533832 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:26.533750    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65c53d14-3a4d-4ff6-b375-75c257f920a0-tmp-dir\") pod \"ipp-route-56c69a-kserve-d8dc878c5-wnhzt\" (UID: \"65c53d14-3a4d-4ff6-b375-75c257f920a0\") " pod="ai-tenant-e2e-ipp-a-56c69a/ipp-route-56c69a-kserve-d8dc878c5-wnhzt"
Jul 31 22:54:26.533832 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:26.533789    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65c53d14-3a4d-4ff6-b375-75c257f920a0-tls-certs\") pod \"ipp-route-56c69a-kserve-d8dc878c5-wnhzt\" (UID: \"65c53d14-3a4d-4ff6-b375-75c257f920a0\") " pod="ai-tenant-e2e-ipp-a-56c69a/ipp-route-56c69a-kserve-d8dc878c5-wnhzt"
Jul 31 22:54:26.534035 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:26.533910    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65c53d14-3a4d-4ff6-b375-75c257f920a0-dshm\") pod \"ipp-route-56c69a-kserve-d8dc878c5-wnhzt\" (UID: \"65c53d14-3a4d-4ff6-b375-75c257f920a0\") " pod="ai-tenant-e2e-ipp-a-56c69a/ipp-route-56c69a-kserve-d8dc878c5-wnhzt"
Jul 31 22:54:26.534035 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:26.533952    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65c53d14-3a4d-4ff6-b375-75c257f920a0-home\") pod \"ipp-route-56c69a-kserve-d8dc878c5-wnhzt\" (UID: \"65c53d14-3a4d-4ff6-b375-75c257f920a0\") " pod="ai-tenant-e2e-ipp-a-56c69a/ipp-route-56c69a-kserve-d8dc878c5-wnhzt"
Jul 31 22:54:26.534035 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:26.533990    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65c53d14-3a4d-4ff6-b375-75c257f920a0-model-cache\") pod \"ipp-route-56c69a-kserve-d8dc878c5-wnhzt\" (UID: \"65c53d14-3a4d-4ff6-b375-75c257f920a0\") " pod="ai-tenant-e2e-ipp-a-56c69a/ipp-route-56c69a-kserve-d8dc878c5-wnhzt"
Jul 31 22:54:26.534035 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:26.534027    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9h2dh\" (UniqueName: \"kubernetes.io/projected/65c53d14-3a4d-4ff6-b375-75c257f920a0-kube-api-access-9h2dh\") pod \"ipp-route-56c69a-kserve-d8dc878c5-wnhzt\" (UID: \"65c53d14-3a4d-4ff6-b375-75c257f920a0\") " pod="ai-tenant-e2e-ipp-a-56c69a/ipp-route-56c69a-kserve-d8dc878c5-wnhzt"
Jul 31 22:54:26.534246 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:26.534123    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65c53d14-3a4d-4ff6-b375-75c257f920a0-tmp-dir\") pod \"ipp-route-56c69a-kserve-d8dc878c5-wnhzt\" (UID: \"65c53d14-3a4d-4ff6-b375-75c257f920a0\") " pod="ai-tenant-e2e-ipp-a-56c69a/ipp-route-56c69a-kserve-d8dc878c5-wnhzt"
Jul 31 22:54:26.534352 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:26.534332    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65c53d14-3a4d-4ff6-b375-75c257f920a0-home\") pod \"ipp-route-56c69a-kserve-d8dc878c5-wnhzt\" (UID: \"65c53d14-3a4d-4ff6-b375-75c257f920a0\") " pod="ai-tenant-e2e-ipp-a-56c69a/ipp-route-56c69a-kserve-d8dc878c5-wnhzt"
Jul 31 22:54:26.534401 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:26.534367    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65c53d14-3a4d-4ff6-b375-75c257f920a0-model-cache\") pod \"ipp-route-56c69a-kserve-d8dc878c5-wnhzt\" (UID: \"65c53d14-3a4d-4ff6-b375-75c257f920a0\") " pod="ai-tenant-e2e-ipp-a-56c69a/ipp-route-56c69a-kserve-d8dc878c5-wnhzt"
Jul 31 22:54:26.536243 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:26.536219    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65c53d14-3a4d-4ff6-b375-75c257f920a0-dshm\") pod \"ipp-route-56c69a-kserve-d8dc878c5-wnhzt\" (UID: \"65c53d14-3a4d-4ff6-b375-75c257f920a0\") " pod="ai-tenant-e2e-ipp-a-56c69a/ipp-route-56c69a-kserve-d8dc878c5-wnhzt"
Jul 31 22:54:26.536443 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:26.536426    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65c53d14-3a4d-4ff6-b375-75c257f920a0-tls-certs\") pod \"ipp-route-56c69a-kserve-d8dc878c5-wnhzt\" (UID: \"65c53d14-3a4d-4ff6-b375-75c257f920a0\") " pod="ai-tenant-e2e-ipp-a-56c69a/ipp-route-56c69a-kserve-d8dc878c5-wnhzt"
Jul 31 22:54:26.543094 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:26.543071    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h2dh\" (UniqueName: \"kubernetes.io/projected/65c53d14-3a4d-4ff6-b375-75c257f920a0-kube-api-access-9h2dh\") pod \"ipp-route-56c69a-kserve-d8dc878c5-wnhzt\" (UID: \"65c53d14-3a4d-4ff6-b375-75c257f920a0\") " pod="ai-tenant-e2e-ipp-a-56c69a/ipp-route-56c69a-kserve-d8dc878c5-wnhzt"
Jul 31 22:54:26.565890 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:26.565870    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-56c69a/ipp-route-56c69a-kserve-d8dc878c5-wnhzt"
Jul 31 22:54:26.696483 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:26.696452    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-56c69a/ipp-route-56c69a-kserve-d8dc878c5-wnhzt"]
Jul 31 22:54:26.700035 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:54:26.700012    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65c53d14_3a4d_4ff6_b375_75c257f920a0.slice/crio-0fc808ed12140887b37984fb42f8bc827b2ba9826ec84e6818daf7a0680d49cb WatchSource:0}: Error finding container 0fc808ed12140887b37984fb42f8bc827b2ba9826ec84e6818daf7a0680d49cb: Status 404 returned error can't find the container with id 0fc808ed12140887b37984fb42f8bc827b2ba9826ec84e6818daf7a0680d49cb
Jul 31 22:54:27.241769 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:27.241729    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-56c69a/ipp-route-56c69a-kserve-d8dc878c5-wnhzt" event={"ID":"65c53d14-3a4d-4ff6-b375-75c257f920a0","Type":"ContainerStarted","Data":"d20a8f2c1eaa88c8b2d5dceaca668027287ed54403366d37efcd2e90baf1e109"}
Jul 31 22:54:27.241944 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:27.241775    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-56c69a/ipp-route-56c69a-kserve-d8dc878c5-wnhzt" event={"ID":"65c53d14-3a4d-4ff6-b375-75c257f920a0","Type":"ContainerStarted","Data":"0fc808ed12140887b37984fb42f8bc827b2ba9826ec84e6818daf7a0680d49cb"}
Jul 31 22:54:27.260765 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:27.260716    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-56c69a/ipp-route-56c69a-kserve-d8dc878c5-wnhzt" podStartSLOduration=1.260700695 podStartE2EDuration="1.260700695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:54:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:54:27.259675704 +0000 UTC m=+3276.354966851" watchObservedRunningTime="2026-07-31 22:54:27.260700695 +0000 UTC m=+3276.355991843"
Jul 31 22:54:36.566814 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:36.566771    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-56c69a/ipp-route-56c69a-kserve-d8dc878c5-wnhzt"
Jul 31 22:54:36.566814 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:36.566829    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-56c69a/ipp-route-56c69a-kserve-d8dc878c5-wnhzt"
Jul 31 22:54:36.579394 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:36.579370    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-56c69a/ipp-route-56c69a-kserve-d8dc878c5-wnhzt"
Jul 31 22:54:37.299827 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:37.299800    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-56c69a/ipp-route-56c69a-kserve-d8dc878c5-wnhzt"
Jul 31 22:54:51.488406 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:51.488373    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ddp8_79e15037-4ffd-47f1-b983-34f06895b2a3/ovn-acl-logging/0.log"
Jul 31 22:54:51.494882 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:54:51.494862    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4ddp8_79e15037-4ffd-47f1-b983-34f06895b2a3/ovn-acl-logging/0.log"
Jul 31 22:55:07.021215 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:07.021183    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"]
Jul 31 22:55:07.024512 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:07.024495    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"
Jul 31 22:55:07.027386 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:07.027367    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-c5b030-openshift-default-dockercfg-mwwjq\""
Jul 31 22:55:07.038369 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:07.038350    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"]
Jul 31 22:55:07.179412 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:07.179371    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/605aac0d-ba4e-4a05-a512-4e429f37a92c-credential-socket\") pod \"e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr\" (UID: \"605aac0d-ba4e-4a05-a512-4e429f37a92c\") " pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"
Jul 31 22:55:07.179716 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:07.179430    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/605aac0d-ba4e-4a05-a512-4e429f37a92c-workload-certs\") pod \"e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr\" (UID: \"605aac0d-ba4e-4a05-a512-4e429f37a92c\") " pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"
Jul 31 22:55:07.179716 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:07.179453    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/605aac0d-ba4e-4a05-a512-4e429f37a92c-istio-podinfo\") pod \"e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr\" (UID: \"605aac0d-ba4e-4a05-a512-4e429f37a92c\") " pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"
Jul 31 22:55:07.179716 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:07.179489    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/605aac0d-ba4e-4a05-a512-4e429f37a92c-istio-envoy\") pod \"e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr\" (UID: \"605aac0d-ba4e-4a05-a512-4e429f37a92c\") " pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"
Jul 31 22:55:07.179716 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:07.179546    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/605aac0d-ba4e-4a05-a512-4e429f37a92c-istio-token\") pod \"e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr\" (UID: \"605aac0d-ba4e-4a05-a512-4e429f37a92c\") " pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"
Jul 31 22:55:07.179716 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:07.179610    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/605aac0d-ba4e-4a05-a512-4e429f37a92c-istiod-ca-cert\") pod \"e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr\" (UID: \"605aac0d-ba4e-4a05-a512-4e429f37a92c\") " pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"
Jul 31 22:55:07.179716 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:07.179629    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z5tp\" (UniqueName: \"kubernetes.io/projected/605aac0d-ba4e-4a05-a512-4e429f37a92c-kube-api-access-8z5tp\") pod \"e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr\" (UID: \"605aac0d-ba4e-4a05-a512-4e429f37a92c\") " pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"
Jul 31 22:55:07.179716 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:07.179651    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/605aac0d-ba4e-4a05-a512-4e429f37a92c-istio-data\") pod \"e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr\" (UID: \"605aac0d-ba4e-4a05-a512-4e429f37a92c\") " pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"
Jul 31 22:55:07.179716 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:07.179674    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/605aac0d-ba4e-4a05-a512-4e429f37a92c-workload-socket\") pod \"e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr\" (UID: \"605aac0d-ba4e-4a05-a512-4e429f37a92c\") " pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"
Jul 31 22:55:07.281139 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:07.281057    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/605aac0d-ba4e-4a05-a512-4e429f37a92c-credential-socket\") pod \"e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr\" (UID: \"605aac0d-ba4e-4a05-a512-4e429f37a92c\") " pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"
Jul 31 22:55:07.281139 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:07.281106    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/605aac0d-ba4e-4a05-a512-4e429f37a92c-workload-certs\") pod \"e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr\" (UID: \"605aac0d-ba4e-4a05-a512-4e429f37a92c\") " pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"
Jul 31 22:55:07.281139 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:07.281129    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/605aac0d-ba4e-4a05-a512-4e429f37a92c-istio-podinfo\") pod \"e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr\" (UID: \"605aac0d-ba4e-4a05-a512-4e429f37a92c\") " pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"
Jul 31 22:55:07.281477 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:07.281183    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/605aac0d-ba4e-4a05-a512-4e429f37a92c-istio-envoy\") pod \"e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr\" (UID: \"605aac0d-ba4e-4a05-a512-4e429f37a92c\") " pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"
Jul 31 22:55:07.281477 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:07.281210    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/605aac0d-ba4e-4a05-a512-4e429f37a92c-istio-token\") pod \"e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr\" (UID: \"605aac0d-ba4e-4a05-a512-4e429f37a92c\") " pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"
Jul 31 22:55:07.281477 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:07.281251    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/605aac0d-ba4e-4a05-a512-4e429f37a92c-istiod-ca-cert\") pod \"e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr\" (UID: \"605aac0d-ba4e-4a05-a512-4e429f37a92c\") " pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"
Jul 31 22:55:07.281477 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:07.281278    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z5tp\" (UniqueName: \"kubernetes.io/projected/605aac0d-ba4e-4a05-a512-4e429f37a92c-kube-api-access-8z5tp\") pod \"e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr\" (UID: \"605aac0d-ba4e-4a05-a512-4e429f37a92c\") " pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"
Jul 31 22:55:07.281477 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:07.281338    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/605aac0d-ba4e-4a05-a512-4e429f37a92c-istio-data\") pod \"e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr\" (UID: \"605aac0d-ba4e-4a05-a512-4e429f37a92c\") " pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"
Jul 31 22:55:07.281477 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:07.281373    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/605aac0d-ba4e-4a05-a512-4e429f37a92c-workload-socket\") pod \"e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr\" (UID: \"605aac0d-ba4e-4a05-a512-4e429f37a92c\") " pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"
Jul 31 22:55:07.281743 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:07.281557    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/605aac0d-ba4e-4a05-a512-4e429f37a92c-credential-socket\") pod \"e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr\" (UID: \"605aac0d-ba4e-4a05-a512-4e429f37a92c\") " pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"
Jul 31 22:55:07.281743 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:07.281602    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/605aac0d-ba4e-4a05-a512-4e429f37a92c-workload-certs\") pod \"e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr\" (UID: \"605aac0d-ba4e-4a05-a512-4e429f37a92c\") " pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"
Jul 31 22:55:07.281834 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:07.281752    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/605aac0d-ba4e-4a05-a512-4e429f37a92c-workload-socket\") pod \"e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr\" (UID: \"605aac0d-ba4e-4a05-a512-4e429f37a92c\") " pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"
Jul 31 22:55:07.281834 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:07.281822    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/605aac0d-ba4e-4a05-a512-4e429f37a92c-istio-data\") pod \"e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr\" (UID: \"605aac0d-ba4e-4a05-a512-4e429f37a92c\") " pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"
Jul 31 22:55:07.282092 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:07.282066    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/605aac0d-ba4e-4a05-a512-4e429f37a92c-istiod-ca-cert\") pod \"e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr\" (UID: \"605aac0d-ba4e-4a05-a512-4e429f37a92c\") " pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"
Jul 31 22:55:07.283618 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:07.283597    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/605aac0d-ba4e-4a05-a512-4e429f37a92c-istio-envoy\") pod \"e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr\" (UID: \"605aac0d-ba4e-4a05-a512-4e429f37a92c\") " pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"
Jul 31 22:55:07.283749 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:07.283732    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/605aac0d-ba4e-4a05-a512-4e429f37a92c-istio-podinfo\") pod \"e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr\" (UID: \"605aac0d-ba4e-4a05-a512-4e429f37a92c\") " pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"
Jul 31 22:55:07.289878 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:07.289859    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z5tp\" (UniqueName: \"kubernetes.io/projected/605aac0d-ba4e-4a05-a512-4e429f37a92c-kube-api-access-8z5tp\") pod \"e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr\" (UID: \"605aac0d-ba4e-4a05-a512-4e429f37a92c\") " pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"
Jul 31 22:55:07.289990 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:07.289906    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/605aac0d-ba4e-4a05-a512-4e429f37a92c-istio-token\") pod \"e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr\" (UID: \"605aac0d-ba4e-4a05-a512-4e429f37a92c\") " pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"
Jul 31 22:55:07.334675 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:07.334653    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"
Jul 31 22:55:07.471375 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:07.471353    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"]
Jul 31 22:55:07.473392 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:55:07.473356    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod605aac0d_ba4e_4a05_a512_4e429f37a92c.slice/crio-f5dd155bbf714dacd8fb7f011820440a7a73cba075556d2096eebca7c4ff9a4b WatchSource:0}: Error finding container f5dd155bbf714dacd8fb7f011820440a7a73cba075556d2096eebca7c4ff9a4b: Status 404 returned error can't find the container with id f5dd155bbf714dacd8fb7f011820440a7a73cba075556d2096eebca7c4ff9a4b
Jul 31 22:55:07.475663 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:07.475628    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 22:55:07.475757 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:07.475702    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 22:55:07.475757 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:07.475731    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 22:55:08.438683 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:08.438644    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr" event={"ID":"605aac0d-ba4e-4a05-a512-4e429f37a92c","Type":"ContainerStarted","Data":"076ce7c96644327d51e418783eb8cdb7232f0d8b197ee9aa1e39eeb07a0e90d8"}
Jul 31 22:55:08.439067 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:08.438712    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr" event={"ID":"605aac0d-ba4e-4a05-a512-4e429f37a92c","Type":"ContainerStarted","Data":"f5dd155bbf714dacd8fb7f011820440a7a73cba075556d2096eebca7c4ff9a4b"}
Jul 31 22:55:08.464256 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:08.464208    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr" podStartSLOduration=2.464194024 podStartE2EDuration="2.464194024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:55:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:55:08.462014749 +0000 UTC m=+3317.557305898" watchObservedRunningTime="2026-07-31 22:55:08.464194024 +0000 UTC m=+3317.559485169"
Jul 31 22:55:09.334927 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:09.334897    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"
Jul 31 22:55:09.339749 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:09.339723    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"
Jul 31 22:55:09.444667 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:09.444638    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"
Jul 31 22:55:09.445555 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:09.445535    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"
Jul 31 22:55:25.486451 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:25.486404    2573 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 31 22:55:25.487037 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:25.486467    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr" podUID="605aac0d-ba4e-4a05-a512-4e429f37a92c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 31 22:55:27.541502 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:27.541468    2573 generic.go:356] "Generic (PLEG): container finished" podID="605aac0d-ba4e-4a05-a512-4e429f37a92c" containerID="076ce7c96644327d51e418783eb8cdb7232f0d8b197ee9aa1e39eeb07a0e90d8" exitCode=0
Jul 31 22:55:27.541933 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:27.541541    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr" event={"ID":"605aac0d-ba4e-4a05-a512-4e429f37a92c","Type":"ContainerDied","Data":"076ce7c96644327d51e418783eb8cdb7232f0d8b197ee9aa1e39eeb07a0e90d8"}
Jul 31 22:55:27.541933 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:27.541866    2573 scope.go:117] "RemoveContainer" containerID="076ce7c96644327d51e418783eb8cdb7232f0d8b197ee9aa1e39eeb07a0e90d8"
Jul 31 22:55:27.542896 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:27.542868    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 22:55:27.543000 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:27.542947    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 22:55:27.543062 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:27.543032    2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 31 22:55:28.547921 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:28.547888    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr" event={"ID":"605aac0d-ba4e-4a05-a512-4e429f37a92c","Type":"ContainerStarted","Data":"e32df3f35213a8c81072d7f11eae94a2e6045cb093e05eed22ea34d0f16dc6d3"}
Jul 31 22:55:29.335047 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:29.335010    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"
Jul 31 22:55:29.335244 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:29.335223    2573 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 31 22:55:29.335367 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:29.335280    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr" podUID="605aac0d-ba4e-4a05-a512-4e429f37a92c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 31 22:55:30.336049 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:30.336007    2573 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 31 22:55:30.336576 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:30.336068    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr" podUID="605aac0d-ba4e-4a05-a512-4e429f37a92c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 31 22:55:31.334949 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:31.334917    2573 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 31 22:55:31.335124 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:31.334966    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr" podUID="605aac0d-ba4e-4a05-a512-4e429f37a92c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 31 22:55:32.335851 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:32.335808    2573 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 31 22:55:32.336374 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:32.335871    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr" podUID="605aac0d-ba4e-4a05-a512-4e429f37a92c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 31 22:55:33.334946 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:33.334914    2573 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 31 22:55:33.335108 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:33.334966    2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr" podUID="605aac0d-ba4e-4a05-a512-4e429f37a92c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 31 22:55:34.339311 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:34.339273    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"
Jul 31 22:55:34.339764 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:34.339747    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"
Jul 31 22:55:34.340310 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:34.340282    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"
Jul 31 22:55:36.209133 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:36.209100    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c5b030-9hcr7"]
Jul 31 22:55:36.212454 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:36.212433    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c5b030-9hcr7"
Jul 31 22:55:36.215954 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:36.215920    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 31 22:55:36.215954 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:36.215953    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lgfz6\""
Jul 31 22:55:36.221606 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:36.221581    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c5b030-9hcr7"]
Jul 31 22:55:36.347977 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:36.347947    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bbb6763-9711-4633-b766-ba06dd9ba30e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-c5b030-9hcr7\" (UID: \"3bbb6763-9711-4633-b766-ba06dd9ba30e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c5b030-9hcr7"
Jul 31 22:55:36.449277 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:36.449250    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bbb6763-9711-4633-b766-ba06dd9ba30e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-c5b030-9hcr7\" (UID: \"3bbb6763-9711-4633-b766-ba06dd9ba30e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c5b030-9hcr7"
Jul 31 22:55:36.449846 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:36.449826    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bbb6763-9711-4633-b766-ba06dd9ba30e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-c5b030-9hcr7\" (UID: \"3bbb6763-9711-4633-b766-ba06dd9ba30e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c5b030-9hcr7"
Jul 31 22:55:36.524195 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:36.524138    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c5b030-9hcr7"
Jul 31 22:55:36.663321 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:36.663266    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c5b030-9hcr7"]
Jul 31 22:55:36.667619 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:55:36.667593    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bbb6763_9711_4633_b766_ba06dd9ba30e.slice/crio-72ead95f1a32f419606ef9cadcdea5c236b7e5b9137210265278d73621c0fb5f WatchSource:0}: Error finding container 72ead95f1a32f419606ef9cadcdea5c236b7e5b9137210265278d73621c0fb5f: Status 404 returned error can't find the container with id 72ead95f1a32f419606ef9cadcdea5c236b7e5b9137210265278d73621c0fb5f
Jul 31 22:55:37.602346 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:37.602247    2573 generic.go:356] "Generic (PLEG): container finished" podID="3bbb6763-9711-4633-b766-ba06dd9ba30e" containerID="8edb8ce895fe57fb021a0dc19dfeeb4af088a603709a2ec8170a26a84cdfe6ea" exitCode=0
Jul 31 22:55:37.602729 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:37.602337    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c5b030-9hcr7" event={"ID":"3bbb6763-9711-4633-b766-ba06dd9ba30e","Type":"ContainerDied","Data":"8edb8ce895fe57fb021a0dc19dfeeb4af088a603709a2ec8170a26a84cdfe6ea"}
Jul 31 22:55:37.602729 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:37.602414    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c5b030-9hcr7" event={"ID":"3bbb6763-9711-4633-b766-ba06dd9ba30e","Type":"ContainerStarted","Data":"72ead95f1a32f419606ef9cadcdea5c236b7e5b9137210265278d73621c0fb5f"}
Jul 31 22:55:38.732266 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:38.732244    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c5b030-9hcr7"
Jul 31 22:55:38.871831 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:38.871745    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bbb6763-9711-4633-b766-ba06dd9ba30e-maas-api-service-ca\") pod \"3bbb6763-9711-4633-b766-ba06dd9ba30e\" (UID: \"3bbb6763-9711-4633-b766-ba06dd9ba30e\") "
Jul 31 22:55:38.872082 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:38.872059    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bbb6763-9711-4633-b766-ba06dd9ba30e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3bbb6763-9711-4633-b766-ba06dd9ba30e" (UID: "3bbb6763-9711-4633-b766-ba06dd9ba30e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:55:38.972671 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:38.972642    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bbb6763-9711-4633-b766-ba06dd9ba30e-maas-api-service-ca\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:55:39.613356 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:39.613279    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c5b030-9hcr7" event={"ID":"3bbb6763-9711-4633-b766-ba06dd9ba30e","Type":"ContainerDied","Data":"72ead95f1a32f419606ef9cadcdea5c236b7e5b9137210265278d73621c0fb5f"}
Jul 31 22:55:39.613356 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:39.613346    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="72ead95f1a32f419606ef9cadcdea5c236b7e5b9137210265278d73621c0fb5f"
Jul 31 22:55:39.613356 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:39.613287    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c5b030-9hcr7"
Jul 31 22:55:42.609518 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:42.609487    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c5b030-9hcr7"]
Jul 31 22:55:42.613725 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:42.613695    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c5b030-9hcr7"]
Jul 31 22:55:43.334871 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:43.334844    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bbb6763-9711-4633-b766-ba06dd9ba30e" path="/var/lib/kubelet/pods/3bbb6763-9711-4633-b766-ba06dd9ba30e/volumes"
Jul 31 22:55:49.376662 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:49.376627    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"]
Jul 31 22:55:49.377127 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:49.376873    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr" podUID="605aac0d-ba4e-4a05-a512-4e429f37a92c" containerName="istio-proxy" containerID="cri-o://e32df3f35213a8c81072d7f11eae94a2e6045cb093e05eed22ea34d0f16dc6d3" gracePeriod=30
Jul 31 22:55:54.622191 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:54.622168    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"
Jul 31 22:55:54.688652 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:54.688621    2573 generic.go:356] "Generic (PLEG): container finished" podID="605aac0d-ba4e-4a05-a512-4e429f37a92c" containerID="e32df3f35213a8c81072d7f11eae94a2e6045cb093e05eed22ea34d0f16dc6d3" exitCode=0
Jul 31 22:55:54.688800 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:54.688676    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"
Jul 31 22:55:54.688800 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:54.688704    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr" event={"ID":"605aac0d-ba4e-4a05-a512-4e429f37a92c","Type":"ContainerDied","Data":"e32df3f35213a8c81072d7f11eae94a2e6045cb093e05eed22ea34d0f16dc6d3"}
Jul 31 22:55:54.688800 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:54.688761    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr" event={"ID":"605aac0d-ba4e-4a05-a512-4e429f37a92c","Type":"ContainerDied","Data":"f5dd155bbf714dacd8fb7f011820440a7a73cba075556d2096eebca7c4ff9a4b"}
Jul 31 22:55:54.688800 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:54.688793    2573 scope.go:117] "RemoveContainer" containerID="e32df3f35213a8c81072d7f11eae94a2e6045cb093e05eed22ea34d0f16dc6d3"
Jul 31 22:55:54.697184 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:54.697167    2573 scope.go:117] "RemoveContainer" containerID="076ce7c96644327d51e418783eb8cdb7232f0d8b197ee9aa1e39eeb07a0e90d8"
Jul 31 22:55:54.704891 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:54.704874    2573 scope.go:117] "RemoveContainer" containerID="e32df3f35213a8c81072d7f11eae94a2e6045cb093e05eed22ea34d0f16dc6d3"
Jul 31 22:55:54.705159 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:55:54.705141    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e32df3f35213a8c81072d7f11eae94a2e6045cb093e05eed22ea34d0f16dc6d3\": container with ID starting with e32df3f35213a8c81072d7f11eae94a2e6045cb093e05eed22ea34d0f16dc6d3 not found: ID does not exist" containerID="e32df3f35213a8c81072d7f11eae94a2e6045cb093e05eed22ea34d0f16dc6d3"
Jul 31 22:55:54.705211 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:54.705168    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e32df3f35213a8c81072d7f11eae94a2e6045cb093e05eed22ea34d0f16dc6d3"} err="failed to get container status \"e32df3f35213a8c81072d7f11eae94a2e6045cb093e05eed22ea34d0f16dc6d3\": rpc error: code = NotFound desc = could not find container \"e32df3f35213a8c81072d7f11eae94a2e6045cb093e05eed22ea34d0f16dc6d3\": container with ID starting with e32df3f35213a8c81072d7f11eae94a2e6045cb093e05eed22ea34d0f16dc6d3 not found: ID does not exist"
Jul 31 22:55:54.705211 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:54.705188    2573 scope.go:117] "RemoveContainer" containerID="076ce7c96644327d51e418783eb8cdb7232f0d8b197ee9aa1e39eeb07a0e90d8"
Jul 31 22:55:54.705426 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:55:54.705410    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"076ce7c96644327d51e418783eb8cdb7232f0d8b197ee9aa1e39eeb07a0e90d8\": container with ID starting with 076ce7c96644327d51e418783eb8cdb7232f0d8b197ee9aa1e39eeb07a0e90d8 not found: ID does not exist" containerID="076ce7c96644327d51e418783eb8cdb7232f0d8b197ee9aa1e39eeb07a0e90d8"
Jul 31 22:55:54.705486 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:54.705430    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"076ce7c96644327d51e418783eb8cdb7232f0d8b197ee9aa1e39eeb07a0e90d8"} err="failed to get container status \"076ce7c96644327d51e418783eb8cdb7232f0d8b197ee9aa1e39eeb07a0e90d8\": rpc error: code = NotFound desc = could not find container \"076ce7c96644327d51e418783eb8cdb7232f0d8b197ee9aa1e39eeb07a0e90d8\": container with ID starting with 076ce7c96644327d51e418783eb8cdb7232f0d8b197ee9aa1e39eeb07a0e90d8 not found: ID does not exist"
Jul 31 22:55:54.715705 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:54.715685    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/605aac0d-ba4e-4a05-a512-4e429f37a92c-istio-envoy\") pod \"605aac0d-ba4e-4a05-a512-4e429f37a92c\" (UID: \"605aac0d-ba4e-4a05-a512-4e429f37a92c\") "
Jul 31 22:55:54.715782 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:54.715728    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/605aac0d-ba4e-4a05-a512-4e429f37a92c-workload-certs\") pod \"605aac0d-ba4e-4a05-a512-4e429f37a92c\" (UID: \"605aac0d-ba4e-4a05-a512-4e429f37a92c\") "
Jul 31 22:55:54.715782 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:54.715757    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/605aac0d-ba4e-4a05-a512-4e429f37a92c-credential-socket\") pod \"605aac0d-ba4e-4a05-a512-4e429f37a92c\" (UID: \"605aac0d-ba4e-4a05-a512-4e429f37a92c\") "
Jul 31 22:55:54.715782 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:54.715779    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/605aac0d-ba4e-4a05-a512-4e429f37a92c-istio-podinfo\") pod \"605aac0d-ba4e-4a05-a512-4e429f37a92c\" (UID: \"605aac0d-ba4e-4a05-a512-4e429f37a92c\") "
Jul 31 22:55:54.715937 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:54.715797    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/605aac0d-ba4e-4a05-a512-4e429f37a92c-istiod-ca-cert\") pod \"605aac0d-ba4e-4a05-a512-4e429f37a92c\" (UID: \"605aac0d-ba4e-4a05-a512-4e429f37a92c\") "
Jul 31 22:55:54.715937 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:54.715831    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/605aac0d-ba4e-4a05-a512-4e429f37a92c-workload-socket\") pod \"605aac0d-ba4e-4a05-a512-4e429f37a92c\" (UID: \"605aac0d-ba4e-4a05-a512-4e429f37a92c\") "
Jul 31 22:55:54.715937 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:54.715864    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/605aac0d-ba4e-4a05-a512-4e429f37a92c-istio-data\") pod \"605aac0d-ba4e-4a05-a512-4e429f37a92c\" (UID: \"605aac0d-ba4e-4a05-a512-4e429f37a92c\") "
Jul 31 22:55:54.716098 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:54.715950    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/605aac0d-ba4e-4a05-a512-4e429f37a92c-istio-token\") pod \"605aac0d-ba4e-4a05-a512-4e429f37a92c\" (UID: \"605aac0d-ba4e-4a05-a512-4e429f37a92c\") "
Jul 31 22:55:54.716098 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:54.715982    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8z5tp\" (UniqueName: \"kubernetes.io/projected/605aac0d-ba4e-4a05-a512-4e429f37a92c-kube-api-access-8z5tp\") pod \"605aac0d-ba4e-4a05-a512-4e429f37a92c\" (UID: \"605aac0d-ba4e-4a05-a512-4e429f37a92c\") "
Jul 31 22:55:54.716098 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:54.715992    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/605aac0d-ba4e-4a05-a512-4e429f37a92c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "605aac0d-ba4e-4a05-a512-4e429f37a92c" (UID: "605aac0d-ba4e-4a05-a512-4e429f37a92c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:55:54.716098 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:54.716009    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/605aac0d-ba4e-4a05-a512-4e429f37a92c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "605aac0d-ba4e-4a05-a512-4e429f37a92c" (UID: "605aac0d-ba4e-4a05-a512-4e429f37a92c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:55:54.716098 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:54.716093    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/605aac0d-ba4e-4a05-a512-4e429f37a92c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "605aac0d-ba4e-4a05-a512-4e429f37a92c" (UID: "605aac0d-ba4e-4a05-a512-4e429f37a92c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:55:54.716443 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:54.716205    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/605aac0d-ba4e-4a05-a512-4e429f37a92c-istio-data" (OuterVolumeSpecName: "istio-data") pod "605aac0d-ba4e-4a05-a512-4e429f37a92c" (UID: "605aac0d-ba4e-4a05-a512-4e429f37a92c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:55:54.716443 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:54.716247    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/605aac0d-ba4e-4a05-a512-4e429f37a92c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "605aac0d-ba4e-4a05-a512-4e429f37a92c" (UID: "605aac0d-ba4e-4a05-a512-4e429f37a92c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:55:54.716443 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:54.716408    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/605aac0d-ba4e-4a05-a512-4e429f37a92c-workload-certs\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:55:54.716443 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:54.716429    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/605aac0d-ba4e-4a05-a512-4e429f37a92c-credential-socket\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:55:54.716443 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:54.716442    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/605aac0d-ba4e-4a05-a512-4e429f37a92c-istiod-ca-cert\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:55:54.716632 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:54.716455    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/605aac0d-ba4e-4a05-a512-4e429f37a92c-workload-socket\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:55:54.716632 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:54.716469    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/605aac0d-ba4e-4a05-a512-4e429f37a92c-istio-data\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:55:54.718047 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:54.718022    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/605aac0d-ba4e-4a05-a512-4e429f37a92c-istio-token" (OuterVolumeSpecName: "istio-token") pod "605aac0d-ba4e-4a05-a512-4e429f37a92c" (UID: "605aac0d-ba4e-4a05-a512-4e429f37a92c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:55:54.718133 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:54.718021    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/605aac0d-ba4e-4a05-a512-4e429f37a92c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "605aac0d-ba4e-4a05-a512-4e429f37a92c" (UID: "605aac0d-ba4e-4a05-a512-4e429f37a92c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:55:54.718359 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:54.718334    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/605aac0d-ba4e-4a05-a512-4e429f37a92c-kube-api-access-8z5tp" (OuterVolumeSpecName: "kube-api-access-8z5tp") pod "605aac0d-ba4e-4a05-a512-4e429f37a92c" (UID: "605aac0d-ba4e-4a05-a512-4e429f37a92c"). InnerVolumeSpecName "kube-api-access-8z5tp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:55:54.718465 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:54.718337    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/605aac0d-ba4e-4a05-a512-4e429f37a92c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "605aac0d-ba4e-4a05-a512-4e429f37a92c" (UID: "605aac0d-ba4e-4a05-a512-4e429f37a92c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 22:55:54.816853 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:54.816828    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/605aac0d-ba4e-4a05-a512-4e429f37a92c-istio-token\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:55:54.816853 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:54.816851    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8z5tp\" (UniqueName: \"kubernetes.io/projected/605aac0d-ba4e-4a05-a512-4e429f37a92c-kube-api-access-8z5tp\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:55:54.816999 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:54.816862    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/605aac0d-ba4e-4a05-a512-4e429f37a92c-istio-envoy\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:55:54.816999 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:54.816871    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/605aac0d-ba4e-4a05-a512-4e429f37a92c-istio-podinfo\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:55:55.014780 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:55.013628    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"]
Jul 31 22:55:55.020051 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:55.020023    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-c5b030-openshift-default-7dc5889bf4-vjgjr"]
Jul 31 22:55:55.334944 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:55:55.334868    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="605aac0d-ba4e-4a05-a512-4e429f37a92c" path="/var/lib/kubelet/pods/605aac0d-ba4e-4a05-a512-4e429f37a92c/volumes"
Jul 31 22:56:14.435339 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:56:14.435292    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-56c69a/ipp-route-56c69a-kserve-d8dc878c5-wnhzt"]
Jul 31 22:56:29.454158 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:56:29.454093    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-56c69a/ipp-route-56c69a-kserve-d8dc878c5-wnhzt" podUID="65c53d14-3a4d-4ff6-b375-75c257f920a0" containerName="main" containerID="cri-o://d20a8f2c1eaa88c8b2d5dceaca668027287ed54403366d37efcd2e90baf1e109" gracePeriod=45
Jul 31 22:56:29.693197 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:56:29.693173    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-56c69a/ipp-route-56c69a-kserve-d8dc878c5-wnhzt"
Jul 31 22:56:29.819476 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:56:29.819399    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65c53d14-3a4d-4ff6-b375-75c257f920a0-dshm\") pod \"65c53d14-3a4d-4ff6-b375-75c257f920a0\" (UID: \"65c53d14-3a4d-4ff6-b375-75c257f920a0\") "
Jul 31 22:56:29.819476 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:56:29.819443    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9h2dh\" (UniqueName: \"kubernetes.io/projected/65c53d14-3a4d-4ff6-b375-75c257f920a0-kube-api-access-9h2dh\") pod \"65c53d14-3a4d-4ff6-b375-75c257f920a0\" (UID: \"65c53d14-3a4d-4ff6-b375-75c257f920a0\") "
Jul 31 22:56:29.819476 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:56:29.819458    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65c53d14-3a4d-4ff6-b375-75c257f920a0-tmp-dir\") pod \"65c53d14-3a4d-4ff6-b375-75c257f920a0\" (UID: \"65c53d14-3a4d-4ff6-b375-75c257f920a0\") "
Jul 31 22:56:29.819728 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:56:29.819511    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65c53d14-3a4d-4ff6-b375-75c257f920a0-home\") pod \"65c53d14-3a4d-4ff6-b375-75c257f920a0\" (UID: \"65c53d14-3a4d-4ff6-b375-75c257f920a0\") "
Jul 31 22:56:29.819728 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:56:29.819543    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65c53d14-3a4d-4ff6-b375-75c257f920a0-model-cache\") pod \"65c53d14-3a4d-4ff6-b375-75c257f920a0\" (UID: \"65c53d14-3a4d-4ff6-b375-75c257f920a0\") "
Jul 31 22:56:29.819728 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:56:29.819619    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65c53d14-3a4d-4ff6-b375-75c257f920a0-tls-certs\") pod \"65c53d14-3a4d-4ff6-b375-75c257f920a0\" (UID: \"65c53d14-3a4d-4ff6-b375-75c257f920a0\") "
Jul 31 22:56:29.819894 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:56:29.819732    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65c53d14-3a4d-4ff6-b375-75c257f920a0-home" (OuterVolumeSpecName: "home") pod "65c53d14-3a4d-4ff6-b375-75c257f920a0" (UID: "65c53d14-3a4d-4ff6-b375-75c257f920a0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:56:29.819894 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:56:29.819775    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65c53d14-3a4d-4ff6-b375-75c257f920a0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "65c53d14-3a4d-4ff6-b375-75c257f920a0" (UID: "65c53d14-3a4d-4ff6-b375-75c257f920a0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:56:29.819894 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:56:29.819852    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65c53d14-3a4d-4ff6-b375-75c257f920a0-model-cache" (OuterVolumeSpecName: "model-cache") pod "65c53d14-3a4d-4ff6-b375-75c257f920a0" (UID: "65c53d14-3a4d-4ff6-b375-75c257f920a0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:56:29.820042 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:56:29.819963    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65c53d14-3a4d-4ff6-b375-75c257f920a0-tmp-dir\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:56:29.820042 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:56:29.819984    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65c53d14-3a4d-4ff6-b375-75c257f920a0-home\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:56:29.820042 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:56:29.819997    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65c53d14-3a4d-4ff6-b375-75c257f920a0-model-cache\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:56:29.821730 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:56:29.821707    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65c53d14-3a4d-4ff6-b375-75c257f920a0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "65c53d14-3a4d-4ff6-b375-75c257f920a0" (UID: "65c53d14-3a4d-4ff6-b375-75c257f920a0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 22:56:29.821884 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:56:29.821864    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65c53d14-3a4d-4ff6-b375-75c257f920a0-dshm" (OuterVolumeSpecName: "dshm") pod "65c53d14-3a4d-4ff6-b375-75c257f920a0" (UID: "65c53d14-3a4d-4ff6-b375-75c257f920a0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:56:29.821943 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:56:29.821886    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65c53d14-3a4d-4ff6-b375-75c257f920a0-kube-api-access-9h2dh" (OuterVolumeSpecName: "kube-api-access-9h2dh") pod "65c53d14-3a4d-4ff6-b375-75c257f920a0" (UID: "65c53d14-3a4d-4ff6-b375-75c257f920a0"). InnerVolumeSpecName "kube-api-access-9h2dh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:56:29.860629 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:56:29.860595    2573 generic.go:356] "Generic (PLEG): container finished" podID="65c53d14-3a4d-4ff6-b375-75c257f920a0" containerID="d20a8f2c1eaa88c8b2d5dceaca668027287ed54403366d37efcd2e90baf1e109" exitCode=0
Jul 31 22:56:29.860756 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:56:29.860648    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-56c69a/ipp-route-56c69a-kserve-d8dc878c5-wnhzt"
Jul 31 22:56:29.860756 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:56:29.860678    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-56c69a/ipp-route-56c69a-kserve-d8dc878c5-wnhzt" event={"ID":"65c53d14-3a4d-4ff6-b375-75c257f920a0","Type":"ContainerDied","Data":"d20a8f2c1eaa88c8b2d5dceaca668027287ed54403366d37efcd2e90baf1e109"}
Jul 31 22:56:29.860756 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:56:29.860722    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-56c69a/ipp-route-56c69a-kserve-d8dc878c5-wnhzt" event={"ID":"65c53d14-3a4d-4ff6-b375-75c257f920a0","Type":"ContainerDied","Data":"0fc808ed12140887b37984fb42f8bc827b2ba9826ec84e6818daf7a0680d49cb"}
Jul 31 22:56:29.860756 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:56:29.860743    2573 scope.go:117] "RemoveContainer" containerID="d20a8f2c1eaa88c8b2d5dceaca668027287ed54403366d37efcd2e90baf1e109"
Jul 31 22:56:29.869198 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:56:29.869181    2573 scope.go:117] "RemoveContainer" containerID="d20a8f2c1eaa88c8b2d5dceaca668027287ed54403366d37efcd2e90baf1e109"
Jul 31 22:56:29.869496 ip-10-0-130-191 kubenswrapper[2573]: E0731 22:56:29.869479    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d20a8f2c1eaa88c8b2d5dceaca668027287ed54403366d37efcd2e90baf1e109\": container with ID starting with d20a8f2c1eaa88c8b2d5dceaca668027287ed54403366d37efcd2e90baf1e109 not found: ID does not exist" containerID="d20a8f2c1eaa88c8b2d5dceaca668027287ed54403366d37efcd2e90baf1e109"
Jul 31 22:56:29.869563 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:56:29.869502    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d20a8f2c1eaa88c8b2d5dceaca668027287ed54403366d37efcd2e90baf1e109"} err="failed to get container status \"d20a8f2c1eaa88c8b2d5dceaca668027287ed54403366d37efcd2e90baf1e109\": rpc error: code = NotFound desc = could not find container \"d20a8f2c1eaa88c8b2d5dceaca668027287ed54403366d37efcd2e90baf1e109\": container with ID starting with d20a8f2c1eaa88c8b2d5dceaca668027287ed54403366d37efcd2e90baf1e109 not found: ID does not exist"
Jul 31 22:56:29.883117 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:56:29.883094    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-56c69a/ipp-route-56c69a-kserve-d8dc878c5-wnhzt"]
Jul 31 22:56:29.887661 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:56:29.887642    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-56c69a/ipp-route-56c69a-kserve-d8dc878c5-wnhzt"]
Jul 31 22:56:29.921166 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:56:29.921142    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65c53d14-3a4d-4ff6-b375-75c257f920a0-tls-certs\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:56:29.921166 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:56:29.921163    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65c53d14-3a4d-4ff6-b375-75c257f920a0-dshm\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:56:29.921331 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:56:29.921173    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9h2dh\" (UniqueName: \"kubernetes.io/projected/65c53d14-3a4d-4ff6-b375-75c257f920a0-kube-api-access-9h2dh\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:56:31.334980 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:56:31.334950    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65c53d14-3a4d-4ff6-b375-75c257f920a0" path="/var/lib/kubelet/pods/65c53d14-3a4d-4ff6-b375-75c257f920a0/volumes"
Jul 31 22:57:03.845064 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:03.845030    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"]
Jul 31 22:57:03.845672 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:03.845236    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv" podUID="ff525904-25f4-4af7-89fa-e1308280926b" containerName="istio-proxy" containerID="cri-o://e4a9469e840eb529240230a98ce1fcf4db625ad3f7551c6e373e1463b1f985a7" gracePeriod=30
Jul 31 22:57:04.249879 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:04.249842    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-918fe5-mcjdc"]
Jul 31 22:57:04.250189 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:04.250176    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bbb6763-9711-4633-b766-ba06dd9ba30e" containerName="revoke-keys"
Jul 31 22:57:04.250241 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:04.250190    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bbb6763-9711-4633-b766-ba06dd9ba30e" containerName="revoke-keys"
Jul 31 22:57:04.250241 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:04.250205    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="605aac0d-ba4e-4a05-a512-4e429f37a92c" containerName="istio-proxy"
Jul 31 22:57:04.250241 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:04.250211    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="605aac0d-ba4e-4a05-a512-4e429f37a92c" containerName="istio-proxy"
Jul 31 22:57:04.250241 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:04.250223    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65c53d14-3a4d-4ff6-b375-75c257f920a0" containerName="main"
Jul 31 22:57:04.250241 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:04.250229    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="65c53d14-3a4d-4ff6-b375-75c257f920a0" containerName="main"
Jul 31 22:57:04.250241 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:04.250238    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="605aac0d-ba4e-4a05-a512-4e429f37a92c" containerName="istio-proxy"
Jul 31 22:57:04.250241 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:04.250243    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="605aac0d-ba4e-4a05-a512-4e429f37a92c" containerName="istio-proxy"
Jul 31 22:57:04.250546 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:04.250311    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="65c53d14-3a4d-4ff6-b375-75c257f920a0" containerName="main"
Jul 31 22:57:04.250546 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:04.250322    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="605aac0d-ba4e-4a05-a512-4e429f37a92c" containerName="istio-proxy"
Jul 31 22:57:04.250546 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:04.250332    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="605aac0d-ba4e-4a05-a512-4e429f37a92c" containerName="istio-proxy"
Jul 31 22:57:04.250546 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:04.250347    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bbb6763-9711-4633-b766-ba06dd9ba30e" containerName="revoke-keys"
Jul 31 22:57:04.254785 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:04.254767    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-918fe5-mcjdc"
Jul 31 22:57:04.257382 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:04.257364    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lgfz6\""
Jul 31 22:57:04.257503 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:04.257367    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 31 22:57:04.262969 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:04.262946    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-918fe5-mcjdc"]
Jul 31 22:57:04.314052 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:04.314022    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c5a3a04-4053-4a1a-a250-124e3b06981b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-918fe5-mcjdc\" (UID: \"2c5a3a04-4053-4a1a-a250-124e3b06981b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-918fe5-mcjdc"
Jul 31 22:57:04.414761 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:04.414727    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c5a3a04-4053-4a1a-a250-124e3b06981b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-918fe5-mcjdc\" (UID: \"2c5a3a04-4053-4a1a-a250-124e3b06981b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-918fe5-mcjdc"
Jul 31 22:57:04.415369 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:04.415338    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c5a3a04-4053-4a1a-a250-124e3b06981b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-918fe5-mcjdc\" (UID: \"2c5a3a04-4053-4a1a-a250-124e3b06981b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-918fe5-mcjdc"
Jul 31 22:57:04.566450 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:04.566385    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-918fe5-mcjdc"
Jul 31 22:57:04.693287 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:04.693263    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-918fe5-mcjdc"]
Jul 31 22:57:04.695242 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:57:04.695216    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c5a3a04_4053_4a1a_a250_124e3b06981b.slice/crio-4afe6c9389a3b4fc12a245ee2f6759344395420e348693e8f9c9edb856886d5a WatchSource:0}: Error finding container 4afe6c9389a3b4fc12a245ee2f6759344395420e348693e8f9c9edb856886d5a: Status 404 returned error can't find the container with id 4afe6c9389a3b4fc12a245ee2f6759344395420e348693e8f9c9edb856886d5a
Jul 31 22:57:05.036834 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:05.036801    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-918fe5-mcjdc" event={"ID":"2c5a3a04-4053-4a1a-a250-124e3b06981b","Type":"ContainerStarted","Data":"6976719c116ba66cc6b62cf9cd4af249bde93a989d31e4df992cc30e46bc839a"}
Jul 31 22:57:05.037134 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:05.036859    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-918fe5-mcjdc" event={"ID":"2c5a3a04-4053-4a1a-a250-124e3b06981b","Type":"ContainerStarted","Data":"4afe6c9389a3b4fc12a245ee2f6759344395420e348693e8f9c9edb856886d5a"}
Jul 31 22:57:05.067064 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:05.067022    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-918fe5-mcjdc" podStartSLOduration=1.067006455 podStartE2EDuration="1.067006455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:57:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:57:05.065783718 +0000 UTC m=+3434.161074865" watchObservedRunningTime="2026-07-31 22:57:05.067006455 +0000 UTC m=+3434.162297601"
Jul 31 22:57:06.042849 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:06.042818    2573 generic.go:356] "Generic (PLEG): container finished" podID="2c5a3a04-4053-4a1a-a250-124e3b06981b" containerID="6976719c116ba66cc6b62cf9cd4af249bde93a989d31e4df992cc30e46bc839a" exitCode=0
Jul 31 22:57:06.043217 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:06.042856    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-918fe5-mcjdc" event={"ID":"2c5a3a04-4053-4a1a-a250-124e3b06981b","Type":"ContainerDied","Data":"6976719c116ba66cc6b62cf9cd4af249bde93a989d31e4df992cc30e46bc839a"}
Jul 31 22:57:07.184713 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:07.184688    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-918fe5-mcjdc"
Jul 31 22:57:07.241175 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:07.241146    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c5a3a04-4053-4a1a-a250-124e3b06981b-maas-api-service-ca\") pod \"2c5a3a04-4053-4a1a-a250-124e3b06981b\" (UID: \"2c5a3a04-4053-4a1a-a250-124e3b06981b\") "
Jul 31 22:57:07.241515 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:07.241493    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c5a3a04-4053-4a1a-a250-124e3b06981b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2c5a3a04-4053-4a1a-a250-124e3b06981b" (UID: "2c5a3a04-4053-4a1a-a250-124e3b06981b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:57:07.342008 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:07.341983    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c5a3a04-4053-4a1a-a250-124e3b06981b-maas-api-service-ca\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:57:08.053894 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:08.053864    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-918fe5-mcjdc" event={"ID":"2c5a3a04-4053-4a1a-a250-124e3b06981b","Type":"ContainerDied","Data":"4afe6c9389a3b4fc12a245ee2f6759344395420e348693e8f9c9edb856886d5a"}
Jul 31 22:57:08.054059 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:08.053898    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-918fe5-mcjdc"
Jul 31 22:57:08.054059 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:08.053910    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4afe6c9389a3b4fc12a245ee2f6759344395420e348693e8f9c9edb856886d5a"
Jul 31 22:57:09.061060 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:09.061029    2573 generic.go:356] "Generic (PLEG): container finished" podID="ff525904-25f4-4af7-89fa-e1308280926b" containerID="e4a9469e840eb529240230a98ce1fcf4db625ad3f7551c6e373e1463b1f985a7" exitCode=0
Jul 31 22:57:09.061547 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:09.061072    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv" event={"ID":"ff525904-25f4-4af7-89fa-e1308280926b","Type":"ContainerDied","Data":"e4a9469e840eb529240230a98ce1fcf4db625ad3f7551c6e373e1463b1f985a7"}
Jul 31 22:57:09.061547 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:09.061119    2573 scope.go:117] "RemoveContainer" containerID="f2e1fdc1f1ce19bc3ffe51794f7562ee3eba6f250d822006f9acc48fe28e5d65"
Jul 31 22:57:09.096701 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:09.096678    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"
Jul 31 22:57:09.157133 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:09.157054    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff525904-25f4-4af7-89fa-e1308280926b-workload-certs\") pod \"ff525904-25f4-4af7-89fa-e1308280926b\" (UID: \"ff525904-25f4-4af7-89fa-e1308280926b\") "
Jul 31 22:57:09.157133 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:09.157094    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff525904-25f4-4af7-89fa-e1308280926b-istio-envoy\") pod \"ff525904-25f4-4af7-89fa-e1308280926b\" (UID: \"ff525904-25f4-4af7-89fa-e1308280926b\") "
Jul 31 22:57:09.157355 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:09.157142    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff525904-25f4-4af7-89fa-e1308280926b-istiod-ca-cert\") pod \"ff525904-25f4-4af7-89fa-e1308280926b\" (UID: \"ff525904-25f4-4af7-89fa-e1308280926b\") "
Jul 31 22:57:09.157355 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:09.157178    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff525904-25f4-4af7-89fa-e1308280926b-credential-socket\") pod \"ff525904-25f4-4af7-89fa-e1308280926b\" (UID: \"ff525904-25f4-4af7-89fa-e1308280926b\") "
Jul 31 22:57:09.157355 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:09.157208    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff525904-25f4-4af7-89fa-e1308280926b-istio-token\") pod \"ff525904-25f4-4af7-89fa-e1308280926b\" (UID: \"ff525904-25f4-4af7-89fa-e1308280926b\") "
Jul 31 22:57:09.157542 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:09.157362    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ltq55\" (UniqueName: \"kubernetes.io/projected/ff525904-25f4-4af7-89fa-e1308280926b-kube-api-access-ltq55\") pod \"ff525904-25f4-4af7-89fa-e1308280926b\" (UID: \"ff525904-25f4-4af7-89fa-e1308280926b\") "
Jul 31 22:57:09.157542 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:09.157415    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff525904-25f4-4af7-89fa-e1308280926b-istio-data\") pod \"ff525904-25f4-4af7-89fa-e1308280926b\" (UID: \"ff525904-25f4-4af7-89fa-e1308280926b\") "
Jul 31 22:57:09.157542 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:09.157362    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff525904-25f4-4af7-89fa-e1308280926b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ff525904-25f4-4af7-89fa-e1308280926b" (UID: "ff525904-25f4-4af7-89fa-e1308280926b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:57:09.157542 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:09.157486    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff525904-25f4-4af7-89fa-e1308280926b-workload-socket\") pod \"ff525904-25f4-4af7-89fa-e1308280926b\" (UID: \"ff525904-25f4-4af7-89fa-e1308280926b\") "
Jul 31 22:57:09.157542 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:09.157497    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff525904-25f4-4af7-89fa-e1308280926b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ff525904-25f4-4af7-89fa-e1308280926b" (UID: "ff525904-25f4-4af7-89fa-e1308280926b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:57:09.157542 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:09.157528    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff525904-25f4-4af7-89fa-e1308280926b-istio-podinfo\") pod \"ff525904-25f4-4af7-89fa-e1308280926b\" (UID: \"ff525904-25f4-4af7-89fa-e1308280926b\") "
Jul 31 22:57:09.157807 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:09.157567    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff525904-25f4-4af7-89fa-e1308280926b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ff525904-25f4-4af7-89fa-e1308280926b" (UID: "ff525904-25f4-4af7-89fa-e1308280926b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:57:09.157807 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:09.157726    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff525904-25f4-4af7-89fa-e1308280926b-istio-data" (OuterVolumeSpecName: "istio-data") pod "ff525904-25f4-4af7-89fa-e1308280926b" (UID: "ff525904-25f4-4af7-89fa-e1308280926b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:57:09.157807 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:09.157741    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff525904-25f4-4af7-89fa-e1308280926b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ff525904-25f4-4af7-89fa-e1308280926b" (UID: "ff525904-25f4-4af7-89fa-e1308280926b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:57:09.157927 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:09.157868    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff525904-25f4-4af7-89fa-e1308280926b-workload-certs\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:57:09.157927 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:09.157886    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff525904-25f4-4af7-89fa-e1308280926b-istiod-ca-cert\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:57:09.157927 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:09.157899    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff525904-25f4-4af7-89fa-e1308280926b-credential-socket\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:57:09.157927 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:09.157912    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff525904-25f4-4af7-89fa-e1308280926b-istio-data\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:57:09.157927 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:09.157925    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff525904-25f4-4af7-89fa-e1308280926b-workload-socket\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:57:09.159456 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:09.159426    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff525904-25f4-4af7-89fa-e1308280926b-istio-token" (OuterVolumeSpecName: "istio-token") pod "ff525904-25f4-4af7-89fa-e1308280926b" (UID: "ff525904-25f4-4af7-89fa-e1308280926b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:57:09.159557 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:09.159467    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff525904-25f4-4af7-89fa-e1308280926b-kube-api-access-ltq55" (OuterVolumeSpecName: "kube-api-access-ltq55") pod "ff525904-25f4-4af7-89fa-e1308280926b" (UID: "ff525904-25f4-4af7-89fa-e1308280926b"). InnerVolumeSpecName "kube-api-access-ltq55". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:57:09.159557 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:09.159476    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff525904-25f4-4af7-89fa-e1308280926b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ff525904-25f4-4af7-89fa-e1308280926b" (UID: "ff525904-25f4-4af7-89fa-e1308280926b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:57:09.159672 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:09.159657    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ff525904-25f4-4af7-89fa-e1308280926b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ff525904-25f4-4af7-89fa-e1308280926b" (UID: "ff525904-25f4-4af7-89fa-e1308280926b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 22:57:09.259149 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:09.259115    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff525904-25f4-4af7-89fa-e1308280926b-istio-token\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:57:09.259149 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:09.259142    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ltq55\" (UniqueName: \"kubernetes.io/projected/ff525904-25f4-4af7-89fa-e1308280926b-kube-api-access-ltq55\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:57:09.259149 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:09.259152    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff525904-25f4-4af7-89fa-e1308280926b-istio-podinfo\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:57:09.259389 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:09.259161    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff525904-25f4-4af7-89fa-e1308280926b-istio-envoy\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:57:10.067573 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:10.067539    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"
Jul 31 22:57:10.067573 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:10.067562    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv" event={"ID":"ff525904-25f4-4af7-89fa-e1308280926b","Type":"ContainerDied","Data":"93e4fc85b9b3cc5fc8c5fb87e48219b0d4bedad89682ddfd724221e3e5bad4d4"}
Jul 31 22:57:10.068086 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:10.067631    2573 scope.go:117] "RemoveContainer" containerID="e4a9469e840eb529240230a98ce1fcf4db625ad3f7551c6e373e1463b1f985a7"
Jul 31 22:57:10.089673 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:10.089643    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"]
Jul 31 22:57:10.095006 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:10.094979    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-56c69a-openshift-default-64d8d8549d-pxmfv"]
Jul 31 22:57:11.335862 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:11.335830    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff525904-25f4-4af7-89fa-e1308280926b" path="/var/lib/kubelet/pods/ff525904-25f4-4af7-89fa-e1308280926b/volumes"
Jul 31 22:57:15.019190 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:15.019152    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-918fe5-mcjdc"]
Jul 31 22:57:15.021497 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:15.021467    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-918fe5-mcjdc"]
Jul 31 22:57:15.334613 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:15.334530    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c5a3a04-4053-4a1a-a250-124e3b06981b" path="/var/lib/kubelet/pods/2c5a3a04-4053-4a1a-a250-124e3b06981b/volumes"
Jul 31 22:57:21.963946 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:21.963912    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"]
Jul 31 22:57:21.964400 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:21.964123    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj" podUID="ce277f75-a1fa-4256-9aeb-b42aa5adbcdd" containerName="istio-proxy" containerID="cri-o://060fe4f9ef1d569972e3e3c4532746df1f035f113e1654466511a7079048582f" gracePeriod=30
Jul 31 22:57:22.370460 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:22.370372    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-08271f-dpzw6"]
Jul 31 22:57:22.370780 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:22.370763    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff525904-25f4-4af7-89fa-e1308280926b" containerName="istio-proxy"
Jul 31 22:57:22.370875 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:22.370783    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff525904-25f4-4af7-89fa-e1308280926b" containerName="istio-proxy"
Jul 31 22:57:22.370875 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:22.370794    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff525904-25f4-4af7-89fa-e1308280926b" containerName="istio-proxy"
Jul 31 22:57:22.370875 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:22.370803    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff525904-25f4-4af7-89fa-e1308280926b" containerName="istio-proxy"
Jul 31 22:57:22.370875 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:22.370823    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c5a3a04-4053-4a1a-a250-124e3b06981b" containerName="revoke-keys"
Jul 31 22:57:22.370875 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:22.370832    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c5a3a04-4053-4a1a-a250-124e3b06981b" containerName="revoke-keys"
Jul 31 22:57:22.371113 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:22.370916    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c5a3a04-4053-4a1a-a250-124e3b06981b" containerName="revoke-keys"
Jul 31 22:57:22.371113 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:22.370932    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff525904-25f4-4af7-89fa-e1308280926b" containerName="istio-proxy"
Jul 31 22:57:22.371113 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:22.370940    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff525904-25f4-4af7-89fa-e1308280926b" containerName="istio-proxy"
Jul 31 22:57:22.375531 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:22.375509    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-08271f-dpzw6"
Jul 31 22:57:22.377956 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:22.377938    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 31 22:57:22.378065 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:22.377976    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lgfz6\""
Jul 31 22:57:22.381592 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:22.381566    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-08271f-dpzw6"]
Jul 31 22:57:22.469055 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:22.469027    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43630b57-b729-4303-8612-d6b83189a07d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-08271f-dpzw6\" (UID: \"43630b57-b729-4303-8612-d6b83189a07d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-08271f-dpzw6"
Jul 31 22:57:22.570031 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:22.570003    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43630b57-b729-4303-8612-d6b83189a07d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-08271f-dpzw6\" (UID: \"43630b57-b729-4303-8612-d6b83189a07d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-08271f-dpzw6"
Jul 31 22:57:22.570578 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:22.570559    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43630b57-b729-4303-8612-d6b83189a07d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-08271f-dpzw6\" (UID: \"43630b57-b729-4303-8612-d6b83189a07d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-08271f-dpzw6"
Jul 31 22:57:22.687437 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:22.687411    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-08271f-dpzw6"
Jul 31 22:57:22.821757 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:22.821731    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-08271f-dpzw6"]
Jul 31 22:57:22.824604 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:57:22.824576    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43630b57_b729_4303_8612_d6b83189a07d.slice/crio-234ab365c6e3c29f1911be51b83279955867d80b387d21922152e7d5f6d2fb14 WatchSource:0}: Error finding container 234ab365c6e3c29f1911be51b83279955867d80b387d21922152e7d5f6d2fb14: Status 404 returned error can't find the container with id 234ab365c6e3c29f1911be51b83279955867d80b387d21922152e7d5f6d2fb14
Jul 31 22:57:23.132899 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:23.132867    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-08271f-dpzw6" event={"ID":"43630b57-b729-4303-8612-d6b83189a07d","Type":"ContainerStarted","Data":"a8177ec02d40d437b083249bfc3f72bc9bc22464d83aca7643f7b5ebedfc28a8"}
Jul 31 22:57:23.133219 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:23.132925    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-08271f-dpzw6" event={"ID":"43630b57-b729-4303-8612-d6b83189a07d","Type":"ContainerStarted","Data":"234ab365c6e3c29f1911be51b83279955867d80b387d21922152e7d5f6d2fb14"}
Jul 31 22:57:23.150516 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:23.150475    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-08271f-dpzw6" podStartSLOduration=1.150461356 podStartE2EDuration="1.150461356s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:57:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:57:23.148443767 +0000 UTC m=+3452.243734917" watchObservedRunningTime="2026-07-31 22:57:23.150461356 +0000 UTC m=+3452.245752503"
Jul 31 22:57:24.138812 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:24.138780    2573 generic.go:356] "Generic (PLEG): container finished" podID="43630b57-b729-4303-8612-d6b83189a07d" containerID="a8177ec02d40d437b083249bfc3f72bc9bc22464d83aca7643f7b5ebedfc28a8" exitCode=0
Jul 31 22:57:24.139192 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:24.138834    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-08271f-dpzw6" event={"ID":"43630b57-b729-4303-8612-d6b83189a07d","Type":"ContainerDied","Data":"a8177ec02d40d437b083249bfc3f72bc9bc22464d83aca7643f7b5ebedfc28a8"}
Jul 31 22:57:25.270711 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:25.270689    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-08271f-dpzw6"
Jul 31 22:57:25.395384 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:25.395290    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43630b57-b729-4303-8612-d6b83189a07d-maas-api-service-ca\") pod \"43630b57-b729-4303-8612-d6b83189a07d\" (UID: \"43630b57-b729-4303-8612-d6b83189a07d\") "
Jul 31 22:57:25.395617 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:25.395593    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43630b57-b729-4303-8612-d6b83189a07d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "43630b57-b729-4303-8612-d6b83189a07d" (UID: "43630b57-b729-4303-8612-d6b83189a07d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:57:25.496423 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:25.496394    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43630b57-b729-4303-8612-d6b83189a07d-maas-api-service-ca\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:57:26.149181 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:26.149155    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-08271f-dpzw6"
Jul 31 22:57:26.149353 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:26.149154    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-08271f-dpzw6" event={"ID":"43630b57-b729-4303-8612-d6b83189a07d","Type":"ContainerDied","Data":"234ab365c6e3c29f1911be51b83279955867d80b387d21922152e7d5f6d2fb14"}
Jul 31 22:57:26.149353 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:26.149289    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="234ab365c6e3c29f1911be51b83279955867d80b387d21922152e7d5f6d2fb14"
Jul 31 22:57:26.283017 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:26.282980    2573 patch_prober.go:28] interesting pod/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 31 22:57:26.283403 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:26.283031    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj" podUID="ce277f75-a1fa-4256-9aeb-b42aa5adbcdd" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 31 22:57:27.157416 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:27.157391    2573 generic.go:356] "Generic (PLEG): container finished" podID="ce277f75-a1fa-4256-9aeb-b42aa5adbcdd" containerID="060fe4f9ef1d569972e3e3c4532746df1f035f113e1654466511a7079048582f" exitCode=0
Jul 31 22:57:27.157555 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:27.157448    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj" event={"ID":"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd","Type":"ContainerDied","Data":"060fe4f9ef1d569972e3e3c4532746df1f035f113e1654466511a7079048582f"}
Jul 31 22:57:27.157555 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:27.157497    2573 scope.go:117] "RemoveContainer" containerID="1c2c35894cc2db3c6a818b745c0ac9aa930bd8c940028ade0fe02bdfc15a3433"
Jul 31 22:57:27.214406 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:27.214384    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"
Jul 31 22:57:27.308874 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:27.308816    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jtfc\" (UniqueName: \"kubernetes.io/projected/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-kube-api-access-8jtfc\") pod \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\" (UID: \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\") "
Jul 31 22:57:27.308874 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:27.308847    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-istio-token\") pod \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\" (UID: \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\") "
Jul 31 22:57:27.309480 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:27.308895    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-credential-socket\") pod \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\" (UID: \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\") "
Jul 31 22:57:27.309480 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:27.308932    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-istio-data\") pod \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\" (UID: \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\") "
Jul 31 22:57:27.309480 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:27.308961    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-istiod-ca-cert\") pod \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\" (UID: \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\") "
Jul 31 22:57:27.309480 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:27.308995    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-istio-podinfo\") pod \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\" (UID: \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\") "
Jul 31 22:57:27.309480 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:27.309023    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-workload-certs\") pod \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\" (UID: \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\") "
Jul 31 22:57:27.309480 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:27.309046    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-workload-socket\") pod \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\" (UID: \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\") "
Jul 31 22:57:27.309480 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:27.309195    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-istio-data" (OuterVolumeSpecName: "istio-data") pod "ce277f75-a1fa-4256-9aeb-b42aa5adbcdd" (UID: "ce277f75-a1fa-4256-9aeb-b42aa5adbcdd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:57:27.309480 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:27.309209    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ce277f75-a1fa-4256-9aeb-b42aa5adbcdd" (UID: "ce277f75-a1fa-4256-9aeb-b42aa5adbcdd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:57:27.309480 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:27.309287    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-istio-envoy\") pod \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\" (UID: \"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd\") "
Jul 31 22:57:27.309480 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:27.309334    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ce277f75-a1fa-4256-9aeb-b42aa5adbcdd" (UID: "ce277f75-a1fa-4256-9aeb-b42aa5adbcdd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:57:27.309480 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:27.309475    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ce277f75-a1fa-4256-9aeb-b42aa5adbcdd" (UID: "ce277f75-a1fa-4256-9aeb-b42aa5adbcdd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:57:27.310076 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:27.309510    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ce277f75-a1fa-4256-9aeb-b42aa5adbcdd" (UID: "ce277f75-a1fa-4256-9aeb-b42aa5adbcdd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:57:27.310076 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:27.309649    2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-credential-socket\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:57:27.310076 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:27.309669    2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-istio-data\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:57:27.310076 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:27.309682    2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-istiod-ca-cert\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:57:27.310076 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:27.309695    2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-workload-certs\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:57:27.310076 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:27.309707    2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-workload-socket\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:57:27.311227 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:27.311195    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ce277f75-a1fa-4256-9aeb-b42aa5adbcdd" (UID: "ce277f75-a1fa-4256-9aeb-b42aa5adbcdd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 22:57:27.311356 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:27.311238    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-kube-api-access-8jtfc" (OuterVolumeSpecName: "kube-api-access-8jtfc") pod "ce277f75-a1fa-4256-9aeb-b42aa5adbcdd" (UID: "ce277f75-a1fa-4256-9aeb-b42aa5adbcdd"). InnerVolumeSpecName "kube-api-access-8jtfc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:57:27.311427 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:27.311368    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-istio-token" (OuterVolumeSpecName: "istio-token") pod "ce277f75-a1fa-4256-9aeb-b42aa5adbcdd" (UID: "ce277f75-a1fa-4256-9aeb-b42aa5adbcdd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 22:57:27.311483 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:27.311441    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ce277f75-a1fa-4256-9aeb-b42aa5adbcdd" (UID: "ce277f75-a1fa-4256-9aeb-b42aa5adbcdd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 22:57:27.410873 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:27.410851    2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-istio-envoy\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:57:27.410873 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:27.410870    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jtfc\" (UniqueName: \"kubernetes.io/projected/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-kube-api-access-8jtfc\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:57:27.411004 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:27.410879    2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-istio-token\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:57:27.411004 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:27.410889    2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd-istio-podinfo\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:57:28.162949 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:28.162914    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj" event={"ID":"ce277f75-a1fa-4256-9aeb-b42aa5adbcdd","Type":"ContainerDied","Data":"18f502699ed4c5bcb670e4054c7f523e35484ae23f6e90452e5864a198b4a982"}
Jul 31 22:57:28.163130 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:28.162976    2573 scope.go:117] "RemoveContainer" containerID="060fe4f9ef1d569972e3e3c4532746df1f035f113e1654466511a7079048582f"
Jul 31 22:57:28.163130 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:28.162936    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"
Jul 31 22:57:28.181570 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:28.181544    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"]
Jul 31 22:57:28.185965 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:28.185940    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-918fe5-openshift-default-6d859f69b-9hjhj"]
Jul 31 22:57:29.334909 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:29.334873    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce277f75-a1fa-4256-9aeb-b42aa5adbcdd" path="/var/lib/kubelet/pods/ce277f75-a1fa-4256-9aeb-b42aa5adbcdd/volumes"
Jul 31 22:57:33.025060 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:33.025025    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-08271f-29758965-b7fcf"]
Jul 31 22:57:33.027189 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:33.027163    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-08271f-29758965-b7fcf"]
Jul 31 22:57:33.230388 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:33.230359    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-08271f-dpzw6"]
Jul 31 22:57:33.233604 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:33.233581    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-08271f-dpzw6"]
Jul 31 22:57:33.335775 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:33.335710    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43630b57-b729-4303-8612-d6b83189a07d" path="/var/lib/kubelet/pods/43630b57-b729-4303-8612-d6b83189a07d/volumes"
Jul 31 22:57:33.336021 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:33.336007    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53793e4c-a5fc-4a91-9ab6-4d17931547c7" path="/var/lib/kubelet/pods/53793e4c-a5fc-4a91-9ab6-4d17931547c7/volumes"
Jul 31 22:57:40.368764 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:40.368733    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3326ad-t7548"]
Jul 31 22:57:40.369229 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:40.369026    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43630b57-b729-4303-8612-d6b83189a07d" containerName="revoke-keys"
Jul 31 22:57:40.369229 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:40.369036    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="43630b57-b729-4303-8612-d6b83189a07d" containerName="revoke-keys"
Jul 31 22:57:40.369229 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:40.369049    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce277f75-a1fa-4256-9aeb-b42aa5adbcdd" containerName="istio-proxy"
Jul 31 22:57:40.369229 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:40.369055    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce277f75-a1fa-4256-9aeb-b42aa5adbcdd" containerName="istio-proxy"
Jul 31 22:57:40.369229 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:40.369072    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce277f75-a1fa-4256-9aeb-b42aa5adbcdd" containerName="istio-proxy"
Jul 31 22:57:40.369229 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:40.369078    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce277f75-a1fa-4256-9aeb-b42aa5adbcdd" containerName="istio-proxy"
Jul 31 22:57:40.369229 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:40.369125    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce277f75-a1fa-4256-9aeb-b42aa5adbcdd" containerName="istio-proxy"
Jul 31 22:57:40.369229 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:40.369135    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="43630b57-b729-4303-8612-d6b83189a07d" containerName="revoke-keys"
Jul 31 22:57:40.372085 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:40.372065    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3326ad-t7548"
Jul 31 22:57:40.374758 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:40.374735    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 31 22:57:40.374870 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:40.374738    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lgfz6\""
Jul 31 22:57:40.380816 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:40.380791    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3326ad-t7548"]
Jul 31 22:57:40.413472 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:40.413433    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e67c837d-d217-48fb-9186-e74cce87ec3e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-3326ad-t7548\" (UID: \"e67c837d-d217-48fb-9186-e74cce87ec3e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3326ad-t7548"
Jul 31 22:57:40.514464 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:40.514435    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e67c837d-d217-48fb-9186-e74cce87ec3e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-3326ad-t7548\" (UID: \"e67c837d-d217-48fb-9186-e74cce87ec3e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3326ad-t7548"
Jul 31 22:57:40.515067 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:40.515045    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e67c837d-d217-48fb-9186-e74cce87ec3e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-3326ad-t7548\" (UID: \"e67c837d-d217-48fb-9186-e74cce87ec3e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3326ad-t7548"
Jul 31 22:57:40.683698 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:40.683663    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3326ad-t7548"
Jul 31 22:57:40.810368 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:40.810343    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3326ad-t7548"]
Jul 31 22:57:40.812173 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:57:40.812143    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode67c837d_d217_48fb_9186_e74cce87ec3e.slice/crio-8fe9898686fd8eab047e8bcf8bf29b6f0b4e1792fcd1f9aab4b839a84581156c WatchSource:0}: Error finding container 8fe9898686fd8eab047e8bcf8bf29b6f0b4e1792fcd1f9aab4b839a84581156c: Status 404 returned error can't find the container with id 8fe9898686fd8eab047e8bcf8bf29b6f0b4e1792fcd1f9aab4b839a84581156c
Jul 31 22:57:41.225713 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:41.225678    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3326ad-t7548" event={"ID":"e67c837d-d217-48fb-9186-e74cce87ec3e","Type":"ContainerStarted","Data":"57f8d82c6746e5c1fbd2158c6ab3dfe96a2b6286fbf6e186eb467a0b94bc7ad8"}
Jul 31 22:57:41.225860 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:41.225737    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3326ad-t7548" event={"ID":"e67c837d-d217-48fb-9186-e74cce87ec3e","Type":"ContainerStarted","Data":"8fe9898686fd8eab047e8bcf8bf29b6f0b4e1792fcd1f9aab4b839a84581156c"}
Jul 31 22:57:41.243510 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:41.243425    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3326ad-t7548" podStartSLOduration=1.243411188 podStartE2EDuration="1.243411188s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:57:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:57:41.242164993 +0000 UTC m=+3470.337456140" watchObservedRunningTime="2026-07-31 22:57:41.243411188 +0000 UTC m=+3470.338702333"
Jul 31 22:57:42.231520 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:42.231489    2573 generic.go:356] "Generic (PLEG): container finished" podID="e67c837d-d217-48fb-9186-e74cce87ec3e" containerID="57f8d82c6746e5c1fbd2158c6ab3dfe96a2b6286fbf6e186eb467a0b94bc7ad8" exitCode=0
Jul 31 22:57:42.231893 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:42.231565    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3326ad-t7548" event={"ID":"e67c837d-d217-48fb-9186-e74cce87ec3e","Type":"ContainerDied","Data":"57f8d82c6746e5c1fbd2158c6ab3dfe96a2b6286fbf6e186eb467a0b94bc7ad8"}
Jul 31 22:57:43.374336 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:43.374312    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3326ad-t7548"
Jul 31 22:57:43.436435 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:43.436397    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e67c837d-d217-48fb-9186-e74cce87ec3e-maas-api-service-ca\") pod \"e67c837d-d217-48fb-9186-e74cce87ec3e\" (UID: \"e67c837d-d217-48fb-9186-e74cce87ec3e\") "
Jul 31 22:57:43.436977 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:43.436734    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e67c837d-d217-48fb-9186-e74cce87ec3e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e67c837d-d217-48fb-9186-e74cce87ec3e" (UID: "e67c837d-d217-48fb-9186-e74cce87ec3e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 22:57:43.437136 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:43.437002    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e67c837d-d217-48fb-9186-e74cce87ec3e-maas-api-service-ca\") on node \"ip-10-0-130-191.ec2.internal\" DevicePath \"\""
Jul 31 22:57:44.241889 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:44.241852    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3326ad-t7548" event={"ID":"e67c837d-d217-48fb-9186-e74cce87ec3e","Type":"ContainerDied","Data":"8fe9898686fd8eab047e8bcf8bf29b6f0b4e1792fcd1f9aab4b839a84581156c"}
Jul 31 22:57:44.241889 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:44.241883    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3326ad-t7548"
Jul 31 22:57:44.242090 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:44.241903    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8fe9898686fd8eab047e8bcf8bf29b6f0b4e1792fcd1f9aab4b839a84581156c"
Jul 31 22:57:51.045383 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:51.045350    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3326ad-29758965-7bwff"]
Jul 31 22:57:51.051081 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:51.051055    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3326ad-29758965-7bwff"]
Jul 31 22:57:51.276915 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:51.276871    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3326ad-t7548"]
Jul 31 22:57:51.279184 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:51.279160    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3326ad-t7548"]
Jul 31 22:57:51.334133 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:51.334070    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72d7c938-e3ac-4351-a364-49166a722cf8" path="/var/lib/kubelet/pods/72d7c938-e3ac-4351-a364-49166a722cf8/volumes"
Jul 31 22:57:51.334376 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:51.334363    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e67c837d-d217-48fb-9186-e74cce87ec3e" path="/var/lib/kubelet/pods/e67c837d-d217-48fb-9186-e74cce87ec3e/volumes"
Jul 31 22:57:51.770737 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:51.770707    2573 scope.go:117] "RemoveContainer" containerID="3c6194f6c22e3e971a9e39c2dacbef9e8e52947db9eb456e52ce7b4061fd64b7"
Jul 31 22:57:51.779480 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:51.779458    2573 scope.go:117] "RemoveContainer" containerID="89425fd2afd579a843b4e5e0a223bb3dae65ffe4de0d6fb1f3f9ab7043c4c4ca"
Jul 31 22:57:59.221238 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:57:59.221206    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-744697ddf8-n9frj_ca5506b3-5a71-491a-b47a-ab87715a6a3c/authorino/0.log"
Jul 31 22:58:05.992923 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:05.992892    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79bdc6db47-pcb8j_9a15bb41-44e8-4b01-b6a6-074fae8016ff/copy-manifests/0.log"
Jul 31 22:58:05.999896 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:05.999874    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79bdc6db47-pcb8j_9a15bb41-44e8-4b01-b6a6-074fae8016ff/manager/0.log"
Jul 31 22:58:06.618221 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:06.618190    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29758950-86zgn_00ed80a3-29bb-43f4-bad8-fa3a5219e0d5/cleanup/0.log"
Jul 31 22:58:06.737700 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:06.737665    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29758965-9gzp8_7f43d3eb-3296-443c-a3c8-3026f6eec532/cleanup/0.log"
Jul 31 22:58:07.680459 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:07.680428    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-744697ddf8-n9frj_ca5506b3-5a71-491a-b47a-ab87715a6a3c/authorino/0.log"
Jul 31 22:58:07.946261 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:07.946186    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-r9ntg_e4432794-a562-4700-94ef-ba19be9eac7b/manager/0.log"
Jul 31 22:58:08.069743 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:08.069718    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-6jzb9_4e3a8daf-65c1-4830-9a80-456b21b9c59b/kuadrant-console-plugin/0.log"
Jul 31 22:58:08.449221 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:08.449191    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-t5jvz_ff26f818-97e3-4f3c-b350-a7e83857b998/manager/0.log"
Jul 31 22:58:09.189666 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:09.189639    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c56dfbf59-9vjlz_0b0abd6f-4fd6-4507-8122-18555489341a/kube-auth-proxy/0.log"
Jul 31 22:58:10.300009 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:10.299979    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-kkv8m_31b6b38a-3c48-4757-acf2-546476cb5990/main/0.log"
Jul 31 22:58:10.659687 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:10.659594    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-t5znf_5fc03870-b0a0-4ece-b4dd-861294624e7a/main/0.log"
Jul 31 22:58:16.397397 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:16.397289    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rch42/must-gather-v7p5n"]
Jul 31 22:58:16.397860 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:16.397778    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e67c837d-d217-48fb-9186-e74cce87ec3e" containerName="revoke-keys"
Jul 31 22:58:16.397860 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:16.397798    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e67c837d-d217-48fb-9186-e74cce87ec3e" containerName="revoke-keys"
Jul 31 22:58:16.397985 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:16.397895    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce277f75-a1fa-4256-9aeb-b42aa5adbcdd" containerName="istio-proxy"
Jul 31 22:58:16.397985 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:16.397910    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e67c837d-d217-48fb-9186-e74cce87ec3e" containerName="revoke-keys"
Jul 31 22:58:16.400919 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:16.400897    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rch42/must-gather-v7p5n"
Jul 31 22:58:16.404981 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:16.404960    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rch42\"/\"kube-root-ca.crt\""
Jul 31 22:58:16.405120 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:16.405002    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rch42\"/\"default-dockercfg-4qg57\""
Jul 31 22:58:16.405319 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:16.405278    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rch42\"/\"openshift-service-ca.crt\""
Jul 31 22:58:16.406091 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:16.406072    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rch42/must-gather-v7p5n"]
Jul 31 22:58:16.511043 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:16.511016    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flsbj\" (UniqueName: \"kubernetes.io/projected/4fbb9a13-90bb-4ebd-8c3c-21d5bc613490-kube-api-access-flsbj\") pod \"must-gather-v7p5n\" (UID: \"4fbb9a13-90bb-4ebd-8c3c-21d5bc613490\") " pod="openshift-must-gather-rch42/must-gather-v7p5n"
Jul 31 22:58:16.511178 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:16.511071    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4fbb9a13-90bb-4ebd-8c3c-21d5bc613490-must-gather-output\") pod \"must-gather-v7p5n\" (UID: \"4fbb9a13-90bb-4ebd-8c3c-21d5bc613490\") " pod="openshift-must-gather-rch42/must-gather-v7p5n"
Jul 31 22:58:16.612473 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:16.612443    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4fbb9a13-90bb-4ebd-8c3c-21d5bc613490-must-gather-output\") pod \"must-gather-v7p5n\" (UID: \"4fbb9a13-90bb-4ebd-8c3c-21d5bc613490\") " pod="openshift-must-gather-rch42/must-gather-v7p5n"
Jul 31 22:58:16.612606 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:16.612496    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flsbj\" (UniqueName: \"kubernetes.io/projected/4fbb9a13-90bb-4ebd-8c3c-21d5bc613490-kube-api-access-flsbj\") pod \"must-gather-v7p5n\" (UID: \"4fbb9a13-90bb-4ebd-8c3c-21d5bc613490\") " pod="openshift-must-gather-rch42/must-gather-v7p5n"
Jul 31 22:58:16.612743 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:16.612725    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4fbb9a13-90bb-4ebd-8c3c-21d5bc613490-must-gather-output\") pod \"must-gather-v7p5n\" (UID: \"4fbb9a13-90bb-4ebd-8c3c-21d5bc613490\") " pod="openshift-must-gather-rch42/must-gather-v7p5n"
Jul 31 22:58:16.620831 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:16.620810    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flsbj\" (UniqueName: \"kubernetes.io/projected/4fbb9a13-90bb-4ebd-8c3c-21d5bc613490-kube-api-access-flsbj\") pod \"must-gather-v7p5n\" (UID: \"4fbb9a13-90bb-4ebd-8c3c-21d5bc613490\") " pod="openshift-must-gather-rch42/must-gather-v7p5n"
Jul 31 22:58:16.711179 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:16.711157    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rch42/must-gather-v7p5n"
Jul 31 22:58:16.845543 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:16.845514    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rch42/must-gather-v7p5n"]
Jul 31 22:58:16.848216 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:58:16.848175    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4fbb9a13_90bb_4ebd_8c3c_21d5bc613490.slice/crio-377c334af611b59e461c3a7478a8db3940a889e80ab315e7d12ce05a7dc3b19e WatchSource:0}: Error finding container 377c334af611b59e461c3a7478a8db3940a889e80ab315e7d12ce05a7dc3b19e: Status 404 returned error can't find the container with id 377c334af611b59e461c3a7478a8db3940a889e80ab315e7d12ce05a7dc3b19e
Jul 31 22:58:16.850403 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:16.850382    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 22:58:17.391267 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:17.391203    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rch42/must-gather-v7p5n" event={"ID":"4fbb9a13-90bb-4ebd-8c3c-21d5bc613490","Type":"ContainerStarted","Data":"377c334af611b59e461c3a7478a8db3940a889e80ab315e7d12ce05a7dc3b19e"}
Jul 31 22:58:18.398267 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:18.398230    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rch42/must-gather-v7p5n" event={"ID":"4fbb9a13-90bb-4ebd-8c3c-21d5bc613490","Type":"ContainerStarted","Data":"60797e503ddc5abcad18630528d16af170b3fc0d1ee77d7dc9d2e0739e83080c"}
Jul 31 22:58:18.398267 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:18.398282    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rch42/must-gather-v7p5n" event={"ID":"4fbb9a13-90bb-4ebd-8c3c-21d5bc613490","Type":"ContainerStarted","Data":"66f7fa2d0bb8da46bbb127191529c5cb6dc8a320f540497815a3ff639c0beeec"}
Jul 31 22:58:18.418799 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:18.418746    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rch42/must-gather-v7p5n" podStartSLOduration=1.723172381 podStartE2EDuration="2.418730824s" totalImagesPullingTime="695.558443ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:58:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:58:18.416055899 +0000 UTC m=+3507.511347044" watchObservedRunningTime="2026-07-31 22:58:18.418730824 +0000 UTC m=+3507.514021970"
Jul 31 22:58:19.159460 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:19.159395    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-422sp_4fbb48e0-0e3e-4864-a018-acb5bb48e0a8/global-pull-secret-syncer/0.log"
Jul 31 22:58:19.396861 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:19.396833    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-r44dc_3b94b353-7445-4d82-8517-72dae731db0d/konnectivity-agent/0.log"
Jul 31 22:58:19.421376 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:19.421349    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-191.ec2.internal_d8d2242e12894094bb066f41e4e156aa/haproxy/0.log"
Jul 31 22:58:24.881168 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:24.880998    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-744697ddf8-n9frj_ca5506b3-5a71-491a-b47a-ab87715a6a3c/authorino/0.log"
Jul 31 22:58:24.939479 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:24.939450    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-r9ntg_e4432794-a562-4700-94ef-ba19be9eac7b/manager/0.log"
Jul 31 22:58:24.977863 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:24.977836    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-6jzb9_4e3a8daf-65c1-4830-9a80-456b21b9c59b/kuadrant-console-plugin/0.log"
Jul 31 22:58:25.183117 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:25.183086    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-t5jvz_ff26f818-97e3-4f3c-b350-a7e83857b998/manager/0.log"
Jul 31 22:58:26.949534 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:26.949503    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-m25h2_835fe2e4-9be8-46ad-a246-82edf6078d58/kube-state-metrics/0.log"
Jul 31 22:58:26.970321 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:26.970267    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-m25h2_835fe2e4-9be8-46ad-a246-82edf6078d58/kube-rbac-proxy-main/0.log"
Jul 31 22:58:27.010247 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:27.010211    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-m25h2_835fe2e4-9be8-46ad-a246-82edf6078d58/kube-rbac-proxy-self/0.log"
Jul 31 22:58:27.364928 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:27.364888    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xhrth_de085141-f4e0-48b7-8984-bb06048df425/node-exporter/0.log"
Jul 31 22:58:27.392564 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:27.392508    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xhrth_de085141-f4e0-48b7-8984-bb06048df425/kube-rbac-proxy/0.log"
Jul 31 22:58:27.426636 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:27.426554    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xhrth_de085141-f4e0-48b7-8984-bb06048df425/init-textfile/0.log"
Jul 31 22:58:27.583316 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:27.583268    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a88dbe81-c916-46e9-be56-37a95a3cd5dd/prometheus/0.log"
Jul 31 22:58:27.622368 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:27.622343    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a88dbe81-c916-46e9-be56-37a95a3cd5dd/config-reloader/0.log"
Jul 31 22:58:27.685799 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:27.685714    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a88dbe81-c916-46e9-be56-37a95a3cd5dd/thanos-sidecar/0.log"
Jul 31 22:58:27.735284 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:27.735252    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a88dbe81-c916-46e9-be56-37a95a3cd5dd/kube-rbac-proxy-web/0.log"
Jul 31 22:58:27.789818 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:27.789773    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a88dbe81-c916-46e9-be56-37a95a3cd5dd/kube-rbac-proxy/0.log"
Jul 31 22:58:27.883744 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:27.883712    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a88dbe81-c916-46e9-be56-37a95a3cd5dd/kube-rbac-proxy-thanos/0.log"
Jul 31 22:58:27.939327 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:27.939221    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a88dbe81-c916-46e9-be56-37a95a3cd5dd/init-config-reloader/0.log"
Jul 31 22:58:27.988857 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:27.988827    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-qbtzj_7939b6d7-b983-45bb-8534-4c10740b9683/prometheus-operator/0.log"
Jul 31 22:58:28.047590 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:28.047561    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-qbtzj_7939b6d7-b983-45bb-8534-4c10740b9683/kube-rbac-proxy/0.log"
Jul 31 22:58:28.762596 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:28.762563    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rch42/perf-node-gather-daemonset-8twfm"]
Jul 31 22:58:28.769945 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:28.769919    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rch42/perf-node-gather-daemonset-8twfm"
Jul 31 22:58:28.778907 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:28.778841    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rch42/perf-node-gather-daemonset-8twfm"]
Jul 31 22:58:28.866911 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:28.866873    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c2ec94d-c1eb-4178-94c8-b6b340c3bc79-sys\") pod \"perf-node-gather-daemonset-8twfm\" (UID: \"1c2ec94d-c1eb-4178-94c8-b6b340c3bc79\") " pod="openshift-must-gather-rch42/perf-node-gather-daemonset-8twfm"
Jul 31 22:58:28.867108 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:28.866938    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1c2ec94d-c1eb-4178-94c8-b6b340c3bc79-podres\") pod \"perf-node-gather-daemonset-8twfm\" (UID: \"1c2ec94d-c1eb-4178-94c8-b6b340c3bc79\") " pod="openshift-must-gather-rch42/perf-node-gather-daemonset-8twfm"
Jul 31 22:58:28.867108 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:28.866970    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpjh2\" (UniqueName: \"kubernetes.io/projected/1c2ec94d-c1eb-4178-94c8-b6b340c3bc79-kube-api-access-tpjh2\") pod \"perf-node-gather-daemonset-8twfm\" (UID: \"1c2ec94d-c1eb-4178-94c8-b6b340c3bc79\") " pod="openshift-must-gather-rch42/perf-node-gather-daemonset-8twfm"
Jul 31 22:58:28.867108 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:28.867025    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1c2ec94d-c1eb-4178-94c8-b6b340c3bc79-proc\") pod \"perf-node-gather-daemonset-8twfm\" (UID: \"1c2ec94d-c1eb-4178-94c8-b6b340c3bc79\") " pod="openshift-must-gather-rch42/perf-node-gather-daemonset-8twfm"
Jul 31 22:58:28.867108 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:28.867079    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c2ec94d-c1eb-4178-94c8-b6b340c3bc79-lib-modules\") pod \"perf-node-gather-daemonset-8twfm\" (UID: \"1c2ec94d-c1eb-4178-94c8-b6b340c3bc79\") " pod="openshift-must-gather-rch42/perf-node-gather-daemonset-8twfm"
Jul 31 22:58:28.968120 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:28.968083    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c2ec94d-c1eb-4178-94c8-b6b340c3bc79-lib-modules\") pod \"perf-node-gather-daemonset-8twfm\" (UID: \"1c2ec94d-c1eb-4178-94c8-b6b340c3bc79\") " pod="openshift-must-gather-rch42/perf-node-gather-daemonset-8twfm"
Jul 31 22:58:28.968339 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:28.968157    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c2ec94d-c1eb-4178-94c8-b6b340c3bc79-sys\") pod \"perf-node-gather-daemonset-8twfm\" (UID: \"1c2ec94d-c1eb-4178-94c8-b6b340c3bc79\") " pod="openshift-must-gather-rch42/perf-node-gather-daemonset-8twfm"
Jul 31 22:58:28.968339 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:28.968191    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1c2ec94d-c1eb-4178-94c8-b6b340c3bc79-podres\") pod \"perf-node-gather-daemonset-8twfm\" (UID: \"1c2ec94d-c1eb-4178-94c8-b6b340c3bc79\") " pod="openshift-must-gather-rch42/perf-node-gather-daemonset-8twfm"
Jul 31 22:58:28.968339 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:28.968212    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpjh2\" (UniqueName: \"kubernetes.io/projected/1c2ec94d-c1eb-4178-94c8-b6b340c3bc79-kube-api-access-tpjh2\") pod \"perf-node-gather-daemonset-8twfm\" (UID: \"1c2ec94d-c1eb-4178-94c8-b6b340c3bc79\") " pod="openshift-must-gather-rch42/perf-node-gather-daemonset-8twfm"
Jul 31 22:58:28.968339 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:28.968260    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1c2ec94d-c1eb-4178-94c8-b6b340c3bc79-proc\") pod \"perf-node-gather-daemonset-8twfm\" (UID: \"1c2ec94d-c1eb-4178-94c8-b6b340c3bc79\") " pod="openshift-must-gather-rch42/perf-node-gather-daemonset-8twfm"
Jul 31 22:58:28.968339 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:28.968283    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c2ec94d-c1eb-4178-94c8-b6b340c3bc79-sys\") pod \"perf-node-gather-daemonset-8twfm\" (UID: \"1c2ec94d-c1eb-4178-94c8-b6b340c3bc79\") " pod="openshift-must-gather-rch42/perf-node-gather-daemonset-8twfm"
Jul 31 22:58:28.968339 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:28.968293    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c2ec94d-c1eb-4178-94c8-b6b340c3bc79-lib-modules\") pod \"perf-node-gather-daemonset-8twfm\" (UID: \"1c2ec94d-c1eb-4178-94c8-b6b340c3bc79\") " pod="openshift-must-gather-rch42/perf-node-gather-daemonset-8twfm"
Jul 31 22:58:28.968661 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:28.968361    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1c2ec94d-c1eb-4178-94c8-b6b340c3bc79-proc\") pod \"perf-node-gather-daemonset-8twfm\" (UID: \"1c2ec94d-c1eb-4178-94c8-b6b340c3bc79\") " pod="openshift-must-gather-rch42/perf-node-gather-daemonset-8twfm"
Jul 31 22:58:28.968661 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:28.968361    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1c2ec94d-c1eb-4178-94c8-b6b340c3bc79-podres\") pod \"perf-node-gather-daemonset-8twfm\" (UID: \"1c2ec94d-c1eb-4178-94c8-b6b340c3bc79\") " pod="openshift-must-gather-rch42/perf-node-gather-daemonset-8twfm"
Jul 31 22:58:28.988682 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:28.988646    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpjh2\" (UniqueName: \"kubernetes.io/projected/1c2ec94d-c1eb-4178-94c8-b6b340c3bc79-kube-api-access-tpjh2\") pod \"perf-node-gather-daemonset-8twfm\" (UID: \"1c2ec94d-c1eb-4178-94c8-b6b340c3bc79\") " pod="openshift-must-gather-rch42/perf-node-gather-daemonset-8twfm"
Jul 31 22:58:29.081649 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:29.081565    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rch42/perf-node-gather-daemonset-8twfm"
Jul 31 22:58:29.264151 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:29.264058    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rch42/perf-node-gather-daemonset-8twfm"]
Jul 31 22:58:29.268017 ip-10-0-130-191 kubenswrapper[2573]: W0731 22:58:29.267824    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1c2ec94d_c1eb_4178_94c8_b6b340c3bc79.slice/crio-9927802a2bec7c32f48da6722f4d818af4967ed0d010ca5c80a47556dfef2c9d WatchSource:0}: Error finding container 9927802a2bec7c32f48da6722f4d818af4967ed0d010ca5c80a47556dfef2c9d: Status 404 returned error can't find the container with id 9927802a2bec7c32f48da6722f4d818af4967ed0d010ca5c80a47556dfef2c9d
Jul 31 22:58:29.482369 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:29.482332    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rch42/perf-node-gather-daemonset-8twfm" event={"ID":"1c2ec94d-c1eb-4178-94c8-b6b340c3bc79","Type":"ContainerStarted","Data":"0ec10b99637a68efb147c0da79df797d039dd7cf7f2f237b4dc78ddcc6733359"}
Jul 31 22:58:29.482561 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:29.482408    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rch42/perf-node-gather-daemonset-8twfm" event={"ID":"1c2ec94d-c1eb-4178-94c8-b6b340c3bc79","Type":"ContainerStarted","Data":"9927802a2bec7c32f48da6722f4d818af4967ed0d010ca5c80a47556dfef2c9d"}
Jul 31 22:58:29.482561 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:29.482469    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rch42/perf-node-gather-daemonset-8twfm"
Jul 31 22:58:29.506002 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:29.505942    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rch42/perf-node-gather-daemonset-8twfm" podStartSLOduration=1.505925927 podStartE2EDuration="1.505925927s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 22:58:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:58:29.503755593 +0000 UTC m=+3518.599046741" watchObservedRunningTime="2026-07-31 22:58:29.505925927 +0000 UTC m=+3518.601217072"
Jul 31 22:58:30.850600 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:30.850563    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7c796bbf97-5mxxq_11f29361-5a98-40d8-b399-fde5bf3c294e/console/0.log"
Jul 31 22:58:32.670687 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:32.670655    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bdmbh_cc043b76-8ded-42e8-b6b1-98cf73ac6303/dns/0.log"
Jul 31 22:58:32.696449 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:32.696425    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bdmbh_cc043b76-8ded-42e8-b6b1-98cf73ac6303/kube-rbac-proxy/0.log"
Jul 31 22:58:32.829936 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:32.829905    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s4gbt_16745241-a6b7-41c6-9c97-176962591677/dns-node-resolver/0.log"
Jul 31 22:58:33.461870 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:33.461836    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-8854b8786-5mz8k_65d82f87-e385-44d0-ae72-38856f99b680/registry/0.log"
Jul 31 22:58:33.524478 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:33.524451    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fv879_085556af-0fc0-4c79-9f9c-ca71dc96dcfc/node-ca/0.log"
Jul 31 22:58:34.880817 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:34.880789    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c56dfbf59-9vjlz_0b0abd6f-4fd6-4507-8122-18555489341a/kube-auth-proxy/0.log"
Jul 31 22:58:35.500372 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:35.500343    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rch42/perf-node-gather-daemonset-8twfm"
Jul 31 22:58:35.880762 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:35.880688    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jfgw6_86970815-e08d-4724-a775-9dce7783c699/serve-healthcheck-canary/0.log"
Jul 31 22:58:36.489813 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:36.489780    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r5bwg_4db250ca-5c14-4b35-b230-2bf6dd980dac/kube-rbac-proxy/0.log"
Jul 31 22:58:36.515886 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:36.515864    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r5bwg_4db250ca-5c14-4b35-b230-2bf6dd980dac/exporter/0.log"
Jul 31 22:58:36.539322 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:36.539283    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r5bwg_4db250ca-5c14-4b35-b230-2bf6dd980dac/extractor/0.log"
Jul 31 22:58:39.639006 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:39.638973    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c56dfbf59-9vjlz_0b0abd6f-4fd6-4507-8122-18555489341a/kube-auth-proxy/0.log"
Jul 31 22:58:39.913593 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:39.913513    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79bdc6db47-pcb8j_9a15bb41-44e8-4b01-b6a6-074fae8016ff/manager/0.log"
Jul 31 22:58:39.948272 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:39.948221    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79bdc6db47-pcb8j_9a15bb41-44e8-4b01-b6a6-074fae8016ff/copy-manifests/0.log"
Jul 31 22:58:41.336195 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:41.336149    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5587bd887b-jtdvw_9a49c172-dced-4faf-ada5-c50bded18d89/manager/0.log"
Jul 31 22:58:41.364393 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:41.364360    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-7tz7n_30f5af08-d570-4886-a8f4-c55ee22231dd/openshift-lws-operator/0.log"
Jul 31 22:58:41.407821 ip-10-0-130-191 kubenswrapper[2573]: I0731 22:58:41.407791    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c56dfbf59-9vjlz_0b0abd6f-4fd6-4507-8122-18555489341a/kube-auth-proxy/0.log"