Aug 05 17:31:02.349583 ip-10-0-129-136 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Aug 05 17:31:02.349593 ip-10-0-129-136 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Aug 05 17:31:02.349600 ip-10-0-129-136 systemd[1]: kubelet.service: Failed with result 'resources'.
Aug 05 17:31:02.349856 ip-10-0-129-136 systemd[1]: Failed to start Kubernetes Kubelet.
Aug 05 17:31:12.584967 ip-10-0-129-136 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Aug 05 17:31:12.584982 ip-10-0-129-136 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot f2b2ffd8ffb84a6b8776b670d48aad6e --
Aug 05 17:32:53.541520 ip-10-0-129-136 systemd[1]: Starting Kubernetes Kubelet...
Aug 05 17:32:54.014239 ip-10-0-129-136 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 05 17:32:54.014239 ip-10-0-129-136 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Aug 05 17:32:54.014239 ip-10-0-129-136 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 05 17:32:54.014239 ip-10-0-129-136 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Aug 05 17:32:54.014982 ip-10-0-129-136 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 05 17:32:54.015402 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.015258    2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Aug 05 17:32:54.021659 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021638    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 17:32:54.021659 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021659    2558 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 17:32:54.021747 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021663    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 17:32:54.021747 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021667    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 17:32:54.021747 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021670    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 17:32:54.021747 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021674    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 17:32:54.021747 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021677    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 17:32:54.021747 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021686    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 17:32:54.021747 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021690    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 17:32:54.021747 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021694    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 17:32:54.021747 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021699    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 17:32:54.021747 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021702    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 17:32:54.021747 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021705    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 17:32:54.021747 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021708    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 17:32:54.021747 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021710    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 17:32:54.021747 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021713    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 17:32:54.021747 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021716    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 17:32:54.021747 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021718    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 17:32:54.021747 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021721    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 17:32:54.021747 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021724    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 17:32:54.021747 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021727    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 17:32:54.021747 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021729    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 17:32:54.022237 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021732    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 17:32:54.022237 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021736    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 17:32:54.022237 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021738    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 17:32:54.022237 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021741    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 17:32:54.022237 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021744    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 17:32:54.022237 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021746    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 17:32:54.022237 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021748    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 17:32:54.022237 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021751    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 17:32:54.022237 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021754    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 17:32:54.022237 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021758    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 17:32:54.022237 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021761    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 17:32:54.022237 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021763    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 17:32:54.022237 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021766    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 17:32:54.022237 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021768    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 17:32:54.022237 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021771    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 17:32:54.022237 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021774    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 17:32:54.022237 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021776    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 17:32:54.022237 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021779    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 17:32:54.022237 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021781    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 17:32:54.022699 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021786    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 17:32:54.022699 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021789    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 17:32:54.022699 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021792    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 17:32:54.022699 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021794    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 17:32:54.022699 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021797    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 17:32:54.022699 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021800    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 17:32:54.022699 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021803    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 17:32:54.022699 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021806    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 17:32:54.022699 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021809    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 17:32:54.022699 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021813    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 17:32:54.022699 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021815    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 17:32:54.022699 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021818    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 17:32:54.022699 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021821    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 17:32:54.022699 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021823    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 17:32:54.022699 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021827    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 17:32:54.022699 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021830    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 17:32:54.022699 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021832    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 17:32:54.022699 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021835    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 17:32:54.022699 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021838    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 17:32:54.023174 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021841    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 17:32:54.023174 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021843    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 17:32:54.023174 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021849    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 17:32:54.023174 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021852    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 17:32:54.023174 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021855    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 17:32:54.023174 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021859    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 17:32:54.023174 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021861    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 17:32:54.023174 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021864    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 17:32:54.023174 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021866    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 17:32:54.023174 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021869    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 17:32:54.023174 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021871    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 17:32:54.023174 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021873    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 17:32:54.023174 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021876    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 17:32:54.023174 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021878    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 17:32:54.023174 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021881    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 17:32:54.023174 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021883    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 17:32:54.023174 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021886    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 17:32:54.023174 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021888    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 17:32:54.023174 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021891    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 17:32:54.023174 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021893    2558 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 17:32:54.023688 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021896    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 17:32:54.023688 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021899    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 17:32:54.023688 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021901    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 17:32:54.023688 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021904    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 17:32:54.023688 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021906    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 17:32:54.023688 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021909    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 17:32:54.023688 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021911    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 17:32:54.023688 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021915    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 17:32:54.023688 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021917    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 17:32:54.023688 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021920    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 17:32:54.023688 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021922    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 17:32:54.023688 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021925    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 17:32:54.023688 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021927    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 17:32:54.023688 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021930    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 17:32:54.023688 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021932    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 17:32:54.023688 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021935    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 17:32:54.023688 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021938    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 17:32:54.023688 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021940    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 17:32:54.023688 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.021942    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 17:32:54.023688 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022706    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 17:32:54.024210 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022713    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 17:32:54.024210 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022716    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 17:32:54.024210 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022719    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 17:32:54.024210 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022722    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 17:32:54.024210 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022724    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 17:32:54.024210 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022727    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 17:32:54.024210 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022730    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 17:32:54.024210 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022732    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 17:32:54.024210 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022735    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 17:32:54.024210 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022739    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 17:32:54.024210 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022743    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 17:32:54.024210 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022746    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 17:32:54.024210 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022749    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 17:32:54.024210 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022751    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 17:32:54.024210 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022754    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 17:32:54.024210 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022756    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 17:32:54.024210 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022759    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 17:32:54.024210 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022762    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 17:32:54.024210 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022764    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 17:32:54.024723 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022767    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 17:32:54.024723 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022769    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 17:32:54.024723 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022772    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 17:32:54.024723 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022774    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 17:32:54.024723 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022777    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 17:32:54.024723 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022780    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 17:32:54.024723 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022783    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 17:32:54.024723 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022785    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 17:32:54.024723 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022788    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 17:32:54.024723 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022790    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 17:32:54.024723 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022793    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 17:32:54.024723 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022795    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 17:32:54.024723 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022798    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 17:32:54.024723 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022800    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 17:32:54.024723 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022803    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 17:32:54.024723 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022805    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 17:32:54.024723 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022808    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 17:32:54.024723 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022810    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 17:32:54.024723 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022813    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 17:32:54.024723 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022815    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 17:32:54.025335 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022827    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 17:32:54.025335 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022830    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 17:32:54.025335 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022833    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 17:32:54.025335 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022836    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 17:32:54.025335 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022839    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 17:32:54.025335 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022841    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 17:32:54.025335 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022845    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 17:32:54.025335 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022848    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 17:32:54.025335 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022851    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 17:32:54.025335 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022853    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 17:32:54.025335 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022856    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 17:32:54.025335 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022858    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 17:32:54.025335 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022861    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 17:32:54.025335 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022863    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 17:32:54.025335 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022866    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 17:32:54.025335 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022868    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 17:32:54.025335 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022871    2558 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 17:32:54.025335 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022873    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 17:32:54.025335 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022876    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 17:32:54.025335 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022878    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 17:32:54.025824 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022881    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 17:32:54.025824 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022883    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 17:32:54.025824 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022886    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 17:32:54.025824 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022889    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 17:32:54.025824 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022891    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 17:32:54.025824 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022894    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 17:32:54.025824 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022896    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 17:32:54.025824 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022899    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 17:32:54.025824 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022901    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 17:32:54.025824 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022904    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 17:32:54.025824 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022906    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 17:32:54.025824 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022909    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 17:32:54.025824 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022911    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 17:32:54.025824 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022914    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 17:32:54.025824 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022916    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 17:32:54.025824 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022920    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 17:32:54.025824 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022926    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 17:32:54.025824 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022932    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 17:32:54.025824 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022935    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 17:32:54.026298 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022938    2558 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 17:32:54.026298 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022941    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 17:32:54.026298 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022944    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 17:32:54.026298 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022947    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 17:32:54.026298 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022949    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 17:32:54.026298 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022951    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 17:32:54.026298 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022954    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 17:32:54.026298 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022956    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 17:32:54.026298 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022959    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 17:32:54.026298 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022961    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 17:32:54.026298 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022964    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 17:32:54.026298 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022966    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 17:32:54.026298 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022969    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 17:32:54.026298 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022972    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 17:32:54.026298 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022975    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 17:32:54.026298 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022977    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 17:32:54.026298 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022980    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 17:32:54.026298 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022983    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 17:32:54.026298 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022985    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 17:32:54.026298 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.022988    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 17:32:54.026803 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023385    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 17:32:54.026803 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023390    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 17:32:54.026803 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023393    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 17:32:54.026803 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023395    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 17:32:54.026803 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023401    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 17:32:54.026803 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023404    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 17:32:54.026803 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023407    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 17:32:54.026803 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023409    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 17:32:54.026803 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023412    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 17:32:54.026803 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023415    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 17:32:54.026803 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023418    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 17:32:54.026803 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023420    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 17:32:54.026803 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023423    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 17:32:54.026803 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023426    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 17:32:54.026803 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023429    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 17:32:54.026803 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023431    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 17:32:54.026803 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023434    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 17:32:54.026803 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023436    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 17:32:54.026803 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023439    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 17:32:54.026803 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023441    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 17:32:54.027319 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023444    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 17:32:54.027319 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023447    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 17:32:54.027319 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023449    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 17:32:54.027319 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023452    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 17:32:54.027319 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023454    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 17:32:54.027319 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023457    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 17:32:54.027319 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023459    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 17:32:54.027319 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023462    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 17:32:54.027319 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023465    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 17:32:54.027319 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023467    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 17:32:54.027319 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023470    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 17:32:54.027319 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023473    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 17:32:54.027319 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023475    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 17:32:54.027319 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023478    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 17:32:54.027319 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023480    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 17:32:54.027319 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023483    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 17:32:54.027319 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023487    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 17:32:54.027319 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023490    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 17:32:54.027319 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023492    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 17:32:54.027319 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023495    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 17:32:54.027825 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023497    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 17:32:54.027825 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023500    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 17:32:54.027825 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023503    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 17:32:54.027825 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023505    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 17:32:54.027825 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023508    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 17:32:54.027825 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023510    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 17:32:54.027825 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023513    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 17:32:54.027825 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023516    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 17:32:54.027825 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023518    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 17:32:54.027825 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023521    2558 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 17:32:54.027825 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023524    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 17:32:54.027825 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023527    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 17:32:54.027825 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023530    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 17:32:54.027825 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023532    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 17:32:54.027825 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023535    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 17:32:54.027825 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023537    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 17:32:54.027825 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023541    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 17:32:54.027825 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023544    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 17:32:54.027825 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023548    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 17:32:54.028315 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023551    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 17:32:54.028315 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023553    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 17:32:54.028315 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023557    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 17:32:54.028315 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023559    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 17:32:54.028315 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023562    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 17:32:54.028315 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023564    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 17:32:54.028315 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023567    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 17:32:54.028315 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023569    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 17:32:54.028315 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023572    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 17:32:54.028315 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023575    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 17:32:54.028315 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023578    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 17:32:54.028315 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023580    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 17:32:54.028315 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023583    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 17:32:54.028315 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023585    2558 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 17:32:54.028315 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023588    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 17:32:54.028315 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023591    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 17:32:54.028315 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023593    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 17:32:54.028315 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023596    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 17:32:54.028315 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023598    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 17:32:54.028315 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023601    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 17:32:54.028811 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023603    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 17:32:54.028811 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023606    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 17:32:54.028811 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023608    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 17:32:54.028811 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023611    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 17:32:54.028811 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023614    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 17:32:54.028811 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023616    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 17:32:54.028811 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023618    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 17:32:54.028811 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023621    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 17:32:54.028811 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023623    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 17:32:54.028811 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023626    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 17:32:54.028811 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023631    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 17:32:54.028811 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023634    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 17:32:54.028811 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023637    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 17:32:54.028811 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023640    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 17:32:54.028811 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023643    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 17:32:54.028811 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023646    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 17:32:54.028811 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023648    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 17:32:54.028811 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023650    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 17:32:54.028811 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023653    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 17:32:54.029329 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.023656    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 17:32:54.029329 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023739    2558 flags.go:64] FLAG: --address="0.0.0.0"
Aug 05 17:32:54.029329 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023748    2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Aug 05 17:32:54.029329 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023757    2558 flags.go:64] FLAG: --anonymous-auth="true"
Aug 05 17:32:54.029329 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023764    2558 flags.go:64] FLAG: --application-metrics-count-limit="100"
Aug 05 17:32:54.029329 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023771    2558 flags.go:64] FLAG: --authentication-token-webhook="false"
Aug 05 17:32:54.029329 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023776    2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Aug 05 17:32:54.029329 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023782    2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Aug 05 17:32:54.029329 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023789    2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Aug 05 17:32:54.029329 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023793    2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Aug 05 17:32:54.029329 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023796    2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Aug 05 17:32:54.029329 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023800    2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Aug 05 17:32:54.029329 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023803    2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Aug 05 17:32:54.029329 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023806    2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Aug 05 17:32:54.029329 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023809    2558 flags.go:64] FLAG: --cgroup-root=""
Aug 05 17:32:54.029329 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023812    2558 flags.go:64] FLAG: --cgroups-per-qos="true"
Aug 05 17:32:54.029329 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023815    2558 flags.go:64] FLAG: --client-ca-file=""
Aug 05 17:32:54.029329 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023818    2558 flags.go:64] FLAG: --cloud-provider="external"
Aug 05 17:32:54.029329 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023821    2558 flags.go:64] FLAG: --cluster-dns="[]"
Aug 05 17:32:54.029329 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023825    2558 flags.go:64] FLAG: --cluster-domain=""
Aug 05 17:32:54.029329 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023828    2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Aug 05 17:32:54.029329 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023831    2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Aug 05 17:32:54.029329 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023834    2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Aug 05 17:32:54.029888 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023837    2558 flags.go:64] FLAG: --container-log-max-files="5"
Aug 05 17:32:54.029888 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023841    2558 flags.go:64] FLAG: --container-log-max-size="10Mi"
Aug 05 17:32:54.029888 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023844    2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Aug 05 17:32:54.029888 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023847    2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Aug 05 17:32:54.029888 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023850    2558 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Aug 05 17:32:54.029888 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023853    2558 flags.go:64] FLAG: --contention-profiling="false"
Aug 05 17:32:54.029888 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023857    2558 flags.go:64] FLAG: --cpu-cfs-quota="true"
Aug 05 17:32:54.029888 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023861    2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Aug 05 17:32:54.029888 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023864    2558 flags.go:64] FLAG: --cpu-manager-policy="none"
Aug 05 17:32:54.029888 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023867    2558 flags.go:64] FLAG: --cpu-manager-policy-options=""
Aug 05 17:32:54.029888 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023873    2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Aug 05 17:32:54.029888 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023877    2558 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Aug 05 17:32:54.029888 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023880    2558 flags.go:64] FLAG: --enable-debugging-handlers="true"
Aug 05 17:32:54.029888 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023883    2558 flags.go:64] FLAG: --enable-load-reader="false"
Aug 05 17:32:54.029888 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023886    2558 flags.go:64] FLAG: --enable-server="true"
Aug 05 17:32:54.029888 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023889    2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Aug 05 17:32:54.029888 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023894    2558 flags.go:64] FLAG: --event-burst="100"
Aug 05 17:32:54.029888 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023897    2558 flags.go:64] FLAG: --event-qps="50"
Aug 05 17:32:54.029888 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023900    2558 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Aug 05 17:32:54.029888 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023903    2558 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Aug 05 17:32:54.029888 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023906    2558 flags.go:64] FLAG: --eviction-hard=""
Aug 05 17:32:54.029888 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023910    2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Aug 05 17:32:54.029888 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023913    2558 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Aug 05 17:32:54.029888 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023916    2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Aug 05 17:32:54.029888 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023919    2558 flags.go:64] FLAG: --eviction-soft=""
Aug 05 17:32:54.030494 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023922    2558 flags.go:64] FLAG: --eviction-soft-grace-period=""
Aug 05 17:32:54.030494 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023924    2558 flags.go:64] FLAG: --exit-on-lock-contention="false"
Aug 05 17:32:54.030494 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023927    2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Aug 05 17:32:54.030494 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023930    2558 flags.go:64] FLAG: --experimental-mounter-path=""
Aug 05 17:32:54.030494 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023933    2558 flags.go:64] FLAG: --fail-cgroupv1="false"
Aug 05 17:32:54.030494 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023935    2558 flags.go:64] FLAG: --fail-swap-on="true"
Aug 05 17:32:54.030494 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023938    2558 flags.go:64] FLAG: --feature-gates=""
Aug 05 17:32:54.030494 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023942    2558 flags.go:64] FLAG: --file-check-frequency="20s"
Aug 05 17:32:54.030494 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023944    2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Aug 05 17:32:54.030494 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023948    2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Aug 05 17:32:54.030494 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023951    2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Aug 05 17:32:54.030494 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023954    2558 flags.go:64] FLAG: --healthz-port="10248"
Aug 05 17:32:54.030494 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023956    2558 flags.go:64] FLAG: --help="false"
Aug 05 17:32:54.030494 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023959    2558 flags.go:64] FLAG: --hostname-override="ip-10-0-129-136.ec2.internal"
Aug 05 17:32:54.030494 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023963    2558 flags.go:64] FLAG: --housekeeping-interval="10s"
Aug 05 17:32:54.030494 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023966    2558 flags.go:64] FLAG: --http-check-frequency="20s"
Aug 05 17:32:54.030494 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023968    2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Aug 05 17:32:54.030494 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023973    2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Aug 05 17:32:54.030494 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023977    2558 flags.go:64] FLAG: --image-gc-high-threshold="85"
Aug 05 17:32:54.030494 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023980    2558 flags.go:64] FLAG: --image-gc-low-threshold="80"
Aug 05 17:32:54.030494 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023982    2558 flags.go:64] FLAG: --image-service-endpoint=""
Aug 05 17:32:54.030494 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023985    2558 flags.go:64] FLAG: --kernel-memcg-notification="false"
Aug 05 17:32:54.030494 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023988    2558 flags.go:64] FLAG: --kube-api-burst="100"
Aug 05 17:32:54.031133 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023991    2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Aug 05 17:32:54.031133 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023994    2558 flags.go:64] FLAG: --kube-api-qps="50"
Aug 05 17:32:54.031133 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023997    2558 flags.go:64] FLAG: --kube-reserved=""
Aug 05 17:32:54.031133 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.023999    2558 flags.go:64] FLAG: --kube-reserved-cgroup=""
Aug 05 17:32:54.031133 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024002    2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Aug 05 17:32:54.031133 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024005    2558 flags.go:64] FLAG: --kubelet-cgroups=""
Aug 05 17:32:54.031133 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024008    2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Aug 05 17:32:54.031133 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024011    2558 flags.go:64] FLAG: --lock-file=""
Aug 05 17:32:54.031133 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024014    2558 flags.go:64] FLAG: --log-cadvisor-usage="false"
Aug 05 17:32:54.031133 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024017    2558 flags.go:64] FLAG: --log-flush-frequency="5s"
Aug 05 17:32:54.031133 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024020    2558 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Aug 05 17:32:54.031133 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024025    2558 flags.go:64] FLAG: --log-json-split-stream="false"
Aug 05 17:32:54.031133 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024027    2558 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Aug 05 17:32:54.031133 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024030    2558 flags.go:64] FLAG: --log-text-split-stream="false"
Aug 05 17:32:54.031133 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024033    2558 flags.go:64] FLAG: --logging-format="text"
Aug 05 17:32:54.031133 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024035    2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Aug 05 17:32:54.031133 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024039    2558 flags.go:64] FLAG: --make-iptables-util-chains="true"
Aug 05 17:32:54.031133 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024041    2558 flags.go:64] FLAG: --manifest-url=""
Aug 05 17:32:54.031133 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024044    2558 flags.go:64] FLAG: --manifest-url-header=""
Aug 05 17:32:54.031133 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024048    2558 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Aug 05 17:32:54.031133 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024051    2558 flags.go:64] FLAG: --max-open-files="1000000"
Aug 05 17:32:54.031133 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024055    2558 flags.go:64] FLAG: --max-pods="110"
Aug 05 17:32:54.031133 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024058    2558 flags.go:64] FLAG: --maximum-dead-containers="-1"
Aug 05 17:32:54.031133 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024061    2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Aug 05 17:32:54.031133 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024064    2558 flags.go:64] FLAG: --memory-manager-policy="None"
Aug 05 17:32:54.031780 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024067    2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Aug 05 17:32:54.031780 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024072    2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Aug 05 17:32:54.031780 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024076    2558 flags.go:64] FLAG: --node-ip="0.0.0.0"
Aug 05 17:32:54.031780 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024079    2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Aug 05 17:32:54.031780 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024087    2558 flags.go:64] FLAG: --node-status-max-images="50"
Aug 05 17:32:54.031780 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024090    2558 flags.go:64] FLAG: --node-status-update-frequency="10s"
Aug 05 17:32:54.031780 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024093    2558 flags.go:64] FLAG: --oom-score-adj="-999"
Aug 05 17:32:54.031780 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024096    2558 flags.go:64] FLAG: --pod-cidr=""
Aug 05 17:32:54.031780 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024099    2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Aug 05 17:32:54.031780 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024105    2558 flags.go:64] FLAG: --pod-manifest-path=""
Aug 05 17:32:54.031780 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024108    2558 flags.go:64] FLAG: --pod-max-pids="-1"
Aug 05 17:32:54.031780 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024111    2558 flags.go:64] FLAG: --pods-per-core="0"
Aug 05 17:32:54.031780 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024114    2558 flags.go:64] FLAG: --port="10250"
Aug 05 17:32:54.031780 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024117    2558 flags.go:64] FLAG: --protect-kernel-defaults="false"
Aug 05 17:32:54.031780 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024120    2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03c6cbf6bb4501158"
Aug 05 17:32:54.031780 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024123    2558 flags.go:64] FLAG: --qos-reserved=""
Aug 05 17:32:54.031780 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024127    2558 flags.go:64] FLAG: --read-only-port="10255"
Aug 05 17:32:54.031780 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024130    2558 flags.go:64] FLAG: --register-node="true"
Aug 05 17:32:54.031780 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024132    2558 flags.go:64] FLAG: --register-with-taints=""
Aug 05 17:32:54.031780 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024136    2558 flags.go:64] FLAG: --registry-burst="10"
Aug 05 17:32:54.031780 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024139    2558 flags.go:64] FLAG: --registry-qps="5"
Aug 05 17:32:54.031780 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024142    2558 flags.go:64] FLAG: --reserved-cpus=""
Aug 05 17:32:54.031780 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024144    2558 flags.go:64] FLAG: --reserved-memory=""
Aug 05 17:32:54.031780 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024148    2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Aug 05 17:32:54.031780 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024151    2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Aug 05 17:32:54.032411 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024154    2558 flags.go:64] FLAG: --rotate-certificates="false"
Aug 05 17:32:54.032411 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024156    2558 flags.go:64] FLAG: --rotate-server-certificates="false"
Aug 05 17:32:54.032411 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024159    2558 flags.go:64] FLAG: --runonce="false"
Aug 05 17:32:54.032411 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024161    2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Aug 05 17:32:54.032411 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024164    2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Aug 05 17:32:54.032411 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024168    2558 flags.go:64] FLAG: --seccomp-default="false"
Aug 05 17:32:54.032411 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024170    2558 flags.go:64] FLAG: --serialize-image-pulls="true"
Aug 05 17:32:54.032411 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024173    2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Aug 05 17:32:54.032411 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024180    2558 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Aug 05 17:32:54.032411 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024183    2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Aug 05 17:32:54.032411 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024187    2558 flags.go:64] FLAG: --storage-driver-password="root"
Aug 05 17:32:54.032411 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024190    2558 flags.go:64] FLAG: --storage-driver-secure="false"
Aug 05 17:32:54.032411 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024193    2558 flags.go:64] FLAG: --storage-driver-table="stats"
Aug 05 17:32:54.032411 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024196    2558 flags.go:64] FLAG: --storage-driver-user="root"
Aug 05 17:32:54.032411 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024198    2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Aug 05 17:32:54.032411 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024201    2558 flags.go:64] FLAG: --sync-frequency="1m0s"
Aug 05 17:32:54.032411 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024204    2558 flags.go:64] FLAG: --system-cgroups=""
Aug 05 17:32:54.032411 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024206    2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Aug 05 17:32:54.032411 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024212    2558 flags.go:64] FLAG: --system-reserved-cgroup=""
Aug 05 17:32:54.032411 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024215    2558 flags.go:64] FLAG: --tls-cert-file=""
Aug 05 17:32:54.032411 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024231    2558 flags.go:64] FLAG: --tls-cipher-suites="[]"
Aug 05 17:32:54.032411 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024236    2558 flags.go:64] FLAG: --tls-min-version=""
Aug 05 17:32:54.032411 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024238    2558 flags.go:64] FLAG: --tls-private-key-file=""
Aug 05 17:32:54.032411 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024241    2558 flags.go:64] FLAG: --topology-manager-policy="none"
Aug 05 17:32:54.032411 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024244    2558 flags.go:64] FLAG: --topology-manager-policy-options=""
Aug 05 17:32:54.033113 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024247    2558 flags.go:64] FLAG: --topology-manager-scope="container"
Aug 05 17:32:54.033113 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024250    2558 flags.go:64] FLAG: --v="2"
Aug 05 17:32:54.033113 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024254    2558 flags.go:64] FLAG: --version="false"
Aug 05 17:32:54.033113 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024258    2558 flags.go:64] FLAG: --vmodule=""
Aug 05 17:32:54.033113 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024262    2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Aug 05 17:32:54.033113 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.024265    2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Aug 05 17:32:54.033113 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024389    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 17:32:54.033113 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024394    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 17:32:54.033113 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024397    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 17:32:54.033113 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024400    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 17:32:54.033113 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024403    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 17:32:54.033113 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024405    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 17:32:54.033113 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024408    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 17:32:54.033113 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024411    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 17:32:54.033113 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024414    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 17:32:54.033113 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024421    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 17:32:54.033113 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024424    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 17:32:54.033113 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024429    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 17:32:54.033113 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024431    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 17:32:54.033113 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024435    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 17:32:54.033113 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024437    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 17:32:54.034046 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024440    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 17:32:54.034046 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024443    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 17:32:54.034046 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024445    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 17:32:54.034046 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024448    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 17:32:54.034046 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024451    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 17:32:54.034046 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024453    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 17:32:54.034046 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024456    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 17:32:54.034046 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024458    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 17:32:54.034046 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024461    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 17:32:54.034046 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024463    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 17:32:54.034046 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024466    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 17:32:54.034046 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024470    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 17:32:54.034046 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024474    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 17:32:54.034046 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024477    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 17:32:54.034046 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024479    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 17:32:54.034046 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024482    2558 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 17:32:54.034046 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024484    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 17:32:54.034046 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024487    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 17:32:54.034046 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024489    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 17:32:54.034046 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024492    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 17:32:54.034630 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024495    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 17:32:54.034630 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024497    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 17:32:54.034630 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024500    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 17:32:54.034630 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024502    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 17:32:54.034630 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024505    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 17:32:54.034630 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024508    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 17:32:54.034630 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024511    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 17:32:54.034630 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024514    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 17:32:54.034630 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024517    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 17:32:54.034630 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024520    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 17:32:54.034630 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024523    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 17:32:54.034630 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024525    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 17:32:54.034630 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024529    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 17:32:54.034630 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024533    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 17:32:54.034630 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024536    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 17:32:54.034630 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024539    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 17:32:54.034630 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024542    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 17:32:54.034630 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024545    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 17:32:54.034630 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024549    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 17:32:54.035121 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024551    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 17:32:54.035121 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024554    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 17:32:54.035121 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024556    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 17:32:54.035121 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024559    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 17:32:54.035121 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024562    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 17:32:54.035121 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024564    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 17:32:54.035121 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024566    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 17:32:54.035121 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024569    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 17:32:54.035121 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024571    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 17:32:54.035121 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024574    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 17:32:54.035121 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024576    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 17:32:54.035121 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024579    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 17:32:54.035121 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024581    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 17:32:54.035121 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024584    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 17:32:54.035121 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024587    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 17:32:54.035121 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024589    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 17:32:54.035121 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024591    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 17:32:54.035121 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024594    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 17:32:54.035121 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024596    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 17:32:54.035121 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024599    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 17:32:54.035625 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024601    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 17:32:54.035625 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024605    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 17:32:54.035625 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024608    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 17:32:54.035625 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024611    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 17:32:54.035625 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024613    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 17:32:54.035625 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024615    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 17:32:54.035625 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024618    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 17:32:54.035625 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024621    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 17:32:54.035625 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024624    2558 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 17:32:54.035625 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024626    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 17:32:54.035625 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024629    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 17:32:54.035625 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024631    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 17:32:54.035625 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024634    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 17:32:54.035625 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024636    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 17:32:54.035625 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024639    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 17:32:54.035625 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024641    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 17:32:54.035625 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024643    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 17:32:54.035625 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024647    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 17:32:54.035625 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024651    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 17:32:54.035625 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024654    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 17:32:54.036115 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024656    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 17:32:54.036115 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024659    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 17:32:54.036115 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024661    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 17:32:54.036115 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024664    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 17:32:54.036115 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.024666    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 17:32:54.036115 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.025479    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 05 17:32:54.036115 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.034628    2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Aug 05 17:32:54.036115 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.034650    2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Aug 05 17:32:54.036115 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.035473    2558 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Aug 05 17:32:54.036115 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.035486    2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Aug 05 17:32:54.036115 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035554    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 17:32:54.036115 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035560    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 17:32:54.036115 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035564    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 17:32:54.036115 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035567    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 17:32:54.036495 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035570    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 17:32:54.036495 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035572    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 17:32:54.036495 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035577    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 17:32:54.036495 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035581    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 17:32:54.036495 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035585    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 17:32:54.036495 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035588    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 17:32:54.036495 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035591    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 17:32:54.036495 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035594    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 17:32:54.036495 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035597    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 17:32:54.036495 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035600    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 17:32:54.036495 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035602    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 17:32:54.036495 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035605    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 17:32:54.036495 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035607    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 17:32:54.036495 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035610    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 17:32:54.036495 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035612    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 17:32:54.036495 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035615    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 17:32:54.036495 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035618    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 17:32:54.036495 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035621    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 17:32:54.036495 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035623    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 17:32:54.036990 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035626    2558 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 17:32:54.036990 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035634    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 17:32:54.036990 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035636    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 17:32:54.036990 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035639    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 17:32:54.036990 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035642    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 17:32:54.036990 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035645    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 17:32:54.036990 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035648    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 17:32:54.036990 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035651    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 17:32:54.036990 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035654    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 17:32:54.036990 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035656    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 17:32:54.036990 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035659    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 17:32:54.036990 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035661    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 17:32:54.036990 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035664    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 17:32:54.036990 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035667    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 17:32:54.036990 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035669    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 17:32:54.036990 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035672    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 17:32:54.036990 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035674    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 17:32:54.036990 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035677    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 17:32:54.036990 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035679    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 17:32:54.036990 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035682    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 17:32:54.037508 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035684    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 17:32:54.037508 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035687    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 17:32:54.037508 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035689    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 17:32:54.037508 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035692    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 17:32:54.037508 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035695    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 17:32:54.037508 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035697    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 17:32:54.037508 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035700    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 17:32:54.037508 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035702    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 17:32:54.037508 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035705    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 17:32:54.037508 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035709    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 17:32:54.037508 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035713    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 17:32:54.037508 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035716    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 17:32:54.037508 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035718    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 17:32:54.037508 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035721    2558 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 17:32:54.037508 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035723    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 17:32:54.037508 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035726    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 17:32:54.037508 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035729    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 17:32:54.037508 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035732    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 17:32:54.037508 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035735    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 17:32:54.037508 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035738    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 17:32:54.037990 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035740    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 17:32:54.037990 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035743    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 17:32:54.037990 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035745    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 17:32:54.037990 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035749    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 17:32:54.037990 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035752    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 17:32:54.037990 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035755    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 17:32:54.037990 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035758    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 17:32:54.037990 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035761    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 17:32:54.037990 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035763    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 17:32:54.037990 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035766    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 17:32:54.037990 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035769    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 17:32:54.037990 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035771    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 17:32:54.037990 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035773    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 17:32:54.037990 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035776    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 17:32:54.037990 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035779    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 17:32:54.037990 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035782    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 17:32:54.037990 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035785    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 17:32:54.037990 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035788    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 17:32:54.037990 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035791    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 17:32:54.038460 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035793    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 17:32:54.038460 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035796    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 17:32:54.038460 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035798    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 17:32:54.038460 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035800    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 17:32:54.038460 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035803    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 17:32:54.038460 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035805    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 17:32:54.038460 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035808    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 17:32:54.038460 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035810    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 17:32:54.038460 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035813    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 17:32:54.038460 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035815    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 17:32:54.038460 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035818    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 17:32:54.038460 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035821    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 17:32:54.038460 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035824    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 17:32:54.038460 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035827    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 17:32:54.038460 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035829    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 17:32:54.038460 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035832    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 17:32:54.038460 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035835    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 17:32:54.038885 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.035841    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 05 17:32:54.038885 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035960    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 17:32:54.038885 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035966    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 17:32:54.038885 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035969    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 17:32:54.038885 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035972    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 17:32:54.038885 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035975    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 17:32:54.038885 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035978    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 17:32:54.038885 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035980    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 17:32:54.038885 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035983    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 17:32:54.038885 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035986    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 17:32:54.038885 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035989    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 17:32:54.038885 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035991    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 17:32:54.038885 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035994    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 17:32:54.038885 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.035997    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 17:32:54.038885 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036000    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 17:32:54.039274 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036002    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 17:32:54.039274 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036005    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 17:32:54.039274 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036007    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 17:32:54.039274 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036009    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 17:32:54.039274 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036012    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 17:32:54.039274 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036014    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 17:32:54.039274 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036017    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 17:32:54.039274 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036019    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 17:32:54.039274 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036022    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 17:32:54.039274 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036025    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 17:32:54.039274 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036028    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 17:32:54.039274 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036030    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 17:32:54.039274 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036033    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 17:32:54.039274 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036035    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 17:32:54.039274 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036038    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 17:32:54.039274 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036040    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 17:32:54.039274 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036043    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 17:32:54.039274 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036045    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 17:32:54.039274 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036048    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 17:32:54.039274 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036050    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 17:32:54.039753 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036053    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 17:32:54.039753 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036055    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 17:32:54.039753 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036058    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 17:32:54.039753 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036060    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 17:32:54.039753 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036063    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 17:32:54.039753 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036065    2558 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 17:32:54.039753 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036067    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 17:32:54.039753 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036070    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 17:32:54.039753 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036072    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 17:32:54.039753 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036075    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 17:32:54.039753 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036077    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 17:32:54.039753 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036080    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 17:32:54.039753 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036084    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 17:32:54.039753 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036086    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 17:32:54.039753 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036088    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 17:32:54.039753 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036091    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 17:32:54.039753 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036093    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 17:32:54.039753 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036096    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 17:32:54.039753 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036098    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 17:32:54.039753 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036101    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 17:32:54.040245 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036104    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 17:32:54.040245 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036107    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 17:32:54.040245 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036109    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 17:32:54.040245 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036112    2558 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 17:32:54.040245 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036114    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 17:32:54.040245 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036117    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 17:32:54.040245 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036120    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 17:32:54.040245 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036122    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 17:32:54.040245 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036125    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 17:32:54.040245 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036128    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 17:32:54.040245 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036130    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 17:32:54.040245 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036133    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 17:32:54.040245 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036135    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 17:32:54.040245 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036138    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 17:32:54.040245 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036140    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 17:32:54.040245 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036143    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 17:32:54.040245 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036145    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 17:32:54.040245 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036148    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 17:32:54.040245 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036151    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 17:32:54.040245 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036154    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 17:32:54.040727 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036157    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 17:32:54.040727 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036160    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 17:32:54.040727 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036163    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 17:32:54.040727 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036165    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 17:32:54.040727 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036168    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 17:32:54.040727 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036171    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 17:32:54.040727 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036175    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 17:32:54.040727 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036179    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 17:32:54.040727 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036182    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 17:32:54.040727 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036184    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 17:32:54.040727 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036187    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 17:32:54.040727 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036189    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 17:32:54.040727 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036192    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 17:32:54.040727 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036194    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 17:32:54.040727 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036196    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 17:32:54.040727 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036199    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 17:32:54.040727 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036202    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 17:32:54.040727 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036204    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 17:32:54.041159 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036208    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 17:32:54.041159 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036211    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 17:32:54.041159 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036214    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 17:32:54.041159 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036233    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 17:32:54.041159 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036236    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 17:32:54.041159 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036240    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 17:32:54.041159 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:54.036242    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 17:32:54.041159 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.036247    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 05 17:32:54.041159 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.036380    2558 server.go:962] "Client rotation is on, will bootstrap in background"
Aug 05 17:32:54.041159 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.038697    2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Aug 05 17:32:54.041159 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.040431    2558 server.go:1019] "Starting client certificate rotation"
Aug 05 17:32:54.041159 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.040537    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 05 17:32:54.041159 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.040573    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 05 17:32:54.043372 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.043355    2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 05 17:32:54.044899 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.044880    2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 05 17:32:54.057534 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.057513    2558 log.go:25] "Validated CRI v1 runtime API"
Aug 05 17:32:54.059962 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.059942    2558 log.go:25] "Validated CRI v1 image API"
Aug 05 17:32:54.061851 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.061826    2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Aug 05 17:32:54.064908 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.064887    2558 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 eea312c4-978f-4017-aa7e-dfa438994b7e:/dev/nvme0n1p4 ffb20f9a-667f-405d-af0b-5733c5a53495:/dev/nvme0n1p3]
Aug 05 17:32:54.064977 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.064907    2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Aug 05 17:32:54.069919 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.069784    2558 manager.go:216] Machine: {Timestamp:2026-08-05 17:32:54.068585104 +0000 UTC m=+0.381436459 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3105391 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ff6be023e3ee0cb13ec2ddea4820c SystemUUID:ec2ff6be-023e-3ee0-cb13-ec2ddea4820c BootID:f2b2ffd8-ffb8-4a6b-8776-b670d48aad6e Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:66:f1:f1:7d:57 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:66:f1:f1:7d:57 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8e:c0:63:d6:96:db Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Aug 05 17:32:54.069919 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.069910    2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Aug 05 17:32:54.070028 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.070002    2558 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Aug 05 17:32:54.071656 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.071637    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 05 17:32:54.074263 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.074210    2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Aug 05 17:32:54.074440 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.074274    2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-136.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Aug 05 17:32:54.076559 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.076544    2558 topology_manager.go:138] "Creating topology manager with none policy"
Aug 05 17:32:54.076598 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.076560    2558 container_manager_linux.go:309] "Creating device plugin manager"
Aug 05 17:32:54.076598 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.076570    2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 05 17:32:54.076598 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.076589    2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 05 17:32:54.077918 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.077905    2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Aug 05 17:32:54.081388 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.081371    2558 state_mem.go:36] "Initialized new in-memory state store"
Aug 05 17:32:54.081909 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.081897    2558 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Aug 05 17:32:54.081961 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.081933    2558 kubelet.go:486] "Attempting to sync node with API server"
Aug 05 17:32:54.081961 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.081943    2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Aug 05 17:32:54.082015 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.081961    2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Aug 05 17:32:54.082015 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.081972    2558 kubelet.go:398] "Adding apiserver pod source"
Aug 05 17:32:54.082015 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.081982    2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Aug 05 17:32:54.082602 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.082575    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 05 17:32:54.082716 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.082610    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 05 17:32:54.085081 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.085058    2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Aug 05 17:32:54.086505 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.086489    2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Aug 05 17:32:54.086592 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.086520    2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Aug 05 17:32:54.087197 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.087184    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Aug 05 17:32:54.087259 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.087207    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Aug 05 17:32:54.087259 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.087214    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Aug 05 17:32:54.087259 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.087236    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Aug 05 17:32:54.087259 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.087246    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Aug 05 17:32:54.087259 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.087251    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Aug 05 17:32:54.087259 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.087259    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Aug 05 17:32:54.087412 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.087264    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Aug 05 17:32:54.087412 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.087270    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Aug 05 17:32:54.087412 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.087275    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Aug 05 17:32:54.087412 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.087284    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Aug 05 17:32:54.087412 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.087290    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Aug 05 17:32:54.088833 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.088819    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Aug 05 17:32:54.088833 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.088832    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Aug 05 17:32:54.092138 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.092117    2558 server.go:1268] "Started kubelet"
Aug 05 17:32:54.092302 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.092235    2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Aug 05 17:32:54.092416 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.092373    2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Aug 05 17:32:54.092516 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.092439    2558 server_v1.go:49] "podresources" method="list" useActivePods=true
Aug 05 17:32:54.092943 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.092921    2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-136.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Aug 05 17:32:54.093081 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:54.093054    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Aug 05 17:32:54.093128 ip-10-0-129-136 systemd[1]: Started Kubernetes Kubelet.
Aug 05 17:32:54.093838 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:54.093182    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-136.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Aug 05 17:32:54.093838 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.093789    2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Aug 05 17:32:54.094284 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.094272    2558 server.go:310] "Adding debug handlers to kubelet server"
Aug 05 17:32:54.098544 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:54.098525    2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Aug 05 17:32:54.099059 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:54.097612    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-136.ec2.internal.18c8f92165f34e32  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-136.ec2.internal,UID:ip-10-0-129-136.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-136.ec2.internal,},FirstTimestamp:2026-08-05 17:32:54.092082738 +0000 UTC m=+0.404934103,LastTimestamp:2026-08-05 17:32:54.092082738 +0000 UTC m=+0.404934103,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-136.ec2.internal,}"
Aug 05 17:32:54.100563 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.100549    2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Aug 05 17:32:54.100613 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.100570    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Aug 05 17:32:54.100652 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:54.100629    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-136.ec2.internal\" not found"
Aug 05 17:32:54.101161 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.101142    2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Aug 05 17:32:54.101254 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.101191    2558 volume_manager.go:311] "The desired_state_of_world populator starts"
Aug 05 17:32:54.101254 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.101239    2558 volume_manager.go:313] "Starting Kubelet Volume Manager"
Aug 05 17:32:54.101339 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.101323    2558 reconstruct.go:97] "Volume reconstruction finished"
Aug 05 17:32:54.101339 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.101332    2558 reconciler.go:29] "Reconciler: start to sync state"
Aug 05 17:32:54.101634 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.101619    2558 factory.go:153] Registering CRI-O factory
Aug 05 17:32:54.101634 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.101639    2558 factory.go:223] Registration of the crio container factory successfully
Aug 05 17:32:54.101779 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.101695    2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Aug 05 17:32:54.101779 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.101703    2558 factory.go:55] Registering systemd factory
Aug 05 17:32:54.101779 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.101708    2558 factory.go:223] Registration of the systemd container factory successfully
Aug 05 17:32:54.101779 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.101725    2558 factory.go:103] Registering Raw factory
Aug 05 17:32:54.101779 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.101734    2558 manager.go:1196] Started watching for new ooms in manager
Aug 05 17:32:54.102288 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.102271    2558 manager.go:349] Starting recovery of all containers
Aug 05 17:32:54.110580 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.110550    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p9gs7"
Aug 05 17:32:54.112869 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:54.112823    2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-136.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Aug 05 17:32:54.113020 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:54.112997    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Aug 05 17:32:54.114772 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.114750    2558 manager.go:354] Recovery completed
Aug 05 17:32:54.116461 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:54.116437    2558 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Aug 05 17:32:54.119728 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.119714    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 17:32:54.121528 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.121511    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-136.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 17:32:54.121582 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.121550    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-136.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 17:32:54.121582 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.121565    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-136.ec2.internal" event="NodeHasSufficientPID"
Aug 05 17:32:54.122048 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.122035    2558 cpu_manager.go:222] "Starting CPU manager" policy="none"
Aug 05 17:32:54.122048 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.122047    2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Aug 05 17:32:54.122187 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.122065    2558 state_mem.go:36] "Initialized new in-memory state store"
Aug 05 17:32:54.122187 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.122046    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 17:32:54.122417 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.122402    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p9gs7"
Aug 05 17:32:54.122862 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.122845    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-136.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 17:32:54.122905 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.122875    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-136.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 17:32:54.122905 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.122886    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-136.ec2.internal" event="NodeHasSufficientPID"
Aug 05 17:32:54.123381 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.123355    2558 policy_none.go:49] "None policy: Start"
Aug 05 17:32:54.123443 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.123391    2558 memory_manager.go:187] "Starting memorymanager" policy="None"
Aug 05 17:32:54.123443 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.123407    2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Aug 05 17:32:54.123537 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:54.123426    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-136.ec2.internal.18c8f92167b4a34f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-136.ec2.internal,UID:ip-10-0-129-136.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-136.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-136.ec2.internal,},FirstTimestamp:2026-08-05 17:32:54.121530191 +0000 UTC m=+0.434381551,LastTimestamp:2026-08-05 17:32:54.121530191 +0000 UTC m=+0.434381551,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-136.ec2.internal,}"
Aug 05 17:32:54.124476 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.124461    2558 policy_none.go:47] "Start"
Aug 05 17:32:54.173300 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.173066    2558 manager.go:337] "Starting Device Plugin manager"
Aug 05 17:32:54.174658 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:54.173345    2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Aug 05 17:32:54.174658 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.173360    2558 server.go:87] "Starting device plugin registration server"
Aug 05 17:32:54.174658 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.173647    2558 eviction_manager.go:189] "Eviction manager: starting control loop"
Aug 05 17:32:54.174658 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.173664    2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Aug 05 17:32:54.174658 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.173853    2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Aug 05 17:32:54.174658 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.173958    2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Aug 05 17:32:54.174658 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.173965    2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Aug 05 17:32:54.174658 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:54.174445    2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Aug 05 17:32:54.174658 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:54.174490    2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-136.ec2.internal\" not found"
Aug 05 17:32:54.246461 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.246412    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Aug 05 17:32:54.247836 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.247808    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Aug 05 17:32:54.247962 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.247854    2558 status_manager.go:244] "Starting to sync pod status with apiserver"
Aug 05 17:32:54.247962 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.247877    2558 kubelet.go:2448] "Starting kubelet main sync loop"
Aug 05 17:32:54.247962 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:54.247931    2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Aug 05 17:32:54.250472 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.250450    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 17:32:54.274811 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.274721    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 17:32:54.275725 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.275708    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-136.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 17:32:54.275807 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.275741    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-136.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 17:32:54.275807 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.275751    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-136.ec2.internal" event="NodeHasSufficientPID"
Aug 05 17:32:54.275807 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.275773    2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-136.ec2.internal"
Aug 05 17:32:54.300855 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.300832    2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-136.ec2.internal"
Aug 05 17:32:54.300930 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:54.300861    2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-136.ec2.internal\": node \"ip-10-0-129-136.ec2.internal\" not found"
Aug 05 17:32:54.348234 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.348194    2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-136.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-136.ec2.internal"]
Aug 05 17:32:54.348418 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.348301    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 17:32:54.349267 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.349245    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-136.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 17:32:54.349384 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.349281    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-136.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 17:32:54.349384 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.349297    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-136.ec2.internal" event="NodeHasSufficientPID"
Aug 05 17:32:54.350619 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.350604    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 17:32:54.350719 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.350700    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-136.ec2.internal"
Aug 05 17:32:54.350763 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.350734    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 17:32:54.351489 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.351474    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-136.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 17:32:54.351569 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.351515    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-136.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 17:32:54.351569 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.351531    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-136.ec2.internal" event="NodeHasSufficientPID"
Aug 05 17:32:54.351569 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.351476    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-136.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 17:32:54.351666 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.351585    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-136.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 17:32:54.351666 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.351610    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-136.ec2.internal" event="NodeHasSufficientPID"
Aug 05 17:32:54.352903 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.352888    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-136.ec2.internal"
Aug 05 17:32:54.352955 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.352927    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 17:32:54.353738 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.353721    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-136.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 17:32:54.353845 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.353750    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-136.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 17:32:54.353845 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.353760    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-136.ec2.internal" event="NodeHasSufficientPID"
Aug 05 17:32:54.360824 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:54.360801    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-136.ec2.internal\" not found"
Aug 05 17:32:54.379263 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:54.379211    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-136.ec2.internal\" not found" node="ip-10-0-129-136.ec2.internal"
Aug 05 17:32:54.382853 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:54.382832    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-136.ec2.internal\" not found" node="ip-10-0-129-136.ec2.internal"
Aug 05 17:32:54.402848 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.402802    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/01733263bf8d53389b9903685bc9db22-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-136.ec2.internal\" (UID: \"01733263bf8d53389b9903685bc9db22\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-136.ec2.internal"
Aug 05 17:32:54.402848 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.402849    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01733263bf8d53389b9903685bc9db22-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-136.ec2.internal\" (UID: \"01733263bf8d53389b9903685bc9db22\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-136.ec2.internal"
Aug 05 17:32:54.403042 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.402880    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1afd46020d6263e2760b405ad0307aa7-config\") pod \"kube-apiserver-proxy-ip-10-0-129-136.ec2.internal\" (UID: \"1afd46020d6263e2760b405ad0307aa7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-136.ec2.internal"
Aug 05 17:32:54.461320 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:54.461283    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-136.ec2.internal\" not found"
Aug 05 17:32:54.503865 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.503834    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/01733263bf8d53389b9903685bc9db22-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-136.ec2.internal\" (UID: \"01733263bf8d53389b9903685bc9db22\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-136.ec2.internal"
Aug 05 17:32:54.504009 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.503868    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01733263bf8d53389b9903685bc9db22-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-136.ec2.internal\" (UID: \"01733263bf8d53389b9903685bc9db22\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-136.ec2.internal"
Aug 05 17:32:54.504009 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.503886    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1afd46020d6263e2760b405ad0307aa7-config\") pod \"kube-apiserver-proxy-ip-10-0-129-136.ec2.internal\" (UID: \"1afd46020d6263e2760b405ad0307aa7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-136.ec2.internal"
Aug 05 17:32:54.504009 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.503940    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01733263bf8d53389b9903685bc9db22-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-136.ec2.internal\" (UID: \"01733263bf8d53389b9903685bc9db22\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-136.ec2.internal"
Aug 05 17:32:54.504009 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.503949    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/01733263bf8d53389b9903685bc9db22-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-136.ec2.internal\" (UID: \"01733263bf8d53389b9903685bc9db22\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-136.ec2.internal"
Aug 05 17:32:54.504138 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.504025    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1afd46020d6263e2760b405ad0307aa7-config\") pod \"kube-apiserver-proxy-ip-10-0-129-136.ec2.internal\" (UID: \"1afd46020d6263e2760b405ad0307aa7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-136.ec2.internal"
Aug 05 17:32:54.561851 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:54.561791    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-136.ec2.internal\" not found"
Aug 05 17:32:54.662599 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:54.662570    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-136.ec2.internal\" not found"
Aug 05 17:32:54.681501 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.681466    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-136.ec2.internal"
Aug 05 17:32:54.686866 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:54.686849    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-136.ec2.internal"
Aug 05 17:32:54.762891 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:54.762854    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-136.ec2.internal\" not found"
Aug 05 17:32:54.863487 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:54.863421    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-136.ec2.internal\" not found"
Aug 05 17:32:54.963939 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:54.963905    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-136.ec2.internal\" not found"
Aug 05 17:32:55.039482 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:55.039450    2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Aug 05 17:32:55.039935 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:55.039585    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 05 17:32:55.064749 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:55.064722    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-136.ec2.internal\" not found"
Aug 05 17:32:55.126005 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:55.125929    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-04 17:27:54 +0000 UTC" deadline="2028-02-10 23:59:05.70827866 +0000 UTC"
Aug 05 17:32:55.126005 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:55.125957    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13302h26m10.582325061s"
Aug 05 17:32:55.165372 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:55.165342    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-136.ec2.internal\" not found"
Aug 05 17:32:55.169632 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:55.169613    2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 17:32:55.196484 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:55.196458    2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 17:32:55.218495 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:55.218467    2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 17:32:55.235042 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:55.235001    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1afd46020d6263e2760b405ad0307aa7.slice/crio-ce9299b67a6b5d798dcd8b36bf0d913b9051c5ab8e574f4f5ba3c9fb2a35d16e WatchSource:0}: Error finding container ce9299b67a6b5d798dcd8b36bf0d913b9051c5ab8e574f4f5ba3c9fb2a35d16e: Status 404 returned error can't find the container with id ce9299b67a6b5d798dcd8b36bf0d913b9051c5ab8e574f4f5ba3c9fb2a35d16e
Aug 05 17:32:55.235913 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:55.235882    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01733263bf8d53389b9903685bc9db22.slice/crio-2b5966785967114e01c8b9a21521a4ded7bab628dfb1cf91a86bb0fb69cc8f51 WatchSource:0}: Error finding container 2b5966785967114e01c8b9a21521a4ded7bab628dfb1cf91a86bb0fb69cc8f51: Status 404 returned error can't find the container with id 2b5966785967114e01c8b9a21521a4ded7bab628dfb1cf91a86bb0fb69cc8f51
Aug 05 17:32:55.240109 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:55.240093    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 17:32:55.253976 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:55.253923    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-136.ec2.internal" event={"ID":"1afd46020d6263e2760b405ad0307aa7","Type":"ContainerStarted","Data":"ce9299b67a6b5d798dcd8b36bf0d913b9051c5ab8e574f4f5ba3c9fb2a35d16e"}
Aug 05 17:32:55.255103 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:55.255081    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-136.ec2.internal" event={"ID":"01733263bf8d53389b9903685bc9db22","Type":"ContainerStarted","Data":"2b5966785967114e01c8b9a21521a4ded7bab628dfb1cf91a86bb0fb69cc8f51"}
Aug 05 17:32:55.301542 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:55.301512    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-136.ec2.internal"
Aug 05 17:32:55.313697 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:55.313491    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 05 17:32:55.318663 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:55.318622    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-136.ec2.internal"
Aug 05 17:32:55.332516 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:55.332481    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 05 17:32:56.083397 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.083354    2558 apiserver.go:52] "Watching apiserver"
Aug 05 17:32:56.097275 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.097234    2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Aug 05 17:32:56.098620 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.098584    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-rwwxz","openshift-network-diagnostics/network-check-target-dnr6s","openshift-network-operator/iptables-alerter-4c5rk","kube-system/kube-apiserver-proxy-ip-10-0-129-136.ec2.internal","openshift-cluster-node-tuning-operator/tuned-4cwp6","openshift-dns/node-resolver-jmdlw","openshift-image-registry/node-ca-ddzbb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-136.ec2.internal","openshift-multus/multus-additional-cni-plugins-trjvx","openshift-ovn-kubernetes/ovnkube-node-6vqmd","kube-system/global-pull-secret-syncer-vth7m","kube-system/konnectivity-agent-nqss6","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2kj6","openshift-multus/multus-bh9fk"]
Aug 05 17:32:56.100751 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.100722    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.101735 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.101711    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Aug 05 17:32:56.102375 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.102357    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2kj6"
Aug 05 17:32:56.103206 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.103180    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4c5rk"
Aug 05 17:32:56.104531 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.104508    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.105966 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.105939    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.107877 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.107417    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jmdlw"
Aug 05 17:32:56.108976 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.108955    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Aug 05 17:32:56.109106 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.108997    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Aug 05 17:32:56.109280 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.109230    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Aug 05 17:32:56.109363 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.109335    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Aug 05 17:32:56.109698 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.109671    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Aug 05 17:32:56.109774 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.109702    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Aug 05 17:32:56.109953 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.109907    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-trjvx"
Aug 05 17:32:56.110389 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.110368    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ddzbb"
Aug 05 17:32:56.111152 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.110967    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Aug 05 17:32:56.111152 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.111018    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zb8qq\""
Aug 05 17:32:56.111152 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.111122    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Aug 05 17:32:56.111354 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.111263    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rkks2\""
Aug 05 17:32:56.111509 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.111490    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Aug 05 17:32:56.111585 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.111509    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Aug 05 17:32:56.111585 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.111564    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Aug 05 17:32:56.111693 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.111644    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Aug 05 17:32:56.111693 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.111648    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2s8jt\""
Aug 05 17:32:56.111800 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.111723    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Aug 05 17:32:56.111935 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.111907    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Aug 05 17:32:56.112047 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.112030    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Aug 05 17:32:56.112213 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.112165    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnr6s"
Aug 05 17:32:56.112312 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:56.112276    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnr6s" podUID="cd100b0f-a2de-4036-a21a-4412e02fa15f"
Aug 05 17:32:56.112917 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.112898    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Aug 05 17:32:56.113015 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.112949    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Aug 05 17:32:56.113099 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.113082    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wmz8g\""
Aug 05 17:32:56.113196 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.113144    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Aug 05 17:32:56.113394 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.113378    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kcnzs\""
Aug 05 17:32:56.113478 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.113433    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Aug 05 17:32:56.117183 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.114026    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Aug 05 17:32:56.117183 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.114235    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mwnf7\""
Aug 05 17:32:56.117183 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.114377    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rwwxz"
Aug 05 17:32:56.117183 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:56.114473    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rwwxz" podUID="83867a5e-d4bd-4da7-a6e4-e129d0f300a9"
Aug 05 17:32:56.117183 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.114798    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-var-lib-openvswitch\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.117183 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.114825    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/99842ca9-d2b9-4e20-b0e3-290f9d68cf4e-socket-dir\") pod \"aws-ebs-csi-driver-node-t2kj6\" (UID: \"99842ca9-d2b9-4e20-b0e3-290f9d68cf4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2kj6"
Aug 05 17:32:56.117183 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.114861    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7m46\" (UniqueName: \"kubernetes.io/projected/99842ca9-d2b9-4e20-b0e3-290f9d68cf4e-kube-api-access-m7m46\") pod \"aws-ebs-csi-driver-node-t2kj6\" (UID: \"99842ca9-d2b9-4e20-b0e3-290f9d68cf4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2kj6"
Aug 05 17:32:56.117183 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.114889    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29glz\" (UniqueName: \"kubernetes.io/projected/5ac9603b-b3c6-4a54-8334-4002e08a6faf-kube-api-access-29glz\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.117183 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.115017    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/99842ca9-d2b9-4e20-b0e3-290f9d68cf4e-registration-dir\") pod \"aws-ebs-csi-driver-node-t2kj6\" (UID: \"99842ca9-d2b9-4e20-b0e3-290f9d68cf4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2kj6"
Aug 05 17:32:56.117183 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.115041    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/99842ca9-d2b9-4e20-b0e3-290f9d68cf4e-etc-selinux\") pod \"aws-ebs-csi-driver-node-t2kj6\" (UID: \"99842ca9-d2b9-4e20-b0e3-290f9d68cf4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2kj6"
Aug 05 17:32:56.117183 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.115062    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-host-run-netns\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.117183 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.115088    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-run-systemd\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.117183 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.115110    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-run-ovn\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.117183 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.115155    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-host-cni-netd\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.117183 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.115311    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-host-kubelet\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.117183 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.115367    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-log-socket\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.117183 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.115653    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5ac9603b-b3c6-4a54-8334-4002e08a6faf-ovnkube-script-lib\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.117183 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.115695    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/99842ca9-d2b9-4e20-b0e3-290f9d68cf4e-sys-fs\") pod \"aws-ebs-csi-driver-node-t2kj6\" (UID: \"99842ca9-d2b9-4e20-b0e3-290f9d68cf4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2kj6"
Aug 05 17:32:56.118234 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.115726    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-node-log\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.118234 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.115824    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-systemd-units\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.118234 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.115867    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.118234 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.115990    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5ac9603b-b3c6-4a54-8334-4002e08a6faf-ovn-node-metrics-cert\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.118234 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.116007    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Aug 05 17:32:56.118234 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.116155    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/99842ca9-d2b9-4e20-b0e3-290f9d68cf4e-device-dir\") pod \"aws-ebs-csi-driver-node-t2kj6\" (UID: \"99842ca9-d2b9-4e20-b0e3-290f9d68cf4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2kj6"
Aug 05 17:32:56.118234 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.116191    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-etc-openvswitch\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.118234 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.116377    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-run-openvswitch\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.118234 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.116409    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-host-slash\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.118234 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.116440    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-host-run-ovn-kubernetes\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.118234 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.116477    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5ac9603b-b3c6-4a54-8334-4002e08a6faf-env-overrides\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.118234 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.116551    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Aug 05 17:32:56.118234 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.116696    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/99842ca9-d2b9-4e20-b0e3-290f9d68cf4e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t2kj6\" (UID: \"99842ca9-d2b9-4e20-b0e3-290f9d68cf4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2kj6"
Aug 05 17:32:56.118234 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.116770    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-host-cni-bin\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.118234 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.116811    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5ac9603b-b3c6-4a54-8334-4002e08a6faf-ovnkube-config\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.118234 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.117035    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Aug 05 17:32:56.118234 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.117044    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Aug 05 17:32:56.118234 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.117290    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Aug 05 17:32:56.118234 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.117409    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vth7m"
Aug 05 17:32:56.119208 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:56.117497    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vth7m" podUID="d79df3a4-4b86-4acd-9884-c9d745b6b79b"
Aug 05 17:32:56.119208 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.118671    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nqss6"
Aug 05 17:32:56.119208 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.118943    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-27cxz\""
Aug 05 17:32:56.119796 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.119775    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rfpd7\""
Aug 05 17:32:56.122911 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.122882    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Aug 05 17:32:56.123122 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.123098    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cp654\""
Aug 05 17:32:56.128139 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.127947    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Aug 05 17:32:56.161234 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.161204    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 05 17:32:56.161403 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.161292    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-p9t8s"
Aug 05 17:32:56.174038 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.174015    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-p9t8s"
Aug 05 17:32:56.203194 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.203157    2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Aug 05 17:32:56.220627 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.217326    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n7ml\" (UniqueName: \"kubernetes.io/projected/e38f44f9-8de8-4953-a874-97f4ddba3451-kube-api-access-2n7ml\") pod \"multus-additional-cni-plugins-trjvx\" (UID: \"e38f44f9-8de8-4953-a874-97f4ddba3451\") " pod="openshift-multus/multus-additional-cni-plugins-trjvx"
Aug 05 17:32:56.220627 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.217380    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t48d5\" (UniqueName: \"kubernetes.io/projected/2c932fc3-5567-4183-97ee-36f5359a9a64-kube-api-access-t48d5\") pod \"node-ca-ddzbb\" (UID: \"2c932fc3-5567-4183-97ee-36f5359a9a64\") " pod="openshift-image-registry/node-ca-ddzbb"
Aug 05 17:32:56.220627 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.217417    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/061ab456-b3f0-4202-bb10-9e741ba5a8a3-iptables-alerter-script\") pod \"iptables-alerter-4c5rk\" (UID: \"061ab456-b3f0-4202-bb10-9e741ba5a8a3\") " pod="openshift-network-operator/iptables-alerter-4c5rk"
Aug 05 17:32:56.220627 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.217445    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d302441f-1c1b-4bb2-9e15-75f7dd84f723-etc-kubernetes\") pod \"tuned-4cwp6\" (UID: \"d302441f-1c1b-4bb2-9e15-75f7dd84f723\") " pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.220627 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.217471    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d302441f-1c1b-4bb2-9e15-75f7dd84f723-etc-sysctl-conf\") pod \"tuned-4cwp6\" (UID: \"d302441f-1c1b-4bb2-9e15-75f7dd84f723\") " pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.220627 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.217507    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6d395bda-7395-40e9-b0cc-1195e1d656d1-konnectivity-ca\") pod \"konnectivity-agent-nqss6\" (UID: \"6d395bda-7395-40e9-b0cc-1195e1d656d1\") " pod="kube-system/konnectivity-agent-nqss6"
Aug 05 17:32:56.220627 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.217535    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-host-var-lib-kubelet\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.220627 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.217572    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29glz\" (UniqueName: \"kubernetes.io/projected/5ac9603b-b3c6-4a54-8334-4002e08a6faf-kube-api-access-29glz\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.220627 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.217601    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/99842ca9-d2b9-4e20-b0e3-290f9d68cf4e-etc-selinux\") pod \"aws-ebs-csi-driver-node-t2kj6\" (UID: \"99842ca9-d2b9-4e20-b0e3-290f9d68cf4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2kj6"
Aug 05 17:32:56.220627 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.217628    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-host-cni-netd\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.220627 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.217667    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e38f44f9-8de8-4953-a874-97f4ddba3451-tuning-conf-dir\") pod \"multus-additional-cni-plugins-trjvx\" (UID: \"e38f44f9-8de8-4953-a874-97f4ddba3451\") " pod="openshift-multus/multus-additional-cni-plugins-trjvx"
Aug 05 17:32:56.220627 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.217694    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d302441f-1c1b-4bb2-9e15-75f7dd84f723-etc-systemd\") pod \"tuned-4cwp6\" (UID: \"d302441f-1c1b-4bb2-9e15-75f7dd84f723\") " pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.220627 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.217717    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d302441f-1c1b-4bb2-9e15-75f7dd84f723-lib-modules\") pod \"tuned-4cwp6\" (UID: \"d302441f-1c1b-4bb2-9e15-75f7dd84f723\") " pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.220627 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.217745    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-multus-daemon-config\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.220627 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.217773    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-host-kubelet\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.220627 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.217798    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/99842ca9-d2b9-4e20-b0e3-290f9d68cf4e-sys-fs\") pod \"aws-ebs-csi-driver-node-t2kj6\" (UID: \"99842ca9-d2b9-4e20-b0e3-290f9d68cf4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2kj6"
Aug 05 17:32:56.221658 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.217822    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e38f44f9-8de8-4953-a874-97f4ddba3451-os-release\") pod \"multus-additional-cni-plugins-trjvx\" (UID: \"e38f44f9-8de8-4953-a874-97f4ddba3451\") " pod="openshift-multus/multus-additional-cni-plugins-trjvx"
Aug 05 17:32:56.221658 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.217860    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d302441f-1c1b-4bb2-9e15-75f7dd84f723-etc-sysconfig\") pod \"tuned-4cwp6\" (UID: \"d302441f-1c1b-4bb2-9e15-75f7dd84f723\") " pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.221658 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.217895    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xk4fn\" (UniqueName: \"kubernetes.io/projected/d302441f-1c1b-4bb2-9e15-75f7dd84f723-kube-api-access-xk4fn\") pod \"tuned-4cwp6\" (UID: \"d302441f-1c1b-4bb2-9e15-75f7dd84f723\") " pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.221658 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.217926    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-systemd-units\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.221658 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.217955    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.221658 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.217985    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d302441f-1c1b-4bb2-9e15-75f7dd84f723-sys\") pod \"tuned-4cwp6\" (UID: \"d302441f-1c1b-4bb2-9e15-75f7dd84f723\") " pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.221658 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.218011    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/061ab456-b3f0-4202-bb10-9e741ba5a8a3-host-slash\") pod \"iptables-alerter-4c5rk\" (UID: \"061ab456-b3f0-4202-bb10-9e741ba5a8a3\") " pod="openshift-network-operator/iptables-alerter-4c5rk"
Aug 05 17:32:56.221658 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.218045    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-multus-conf-dir\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.221658 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.218070    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-etc-kubernetes\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.221658 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.218108    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5ac9603b-b3c6-4a54-8334-4002e08a6faf-ovn-node-metrics-cert\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.221658 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.218137    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxths\" (UniqueName: \"kubernetes.io/projected/83867a5e-d4bd-4da7-a6e4-e129d0f300a9-kube-api-access-bxths\") pod \"network-metrics-daemon-rwwxz\" (UID: \"83867a5e-d4bd-4da7-a6e4-e129d0f300a9\") " pod="openshift-multus/network-metrics-daemon-rwwxz"
Aug 05 17:32:56.221658 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.218166    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxzzk\" (UniqueName: \"kubernetes.io/projected/061ab456-b3f0-4202-bb10-9e741ba5a8a3-kube-api-access-fxzzk\") pod \"iptables-alerter-4c5rk\" (UID: \"061ab456-b3f0-4202-bb10-9e741ba5a8a3\") " pod="openshift-network-operator/iptables-alerter-4c5rk"
Aug 05 17:32:56.221658 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.218190    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-system-cni-dir\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.221658 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.218217    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-host-var-lib-cni-multus\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.221658 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.218243    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-etc-openvswitch\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.221658 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.218273    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e38f44f9-8de8-4953-a874-97f4ddba3451-cni-binary-copy\") pod \"multus-additional-cni-plugins-trjvx\" (UID: \"e38f44f9-8de8-4953-a874-97f4ddba3451\") " pod="openshift-multus/multus-additional-cni-plugins-trjvx"
Aug 05 17:32:56.222510 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.218330    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d302441f-1c1b-4bb2-9e15-75f7dd84f723-etc-tuned\") pod \"tuned-4cwp6\" (UID: \"d302441f-1c1b-4bb2-9e15-75f7dd84f723\") " pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.222510 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.218392    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-os-release\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.222510 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.218422    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-cni-binary-copy\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.222510 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.218454    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-host-slash\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.222510 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.218483    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-host-run-ovn-kubernetes\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.222510 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.218509    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d302441f-1c1b-4bb2-9e15-75f7dd84f723-host\") pod \"tuned-4cwp6\" (UID: \"d302441f-1c1b-4bb2-9e15-75f7dd84f723\") " pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.222510 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.218537    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d79df3a4-4b86-4acd-9884-c9d745b6b79b-original-pull-secret\") pod \"global-pull-secret-syncer-vth7m\" (UID: \"d79df3a4-4b86-4acd-9884-c9d745b6b79b\") " pod="kube-system/global-pull-secret-syncer-vth7m"
Aug 05 17:32:56.222510 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.218564    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d302441f-1c1b-4bb2-9e15-75f7dd84f723-run\") pod \"tuned-4cwp6\" (UID: \"d302441f-1c1b-4bb2-9e15-75f7dd84f723\") " pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.222510 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.218592    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-hostroot\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.222510 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.218625    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-var-lib-openvswitch\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.222510 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.218653    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/99842ca9-d2b9-4e20-b0e3-290f9d68cf4e-socket-dir\") pod \"aws-ebs-csi-driver-node-t2kj6\" (UID: \"99842ca9-d2b9-4e20-b0e3-290f9d68cf4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2kj6"
Aug 05 17:32:56.222510 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.218683    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7m46\" (UniqueName: \"kubernetes.io/projected/99842ca9-d2b9-4e20-b0e3-290f9d68cf4e-kube-api-access-m7m46\") pod \"aws-ebs-csi-driver-node-t2kj6\" (UID: \"99842ca9-d2b9-4e20-b0e3-290f9d68cf4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2kj6"
Aug 05 17:32:56.222510 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.218710    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/795a8ab5-035a-4295-a4ea-e7d44991562d-tmp-dir\") pod \"node-resolver-jmdlw\" (UID: \"795a8ab5-035a-4295-a4ea-e7d44991562d\") " pod="openshift-dns/node-resolver-jmdlw"
Aug 05 17:32:56.222510 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.218734    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6d395bda-7395-40e9-b0cc-1195e1d656d1-agent-certs\") pod \"konnectivity-agent-nqss6\" (UID: \"6d395bda-7395-40e9-b0cc-1195e1d656d1\") " pod="kube-system/konnectivity-agent-nqss6"
Aug 05 17:32:56.222510 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.218752    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/99842ca9-d2b9-4e20-b0e3-290f9d68cf4e-registration-dir\") pod \"aws-ebs-csi-driver-node-t2kj6\" (UID: \"99842ca9-d2b9-4e20-b0e3-290f9d68cf4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2kj6"
Aug 05 17:32:56.222510 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.218775    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-host-run-netns\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.222510 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.218800    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-run-systemd\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.223385 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.218831    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-run-ovn\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.223385 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.218858    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5ac9603b-b3c6-4a54-8334-4002e08a6faf-ovnkube-script-lib\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.223385 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.218888    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g98sl\" (UniqueName: \"kubernetes.io/projected/795a8ab5-035a-4295-a4ea-e7d44991562d-kube-api-access-g98sl\") pod \"node-resolver-jmdlw\" (UID: \"795a8ab5-035a-4295-a4ea-e7d44991562d\") " pod="openshift-dns/node-resolver-jmdlw"
Aug 05 17:32:56.223385 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.218925    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d302441f-1c1b-4bb2-9e15-75f7dd84f723-etc-modprobe-d\") pod \"tuned-4cwp6\" (UID: \"d302441f-1c1b-4bb2-9e15-75f7dd84f723\") " pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.223385 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.218995    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-log-socket\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.223385 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.219025    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/795a8ab5-035a-4295-a4ea-e7d44991562d-hosts-file\") pod \"node-resolver-jmdlw\" (UID: \"795a8ab5-035a-4295-a4ea-e7d44991562d\") " pod="openshift-dns/node-resolver-jmdlw"
Aug 05 17:32:56.223385 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.219056    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d302441f-1c1b-4bb2-9e15-75f7dd84f723-var-lib-kubelet\") pod \"tuned-4cwp6\" (UID: \"d302441f-1c1b-4bb2-9e15-75f7dd84f723\") " pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.223385 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.219083    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83867a5e-d4bd-4da7-a6e4-e129d0f300a9-metrics-certs\") pod \"network-metrics-daemon-rwwxz\" (UID: \"83867a5e-d4bd-4da7-a6e4-e129d0f300a9\") " pod="openshift-multus/network-metrics-daemon-rwwxz"
Aug 05 17:32:56.223385 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.219110    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d79df3a4-4b86-4acd-9884-c9d745b6b79b-kubelet-config\") pod \"global-pull-secret-syncer-vth7m\" (UID: \"d79df3a4-4b86-4acd-9884-c9d745b6b79b\") " pod="kube-system/global-pull-secret-syncer-vth7m"
Aug 05 17:32:56.223385 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.219135    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-cnibin\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.223385 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.219157    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-host-run-multus-certs\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.223385 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.219177    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-node-log\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.223385 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.219195    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e38f44f9-8de8-4953-a874-97f4ddba3451-cnibin\") pod \"multus-additional-cni-plugins-trjvx\" (UID: \"e38f44f9-8de8-4953-a874-97f4ddba3451\") " pod="openshift-multus/multus-additional-cni-plugins-trjvx"
Aug 05 17:32:56.223385 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.219211    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d302441f-1c1b-4bb2-9e15-75f7dd84f723-etc-sysctl-d\") pod \"tuned-4cwp6\" (UID: \"d302441f-1c1b-4bb2-9e15-75f7dd84f723\") " pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.223385 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.219230    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-host-run-k8s-cni-cncf-io\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.223385 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.219256    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-host-run-netns\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.223385 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.219282    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m2j2\" (UniqueName: \"kubernetes.io/projected/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-kube-api-access-6m2j2\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.224240 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.219322    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/99842ca9-d2b9-4e20-b0e3-290f9d68cf4e-device-dir\") pod \"aws-ebs-csi-driver-node-t2kj6\" (UID: \"99842ca9-d2b9-4e20-b0e3-290f9d68cf4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2kj6"
Aug 05 17:32:56.224240 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.219354    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e38f44f9-8de8-4953-a874-97f4ddba3451-system-cni-dir\") pod \"multus-additional-cni-plugins-trjvx\" (UID: \"e38f44f9-8de8-4953-a874-97f4ddba3451\") " pod="openshift-multus/multus-additional-cni-plugins-trjvx"
Aug 05 17:32:56.224240 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.219384    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d302441f-1c1b-4bb2-9e15-75f7dd84f723-tmp\") pod \"tuned-4cwp6\" (UID: \"d302441f-1c1b-4bb2-9e15-75f7dd84f723\") " pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.224240 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.219421    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2c932fc3-5567-4183-97ee-36f5359a9a64-host\") pod \"node-ca-ddzbb\" (UID: \"2c932fc3-5567-4183-97ee-36f5359a9a64\") " pod="openshift-image-registry/node-ca-ddzbb"
Aug 05 17:32:56.224240 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.219440    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-run-ovn\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.224240 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.219459    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhth2\" (UniqueName: \"kubernetes.io/projected/cd100b0f-a2de-4036-a21a-4412e02fa15f-kube-api-access-lhth2\") pod \"network-check-target-dnr6s\" (UID: \"cd100b0f-a2de-4036-a21a-4412e02fa15f\") " pod="openshift-network-diagnostics/network-check-target-dnr6s"
Aug 05 17:32:56.224240 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.219615    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-etc-openvswitch\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.224240 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.219624    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-node-log\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.224240 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.219664    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-host-cni-netd\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.224240 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.219674    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/99842ca9-d2b9-4e20-b0e3-290f9d68cf4e-etc-selinux\") pod \"aws-ebs-csi-driver-node-t2kj6\" (UID: \"99842ca9-d2b9-4e20-b0e3-290f9d68cf4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2kj6"
Aug 05 17:32:56.224240 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.219710    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-var-lib-openvswitch\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.224240 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.219715    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-host-run-ovn-kubernetes\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.224240 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.219839    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/99842ca9-d2b9-4e20-b0e3-290f9d68cf4e-socket-dir\") pod \"aws-ebs-csi-driver-node-t2kj6\" (UID: \"99842ca9-d2b9-4e20-b0e3-290f9d68cf4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2kj6"
Aug 05 17:32:56.224240 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.219875    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/99842ca9-d2b9-4e20-b0e3-290f9d68cf4e-device-dir\") pod \"aws-ebs-csi-driver-node-t2kj6\" (UID: \"99842ca9-d2b9-4e20-b0e3-290f9d68cf4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2kj6"
Aug 05 17:32:56.224240 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.219897    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-host-kubelet\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.224240 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.220048    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/99842ca9-d2b9-4e20-b0e3-290f9d68cf4e-sys-fs\") pod \"aws-ebs-csi-driver-node-t2kj6\" (UID: \"99842ca9-d2b9-4e20-b0e3-290f9d68cf4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2kj6"
Aug 05 17:32:56.224240 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.220126    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/99842ca9-d2b9-4e20-b0e3-290f9d68cf4e-registration-dir\") pod \"aws-ebs-csi-driver-node-t2kj6\" (UID: \"99842ca9-d2b9-4e20-b0e3-290f9d68cf4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2kj6"
Aug 05 17:32:56.224970 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.220155    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-host-run-netns\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.224970 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.220181    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-systemd-units\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.224970 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.220201    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-run-systemd\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.224970 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.220235    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-run-openvswitch\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.224970 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.220257    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e38f44f9-8de8-4953-a874-97f4ddba3451-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-trjvx\" (UID: \"e38f44f9-8de8-4953-a874-97f4ddba3451\") " pod="openshift-multus/multus-additional-cni-plugins-trjvx"
Aug 05 17:32:56.224970 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.220321    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2c932fc3-5567-4183-97ee-36f5359a9a64-serviceca\") pod \"node-ca-ddzbb\" (UID: \"2c932fc3-5567-4183-97ee-36f5359a9a64\") " pod="openshift-image-registry/node-ca-ddzbb"
Aug 05 17:32:56.224970 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.220349    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5ac9603b-b3c6-4a54-8334-4002e08a6faf-env-overrides\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.224970 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.220356    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5ac9603b-b3c6-4a54-8334-4002e08a6faf-ovnkube-script-lib\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.224970 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.220376    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/99842ca9-d2b9-4e20-b0e3-290f9d68cf4e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t2kj6\" (UID: \"99842ca9-d2b9-4e20-b0e3-290f9d68cf4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2kj6"
Aug 05 17:32:56.224970 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.220425    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-run-openvswitch\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.224970 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.220425    2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Aug 05 17:32:56.224970 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.220448    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.224970 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.220463    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-host-slash\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.224970 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.220455    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-log-socket\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.224970 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.220509    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e38f44f9-8de8-4953-a874-97f4ddba3451-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-trjvx\" (UID: \"e38f44f9-8de8-4953-a874-97f4ddba3451\") " pod="openshift-multus/multus-additional-cni-plugins-trjvx"
Aug 05 17:32:56.224970 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.220514    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/99842ca9-d2b9-4e20-b0e3-290f9d68cf4e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t2kj6\" (UID: \"99842ca9-d2b9-4e20-b0e3-290f9d68cf4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2kj6"
Aug 05 17:32:56.224970 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.220550    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d79df3a4-4b86-4acd-9884-c9d745b6b79b-dbus\") pod \"global-pull-secret-syncer-vth7m\" (UID: \"d79df3a4-4b86-4acd-9884-c9d745b6b79b\") " pod="kube-system/global-pull-secret-syncer-vth7m"
Aug 05 17:32:56.225853 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.220582    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-multus-cni-dir\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.225853 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.220615    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-multus-socket-dir-parent\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.225853 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.220686    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-host-var-lib-cni-bin\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.225853 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.220748    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-host-cni-bin\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.225853 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.220785    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5ac9603b-b3c6-4a54-8334-4002e08a6faf-env-overrides\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.225853 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.220805    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5ac9603b-b3c6-4a54-8334-4002e08a6faf-ovnkube-config\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.225853 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.220815    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5ac9603b-b3c6-4a54-8334-4002e08a6faf-host-cni-bin\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.225853 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.221352    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5ac9603b-b3c6-4a54-8334-4002e08a6faf-ovnkube-config\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.225853 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.225079    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5ac9603b-b3c6-4a54-8334-4002e08a6faf-ovn-node-metrics-cert\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.235362 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.235324    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7m46\" (UniqueName: \"kubernetes.io/projected/99842ca9-d2b9-4e20-b0e3-290f9d68cf4e-kube-api-access-m7m46\") pod \"aws-ebs-csi-driver-node-t2kj6\" (UID: \"99842ca9-d2b9-4e20-b0e3-290f9d68cf4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2kj6"
Aug 05 17:32:56.236236 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.236191    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29glz\" (UniqueName: \"kubernetes.io/projected/5ac9603b-b3c6-4a54-8334-4002e08a6faf-kube-api-access-29glz\") pod \"ovnkube-node-6vqmd\" (UID: \"5ac9603b-b3c6-4a54-8334-4002e08a6faf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.321762 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.321729    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d302441f-1c1b-4bb2-9e15-75f7dd84f723-run\") pod \"tuned-4cwp6\" (UID: \"d302441f-1c1b-4bb2-9e15-75f7dd84f723\") " pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.321762 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.321768    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-hostroot\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.322047 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.321797    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/795a8ab5-035a-4295-a4ea-e7d44991562d-tmp-dir\") pod \"node-resolver-jmdlw\" (UID: \"795a8ab5-035a-4295-a4ea-e7d44991562d\") " pod="openshift-dns/node-resolver-jmdlw"
Aug 05 17:32:56.322047 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.321874    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-hostroot\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.322047 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.321898    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6d395bda-7395-40e9-b0cc-1195e1d656d1-agent-certs\") pod \"konnectivity-agent-nqss6\" (UID: \"6d395bda-7395-40e9-b0cc-1195e1d656d1\") " pod="kube-system/konnectivity-agent-nqss6"
Aug 05 17:32:56.322047 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.321878    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d302441f-1c1b-4bb2-9e15-75f7dd84f723-run\") pod \"tuned-4cwp6\" (UID: \"d302441f-1c1b-4bb2-9e15-75f7dd84f723\") " pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.322047 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.321949    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g98sl\" (UniqueName: \"kubernetes.io/projected/795a8ab5-035a-4295-a4ea-e7d44991562d-kube-api-access-g98sl\") pod \"node-resolver-jmdlw\" (UID: \"795a8ab5-035a-4295-a4ea-e7d44991562d\") " pod="openshift-dns/node-resolver-jmdlw"
Aug 05 17:32:56.322047 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.321971    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d302441f-1c1b-4bb2-9e15-75f7dd84f723-etc-modprobe-d\") pod \"tuned-4cwp6\" (UID: \"d302441f-1c1b-4bb2-9e15-75f7dd84f723\") " pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.322047 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.321998    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/795a8ab5-035a-4295-a4ea-e7d44991562d-hosts-file\") pod \"node-resolver-jmdlw\" (UID: \"795a8ab5-035a-4295-a4ea-e7d44991562d\") " pod="openshift-dns/node-resolver-jmdlw"
Aug 05 17:32:56.322047 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.322021    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d302441f-1c1b-4bb2-9e15-75f7dd84f723-var-lib-kubelet\") pod \"tuned-4cwp6\" (UID: \"d302441f-1c1b-4bb2-9e15-75f7dd84f723\") " pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.322047 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.322037    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83867a5e-d4bd-4da7-a6e4-e129d0f300a9-metrics-certs\") pod \"network-metrics-daemon-rwwxz\" (UID: \"83867a5e-d4bd-4da7-a6e4-e129d0f300a9\") " pod="openshift-multus/network-metrics-daemon-rwwxz"
Aug 05 17:32:56.322629 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.322063    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d79df3a4-4b86-4acd-9884-c9d745b6b79b-kubelet-config\") pod \"global-pull-secret-syncer-vth7m\" (UID: \"d79df3a4-4b86-4acd-9884-c9d745b6b79b\") " pod="kube-system/global-pull-secret-syncer-vth7m"
Aug 05 17:32:56.322629 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.322084    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-cnibin\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.322629 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.322099    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-host-run-multus-certs\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.322629 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.322118    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e38f44f9-8de8-4953-a874-97f4ddba3451-cnibin\") pod \"multus-additional-cni-plugins-trjvx\" (UID: \"e38f44f9-8de8-4953-a874-97f4ddba3451\") " pod="openshift-multus/multus-additional-cni-plugins-trjvx"
Aug 05 17:32:56.322629 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.322134    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d302441f-1c1b-4bb2-9e15-75f7dd84f723-etc-sysctl-d\") pod \"tuned-4cwp6\" (UID: \"d302441f-1c1b-4bb2-9e15-75f7dd84f723\") " pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.322629 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.322149    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-host-run-k8s-cni-cncf-io\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.322629 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.322170    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/795a8ab5-035a-4295-a4ea-e7d44991562d-tmp-dir\") pod \"node-resolver-jmdlw\" (UID: \"795a8ab5-035a-4295-a4ea-e7d44991562d\") " pod="openshift-dns/node-resolver-jmdlw"
Aug 05 17:32:56.322629 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.322214    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-host-run-netns\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.322629 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.322177    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-host-run-netns\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.322629 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.322309    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m2j2\" (UniqueName: \"kubernetes.io/projected/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-kube-api-access-6m2j2\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.322629 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.322345    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e38f44f9-8de8-4953-a874-97f4ddba3451-system-cni-dir\") pod \"multus-additional-cni-plugins-trjvx\" (UID: \"e38f44f9-8de8-4953-a874-97f4ddba3451\") " pod="openshift-multus/multus-additional-cni-plugins-trjvx"
Aug 05 17:32:56.322629 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.322372    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d302441f-1c1b-4bb2-9e15-75f7dd84f723-tmp\") pod \"tuned-4cwp6\" (UID: \"d302441f-1c1b-4bb2-9e15-75f7dd84f723\") " pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.322629 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.322409    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d79df3a4-4b86-4acd-9884-c9d745b6b79b-kubelet-config\") pod \"global-pull-secret-syncer-vth7m\" (UID: \"d79df3a4-4b86-4acd-9884-c9d745b6b79b\") " pod="kube-system/global-pull-secret-syncer-vth7m"
Aug 05 17:32:56.322629 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.322401    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2c932fc3-5567-4183-97ee-36f5359a9a64-host\") pod \"node-ca-ddzbb\" (UID: \"2c932fc3-5567-4183-97ee-36f5359a9a64\") " pod="openshift-image-registry/node-ca-ddzbb"
Aug 05 17:32:56.322629 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.322446    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/795a8ab5-035a-4295-a4ea-e7d44991562d-hosts-file\") pod \"node-resolver-jmdlw\" (UID: \"795a8ab5-035a-4295-a4ea-e7d44991562d\") " pod="openshift-dns/node-resolver-jmdlw"
Aug 05 17:32:56.322629 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.322454    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhth2\" (UniqueName: \"kubernetes.io/projected/cd100b0f-a2de-4036-a21a-4412e02fa15f-kube-api-access-lhth2\") pod \"network-check-target-dnr6s\" (UID: \"cd100b0f-a2de-4036-a21a-4412e02fa15f\") " pod="openshift-network-diagnostics/network-check-target-dnr6s"
Aug 05 17:32:56.322629 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.322493    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e38f44f9-8de8-4953-a874-97f4ddba3451-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-trjvx\" (UID: \"e38f44f9-8de8-4953-a874-97f4ddba3451\") " pod="openshift-multus/multus-additional-cni-plugins-trjvx"
Aug 05 17:32:56.322629 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.322520    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2c932fc3-5567-4183-97ee-36f5359a9a64-serviceca\") pod \"node-ca-ddzbb\" (UID: \"2c932fc3-5567-4183-97ee-36f5359a9a64\") " pod="openshift-image-registry/node-ca-ddzbb"
Aug 05 17:32:56.323351 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:56.322537    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 17:32:56.323351 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.322542    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-host-run-multus-certs\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.323351 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.322541    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e38f44f9-8de8-4953-a874-97f4ddba3451-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-trjvx\" (UID: \"e38f44f9-8de8-4953-a874-97f4ddba3451\") " pod="openshift-multus/multus-additional-cni-plugins-trjvx"
Aug 05 17:32:56.323351 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.322581    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d79df3a4-4b86-4acd-9884-c9d745b6b79b-dbus\") pod \"global-pull-secret-syncer-vth7m\" (UID: \"d79df3a4-4b86-4acd-9884-c9d745b6b79b\") " pod="kube-system/global-pull-secret-syncer-vth7m"
Aug 05 17:32:56.323351 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.322589    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e38f44f9-8de8-4953-a874-97f4ddba3451-cnibin\") pod \"multus-additional-cni-plugins-trjvx\" (UID: \"e38f44f9-8de8-4953-a874-97f4ddba3451\") " pod="openshift-multus/multus-additional-cni-plugins-trjvx"
Aug 05 17:32:56.323351 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:56.322612    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83867a5e-d4bd-4da7-a6e4-e129d0f300a9-metrics-certs podName:83867a5e-d4bd-4da7-a6e4-e129d0f300a9 nodeName:}" failed. No retries permitted until 2026-08-05 17:32:56.822587234 +0000 UTC m=+3.135438600 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83867a5e-d4bd-4da7-a6e4-e129d0f300a9-metrics-certs") pod "network-metrics-daemon-rwwxz" (UID: "83867a5e-d4bd-4da7-a6e4-e129d0f300a9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 17:32:56.323351 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.322684    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d302441f-1c1b-4bb2-9e15-75f7dd84f723-etc-sysctl-d\") pod \"tuned-4cwp6\" (UID: \"d302441f-1c1b-4bb2-9e15-75f7dd84f723\") " pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.323351 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.322691    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d79df3a4-4b86-4acd-9884-c9d745b6b79b-dbus\") pod \"global-pull-secret-syncer-vth7m\" (UID: \"d79df3a4-4b86-4acd-9884-c9d745b6b79b\") " pod="kube-system/global-pull-secret-syncer-vth7m"
Aug 05 17:32:56.323351 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.322713    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-host-run-k8s-cni-cncf-io\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.323351 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.322751    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-cnibin\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.323838 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.323532    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e38f44f9-8de8-4953-a874-97f4ddba3451-system-cni-dir\") pod \"multus-additional-cni-plugins-trjvx\" (UID: \"e38f44f9-8de8-4953-a874-97f4ddba3451\") " pod="openshift-multus/multus-additional-cni-plugins-trjvx"
Aug 05 17:32:56.323838 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.323666    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d302441f-1c1b-4bb2-9e15-75f7dd84f723-etc-modprobe-d\") pod \"tuned-4cwp6\" (UID: \"d302441f-1c1b-4bb2-9e15-75f7dd84f723\") " pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.323838 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.323727    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-multus-cni-dir\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.323838 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.323762    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2c932fc3-5567-4183-97ee-36f5359a9a64-host\") pod \"node-ca-ddzbb\" (UID: \"2c932fc3-5567-4183-97ee-36f5359a9a64\") " pod="openshift-image-registry/node-ca-ddzbb"
Aug 05 17:32:56.323838 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.323770    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-multus-socket-dir-parent\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.323838 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.323803    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-host-var-lib-cni-bin\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.324200 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.323844    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n7ml\" (UniqueName: \"kubernetes.io/projected/e38f44f9-8de8-4953-a874-97f4ddba3451-kube-api-access-2n7ml\") pod \"multus-additional-cni-plugins-trjvx\" (UID: \"e38f44f9-8de8-4953-a874-97f4ddba3451\") " pod="openshift-multus/multus-additional-cni-plugins-trjvx"
Aug 05 17:32:56.324200 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.323877    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t48d5\" (UniqueName: \"kubernetes.io/projected/2c932fc3-5567-4183-97ee-36f5359a9a64-kube-api-access-t48d5\") pod \"node-ca-ddzbb\" (UID: \"2c932fc3-5567-4183-97ee-36f5359a9a64\") " pod="openshift-image-registry/node-ca-ddzbb"
Aug 05 17:32:56.324200 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.323997    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e38f44f9-8de8-4953-a874-97f4ddba3451-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-trjvx\" (UID: \"e38f44f9-8de8-4953-a874-97f4ddba3451\") " pod="openshift-multus/multus-additional-cni-plugins-trjvx"
Aug 05 17:32:56.324384 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.324279    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-multus-cni-dir\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.324434 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.324395    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-multus-socket-dir-parent\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.324498 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.324451    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-host-var-lib-cni-bin\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.324548 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.324476    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2c932fc3-5567-4183-97ee-36f5359a9a64-serviceca\") pod \"node-ca-ddzbb\" (UID: \"2c932fc3-5567-4183-97ee-36f5359a9a64\") " pod="openshift-image-registry/node-ca-ddzbb"
Aug 05 17:32:56.324548 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.324531    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d302441f-1c1b-4bb2-9e15-75f7dd84f723-var-lib-kubelet\") pod \"tuned-4cwp6\" (UID: \"d302441f-1c1b-4bb2-9e15-75f7dd84f723\") " pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.324796 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.324765    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/061ab456-b3f0-4202-bb10-9e741ba5a8a3-iptables-alerter-script\") pod \"iptables-alerter-4c5rk\" (UID: \"061ab456-b3f0-4202-bb10-9e741ba5a8a3\") " pod="openshift-network-operator/iptables-alerter-4c5rk"
Aug 05 17:32:56.324930 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.324820    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d302441f-1c1b-4bb2-9e15-75f7dd84f723-etc-kubernetes\") pod \"tuned-4cwp6\" (UID: \"d302441f-1c1b-4bb2-9e15-75f7dd84f723\") " pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.324930 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.324852    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d302441f-1c1b-4bb2-9e15-75f7dd84f723-etc-sysctl-conf\") pod \"tuned-4cwp6\" (UID: \"d302441f-1c1b-4bb2-9e15-75f7dd84f723\") " pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.324930 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.324885    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6d395bda-7395-40e9-b0cc-1195e1d656d1-konnectivity-ca\") pod \"konnectivity-agent-nqss6\" (UID: \"6d395bda-7395-40e9-b0cc-1195e1d656d1\") " pod="kube-system/konnectivity-agent-nqss6"
Aug 05 17:32:56.325095 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.324929    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-host-var-lib-kubelet\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.325095 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.324972    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e38f44f9-8de8-4953-a874-97f4ddba3451-tuning-conf-dir\") pod \"multus-additional-cni-plugins-trjvx\" (UID: \"e38f44f9-8de8-4953-a874-97f4ddba3451\") " pod="openshift-multus/multus-additional-cni-plugins-trjvx"
Aug 05 17:32:56.325095 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.325009    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e38f44f9-8de8-4953-a874-97f4ddba3451-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-trjvx\" (UID: \"e38f44f9-8de8-4953-a874-97f4ddba3451\") " pod="openshift-multus/multus-additional-cni-plugins-trjvx"
Aug 05 17:32:56.325095 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.325032    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d302441f-1c1b-4bb2-9e15-75f7dd84f723-etc-systemd\") pod \"tuned-4cwp6\" (UID: \"d302441f-1c1b-4bb2-9e15-75f7dd84f723\") " pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.325271 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.325194    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6d395bda-7395-40e9-b0cc-1195e1d656d1-agent-certs\") pod \"konnectivity-agent-nqss6\" (UID: \"6d395bda-7395-40e9-b0cc-1195e1d656d1\") " pod="kube-system/konnectivity-agent-nqss6"
Aug 05 17:32:56.325340 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.325295    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d302441f-1c1b-4bb2-9e15-75f7dd84f723-lib-modules\") pod \"tuned-4cwp6\" (UID: \"d302441f-1c1b-4bb2-9e15-75f7dd84f723\") " pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.325473 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.325455    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d302441f-1c1b-4bb2-9e15-75f7dd84f723-lib-modules\") pod \"tuned-4cwp6\" (UID: \"d302441f-1c1b-4bb2-9e15-75f7dd84f723\") " pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.325532 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.325482    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d302441f-1c1b-4bb2-9e15-75f7dd84f723-etc-sysctl-conf\") pod \"tuned-4cwp6\" (UID: \"d302441f-1c1b-4bb2-9e15-75f7dd84f723\") " pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.325695 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.325677    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d302441f-1c1b-4bb2-9e15-75f7dd84f723-etc-systemd\") pod \"tuned-4cwp6\" (UID: \"d302441f-1c1b-4bb2-9e15-75f7dd84f723\") " pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.326088 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.326068    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-host-var-lib-kubelet\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.326212 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.326165    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d302441f-1c1b-4bb2-9e15-75f7dd84f723-etc-kubernetes\") pod \"tuned-4cwp6\" (UID: \"d302441f-1c1b-4bb2-9e15-75f7dd84f723\") " pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.326299 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.326210    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6d395bda-7395-40e9-b0cc-1195e1d656d1-konnectivity-ca\") pod \"konnectivity-agent-nqss6\" (UID: \"6d395bda-7395-40e9-b0cc-1195e1d656d1\") " pod="kube-system/konnectivity-agent-nqss6"
Aug 05 17:32:56.326299 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.326212    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/061ab456-b3f0-4202-bb10-9e741ba5a8a3-iptables-alerter-script\") pod \"iptables-alerter-4c5rk\" (UID: \"061ab456-b3f0-4202-bb10-9e741ba5a8a3\") " pod="openshift-network-operator/iptables-alerter-4c5rk"
Aug 05 17:32:56.326423 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.326319    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-multus-daemon-config\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.326423 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.326365    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e38f44f9-8de8-4953-a874-97f4ddba3451-tuning-conf-dir\") pod \"multus-additional-cni-plugins-trjvx\" (UID: \"e38f44f9-8de8-4953-a874-97f4ddba3451\") " pod="openshift-multus/multus-additional-cni-plugins-trjvx"
Aug 05 17:32:56.326423 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.326368    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e38f44f9-8de8-4953-a874-97f4ddba3451-os-release\") pod \"multus-additional-cni-plugins-trjvx\" (UID: \"e38f44f9-8de8-4953-a874-97f4ddba3451\") " pod="openshift-multus/multus-additional-cni-plugins-trjvx"
Aug 05 17:32:56.326576 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.326422    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d302441f-1c1b-4bb2-9e15-75f7dd84f723-etc-sysconfig\") pod \"tuned-4cwp6\" (UID: \"d302441f-1c1b-4bb2-9e15-75f7dd84f723\") " pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.326576 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.326439    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e38f44f9-8de8-4953-a874-97f4ddba3451-os-release\") pod \"multus-additional-cni-plugins-trjvx\" (UID: \"e38f44f9-8de8-4953-a874-97f4ddba3451\") " pod="openshift-multus/multus-additional-cni-plugins-trjvx"
Aug 05 17:32:56.326576 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.326460    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk4fn\" (UniqueName: \"kubernetes.io/projected/d302441f-1c1b-4bb2-9e15-75f7dd84f723-kube-api-access-xk4fn\") pod \"tuned-4cwp6\" (UID: \"d302441f-1c1b-4bb2-9e15-75f7dd84f723\") " pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.326576 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.326502    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d302441f-1c1b-4bb2-9e15-75f7dd84f723-sys\") pod \"tuned-4cwp6\" (UID: \"d302441f-1c1b-4bb2-9e15-75f7dd84f723\") " pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.326576 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.326531    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/061ab456-b3f0-4202-bb10-9e741ba5a8a3-host-slash\") pod \"iptables-alerter-4c5rk\" (UID: \"061ab456-b3f0-4202-bb10-9e741ba5a8a3\") " pod="openshift-network-operator/iptables-alerter-4c5rk"
Aug 05 17:32:56.326576 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.326567    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-multus-conf-dir\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.326935 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.326602    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-etc-kubernetes\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.326935 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.326638    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxths\" (UniqueName: \"kubernetes.io/projected/83867a5e-d4bd-4da7-a6e4-e129d0f300a9-kube-api-access-bxths\") pod \"network-metrics-daemon-rwwxz\" (UID: \"83867a5e-d4bd-4da7-a6e4-e129d0f300a9\") " pod="openshift-multus/network-metrics-daemon-rwwxz"
Aug 05 17:32:56.326935 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.326740    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxzzk\" (UniqueName: \"kubernetes.io/projected/061ab456-b3f0-4202-bb10-9e741ba5a8a3-kube-api-access-fxzzk\") pod \"iptables-alerter-4c5rk\" (UID: \"061ab456-b3f0-4202-bb10-9e741ba5a8a3\") " pod="openshift-network-operator/iptables-alerter-4c5rk"
Aug 05 17:32:56.326935 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.326770    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-system-cni-dir\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.326935 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.326804    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-host-var-lib-cni-multus\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.326935 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.326840    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e38f44f9-8de8-4953-a874-97f4ddba3451-cni-binary-copy\") pod \"multus-additional-cni-plugins-trjvx\" (UID: \"e38f44f9-8de8-4953-a874-97f4ddba3451\") " pod="openshift-multus/multus-additional-cni-plugins-trjvx"
Aug 05 17:32:56.326935 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.326872    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d302441f-1c1b-4bb2-9e15-75f7dd84f723-etc-tuned\") pod \"tuned-4cwp6\" (UID: \"d302441f-1c1b-4bb2-9e15-75f7dd84f723\") " pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.326935 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.326899    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-os-release\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.326935 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.326932    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-cni-binary-copy\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.327444 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.326967    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d302441f-1c1b-4bb2-9e15-75f7dd84f723-host\") pod \"tuned-4cwp6\" (UID: \"d302441f-1c1b-4bb2-9e15-75f7dd84f723\") " pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.327444 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.327001    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d79df3a4-4b86-4acd-9884-c9d745b6b79b-original-pull-secret\") pod \"global-pull-secret-syncer-vth7m\" (UID: \"d79df3a4-4b86-4acd-9884-c9d745b6b79b\") " pod="kube-system/global-pull-secret-syncer-vth7m"
Aug 05 17:32:56.327444 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.327020    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-multus-daemon-config\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.327444 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.327204    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d302441f-1c1b-4bb2-9e15-75f7dd84f723-etc-sysconfig\") pod \"tuned-4cwp6\" (UID: \"d302441f-1c1b-4bb2-9e15-75f7dd84f723\") " pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.327650 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.327508    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d302441f-1c1b-4bb2-9e15-75f7dd84f723-sys\") pod \"tuned-4cwp6\" (UID: \"d302441f-1c1b-4bb2-9e15-75f7dd84f723\") " pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.327650 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.327531    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-os-release\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.327650 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.327567    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e38f44f9-8de8-4953-a874-97f4ddba3451-cni-binary-copy\") pod \"multus-additional-cni-plugins-trjvx\" (UID: \"e38f44f9-8de8-4953-a874-97f4ddba3451\") " pod="openshift-multus/multus-additional-cni-plugins-trjvx"
Aug 05 17:32:56.327650 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.327616    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-system-cni-dir\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.327853 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:56.327678    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 17:32:56.327853 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:56.327746    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d79df3a4-4b86-4acd-9884-c9d745b6b79b-original-pull-secret podName:d79df3a4-4b86-4acd-9884-c9d745b6b79b nodeName:}" failed. No retries permitted until 2026-08-05 17:32:56.827720141 +0000 UTC m=+3.140571484 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d79df3a4-4b86-4acd-9884-c9d745b6b79b-original-pull-secret") pod "global-pull-secret-syncer-vth7m" (UID: "d79df3a4-4b86-4acd-9884-c9d745b6b79b") : object "kube-system"/"original-pull-secret" not registered
Aug 05 17:32:56.327853 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.327810    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-host-var-lib-cni-multus\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.328040 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.327879    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d302441f-1c1b-4bb2-9e15-75f7dd84f723-host\") pod \"tuned-4cwp6\" (UID: \"d302441f-1c1b-4bb2-9e15-75f7dd84f723\") " pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.328040 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.327941    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-cni-binary-copy\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.328040 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.327951    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-multus-conf-dir\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.328040 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.327982    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-etc-kubernetes\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.328040 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.328016    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/061ab456-b3f0-4202-bb10-9e741ba5a8a3-host-slash\") pod \"iptables-alerter-4c5rk\" (UID: \"061ab456-b3f0-4202-bb10-9e741ba5a8a3\") " pod="openshift-network-operator/iptables-alerter-4c5rk"
Aug 05 17:32:56.330471 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.330443    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d302441f-1c1b-4bb2-9e15-75f7dd84f723-tmp\") pod \"tuned-4cwp6\" (UID: \"d302441f-1c1b-4bb2-9e15-75f7dd84f723\") " pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.331362 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.331309    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d302441f-1c1b-4bb2-9e15-75f7dd84f723-etc-tuned\") pod \"tuned-4cwp6\" (UID: \"d302441f-1c1b-4bb2-9e15-75f7dd84f723\") " pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.339695 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:56.339621    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 17:32:56.339695 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:56.339652    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 17:32:56.339695 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:56.339667    2558 projected.go:196] Error preparing data for projected volume kube-api-access-lhth2 for pod openshift-network-diagnostics/network-check-target-dnr6s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 17:32:56.339938 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:56.339770    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd100b0f-a2de-4036-a21a-4412e02fa15f-kube-api-access-lhth2 podName:cd100b0f-a2de-4036-a21a-4412e02fa15f nodeName:}" failed. No retries permitted until 2026-08-05 17:32:56.839751407 +0000 UTC m=+3.152602776 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lhth2" (UniqueName: "kubernetes.io/projected/cd100b0f-a2de-4036-a21a-4412e02fa15f-kube-api-access-lhth2") pod "network-check-target-dnr6s" (UID: "cd100b0f-a2de-4036-a21a-4412e02fa15f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 17:32:56.342541 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.342513    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t48d5\" (UniqueName: \"kubernetes.io/projected/2c932fc3-5567-4183-97ee-36f5359a9a64-kube-api-access-t48d5\") pod \"node-ca-ddzbb\" (UID: \"2c932fc3-5567-4183-97ee-36f5359a9a64\") " pod="openshift-image-registry/node-ca-ddzbb"
Aug 05 17:32:56.342645 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.342599    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m2j2\" (UniqueName: \"kubernetes.io/projected/ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297-kube-api-access-6m2j2\") pod \"multus-bh9fk\" (UID: \"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297\") " pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.342645 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.342610    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g98sl\" (UniqueName: \"kubernetes.io/projected/795a8ab5-035a-4295-a4ea-e7d44991562d-kube-api-access-g98sl\") pod \"node-resolver-jmdlw\" (UID: \"795a8ab5-035a-4295-a4ea-e7d44991562d\") " pod="openshift-dns/node-resolver-jmdlw"
Aug 05 17:32:56.350861 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.350829    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n7ml\" (UniqueName: \"kubernetes.io/projected/e38f44f9-8de8-4953-a874-97f4ddba3451-kube-api-access-2n7ml\") pod \"multus-additional-cni-plugins-trjvx\" (UID: \"e38f44f9-8de8-4953-a874-97f4ddba3451\") " pod="openshift-multus/multus-additional-cni-plugins-trjvx"
Aug 05 17:32:56.359347 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.359301    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxzzk\" (UniqueName: \"kubernetes.io/projected/061ab456-b3f0-4202-bb10-9e741ba5a8a3-kube-api-access-fxzzk\") pod \"iptables-alerter-4c5rk\" (UID: \"061ab456-b3f0-4202-bb10-9e741ba5a8a3\") " pod="openshift-network-operator/iptables-alerter-4c5rk"
Aug 05 17:32:56.359850 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.359826    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxths\" (UniqueName: \"kubernetes.io/projected/83867a5e-d4bd-4da7-a6e4-e129d0f300a9-kube-api-access-bxths\") pod \"network-metrics-daemon-rwwxz\" (UID: \"83867a5e-d4bd-4da7-a6e4-e129d0f300a9\") " pod="openshift-multus/network-metrics-daemon-rwwxz"
Aug 05 17:32:56.360771 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.360745    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xk4fn\" (UniqueName: \"kubernetes.io/projected/d302441f-1c1b-4bb2-9e15-75f7dd84f723-kube-api-access-xk4fn\") pod \"tuned-4cwp6\" (UID: \"d302441f-1c1b-4bb2-9e15-75f7dd84f723\") " pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.415978 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.415943    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:32:56.424960 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.424892    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2kj6"
Aug 05 17:32:56.435185 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.435151    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4c5rk"
Aug 05 17:32:56.437765 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.437739    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 17:32:56.444315 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.444283    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bh9fk"
Aug 05 17:32:56.451736 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.451702    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4cwp6"
Aug 05 17:32:56.460027 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.459997    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jmdlw"
Aug 05 17:32:56.467954 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.467912    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ddzbb"
Aug 05 17:32:56.476168 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.476134    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-trjvx"
Aug 05 17:32:56.482523 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.482485    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nqss6"
Aug 05 17:32:56.831257 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.831216    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d79df3a4-4b86-4acd-9884-c9d745b6b79b-original-pull-secret\") pod \"global-pull-secret-syncer-vth7m\" (UID: \"d79df3a4-4b86-4acd-9884-c9d745b6b79b\") " pod="kube-system/global-pull-secret-syncer-vth7m"
Aug 05 17:32:56.831455 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.831288    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83867a5e-d4bd-4da7-a6e4-e129d0f300a9-metrics-certs\") pod \"network-metrics-daemon-rwwxz\" (UID: \"83867a5e-d4bd-4da7-a6e4-e129d0f300a9\") " pod="openshift-multus/network-metrics-daemon-rwwxz"
Aug 05 17:32:56.831455 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:56.831398    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 17:32:56.831455 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:56.831433    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 17:32:56.831591 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:56.831485    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d79df3a4-4b86-4acd-9884-c9d745b6b79b-original-pull-secret podName:d79df3a4-4b86-4acd-9884-c9d745b6b79b nodeName:}" failed. No retries permitted until 2026-08-05 17:32:57.831465975 +0000 UTC m=+4.144317338 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d79df3a4-4b86-4acd-9884-c9d745b6b79b-original-pull-secret") pod "global-pull-secret-syncer-vth7m" (UID: "d79df3a4-4b86-4acd-9884-c9d745b6b79b") : object "kube-system"/"original-pull-secret" not registered
Aug 05 17:32:56.831591 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:56.831509    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83867a5e-d4bd-4da7-a6e4-e129d0f300a9-metrics-certs podName:83867a5e-d4bd-4da7-a6e4-e129d0f300a9 nodeName:}" failed. No retries permitted until 2026-08-05 17:32:57.831497307 +0000 UTC m=+4.144348649 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83867a5e-d4bd-4da7-a6e4-e129d0f300a9-metrics-certs") pod "network-metrics-daemon-rwwxz" (UID: "83867a5e-d4bd-4da7-a6e4-e129d0f300a9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 17:32:56.932568 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:56.932519    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhth2\" (UniqueName: \"kubernetes.io/projected/cd100b0f-a2de-4036-a21a-4412e02fa15f-kube-api-access-lhth2\") pod \"network-check-target-dnr6s\" (UID: \"cd100b0f-a2de-4036-a21a-4412e02fa15f\") " pod="openshift-network-diagnostics/network-check-target-dnr6s"
Aug 05 17:32:56.932744 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:56.932708    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 17:32:56.932744 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:56.932730    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 17:32:56.932744 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:56.932740    2558 projected.go:196] Error preparing data for projected volume kube-api-access-lhth2 for pod openshift-network-diagnostics/network-check-target-dnr6s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 17:32:56.932883 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:56.932802    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd100b0f-a2de-4036-a21a-4412e02fa15f-kube-api-access-lhth2 podName:cd100b0f-a2de-4036-a21a-4412e02fa15f nodeName:}" failed. No retries permitted until 2026-08-05 17:32:57.932783386 +0000 UTC m=+4.245634743 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lhth2" (UniqueName: "kubernetes.io/projected/cd100b0f-a2de-4036-a21a-4412e02fa15f-kube-api-access-lhth2") pod "network-check-target-dnr6s" (UID: "cd100b0f-a2de-4036-a21a-4412e02fa15f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 17:32:57.176518 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:57.176468    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-04 17:27:56 +0000 UTC" deadline="2028-04-05 16:02:21.045889709 +0000 UTC"
Aug 05 17:32:57.176518 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:57.176510    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14614h29m23.869383606s"
Aug 05 17:32:57.262176 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:57.262132    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod061ab456_b3f0_4202_bb10_9e741ba5a8a3.slice/crio-6a80d0cedf333be6939559970fcd26b389f34f77afee770fb2cc92696f9fab9c WatchSource:0}: Error finding container 6a80d0cedf333be6939559970fcd26b389f34f77afee770fb2cc92696f9fab9c: Status 404 returned error can't find the container with id 6a80d0cedf333be6939559970fcd26b389f34f77afee770fb2cc92696f9fab9c
Aug 05 17:32:57.262906 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:57.262883    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99842ca9_d2b9_4e20_b0e3_290f9d68cf4e.slice/crio-9f3f351a9f5dc817549f598b6fba557d442491bbd6cd7e9c615ddf22a84d84fc WatchSource:0}: Error finding container 9f3f351a9f5dc817549f598b6fba557d442491bbd6cd7e9c615ddf22a84d84fc: Status 404 returned error can't find the container with id 9f3f351a9f5dc817549f598b6fba557d442491bbd6cd7e9c615ddf22a84d84fc
Aug 05 17:32:57.264655 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:57.264628    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ac9603b_b3c6_4a54_8334_4002e08a6faf.slice/crio-e7ca5a0651719dad04eff9a65737aef7805442ee335aa38521e998e8e83fc6c0 WatchSource:0}: Error finding container e7ca5a0651719dad04eff9a65737aef7805442ee335aa38521e998e8e83fc6c0: Status 404 returned error can't find the container with id e7ca5a0651719dad04eff9a65737aef7805442ee335aa38521e998e8e83fc6c0
Aug 05 17:32:57.265299 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:57.265159    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode38f44f9_8de8_4953_a874_97f4ddba3451.slice/crio-feddc7151772761c55311a507d0903cfdc513d31fc8e77f0749f58cb0db7a7f4 WatchSource:0}: Error finding container feddc7151772761c55311a507d0903cfdc513d31fc8e77f0749f58cb0db7a7f4: Status 404 returned error can't find the container with id feddc7151772761c55311a507d0903cfdc513d31fc8e77f0749f58cb0db7a7f4
Aug 05 17:32:57.266782 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:57.266703    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c932fc3_5567_4183_97ee_36f5359a9a64.slice/crio-0f1926d8b1ed5e99cfb76d5a8b85357140dd0e1f24912935d42c66fd17ffb087 WatchSource:0}: Error finding container 0f1926d8b1ed5e99cfb76d5a8b85357140dd0e1f24912935d42c66fd17ffb087: Status 404 returned error can't find the container with id 0f1926d8b1ed5e99cfb76d5a8b85357140dd0e1f24912935d42c66fd17ffb087
Aug 05 17:32:57.268135 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:57.268094    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod795a8ab5_035a_4295_a4ea_e7d44991562d.slice/crio-a441fe1167aaeca82635cc8edce5d860d31f168f37773ec9e38a6cb032338043 WatchSource:0}: Error finding container a441fe1167aaeca82635cc8edce5d860d31f168f37773ec9e38a6cb032338043: Status 404 returned error can't find the container with id a441fe1167aaeca82635cc8edce5d860d31f168f37773ec9e38a6cb032338043
Aug 05 17:32:57.269967 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:57.269929    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef2c5ee7_f2b6_4f58_9f03_c51f36b9b297.slice/crio-ad96925dbe05e9c541fff36de0dcb18d83a621da839a8c1bb7b8d6e9e2d997ed WatchSource:0}: Error finding container ad96925dbe05e9c541fff36de0dcb18d83a621da839a8c1bb7b8d6e9e2d997ed: Status 404 returned error can't find the container with id ad96925dbe05e9c541fff36de0dcb18d83a621da839a8c1bb7b8d6e9e2d997ed
Aug 05 17:32:57.271647 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:32:57.271612    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d395bda_7395_40e9_b0cc_1195e1d656d1.slice/crio-9dc100c474acf6bd816ecc47fa83d32285404055ce1ef6ed7a06bc8bc993be84 WatchSource:0}: Error finding container 9dc100c474acf6bd816ecc47fa83d32285404055ce1ef6ed7a06bc8bc993be84: Status 404 returned error can't find the container with id 9dc100c474acf6bd816ecc47fa83d32285404055ce1ef6ed7a06bc8bc993be84
Aug 05 17:32:57.840363 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:57.839998    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83867a5e-d4bd-4da7-a6e4-e129d0f300a9-metrics-certs\") pod \"network-metrics-daemon-rwwxz\" (UID: \"83867a5e-d4bd-4da7-a6e4-e129d0f300a9\") " pod="openshift-multus/network-metrics-daemon-rwwxz"
Aug 05 17:32:57.840548 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:57.840381    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d79df3a4-4b86-4acd-9884-c9d745b6b79b-original-pull-secret\") pod \"global-pull-secret-syncer-vth7m\" (UID: \"d79df3a4-4b86-4acd-9884-c9d745b6b79b\") " pod="kube-system/global-pull-secret-syncer-vth7m"
Aug 05 17:32:57.840548 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:57.840514    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 17:32:57.840664 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:57.840578    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d79df3a4-4b86-4acd-9884-c9d745b6b79b-original-pull-secret podName:d79df3a4-4b86-4acd-9884-c9d745b6b79b nodeName:}" failed. No retries permitted until 2026-08-05 17:32:59.840559939 +0000 UTC m=+6.153411298 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d79df3a4-4b86-4acd-9884-c9d745b6b79b-original-pull-secret") pod "global-pull-secret-syncer-vth7m" (UID: "d79df3a4-4b86-4acd-9884-c9d745b6b79b") : object "kube-system"/"original-pull-secret" not registered
Aug 05 17:32:57.841033 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:57.841012    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 17:32:57.841136 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:57.841074    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83867a5e-d4bd-4da7-a6e4-e129d0f300a9-metrics-certs podName:83867a5e-d4bd-4da7-a6e4-e129d0f300a9 nodeName:}" failed. No retries permitted until 2026-08-05 17:32:59.841056422 +0000 UTC m=+6.153907779 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83867a5e-d4bd-4da7-a6e4-e129d0f300a9-metrics-certs") pod "network-metrics-daemon-rwwxz" (UID: "83867a5e-d4bd-4da7-a6e4-e129d0f300a9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 17:32:57.940805 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:57.940760    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhth2\" (UniqueName: \"kubernetes.io/projected/cd100b0f-a2de-4036-a21a-4412e02fa15f-kube-api-access-lhth2\") pod \"network-check-target-dnr6s\" (UID: \"cd100b0f-a2de-4036-a21a-4412e02fa15f\") " pod="openshift-network-diagnostics/network-check-target-dnr6s"
Aug 05 17:32:57.941065 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:57.940967    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 17:32:57.941065 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:57.940991    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 17:32:57.941065 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:57.941006    2558 projected.go:196] Error preparing data for projected volume kube-api-access-lhth2 for pod openshift-network-diagnostics/network-check-target-dnr6s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 17:32:57.941234 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:57.941071    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd100b0f-a2de-4036-a21a-4412e02fa15f-kube-api-access-lhth2 podName:cd100b0f-a2de-4036-a21a-4412e02fa15f nodeName:}" failed. No retries permitted until 2026-08-05 17:32:59.941053178 +0000 UTC m=+6.253904543 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lhth2" (UniqueName: "kubernetes.io/projected/cd100b0f-a2de-4036-a21a-4412e02fa15f-kube-api-access-lhth2") pod "network-check-target-dnr6s" (UID: "cd100b0f-a2de-4036-a21a-4412e02fa15f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 17:32:58.176883 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:58.176816    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-04 17:27:56 +0000 UTC" deadline="2028-03-21 19:50:49.173911707 +0000 UTC"
Aug 05 17:32:58.176883 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:58.176879    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14258h17m50.997036981s"
Aug 05 17:32:58.250514 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:58.250463    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnr6s"
Aug 05 17:32:58.250722 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:58.250605    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnr6s" podUID="cd100b0f-a2de-4036-a21a-4412e02fa15f"
Aug 05 17:32:58.251085 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:58.251063    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rwwxz"
Aug 05 17:32:58.251204 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:58.251182    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rwwxz" podUID="83867a5e-d4bd-4da7-a6e4-e129d0f300a9"
Aug 05 17:32:58.251309 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:58.251283    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vth7m"
Aug 05 17:32:58.251433 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:58.251387    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vth7m" podUID="d79df3a4-4b86-4acd-9884-c9d745b6b79b"
Aug 05 17:32:58.281007 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:58.280967    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4cwp6" event={"ID":"d302441f-1c1b-4bb2-9e15-75f7dd84f723","Type":"ContainerStarted","Data":"7319cb6c0eeda36d2489422ae354a69aea3b3a8f8db375f562fad46a6830f79a"}
Aug 05 17:32:58.289761 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:58.289714    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jmdlw" event={"ID":"795a8ab5-035a-4295-a4ea-e7d44991562d","Type":"ContainerStarted","Data":"a441fe1167aaeca82635cc8edce5d860d31f168f37773ec9e38a6cb032338043"}
Aug 05 17:32:58.292995 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:58.292958    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ddzbb" event={"ID":"2c932fc3-5567-4183-97ee-36f5359a9a64","Type":"ContainerStarted","Data":"0f1926d8b1ed5e99cfb76d5a8b85357140dd0e1f24912935d42c66fd17ffb087"}
Aug 05 17:32:58.301022 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:58.300817    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-trjvx" event={"ID":"e38f44f9-8de8-4953-a874-97f4ddba3451","Type":"ContainerStarted","Data":"feddc7151772761c55311a507d0903cfdc513d31fc8e77f0749f58cb0db7a7f4"}
Aug 05 17:32:58.316822 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:58.316783    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-136.ec2.internal" event={"ID":"1afd46020d6263e2760b405ad0307aa7","Type":"ContainerStarted","Data":"7ac54fc39347ebf777f378ad237bb2dc7a21bdcac4b8d0fa2d8c2c9543c900c8"}
Aug 05 17:32:58.325628 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:58.325583    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nqss6" event={"ID":"6d395bda-7395-40e9-b0cc-1195e1d656d1","Type":"ContainerStarted","Data":"9dc100c474acf6bd816ecc47fa83d32285404055ce1ef6ed7a06bc8bc993be84"}
Aug 05 17:32:58.343452 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:58.343407    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bh9fk" event={"ID":"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297","Type":"ContainerStarted","Data":"ad96925dbe05e9c541fff36de0dcb18d83a621da839a8c1bb7b8d6e9e2d997ed"}
Aug 05 17:32:58.347246 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:58.347208    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd" event={"ID":"5ac9603b-b3c6-4a54-8334-4002e08a6faf","Type":"ContainerStarted","Data":"e7ca5a0651719dad04eff9a65737aef7805442ee335aa38521e998e8e83fc6c0"}
Aug 05 17:32:58.349398 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:58.349364    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2kj6" event={"ID":"99842ca9-d2b9-4e20-b0e3-290f9d68cf4e","Type":"ContainerStarted","Data":"9f3f351a9f5dc817549f598b6fba557d442491bbd6cd7e9c615ddf22a84d84fc"}
Aug 05 17:32:58.351328 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:58.351251    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4c5rk" event={"ID":"061ab456-b3f0-4202-bb10-9e741ba5a8a3","Type":"ContainerStarted","Data":"6a80d0cedf333be6939559970fcd26b389f34f77afee770fb2cc92696f9fab9c"}
Aug 05 17:32:58.357568 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:58.356869    2558 generic.go:356] "Generic (PLEG): container finished" podID="01733263bf8d53389b9903685bc9db22" containerID="fa840e70897480497bd0f4c9703fd7d87ad79bb3089c527d60425a7742072887" exitCode=0
Aug 05 17:32:58.357568 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:58.356919    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-136.ec2.internal" event={"ID":"01733263bf8d53389b9903685bc9db22","Type":"ContainerDied","Data":"fa840e70897480497bd0f4c9703fd7d87ad79bb3089c527d60425a7742072887"}
Aug 05 17:32:58.380866 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:58.380797    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-136.ec2.internal" podStartSLOduration=2.380773573 podStartE2EDuration="2.380773573s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:32:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:32:58.340909981 +0000 UTC m=+4.653761343" watchObservedRunningTime="2026-08-05 17:32:58.380773573 +0000 UTC m=+4.693624941"
Aug 05 17:32:59.373448 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:59.373399    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-136.ec2.internal" event={"ID":"01733263bf8d53389b9903685bc9db22","Type":"ContainerStarted","Data":"63b8b2d2b4991dfae4fb1217b1cbdcef7a8de005a0eb51b23d0af430efd9176c"}
Aug 05 17:32:59.859843 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:59.858986    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d79df3a4-4b86-4acd-9884-c9d745b6b79b-original-pull-secret\") pod \"global-pull-secret-syncer-vth7m\" (UID: \"d79df3a4-4b86-4acd-9884-c9d745b6b79b\") " pod="kube-system/global-pull-secret-syncer-vth7m"
Aug 05 17:32:59.859843 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:59.859059    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83867a5e-d4bd-4da7-a6e4-e129d0f300a9-metrics-certs\") pod \"network-metrics-daemon-rwwxz\" (UID: \"83867a5e-d4bd-4da7-a6e4-e129d0f300a9\") " pod="openshift-multus/network-metrics-daemon-rwwxz"
Aug 05 17:32:59.859843 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:59.859242    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 17:32:59.859843 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:59.859336    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83867a5e-d4bd-4da7-a6e4-e129d0f300a9-metrics-certs podName:83867a5e-d4bd-4da7-a6e4-e129d0f300a9 nodeName:}" failed. No retries permitted until 2026-08-05 17:33:03.859312519 +0000 UTC m=+10.172163881 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83867a5e-d4bd-4da7-a6e4-e129d0f300a9-metrics-certs") pod "network-metrics-daemon-rwwxz" (UID: "83867a5e-d4bd-4da7-a6e4-e129d0f300a9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 17:32:59.859843 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:59.859415    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 17:32:59.859843 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:59.859452    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d79df3a4-4b86-4acd-9884-c9d745b6b79b-original-pull-secret podName:d79df3a4-4b86-4acd-9884-c9d745b6b79b nodeName:}" failed. No retries permitted until 2026-08-05 17:33:03.859439763 +0000 UTC m=+10.172291121 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d79df3a4-4b86-4acd-9884-c9d745b6b79b-original-pull-secret") pod "global-pull-secret-syncer-vth7m" (UID: "d79df3a4-4b86-4acd-9884-c9d745b6b79b") : object "kube-system"/"original-pull-secret" not registered
Aug 05 17:32:59.960420 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:32:59.959737    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhth2\" (UniqueName: \"kubernetes.io/projected/cd100b0f-a2de-4036-a21a-4412e02fa15f-kube-api-access-lhth2\") pod \"network-check-target-dnr6s\" (UID: \"cd100b0f-a2de-4036-a21a-4412e02fa15f\") " pod="openshift-network-diagnostics/network-check-target-dnr6s"
Aug 05 17:32:59.960420 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:59.959913    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 17:32:59.960420 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:59.959938    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 17:32:59.960420 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:59.959951    2558 projected.go:196] Error preparing data for projected volume kube-api-access-lhth2 for pod openshift-network-diagnostics/network-check-target-dnr6s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 17:32:59.960420 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:32:59.960015    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd100b0f-a2de-4036-a21a-4412e02fa15f-kube-api-access-lhth2 podName:cd100b0f-a2de-4036-a21a-4412e02fa15f nodeName:}" failed. No retries permitted until 2026-08-05 17:33:03.959995241 +0000 UTC m=+10.272846604 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lhth2" (UniqueName: "kubernetes.io/projected/cd100b0f-a2de-4036-a21a-4412e02fa15f-kube-api-access-lhth2") pod "network-check-target-dnr6s" (UID: "cd100b0f-a2de-4036-a21a-4412e02fa15f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 17:33:00.249468 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:00.249434    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnr6s"
Aug 05 17:33:00.249674 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:00.249450    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rwwxz"
Aug 05 17:33:00.249674 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:00.249609    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vth7m"
Aug 05 17:33:00.249802 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:00.249575    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnr6s" podUID="cd100b0f-a2de-4036-a21a-4412e02fa15f"
Aug 05 17:33:00.249802 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:00.249729    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rwwxz" podUID="83867a5e-d4bd-4da7-a6e4-e129d0f300a9"
Aug 05 17:33:00.249918 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:00.249823    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vth7m" podUID="d79df3a4-4b86-4acd-9884-c9d745b6b79b"
Aug 05 17:33:02.249996 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:02.249359    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnr6s"
Aug 05 17:33:02.249996 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:02.249469    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnr6s" podUID="cd100b0f-a2de-4036-a21a-4412e02fa15f"
Aug 05 17:33:02.249996 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:02.249813    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rwwxz"
Aug 05 17:33:02.249996 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:02.249940    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rwwxz" podUID="83867a5e-d4bd-4da7-a6e4-e129d0f300a9"
Aug 05 17:33:02.250945 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:02.250764    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vth7m"
Aug 05 17:33:02.250945 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:02.250881    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vth7m" podUID="d79df3a4-4b86-4acd-9884-c9d745b6b79b"
Aug 05 17:33:03.894440 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:03.894312    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d79df3a4-4b86-4acd-9884-c9d745b6b79b-original-pull-secret\") pod \"global-pull-secret-syncer-vth7m\" (UID: \"d79df3a4-4b86-4acd-9884-c9d745b6b79b\") " pod="kube-system/global-pull-secret-syncer-vth7m"
Aug 05 17:33:03.894440 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:03.894378    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83867a5e-d4bd-4da7-a6e4-e129d0f300a9-metrics-certs\") pod \"network-metrics-daemon-rwwxz\" (UID: \"83867a5e-d4bd-4da7-a6e4-e129d0f300a9\") " pod="openshift-multus/network-metrics-daemon-rwwxz"
Aug 05 17:33:03.894994 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:03.894539    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 17:33:03.894994 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:03.894614    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d79df3a4-4b86-4acd-9884-c9d745b6b79b-original-pull-secret podName:d79df3a4-4b86-4acd-9884-c9d745b6b79b nodeName:}" failed. No retries permitted until 2026-08-05 17:33:11.894591901 +0000 UTC m=+18.207443262 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d79df3a4-4b86-4acd-9884-c9d745b6b79b-original-pull-secret") pod "global-pull-secret-syncer-vth7m" (UID: "d79df3a4-4b86-4acd-9884-c9d745b6b79b") : object "kube-system"/"original-pull-secret" not registered
Aug 05 17:33:03.894994 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:03.894656    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 17:33:03.894994 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:03.894726    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83867a5e-d4bd-4da7-a6e4-e129d0f300a9-metrics-certs podName:83867a5e-d4bd-4da7-a6e4-e129d0f300a9 nodeName:}" failed. No retries permitted until 2026-08-05 17:33:11.894706352 +0000 UTC m=+18.207557715 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83867a5e-d4bd-4da7-a6e4-e129d0f300a9-metrics-certs") pod "network-metrics-daemon-rwwxz" (UID: "83867a5e-d4bd-4da7-a6e4-e129d0f300a9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 17:33:03.994836 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:03.994786    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhth2\" (UniqueName: \"kubernetes.io/projected/cd100b0f-a2de-4036-a21a-4412e02fa15f-kube-api-access-lhth2\") pod \"network-check-target-dnr6s\" (UID: \"cd100b0f-a2de-4036-a21a-4412e02fa15f\") " pod="openshift-network-diagnostics/network-check-target-dnr6s"
Aug 05 17:33:03.995056 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:03.994953    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 17:33:03.995056 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:03.994977    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 17:33:03.995056 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:03.994991    2558 projected.go:196] Error preparing data for projected volume kube-api-access-lhth2 for pod openshift-network-diagnostics/network-check-target-dnr6s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 17:33:03.995352 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:03.995061    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd100b0f-a2de-4036-a21a-4412e02fa15f-kube-api-access-lhth2 podName:cd100b0f-a2de-4036-a21a-4412e02fa15f nodeName:}" failed. No retries permitted until 2026-08-05 17:33:11.995040024 +0000 UTC m=+18.307891392 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lhth2" (UniqueName: "kubernetes.io/projected/cd100b0f-a2de-4036-a21a-4412e02fa15f-kube-api-access-lhth2") pod "network-check-target-dnr6s" (UID: "cd100b0f-a2de-4036-a21a-4412e02fa15f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 17:33:04.249886 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:04.249849    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnr6s"
Aug 05 17:33:04.250085 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:04.249977    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnr6s" podUID="cd100b0f-a2de-4036-a21a-4412e02fa15f"
Aug 05 17:33:04.250476 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:04.250451    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rwwxz"
Aug 05 17:33:04.250608 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:04.250588    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rwwxz" podUID="83867a5e-d4bd-4da7-a6e4-e129d0f300a9"
Aug 05 17:33:04.250668 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:04.250611    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vth7m"
Aug 05 17:33:04.250754 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:04.250725    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vth7m" podUID="d79df3a4-4b86-4acd-9884-c9d745b6b79b"
Aug 05 17:33:06.249371 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:06.249340    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnr6s"
Aug 05 17:33:06.249825 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:06.249344    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rwwxz"
Aug 05 17:33:06.249825 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:06.249464    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnr6s" podUID="cd100b0f-a2de-4036-a21a-4412e02fa15f"
Aug 05 17:33:06.249825 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:06.249572    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rwwxz" podUID="83867a5e-d4bd-4da7-a6e4-e129d0f300a9"
Aug 05 17:33:06.249825 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:06.249353    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vth7m"
Aug 05 17:33:06.249825 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:06.249650    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vth7m" podUID="d79df3a4-4b86-4acd-9884-c9d745b6b79b"
Aug 05 17:33:08.249198 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:08.249161    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rwwxz"
Aug 05 17:33:08.249688 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:08.249178    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vth7m"
Aug 05 17:33:08.249688 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:08.249308    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rwwxz" podUID="83867a5e-d4bd-4da7-a6e4-e129d0f300a9"
Aug 05 17:33:08.249688 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:08.249374    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vth7m" podUID="d79df3a4-4b86-4acd-9884-c9d745b6b79b"
Aug 05 17:33:08.249688 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:08.249398    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnr6s"
Aug 05 17:33:08.249688 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:08.249498    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnr6s" podUID="cd100b0f-a2de-4036-a21a-4412e02fa15f"
Aug 05 17:33:10.248880 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:10.248838    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnr6s"
Aug 05 17:33:10.249312 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:10.248981    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnr6s" podUID="cd100b0f-a2de-4036-a21a-4412e02fa15f"
Aug 05 17:33:10.249312 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:10.248838    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rwwxz"
Aug 05 17:33:10.249312 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:10.249094    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rwwxz" podUID="83867a5e-d4bd-4da7-a6e4-e129d0f300a9"
Aug 05 17:33:10.249312 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:10.248838    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vth7m"
Aug 05 17:33:10.249312 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:10.249169    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vth7m" podUID="d79df3a4-4b86-4acd-9884-c9d745b6b79b"
Aug 05 17:33:11.957263 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:11.957209    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d79df3a4-4b86-4acd-9884-c9d745b6b79b-original-pull-secret\") pod \"global-pull-secret-syncer-vth7m\" (UID: \"d79df3a4-4b86-4acd-9884-c9d745b6b79b\") " pod="kube-system/global-pull-secret-syncer-vth7m"
Aug 05 17:33:11.957845 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:11.957293    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83867a5e-d4bd-4da7-a6e4-e129d0f300a9-metrics-certs\") pod \"network-metrics-daemon-rwwxz\" (UID: \"83867a5e-d4bd-4da7-a6e4-e129d0f300a9\") " pod="openshift-multus/network-metrics-daemon-rwwxz"
Aug 05 17:33:11.957845 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:11.957375    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 17:33:11.957845 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:11.957393    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 17:33:11.957845 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:11.957440    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d79df3a4-4b86-4acd-9884-c9d745b6b79b-original-pull-secret podName:d79df3a4-4b86-4acd-9884-c9d745b6b79b nodeName:}" failed. No retries permitted until 2026-08-05 17:33:27.95742639 +0000 UTC m=+34.270277730 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d79df3a4-4b86-4acd-9884-c9d745b6b79b-original-pull-secret") pod "global-pull-secret-syncer-vth7m" (UID: "d79df3a4-4b86-4acd-9884-c9d745b6b79b") : object "kube-system"/"original-pull-secret" not registered
Aug 05 17:33:11.957845 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:11.957457    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83867a5e-d4bd-4da7-a6e4-e129d0f300a9-metrics-certs podName:83867a5e-d4bd-4da7-a6e4-e129d0f300a9 nodeName:}" failed. No retries permitted until 2026-08-05 17:33:27.957450157 +0000 UTC m=+34.270301497 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83867a5e-d4bd-4da7-a6e4-e129d0f300a9-metrics-certs") pod "network-metrics-daemon-rwwxz" (UID: "83867a5e-d4bd-4da7-a6e4-e129d0f300a9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 17:33:12.058398 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:12.058364    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhth2\" (UniqueName: \"kubernetes.io/projected/cd100b0f-a2de-4036-a21a-4412e02fa15f-kube-api-access-lhth2\") pod \"network-check-target-dnr6s\" (UID: \"cd100b0f-a2de-4036-a21a-4412e02fa15f\") " pod="openshift-network-diagnostics/network-check-target-dnr6s"
Aug 05 17:33:12.058577 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:12.058528    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 17:33:12.058577 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:12.058552    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 17:33:12.058577 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:12.058567    2558 projected.go:196] Error preparing data for projected volume kube-api-access-lhth2 for pod openshift-network-diagnostics/network-check-target-dnr6s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 17:33:12.058721 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:12.058627    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd100b0f-a2de-4036-a21a-4412e02fa15f-kube-api-access-lhth2 podName:cd100b0f-a2de-4036-a21a-4412e02fa15f nodeName:}" failed. No retries permitted until 2026-08-05 17:33:28.058611119 +0000 UTC m=+34.371462479 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lhth2" (UniqueName: "kubernetes.io/projected/cd100b0f-a2de-4036-a21a-4412e02fa15f-kube-api-access-lhth2") pod "network-check-target-dnr6s" (UID: "cd100b0f-a2de-4036-a21a-4412e02fa15f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 17:33:12.249153 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:12.248636    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnr6s"
Aug 05 17:33:12.249153 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:12.248657    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rwwxz"
Aug 05 17:33:12.249153 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:12.248773    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vth7m"
Aug 05 17:33:12.249153 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:12.248849    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vth7m" podUID="d79df3a4-4b86-4acd-9884-c9d745b6b79b"
Aug 05 17:33:12.249153 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:12.248769    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnr6s" podUID="cd100b0f-a2de-4036-a21a-4412e02fa15f"
Aug 05 17:33:12.249153 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:12.248943    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rwwxz" podUID="83867a5e-d4bd-4da7-a6e4-e129d0f300a9"
Aug 05 17:33:14.254603 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:14.254271    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vth7m"
Aug 05 17:33:14.254603 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:14.254453    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vth7m" podUID="d79df3a4-4b86-4acd-9884-c9d745b6b79b"
Aug 05 17:33:14.255558 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:14.255062    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnr6s"
Aug 05 17:33:14.255558 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:14.255206    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnr6s" podUID="cd100b0f-a2de-4036-a21a-4412e02fa15f"
Aug 05 17:33:14.255558 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:14.255311    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rwwxz"
Aug 05 17:33:14.255558 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:14.255462    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rwwxz" podUID="83867a5e-d4bd-4da7-a6e4-e129d0f300a9"
Aug 05 17:33:16.248651 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:16.248617    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vth7m"
Aug 05 17:33:16.249212 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:16.248746    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vth7m" podUID="d79df3a4-4b86-4acd-9884-c9d745b6b79b"
Aug 05 17:33:16.249212 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:16.248614    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rwwxz"
Aug 05 17:33:16.249212 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:16.248851    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rwwxz" podUID="83867a5e-d4bd-4da7-a6e4-e129d0f300a9"
Aug 05 17:33:16.249212 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:16.248614    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnr6s"
Aug 05 17:33:16.249212 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:16.248926    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnr6s" podUID="cd100b0f-a2de-4036-a21a-4412e02fa15f"
Aug 05 17:33:17.416132 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:17.415744    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd" event={"ID":"5ac9603b-b3c6-4a54-8334-4002e08a6faf","Type":"ContainerStarted","Data":"98380858cbca2785573982c08c015cf6c9b8af7ea88221ada4e34445e03d0b99"}
Aug 05 17:33:17.417027 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:17.416275    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd" event={"ID":"5ac9603b-b3c6-4a54-8334-4002e08a6faf","Type":"ContainerStarted","Data":"7f5d34b577443e17df76b0d1f529c62e1422395e704b83e3a0f3f93fb16f7308"}
Aug 05 17:33:17.417027 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:17.416336    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd" event={"ID":"5ac9603b-b3c6-4a54-8334-4002e08a6faf","Type":"ContainerStarted","Data":"d4af9aded77bf978dd0e16f4509c28084c38af00fc08486111fa82877844faac"}
Aug 05 17:33:17.417027 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:17.416382    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd" event={"ID":"5ac9603b-b3c6-4a54-8334-4002e08a6faf","Type":"ContainerStarted","Data":"0c43dc4765af5428282514d2a9620bcc7c05de155fad11fb87e5e93134122af1"}
Aug 05 17:33:17.417427 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:17.417403    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2kj6" event={"ID":"99842ca9-d2b9-4e20-b0e3-290f9d68cf4e","Type":"ContainerStarted","Data":"e198c6626829ab30db6d0485caa5eb453237b7d47d2db1aac8efabe4498badae"}
Aug 05 17:33:17.419334 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:17.419307    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4cwp6" event={"ID":"d302441f-1c1b-4bb2-9e15-75f7dd84f723","Type":"ContainerStarted","Data":"d0b54659c43a867cdbe4f09f36cf07e3e4ee984f5696c6a3aee7c3a6234f2acb"}
Aug 05 17:33:17.421189 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:17.421147    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jmdlw" event={"ID":"795a8ab5-035a-4295-a4ea-e7d44991562d","Type":"ContainerStarted","Data":"798daac0c15107873ea768d73ecbbb05b05075ee9cfd54a4dd51a1c44ea04f4a"}
Aug 05 17:33:17.422781 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:17.422667    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ddzbb" event={"ID":"2c932fc3-5567-4183-97ee-36f5359a9a64","Type":"ContainerStarted","Data":"e2debd2084efe92565a7f9df6b88d69b6a767f550ad2fbd53aebb60b29ba7ae0"}
Aug 05 17:33:17.423991 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:17.423971    2558 generic.go:356] "Generic (PLEG): container finished" podID="e38f44f9-8de8-4953-a874-97f4ddba3451" containerID="5647a6f4927a9702dcb9f195d3476db89db4df34fd8296db4d3fb1e0044c37bb" exitCode=0
Aug 05 17:33:17.424095 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:17.424034    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-trjvx" event={"ID":"e38f44f9-8de8-4953-a874-97f4ddba3451","Type":"ContainerDied","Data":"5647a6f4927a9702dcb9f195d3476db89db4df34fd8296db4d3fb1e0044c37bb"}
Aug 05 17:33:17.425949 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:17.425933    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nqss6" event={"ID":"6d395bda-7395-40e9-b0cc-1195e1d656d1","Type":"ContainerStarted","Data":"61f0a0eeeb0ce8f349261f1451151e2aa2ebaa2095b0a93d9d6e190548cf760b"}
Aug 05 17:33:17.427968 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:17.427427    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bh9fk" event={"ID":"ef2c5ee7-f2b6-4f58-9f03-c51f36b9b297","Type":"ContainerStarted","Data":"2814ad633de5fa6c4d5ecb2cd4654ed90e4f53899d9d3c1774bc4e1a0660b669"}
Aug 05 17:33:17.444744 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:17.444706    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4cwp6" podStartSLOduration=2.705801358 podStartE2EDuration="22.444693394s" totalImagesPullingTime="19.738892036s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:32:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:33:17.444537113 +0000 UTC m=+23.757388488" watchObservedRunningTime="2026-08-05 17:33:17.444693394 +0000 UTC m=+23.757544827"
Aug 05 17:33:17.444888 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:17.444845    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-136.ec2.internal" podStartSLOduration=21.444841549 podStartE2EDuration="21.444841549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:32:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:32:59.396703926 +0000 UTC m=+5.709555296" watchObservedRunningTime="2026-08-05 17:33:17.444841549 +0000 UTC m=+23.757692912"
Aug 05 17:33:17.468821 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:17.468761    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bh9fk" podStartSLOduration=2.659588297 podStartE2EDuration="22.468733447s" totalImagesPullingTime="19.80914515s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:32:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:33:17.467968581 +0000 UTC m=+23.780819944" watchObservedRunningTime="2026-08-05 17:33:17.468733447 +0000 UTC m=+23.781584812"
Aug 05 17:33:17.516079 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:17.516029    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jmdlw" podStartSLOduration=2.797761656 podStartE2EDuration="22.516014361s" totalImagesPullingTime="19.718252705s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:32:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:33:17.489683353 +0000 UTC m=+23.802534716" watchObservedRunningTime="2026-08-05 17:33:17.516014361 +0000 UTC m=+23.828865723"
Aug 05 17:33:17.546340 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:17.546286    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nqss6" podStartSLOduration=6.543647136 podStartE2EDuration="22.546272073s" totalImagesPullingTime="16.002624937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:32:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:33:17.5459903 +0000 UTC m=+23.858841665" watchObservedRunningTime="2026-08-05 17:33:17.546272073 +0000 UTC m=+23.859123432"
Aug 05 17:33:17.568282 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:17.568238    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ddzbb" podStartSLOduration=2.846042422 podStartE2EDuration="22.56821152s" totalImagesPullingTime="19.722169098s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:32:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:33:17.568182974 +0000 UTC m=+23.881034338" watchObservedRunningTime="2026-08-05 17:33:17.56821152 +0000 UTC m=+23.881062873"
Aug 05 17:33:17.805710 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:17.805661    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nqss6"
Aug 05 17:33:17.806505 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:17.806482    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nqss6"
Aug 05 17:33:18.250890 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:18.250864    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vth7m"
Aug 05 17:33:18.250890 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:18.250878    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnr6s"
Aug 05 17:33:18.250890 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:18.250879    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rwwxz"
Aug 05 17:33:18.251109 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:18.250959    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vth7m" podUID="d79df3a4-4b86-4acd-9884-c9d745b6b79b"
Aug 05 17:33:18.251109 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:18.251023    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnr6s" podUID="cd100b0f-a2de-4036-a21a-4412e02fa15f"
Aug 05 17:33:18.251109 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:18.251089    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rwwxz" podUID="83867a5e-d4bd-4da7-a6e4-e129d0f300a9"
Aug 05 17:33:18.430608 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:18.430576    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4c5rk" event={"ID":"061ab456-b3f0-4202-bb10-9e741ba5a8a3","Type":"ContainerStarted","Data":"527fd069372887a1c0b36339e1045fb82c90b29724e19ae93b2ffcd2e89cc132"}
Aug 05 17:33:18.433664 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:18.433636    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd" event={"ID":"5ac9603b-b3c6-4a54-8334-4002e08a6faf","Type":"ContainerStarted","Data":"a67d3fa88ec7404d5bae803b0c18c1fe7b5a7ed55c8ec0049c4ad4e445d5eab4"}
Aug 05 17:33:18.433773 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:18.433705    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd" event={"ID":"5ac9603b-b3c6-4a54-8334-4002e08a6faf","Type":"ContainerStarted","Data":"2b8a783d5291a5bddbc82335025bcda45997771df59ce0d5d296a3e61714f54d"}
Aug 05 17:33:18.446859 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:18.446819    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4c5rk" podStartSLOduration=3.700603229 podStartE2EDuration="23.44680623s" totalImagesPullingTime="19.746203001s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:32:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:33:18.446578258 +0000 UTC m=+24.759429621" watchObservedRunningTime="2026-08-05 17:33:18.44680623 +0000 UTC m=+24.759657593"
Aug 05 17:33:18.768243 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:18.768165    2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Aug 05 17:33:19.191240 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:19.191115    2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-05T17:33:18.768183471Z","UUID":"edafcbaa-0338-4bc3-baa6-ed1f64eca617","Handler":null,"Name":"","Endpoint":""}
Aug 05 17:33:19.192990 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:19.192963    2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Aug 05 17:33:19.193118 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:19.193008    2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Aug 05 17:33:19.439414 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:19.439381    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2kj6" event={"ID":"99842ca9-d2b9-4e20-b0e3-290f9d68cf4e","Type":"ContainerStarted","Data":"26bcf990b30606382fb70b32f81f0357e925fe83b537fec5af76da14ed195d3f"}
Aug 05 17:33:19.439928 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:19.439508    2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Aug 05 17:33:20.255411 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:20.254955    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rwwxz"
Aug 05 17:33:20.255411 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:20.254996    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vth7m"
Aug 05 17:33:20.255411 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:20.254996    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnr6s"
Aug 05 17:33:20.255411 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:20.255092    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rwwxz" podUID="83867a5e-d4bd-4da7-a6e4-e129d0f300a9"
Aug 05 17:33:20.255411 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:20.255244    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vth7m" podUID="d79df3a4-4b86-4acd-9884-c9d745b6b79b"
Aug 05 17:33:20.255411 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:20.255316    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnr6s" podUID="cd100b0f-a2de-4036-a21a-4412e02fa15f"
Aug 05 17:33:20.445835 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:20.445795    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd" event={"ID":"5ac9603b-b3c6-4a54-8334-4002e08a6faf","Type":"ContainerStarted","Data":"860271591c8783329fa8bd6452d930fc366ea296e3c7aa915d09cd47f4a3daa3"}
Aug 05 17:33:20.448140 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:20.448070    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2kj6" event={"ID":"99842ca9-d2b9-4e20-b0e3-290f9d68cf4e","Type":"ContainerStarted","Data":"a10375087b6d0dba4d22a4b635588e02674364c29defb98ff788dedbd986e248"}
Aug 05 17:33:20.468622 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:20.468556    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t2kj6" podStartSLOduration=3.094060932 podStartE2EDuration="25.468534443s" totalImagesPullingTime="22.374473511s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:32:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:33:20.467479585 +0000 UTC m=+26.780330948" watchObservedRunningTime="2026-08-05 17:33:20.468534443 +0000 UTC m=+26.781385808"
Aug 05 17:33:22.248510 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:22.248329    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnr6s"
Aug 05 17:33:22.248936 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:22.248350    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rwwxz"
Aug 05 17:33:22.248936 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:22.248585    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnr6s" podUID="cd100b0f-a2de-4036-a21a-4412e02fa15f"
Aug 05 17:33:22.248936 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:22.248359    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vth7m"
Aug 05 17:33:22.248936 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:22.248705    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rwwxz" podUID="83867a5e-d4bd-4da7-a6e4-e129d0f300a9"
Aug 05 17:33:22.248936 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:22.248761    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vth7m" podUID="d79df3a4-4b86-4acd-9884-c9d745b6b79b"
Aug 05 17:33:22.458168 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:22.458121    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd" event={"ID":"5ac9603b-b3c6-4a54-8334-4002e08a6faf","Type":"ContainerStarted","Data":"3cd47e01b0a661a9383796dc7b8c8f0024466fe0215de83d50e7856424721d21"}
Aug 05 17:33:22.458440 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:22.458413    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:33:22.476251 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:22.476199    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:33:22.488023 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:22.487979    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd" podStartSLOduration=7.694564952 podStartE2EDuration="27.487963448s" totalImagesPullingTime="19.793398496s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:32:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:33:22.487448422 +0000 UTC m=+28.800299789" watchObservedRunningTime="2026-08-05 17:33:22.487963448 +0000 UTC m=+28.800814805"
Aug 05 17:33:23.321861 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:23.321820    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nqss6"
Aug 05 17:33:23.322744 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:23.322014    2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Aug 05 17:33:23.322744 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:23.322612    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nqss6"
Aug 05 17:33:23.462068 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:23.462007    2558 generic.go:356] "Generic (PLEG): container finished" podID="e38f44f9-8de8-4953-a874-97f4ddba3451" containerID="32361a9d461cc4d9372fed34faa157ef1648eeda927df5a59676d6cd3ed8c98c" exitCode=0
Aug 05 17:33:23.462248 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:23.462067    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-trjvx" event={"ID":"e38f44f9-8de8-4953-a874-97f4ddba3451","Type":"ContainerDied","Data":"32361a9d461cc4d9372fed34faa157ef1648eeda927df5a59676d6cd3ed8c98c"}
Aug 05 17:33:23.462653 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:23.462636    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:33:23.462725 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:23.462703    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:33:23.478314 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:23.478292    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:33:24.249358 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:24.249104    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rwwxz"
Aug 05 17:33:24.249616 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:24.249158    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnr6s"
Aug 05 17:33:24.249616 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:24.249454    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rwwxz" podUID="83867a5e-d4bd-4da7-a6e4-e129d0f300a9"
Aug 05 17:33:24.249616 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:24.249189    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vth7m"
Aug 05 17:33:24.249616 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:24.249558    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnr6s" podUID="cd100b0f-a2de-4036-a21a-4412e02fa15f"
Aug 05 17:33:24.249835 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:24.249630    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vth7m" podUID="d79df3a4-4b86-4acd-9884-c9d745b6b79b"
Aug 05 17:33:24.327807 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:24.327777    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dnr6s"]
Aug 05 17:33:24.330475 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:24.330450    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vth7m"]
Aug 05 17:33:24.335154 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:24.333922    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rwwxz"]
Aug 05 17:33:24.464577 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:24.464544    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnr6s"
Aug 05 17:33:24.464577 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:24.464561    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rwwxz"
Aug 05 17:33:24.464759 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:24.464635    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vth7m"
Aug 05 17:33:24.464759 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:24.464650    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnr6s" podUID="cd100b0f-a2de-4036-a21a-4412e02fa15f"
Aug 05 17:33:24.464759 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:24.464737    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rwwxz" podUID="83867a5e-d4bd-4da7-a6e4-e129d0f300a9"
Aug 05 17:33:24.464855 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:24.464786    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vth7m" podUID="d79df3a4-4b86-4acd-9884-c9d745b6b79b"
Aug 05 17:33:25.468867 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:25.468824    2558 generic.go:356] "Generic (PLEG): container finished" podID="e38f44f9-8de8-4953-a874-97f4ddba3451" containerID="f387cd3c99c9d28dc9209c88ea37f25c43c9f1e19de7080e2af3203018afb250" exitCode=0
Aug 05 17:33:25.469356 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:25.468902    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-trjvx" event={"ID":"e38f44f9-8de8-4953-a874-97f4ddba3451","Type":"ContainerDied","Data":"f387cd3c99c9d28dc9209c88ea37f25c43c9f1e19de7080e2af3203018afb250"}
Aug 05 17:33:26.248497 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:26.248465    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnr6s"
Aug 05 17:33:26.248658 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:26.248480    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rwwxz"
Aug 05 17:33:26.248658 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:26.248579    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vth7m"
Aug 05 17:33:26.248658 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:26.248600    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnr6s" podUID="cd100b0f-a2de-4036-a21a-4412e02fa15f"
Aug 05 17:33:26.248804 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:26.248693    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vth7m" podUID="d79df3a4-4b86-4acd-9884-c9d745b6b79b"
Aug 05 17:33:26.248854 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:26.248795    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rwwxz" podUID="83867a5e-d4bd-4da7-a6e4-e129d0f300a9"
Aug 05 17:33:27.476885 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:27.476701    2558 generic.go:356] "Generic (PLEG): container finished" podID="e38f44f9-8de8-4953-a874-97f4ddba3451" containerID="bc24631a3da074dc28462b7acf6517719a7f1ff927ba4820d28583185867720b" exitCode=0
Aug 05 17:33:27.477369 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:27.476787    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-trjvx" event={"ID":"e38f44f9-8de8-4953-a874-97f4ddba3451","Type":"ContainerDied","Data":"bc24631a3da074dc28462b7acf6517719a7f1ff927ba4820d28583185867720b"}
Aug 05 17:33:27.975556 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:27.975523    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d79df3a4-4b86-4acd-9884-c9d745b6b79b-original-pull-secret\") pod \"global-pull-secret-syncer-vth7m\" (UID: \"d79df3a4-4b86-4acd-9884-c9d745b6b79b\") " pod="kube-system/global-pull-secret-syncer-vth7m"
Aug 05 17:33:27.975725 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:27.975564    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83867a5e-d4bd-4da7-a6e4-e129d0f300a9-metrics-certs\") pod \"network-metrics-daemon-rwwxz\" (UID: \"83867a5e-d4bd-4da7-a6e4-e129d0f300a9\") " pod="openshift-multus/network-metrics-daemon-rwwxz"
Aug 05 17:33:27.975725 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:27.975674    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 17:33:27.975725 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:27.975681    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 17:33:27.975725 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:27.975726    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83867a5e-d4bd-4da7-a6e4-e129d0f300a9-metrics-certs podName:83867a5e-d4bd-4da7-a6e4-e129d0f300a9 nodeName:}" failed. No retries permitted until 2026-08-05 17:33:59.97571152 +0000 UTC m=+66.288562874 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83867a5e-d4bd-4da7-a6e4-e129d0f300a9-metrics-certs") pod "network-metrics-daemon-rwwxz" (UID: "83867a5e-d4bd-4da7-a6e4-e129d0f300a9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 17:33:27.975861 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:27.975738    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d79df3a4-4b86-4acd-9884-c9d745b6b79b-original-pull-secret podName:d79df3a4-4b86-4acd-9884-c9d745b6b79b nodeName:}" failed. No retries permitted until 2026-08-05 17:33:59.975732682 +0000 UTC m=+66.288584036 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d79df3a4-4b86-4acd-9884-c9d745b6b79b-original-pull-secret") pod "global-pull-secret-syncer-vth7m" (UID: "d79df3a4-4b86-4acd-9884-c9d745b6b79b") : object "kube-system"/"original-pull-secret" not registered
Aug 05 17:33:28.076433 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:28.076394    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhth2\" (UniqueName: \"kubernetes.io/projected/cd100b0f-a2de-4036-a21a-4412e02fa15f-kube-api-access-lhth2\") pod \"network-check-target-dnr6s\" (UID: \"cd100b0f-a2de-4036-a21a-4412e02fa15f\") " pod="openshift-network-diagnostics/network-check-target-dnr6s"
Aug 05 17:33:28.076603 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:28.076524    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 17:33:28.076603 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:28.076538    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 17:33:28.076603 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:28.076548    2558 projected.go:196] Error preparing data for projected volume kube-api-access-lhth2 for pod openshift-network-diagnostics/network-check-target-dnr6s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 17:33:28.076603 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:28.076599    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd100b0f-a2de-4036-a21a-4412e02fa15f-kube-api-access-lhth2 podName:cd100b0f-a2de-4036-a21a-4412e02fa15f nodeName:}" failed. No retries permitted until 2026-08-05 17:34:00.076585638 +0000 UTC m=+66.389436991 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lhth2" (UniqueName: "kubernetes.io/projected/cd100b0f-a2de-4036-a21a-4412e02fa15f-kube-api-access-lhth2") pod "network-check-target-dnr6s" (UID: "cd100b0f-a2de-4036-a21a-4412e02fa15f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 17:33:28.248829 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:28.248787    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnr6s"
Aug 05 17:33:28.249013 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:28.248856    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vth7m"
Aug 05 17:33:28.249013 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:28.248873    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rwwxz"
Aug 05 17:33:28.249013 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:28.248984    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vth7m" podUID="d79df3a4-4b86-4acd-9884-c9d745b6b79b"
Aug 05 17:33:28.249269 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:28.249211    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dnr6s" podUID="cd100b0f-a2de-4036-a21a-4412e02fa15f"
Aug 05 17:33:28.249368 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:28.249333    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rwwxz" podUID="83867a5e-d4bd-4da7-a6e4-e129d0f300a9"
Aug 05 17:33:29.940923 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:29.940893    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-136.ec2.internal" event="NodeReady"
Aug 05 17:33:29.941357 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:29.941048    2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Aug 05 17:33:29.992207 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:29.992168    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ll8qf"]
Aug 05 17:33:29.996156 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:29.996115    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nldnk"]
Aug 05 17:33:29.996328 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:29.996279    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ll8qf"
Aug 05 17:33:29.999120 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:29.999089    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Aug 05 17:33:29.999280 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:29.999159    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Aug 05 17:33:29.999620 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:29.999478    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xvqv4\""
Aug 05 17:33:29.999620 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:29.999561    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Aug 05 17:33:30.001099 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:30.001079    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nldnk"
Aug 05 17:33:30.003490 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:30.003470    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Aug 05 17:33:30.003654 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:30.003472    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-59qnw\""
Aug 05 17:33:30.003757 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:30.003725    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Aug 05 17:33:30.007293 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:30.007271    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ll8qf"]
Aug 05 17:33:30.011053 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:30.010824    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nldnk"]
Aug 05 17:33:30.089533 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:30.089491    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzv2r\" (UniqueName: \"kubernetes.io/projected/20a85ae0-3338-4063-923a-3f69efab43ff-kube-api-access-bzv2r\") pod \"dns-default-nldnk\" (UID: \"20a85ae0-3338-4063-923a-3f69efab43ff\") " pod="openshift-dns/dns-default-nldnk"
Aug 05 17:33:30.089700 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:30.089572    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20a85ae0-3338-4063-923a-3f69efab43ff-tmp-dir\") pod \"dns-default-nldnk\" (UID: \"20a85ae0-3338-4063-923a-3f69efab43ff\") " pod="openshift-dns/dns-default-nldnk"
Aug 05 17:33:30.089700 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:30.089621    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2zv8\" (UniqueName: \"kubernetes.io/projected/43fc005c-77a6-4226-8938-b8f123e9dae6-kube-api-access-p2zv8\") pod \"ingress-canary-ll8qf\" (UID: \"43fc005c-77a6-4226-8938-b8f123e9dae6\") " pod="openshift-ingress-canary/ingress-canary-ll8qf"
Aug 05 17:33:30.089700 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:30.089641    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/20a85ae0-3338-4063-923a-3f69efab43ff-config-volume\") pod \"dns-default-nldnk\" (UID: \"20a85ae0-3338-4063-923a-3f69efab43ff\") " pod="openshift-dns/dns-default-nldnk"
Aug 05 17:33:30.089854 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:30.089701    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/20a85ae0-3338-4063-923a-3f69efab43ff-metrics-tls\") pod \"dns-default-nldnk\" (UID: \"20a85ae0-3338-4063-923a-3f69efab43ff\") " pod="openshift-dns/dns-default-nldnk"
Aug 05 17:33:30.089854 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:30.089783    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43fc005c-77a6-4226-8938-b8f123e9dae6-cert\") pod \"ingress-canary-ll8qf\" (UID: \"43fc005c-77a6-4226-8938-b8f123e9dae6\") " pod="openshift-ingress-canary/ingress-canary-ll8qf"
Aug 05 17:33:30.190755 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:30.190717    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2zv8\" (UniqueName: \"kubernetes.io/projected/43fc005c-77a6-4226-8938-b8f123e9dae6-kube-api-access-p2zv8\") pod \"ingress-canary-ll8qf\" (UID: \"43fc005c-77a6-4226-8938-b8f123e9dae6\") " pod="openshift-ingress-canary/ingress-canary-ll8qf"
Aug 05 17:33:30.190755 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:30.190760    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/20a85ae0-3338-4063-923a-3f69efab43ff-config-volume\") pod \"dns-default-nldnk\" (UID: \"20a85ae0-3338-4063-923a-3f69efab43ff\") " pod="openshift-dns/dns-default-nldnk"
Aug 05 17:33:30.191005 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:30.190793    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/20a85ae0-3338-4063-923a-3f69efab43ff-metrics-tls\") pod \"dns-default-nldnk\" (UID: \"20a85ae0-3338-4063-923a-3f69efab43ff\") " pod="openshift-dns/dns-default-nldnk"
Aug 05 17:33:30.191005 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:30.190845    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43fc005c-77a6-4226-8938-b8f123e9dae6-cert\") pod \"ingress-canary-ll8qf\" (UID: \"43fc005c-77a6-4226-8938-b8f123e9dae6\") " pod="openshift-ingress-canary/ingress-canary-ll8qf"
Aug 05 17:33:30.191005 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:30.190870    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzv2r\" (UniqueName: \"kubernetes.io/projected/20a85ae0-3338-4063-923a-3f69efab43ff-kube-api-access-bzv2r\") pod \"dns-default-nldnk\" (UID: \"20a85ae0-3338-4063-923a-3f69efab43ff\") " pod="openshift-dns/dns-default-nldnk"
Aug 05 17:33:30.191005 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:30.190971    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 17:33:30.191196 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:30.191037    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20a85ae0-3338-4063-923a-3f69efab43ff-tmp-dir\") pod \"dns-default-nldnk\" (UID: \"20a85ae0-3338-4063-923a-3f69efab43ff\") " pod="openshift-dns/dns-default-nldnk"
Aug 05 17:33:30.191196 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:30.191052    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a85ae0-3338-4063-923a-3f69efab43ff-metrics-tls podName:20a85ae0-3338-4063-923a-3f69efab43ff nodeName:}" failed. No retries permitted until 2026-08-05 17:33:30.691030301 +0000 UTC m=+37.003881665 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/20a85ae0-3338-4063-923a-3f69efab43ff-metrics-tls") pod "dns-default-nldnk" (UID: "20a85ae0-3338-4063-923a-3f69efab43ff") : secret "dns-default-metrics-tls" not found
Aug 05 17:33:30.191384 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:30.191363    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/20a85ae0-3338-4063-923a-3f69efab43ff-config-volume\") pod \"dns-default-nldnk\" (UID: \"20a85ae0-3338-4063-923a-3f69efab43ff\") " pod="openshift-dns/dns-default-nldnk"
Aug 05 17:33:30.191422 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:30.191387    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20a85ae0-3338-4063-923a-3f69efab43ff-tmp-dir\") pod \"dns-default-nldnk\" (UID: \"20a85ae0-3338-4063-923a-3f69efab43ff\") " pod="openshift-dns/dns-default-nldnk"
Aug 05 17:33:30.195164 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:30.195140    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43fc005c-77a6-4226-8938-b8f123e9dae6-cert\") pod \"ingress-canary-ll8qf\" (UID: \"43fc005c-77a6-4226-8938-b8f123e9dae6\") " pod="openshift-ingress-canary/ingress-canary-ll8qf"
Aug 05 17:33:30.202109 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:30.202076    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzv2r\" (UniqueName: \"kubernetes.io/projected/20a85ae0-3338-4063-923a-3f69efab43ff-kube-api-access-bzv2r\") pod \"dns-default-nldnk\" (UID: \"20a85ae0-3338-4063-923a-3f69efab43ff\") " pod="openshift-dns/dns-default-nldnk"
Aug 05 17:33:30.202441 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:30.202418    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2zv8\" (UniqueName: \"kubernetes.io/projected/43fc005c-77a6-4226-8938-b8f123e9dae6-kube-api-access-p2zv8\") pod \"ingress-canary-ll8qf\" (UID: \"43fc005c-77a6-4226-8938-b8f123e9dae6\") " pod="openshift-ingress-canary/ingress-canary-ll8qf"
Aug 05 17:33:30.248876 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:30.248840    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnr6s"
Aug 05 17:33:30.249044 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:30.248840    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rwwxz"
Aug 05 17:33:30.249311 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:30.248853    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vth7m"
Aug 05 17:33:30.252434 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:30.251878    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 05 17:33:30.252434 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:30.251883    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 05 17:33:30.252434 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:30.251918    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 05 17:33:30.252434 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:30.251883    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dt589\""
Aug 05 17:33:30.252434 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:30.252173    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 05 17:33:30.252434 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:30.252258    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bbv86\""
Aug 05 17:33:30.309424 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:30.309383    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ll8qf"
Aug 05 17:33:30.694297 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:30.694259    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/20a85ae0-3338-4063-923a-3f69efab43ff-metrics-tls\") pod \"dns-default-nldnk\" (UID: \"20a85ae0-3338-4063-923a-3f69efab43ff\") " pod="openshift-dns/dns-default-nldnk"
Aug 05 17:33:30.694507 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:30.694447    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 17:33:30.694577 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:30.694523    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a85ae0-3338-4063-923a-3f69efab43ff-metrics-tls podName:20a85ae0-3338-4063-923a-3f69efab43ff nodeName:}" failed. No retries permitted until 2026-08-05 17:33:31.694504839 +0000 UTC m=+38.007356199 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/20a85ae0-3338-4063-923a-3f69efab43ff-metrics-tls") pod "dns-default-nldnk" (UID: "20a85ae0-3338-4063-923a-3f69efab43ff") : secret "dns-default-metrics-tls" not found
Aug 05 17:33:31.704046 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:31.704013    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/20a85ae0-3338-4063-923a-3f69efab43ff-metrics-tls\") pod \"dns-default-nldnk\" (UID: \"20a85ae0-3338-4063-923a-3f69efab43ff\") " pod="openshift-dns/dns-default-nldnk"
Aug 05 17:33:31.704614 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:31.704147    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 17:33:31.704614 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:31.704208    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a85ae0-3338-4063-923a-3f69efab43ff-metrics-tls podName:20a85ae0-3338-4063-923a-3f69efab43ff nodeName:}" failed. No retries permitted until 2026-08-05 17:33:33.704194601 +0000 UTC m=+40.017045961 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/20a85ae0-3338-4063-923a-3f69efab43ff-metrics-tls") pod "dns-default-nldnk" (UID: "20a85ae0-3338-4063-923a-3f69efab43ff") : secret "dns-default-metrics-tls" not found
Aug 05 17:33:31.818519 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:31.818301    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ll8qf"]
Aug 05 17:33:31.821731 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:33:31.821697    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43fc005c_77a6_4226_8938_b8f123e9dae6.slice/crio-63ceca9885990d12c5a6a6cfdf6d79046ff8ab10a3027654a07028acb376abe7 WatchSource:0}: Error finding container 63ceca9885990d12c5a6a6cfdf6d79046ff8ab10a3027654a07028acb376abe7: Status 404 returned error can't find the container with id 63ceca9885990d12c5a6a6cfdf6d79046ff8ab10a3027654a07028acb376abe7
Aug 05 17:33:32.490126 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.490093    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ll8qf" event={"ID":"43fc005c-77a6-4226-8938-b8f123e9dae6","Type":"ContainerStarted","Data":"63ceca9885990d12c5a6a6cfdf6d79046ff8ab10a3027654a07028acb376abe7"}
Aug 05 17:33:32.493367 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.493340    2558 generic.go:356] "Generic (PLEG): container finished" podID="e38f44f9-8de8-4953-a874-97f4ddba3451" containerID="5ed77ff15dcd5fea4671f3175635ffe825622f15ea9a1a3b7dfb21f683604c07" exitCode=0
Aug 05 17:33:32.493487 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.493377    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-trjvx" event={"ID":"e38f44f9-8de8-4953-a874-97f4ddba3451","Type":"ContainerDied","Data":"5ed77ff15dcd5fea4671f3175635ffe825622f15ea9a1a3b7dfb21f683604c07"}
Aug 05 17:33:32.719500 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.716285    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-rvhhd"]
Aug 05 17:33:32.722245 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.722207    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-jkg89"]
Aug 05 17:33:32.722374 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.722350    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-rvhhd"
Aug 05 17:33:32.725395 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.725374    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-9hwtc"]
Aug 05 17:33:32.725520 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.725494    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-jkg89"
Aug 05 17:33:32.728098 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.728072    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Aug 05 17:33:32.728816 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.728540    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-9hwtc"
Aug 05 17:33:32.728816 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.728614    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-jhqp6\""
Aug 05 17:33:32.728816 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.728779    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Aug 05 17:33:32.729012 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.728996    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Aug 05 17:33:32.729094 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.729078    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Aug 05 17:33:32.729365 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.729346    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-nd97w\""
Aug 05 17:33:32.729365 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.729366    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Aug 05 17:33:32.729858 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.729840    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Aug 05 17:33:32.733545 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.733525    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-jkg89"]
Aug 05 17:33:32.734447 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.734429    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-rvhhd"]
Aug 05 17:33:32.737335 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.737314    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-9hwtc"]
Aug 05 17:33:32.738795 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.738774    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Aug 05 17:33:32.740101 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.740082    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Aug 05 17:33:32.740495 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.740447    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Aug 05 17:33:32.740621 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.740602    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-p9fmg\""
Aug 05 17:33:32.803688 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.803660    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-c48lr"]
Aug 05 17:33:32.807584 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.807560    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-c48lr"
Aug 05 17:33:32.811104 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.811032    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Aug 05 17:33:32.811104 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.811060    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Aug 05 17:33:32.811397 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.811379    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Aug 05 17:33:32.811489 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.811401    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-6hlhq\""
Aug 05 17:33:32.811562 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.811539    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Aug 05 17:33:32.813679 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.813649    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm5nf\" (UniqueName: \"kubernetes.io/projected/909a96ea-ff5f-464a-bac0-5040d12b5625-kube-api-access-vm5nf\") pod \"cluster-samples-operator-559cbf5745-9hwtc\" (UID: \"909a96ea-ff5f-464a-bac0-5040d12b5625\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-9hwtc"
Aug 05 17:33:32.813795 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.813691    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f70154f9-6dbd-460a-9d64-cac2d7aea5b4-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-rvhhd\" (UID: \"f70154f9-6dbd-460a-9d64-cac2d7aea5b4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-rvhhd"
Aug 05 17:33:32.813795 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.813739    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7s5b\" (UniqueName: \"kubernetes.io/projected/f70154f9-6dbd-460a-9d64-cac2d7aea5b4-kube-api-access-d7s5b\") pod \"kube-storage-version-migrator-operator-7878f4b88c-rvhhd\" (UID: \"f70154f9-6dbd-460a-9d64-cac2d7aea5b4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-rvhhd"
Aug 05 17:33:32.813795 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.813771    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/909a96ea-ff5f-464a-bac0-5040d12b5625-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-9hwtc\" (UID: \"909a96ea-ff5f-464a-bac0-5040d12b5625\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-9hwtc"
Aug 05 17:33:32.813956 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.813855    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f70154f9-6dbd-460a-9d64-cac2d7aea5b4-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-rvhhd\" (UID: \"f70154f9-6dbd-460a-9d64-cac2d7aea5b4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-rvhhd"
Aug 05 17:33:32.813956 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.813940    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvptf\" (UniqueName: \"kubernetes.io/projected/cae69257-293c-4fcd-a177-ff098d535a99-kube-api-access-fvptf\") pod \"volume-data-source-validator-5b8776669-jkg89\" (UID: \"cae69257-293c-4fcd-a177-ff098d535a99\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-jkg89"
Aug 05 17:33:32.822360 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.822334    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-c48lr"]
Aug 05 17:33:32.906948 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.906899    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-js46d"]
Aug 05 17:33:32.912635 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.912519    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-77696685b-56tqj"]
Aug 05 17:33:32.912773 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.912648    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-js46d"
Aug 05 17:33:32.914659 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.914631    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/08c73da4-a7f6-40e1-b6be-6b9284fd4875-config\") pod \"service-ca-operator-784f97bcf6-c48lr\" (UID: \"08c73da4-a7f6-40e1-b6be-6b9284fd4875\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-c48lr"
Aug 05 17:33:32.914782 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.914693    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvptf\" (UniqueName: \"kubernetes.io/projected/cae69257-293c-4fcd-a177-ff098d535a99-kube-api-access-fvptf\") pod \"volume-data-source-validator-5b8776669-jkg89\" (UID: \"cae69257-293c-4fcd-a177-ff098d535a99\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-jkg89"
Aug 05 17:33:32.914782 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.914722    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm5nf\" (UniqueName: \"kubernetes.io/projected/909a96ea-ff5f-464a-bac0-5040d12b5625-kube-api-access-vm5nf\") pod \"cluster-samples-operator-559cbf5745-9hwtc\" (UID: \"909a96ea-ff5f-464a-bac0-5040d12b5625\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-9hwtc"
Aug 05 17:33:32.914782 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.914766    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f70154f9-6dbd-460a-9d64-cac2d7aea5b4-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-rvhhd\" (UID: \"f70154f9-6dbd-460a-9d64-cac2d7aea5b4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-rvhhd"
Aug 05 17:33:32.914946 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.914807    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7s5b\" (UniqueName: \"kubernetes.io/projected/f70154f9-6dbd-460a-9d64-cac2d7aea5b4-kube-api-access-d7s5b\") pod \"kube-storage-version-migrator-operator-7878f4b88c-rvhhd\" (UID: \"f70154f9-6dbd-460a-9d64-cac2d7aea5b4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-rvhhd"
Aug 05 17:33:32.914946 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.914837    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvm5v\" (UniqueName: \"kubernetes.io/projected/08c73da4-a7f6-40e1-b6be-6b9284fd4875-kube-api-access-rvm5v\") pod \"service-ca-operator-784f97bcf6-c48lr\" (UID: \"08c73da4-a7f6-40e1-b6be-6b9284fd4875\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-c48lr"
Aug 05 17:33:32.914946 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.914865    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/909a96ea-ff5f-464a-bac0-5040d12b5625-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-9hwtc\" (UID: \"909a96ea-ff5f-464a-bac0-5040d12b5625\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-9hwtc"
Aug 05 17:33:32.914946 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.914904    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f70154f9-6dbd-460a-9d64-cac2d7aea5b4-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-rvhhd\" (UID: \"f70154f9-6dbd-460a-9d64-cac2d7aea5b4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-rvhhd"
Aug 05 17:33:32.914946 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.914929    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/08c73da4-a7f6-40e1-b6be-6b9284fd4875-serving-cert\") pod \"service-ca-operator-784f97bcf6-c48lr\" (UID: \"08c73da4-a7f6-40e1-b6be-6b9284fd4875\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-c48lr"
Aug 05 17:33:32.915678 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.915625    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f70154f9-6dbd-460a-9d64-cac2d7aea5b4-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-rvhhd\" (UID: \"f70154f9-6dbd-460a-9d64-cac2d7aea5b4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-rvhhd"
Aug 05 17:33:32.915678 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:32.915642    2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Aug 05 17:33:32.915838 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:32.915749    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/909a96ea-ff5f-464a-bac0-5040d12b5625-samples-operator-tls podName:909a96ea-ff5f-464a-bac0-5040d12b5625 nodeName:}" failed. No retries permitted until 2026-08-05 17:33:33.415730098 +0000 UTC m=+39.728581440 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/909a96ea-ff5f-464a-bac0-5040d12b5625-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-9hwtc" (UID: "909a96ea-ff5f-464a-bac0-5040d12b5625") : secret "samples-operator-tls" not found
Aug 05 17:33:32.916385 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.916108    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Aug 05 17:33:32.917800 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.917780    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-74466bdff7-mzc64"]
Aug 05 17:33:32.918068 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.918045    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-z4g6p\""
Aug 05 17:33:32.918556 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.918531    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Aug 05 17:33:32.918641 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.918568    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Aug 05 17:33:32.918807 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.918788    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Aug 05 17:33:32.918807 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.918802    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-56tqj"
Aug 05 17:33:32.920068 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.920045    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f70154f9-6dbd-460a-9d64-cac2d7aea5b4-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-rvhhd\" (UID: \"f70154f9-6dbd-460a-9d64-cac2d7aea5b4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-rvhhd"
Aug 05 17:33:32.921627 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.920954    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74466bdff7-mzc64"
Aug 05 17:33:32.924611 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.924589    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Aug 05 17:33:32.924611 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.924608    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Aug 05 17:33:32.924919 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.924900    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Aug 05 17:33:32.925035 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.924930    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Aug 05 17:33:32.925155 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.925142    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-8ztvr\""
Aug 05 17:33:32.928272 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.928250    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-js46d"]
Aug 05 17:33:32.930630 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.930606    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Aug 05 17:33:32.930630 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.930629    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Aug 05 17:33:32.930796 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.930682    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jvd4r\""
Aug 05 17:33:32.930857 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.930826    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Aug 05 17:33:32.948112 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.948080    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Aug 05 17:33:32.950418 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.950394    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Aug 05 17:33:32.951721 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.951694    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-56tqj"]
Aug 05 17:33:32.953575 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.953285    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74466bdff7-mzc64"]
Aug 05 17:33:32.955260 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.955206    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvptf\" (UniqueName: \"kubernetes.io/projected/cae69257-293c-4fcd-a177-ff098d535a99-kube-api-access-fvptf\") pod \"volume-data-source-validator-5b8776669-jkg89\" (UID: \"cae69257-293c-4fcd-a177-ff098d535a99\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-jkg89"
Aug 05 17:33:32.955672 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.955653    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7s5b\" (UniqueName: \"kubernetes.io/projected/f70154f9-6dbd-460a-9d64-cac2d7aea5b4-kube-api-access-d7s5b\") pod \"kube-storage-version-migrator-operator-7878f4b88c-rvhhd\" (UID: \"f70154f9-6dbd-460a-9d64-cac2d7aea5b4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-rvhhd"
Aug 05 17:33:32.956812 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:32.956787    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm5nf\" (UniqueName: \"kubernetes.io/projected/909a96ea-ff5f-464a-bac0-5040d12b5625-kube-api-access-vm5nf\") pod \"cluster-samples-operator-559cbf5745-9hwtc\" (UID: \"909a96ea-ff5f-464a-bac0-5040d12b5625\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-9hwtc"
Aug 05 17:33:33.015676 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.015593    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvm5v\" (UniqueName: \"kubernetes.io/projected/08c73da4-a7f6-40e1-b6be-6b9284fd4875-kube-api-access-rvm5v\") pod \"service-ca-operator-784f97bcf6-c48lr\" (UID: \"08c73da4-a7f6-40e1-b6be-6b9284fd4875\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-c48lr"
Aug 05 17:33:33.015676 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.015632    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/af7ba770-5123-4eb7-a8f8-c023fdf96fad-serving-cert\") pod \"insights-operator-77696685b-56tqj\" (UID: \"af7ba770-5123-4eb7-a8f8-c023fdf96fad\") " pod="openshift-insights/insights-operator-77696685b-56tqj"
Aug 05 17:33:33.015676 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.015654    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23c8edfb-7426-4ea8-acfe-edd9154b4b70-bound-sa-token\") pod \"image-registry-74466bdff7-mzc64\" (UID: \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\") " pod="openshift-image-registry/image-registry-74466bdff7-mzc64"
Aug 05 17:33:33.015899 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.015681    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af7ba770-5123-4eb7-a8f8-c023fdf96fad-tmp\") pod \"insights-operator-77696685b-56tqj\" (UID: \"af7ba770-5123-4eb7-a8f8-c023fdf96fad\") " pod="openshift-insights/insights-operator-77696685b-56tqj"
Aug 05 17:33:33.015899 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.015713    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af7ba770-5123-4eb7-a8f8-c023fdf96fad-trusted-ca-bundle\") pod \"insights-operator-77696685b-56tqj\" (UID: \"af7ba770-5123-4eb7-a8f8-c023fdf96fad\") " pod="openshift-insights/insights-operator-77696685b-56tqj"
Aug 05 17:33:33.015899 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.015747    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/08c73da4-a7f6-40e1-b6be-6b9284fd4875-config\") pod \"service-ca-operator-784f97bcf6-c48lr\" (UID: \"08c73da4-a7f6-40e1-b6be-6b9284fd4875\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-c48lr"
Aug 05 17:33:33.015899 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.015766    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wpxs\" (UniqueName: \"kubernetes.io/projected/23c8edfb-7426-4ea8-acfe-edd9154b4b70-kube-api-access-6wpxs\") pod \"image-registry-74466bdff7-mzc64\" (UID: \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\") " pod="openshift-image-registry/image-registry-74466bdff7-mzc64"
Aug 05 17:33:33.015899 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.015784    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/23c8edfb-7426-4ea8-acfe-edd9154b4b70-image-registry-private-configuration\") pod \"image-registry-74466bdff7-mzc64\" (UID: \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\") " pod="openshift-image-registry/image-registry-74466bdff7-mzc64"
Aug 05 17:33:33.015899 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.015810    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af7ba770-5123-4eb7-a8f8-c023fdf96fad-service-ca-bundle\") pod \"insights-operator-77696685b-56tqj\" (UID: \"af7ba770-5123-4eb7-a8f8-c023fdf96fad\") " pod="openshift-insights/insights-operator-77696685b-56tqj"
Aug 05 17:33:33.015899 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.015829    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23c8edfb-7426-4ea8-acfe-edd9154b4b70-registry-tls\") pod \"image-registry-74466bdff7-mzc64\" (UID: \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\") " pod="openshift-image-registry/image-registry-74466bdff7-mzc64"
Aug 05 17:33:33.015899 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.015850    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/23c8edfb-7426-4ea8-acfe-edd9154b4b70-installation-pull-secrets\") pod \"image-registry-74466bdff7-mzc64\" (UID: \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\") " pod="openshift-image-registry/image-registry-74466bdff7-mzc64"
Aug 05 17:33:33.015899 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.015884    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/af7ba770-5123-4eb7-a8f8-c023fdf96fad-snapshots\") pod \"insights-operator-77696685b-56tqj\" (UID: \"af7ba770-5123-4eb7-a8f8-c023fdf96fad\") " pod="openshift-insights/insights-operator-77696685b-56tqj"
Aug 05 17:33:33.016343 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.015911    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tswpb\" (UniqueName: \"kubernetes.io/projected/af7ba770-5123-4eb7-a8f8-c023fdf96fad-kube-api-access-tswpb\") pod \"insights-operator-77696685b-56tqj\" (UID: \"af7ba770-5123-4eb7-a8f8-c023fdf96fad\") " pod="openshift-insights/insights-operator-77696685b-56tqj"
Aug 05 17:33:33.016343 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.015937    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chbtk\" (UniqueName: \"kubernetes.io/projected/234a7600-2e87-4367-a77f-cb2b59ee4b3f-kube-api-access-chbtk\") pod \"cluster-monitoring-operator-6f55c4f58d-js46d\" (UID: \"234a7600-2e87-4367-a77f-cb2b59ee4b3f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-js46d"
Aug 05 17:33:33.016343 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.015963    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/08c73da4-a7f6-40e1-b6be-6b9284fd4875-serving-cert\") pod \"service-ca-operator-784f97bcf6-c48lr\" (UID: \"08c73da4-a7f6-40e1-b6be-6b9284fd4875\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-c48lr"
Aug 05 17:33:33.016343 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.015992    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/23c8edfb-7426-4ea8-acfe-edd9154b4b70-ca-trust-extracted\") pod \"image-registry-74466bdff7-mzc64\" (UID: \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\") " pod="openshift-image-registry/image-registry-74466bdff7-mzc64"
Aug 05 17:33:33.016343 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.016014    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/234a7600-2e87-4367-a77f-cb2b59ee4b3f-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-js46d\" (UID: \"234a7600-2e87-4367-a77f-cb2b59ee4b3f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-js46d"
Aug 05 17:33:33.016343 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.016036    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/23c8edfb-7426-4ea8-acfe-edd9154b4b70-registry-certificates\") pod \"image-registry-74466bdff7-mzc64\" (UID: \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\") " pod="openshift-image-registry/image-registry-74466bdff7-mzc64"
Aug 05 17:33:33.016343 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.016068    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/234a7600-2e87-4367-a77f-cb2b59ee4b3f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-js46d\" (UID: \"234a7600-2e87-4367-a77f-cb2b59ee4b3f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-js46d"
Aug 05 17:33:33.016343 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.016105    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/23c8edfb-7426-4ea8-acfe-edd9154b4b70-trusted-ca\") pod \"image-registry-74466bdff7-mzc64\" (UID: \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\") " pod="openshift-image-registry/image-registry-74466bdff7-mzc64"
Aug 05 17:33:33.016823 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.016783    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/08c73da4-a7f6-40e1-b6be-6b9284fd4875-config\") pod \"service-ca-operator-784f97bcf6-c48lr\" (UID: \"08c73da4-a7f6-40e1-b6be-6b9284fd4875\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-c48lr"
Aug 05 17:33:33.018962 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.018939    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/08c73da4-a7f6-40e1-b6be-6b9284fd4875-serving-cert\") pod \"service-ca-operator-784f97bcf6-c48lr\" (UID: \"08c73da4-a7f6-40e1-b6be-6b9284fd4875\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-c48lr"
Aug 05 17:33:33.029890 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.029861    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvm5v\" (UniqueName: \"kubernetes.io/projected/08c73da4-a7f6-40e1-b6be-6b9284fd4875-kube-api-access-rvm5v\") pod \"service-ca-operator-784f97bcf6-c48lr\" (UID: \"08c73da4-a7f6-40e1-b6be-6b9284fd4875\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-c48lr"
Aug 05 17:33:33.035686 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.035664    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-rvhhd"
Aug 05 17:33:33.043799 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.043774    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-jkg89"
Aug 05 17:33:33.117119 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.117011    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/23c8edfb-7426-4ea8-acfe-edd9154b4b70-registry-certificates\") pod \"image-registry-74466bdff7-mzc64\" (UID: \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\") " pod="openshift-image-registry/image-registry-74466bdff7-mzc64"
Aug 05 17:33:33.117119 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.117078    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/234a7600-2e87-4367-a77f-cb2b59ee4b3f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-js46d\" (UID: \"234a7600-2e87-4367-a77f-cb2b59ee4b3f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-js46d"
Aug 05 17:33:33.117354 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.117129    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/23c8edfb-7426-4ea8-acfe-edd9154b4b70-trusted-ca\") pod \"image-registry-74466bdff7-mzc64\" (UID: \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\") " pod="openshift-image-registry/image-registry-74466bdff7-mzc64"
Aug 05 17:33:33.117354 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.117167    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/af7ba770-5123-4eb7-a8f8-c023fdf96fad-serving-cert\") pod \"insights-operator-77696685b-56tqj\" (UID: \"af7ba770-5123-4eb7-a8f8-c023fdf96fad\") " pod="openshift-insights/insights-operator-77696685b-56tqj"
Aug 05 17:33:33.117354 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.117194    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23c8edfb-7426-4ea8-acfe-edd9154b4b70-bound-sa-token\") pod \"image-registry-74466bdff7-mzc64\" (UID: \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\") " pod="openshift-image-registry/image-registry-74466bdff7-mzc64"
Aug 05 17:33:33.117354 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.117241    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af7ba770-5123-4eb7-a8f8-c023fdf96fad-tmp\") pod \"insights-operator-77696685b-56tqj\" (UID: \"af7ba770-5123-4eb7-a8f8-c023fdf96fad\") " pod="openshift-insights/insights-operator-77696685b-56tqj"
Aug 05 17:33:33.117354 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.117273    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af7ba770-5123-4eb7-a8f8-c023fdf96fad-trusted-ca-bundle\") pod \"insights-operator-77696685b-56tqj\" (UID: \"af7ba770-5123-4eb7-a8f8-c023fdf96fad\") " pod="openshift-insights/insights-operator-77696685b-56tqj"
Aug 05 17:33:33.117354 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.117301    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wpxs\" (UniqueName: \"kubernetes.io/projected/23c8edfb-7426-4ea8-acfe-edd9154b4b70-kube-api-access-6wpxs\") pod \"image-registry-74466bdff7-mzc64\" (UID: \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\") " pod="openshift-image-registry/image-registry-74466bdff7-mzc64"
Aug 05 17:33:33.117354 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.117318    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/23c8edfb-7426-4ea8-acfe-edd9154b4b70-image-registry-private-configuration\") pod \"image-registry-74466bdff7-mzc64\" (UID: \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\") " pod="openshift-image-registry/image-registry-74466bdff7-mzc64"
Aug 05 17:33:33.117354 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.117346    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af7ba770-5123-4eb7-a8f8-c023fdf96fad-service-ca-bundle\") pod \"insights-operator-77696685b-56tqj\" (UID: \"af7ba770-5123-4eb7-a8f8-c023fdf96fad\") " pod="openshift-insights/insights-operator-77696685b-56tqj"
Aug 05 17:33:33.117751 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.117376    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23c8edfb-7426-4ea8-acfe-edd9154b4b70-registry-tls\") pod \"image-registry-74466bdff7-mzc64\" (UID: \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\") " pod="openshift-image-registry/image-registry-74466bdff7-mzc64"
Aug 05 17:33:33.117751 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.117402    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/23c8edfb-7426-4ea8-acfe-edd9154b4b70-installation-pull-secrets\") pod \"image-registry-74466bdff7-mzc64\" (UID: \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\") " pod="openshift-image-registry/image-registry-74466bdff7-mzc64"
Aug 05 17:33:33.117751 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.117445    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/af7ba770-5123-4eb7-a8f8-c023fdf96fad-snapshots\") pod \"insights-operator-77696685b-56tqj\" (UID: \"af7ba770-5123-4eb7-a8f8-c023fdf96fad\") " pod="openshift-insights/insights-operator-77696685b-56tqj"
Aug 05 17:33:33.117751 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.117472    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tswpb\" (UniqueName: \"kubernetes.io/projected/af7ba770-5123-4eb7-a8f8-c023fdf96fad-kube-api-access-tswpb\") pod \"insights-operator-77696685b-56tqj\" (UID: \"af7ba770-5123-4eb7-a8f8-c023fdf96fad\") " pod="openshift-insights/insights-operator-77696685b-56tqj"
Aug 05 17:33:33.117751 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.117496    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chbtk\" (UniqueName: \"kubernetes.io/projected/234a7600-2e87-4367-a77f-cb2b59ee4b3f-kube-api-access-chbtk\") pod \"cluster-monitoring-operator-6f55c4f58d-js46d\" (UID: \"234a7600-2e87-4367-a77f-cb2b59ee4b3f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-js46d"
Aug 05 17:33:33.117751 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.117512    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/23c8edfb-7426-4ea8-acfe-edd9154b4b70-ca-trust-extracted\") pod \"image-registry-74466bdff7-mzc64\" (UID: \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\") " pod="openshift-image-registry/image-registry-74466bdff7-mzc64"
Aug 05 17:33:33.117751 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.117529    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/234a7600-2e87-4367-a77f-cb2b59ee4b3f-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-js46d\" (UID: \"234a7600-2e87-4367-a77f-cb2b59ee4b3f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-js46d"
Aug 05 17:33:33.119096 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.118426    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-c48lr"
Aug 05 17:33:33.119096 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.118939    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/23c8edfb-7426-4ea8-acfe-edd9154b4b70-registry-certificates\") pod \"image-registry-74466bdff7-mzc64\" (UID: \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\") " pod="openshift-image-registry/image-registry-74466bdff7-mzc64"
Aug 05 17:33:33.120425 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:33.119358    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 17:33:33.120425 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:33.119377    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74466bdff7-mzc64: secret "image-registry-tls" not found
Aug 05 17:33:33.120425 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:33.119443    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23c8edfb-7426-4ea8-acfe-edd9154b4b70-registry-tls podName:23c8edfb-7426-4ea8-acfe-edd9154b4b70 nodeName:}" failed. No retries permitted until 2026-08-05 17:33:33.619424403 +0000 UTC m=+39.932275749 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/23c8edfb-7426-4ea8-acfe-edd9154b4b70-registry-tls") pod "image-registry-74466bdff7-mzc64" (UID: "23c8edfb-7426-4ea8-acfe-edd9154b4b70") : secret "image-registry-tls" not found
Aug 05 17:33:33.120425 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.119446    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af7ba770-5123-4eb7-a8f8-c023fdf96fad-tmp\") pod \"insights-operator-77696685b-56tqj\" (UID: \"af7ba770-5123-4eb7-a8f8-c023fdf96fad\") " pod="openshift-insights/insights-operator-77696685b-56tqj"
Aug 05 17:33:33.120425 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.119549    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af7ba770-5123-4eb7-a8f8-c023fdf96fad-service-ca-bundle\") pod \"insights-operator-77696685b-56tqj\" (UID: \"af7ba770-5123-4eb7-a8f8-c023fdf96fad\") " pod="openshift-insights/insights-operator-77696685b-56tqj"
Aug 05 17:33:33.120425 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:33.119683    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 05 17:33:33.120425 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:33.119731    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/234a7600-2e87-4367-a77f-cb2b59ee4b3f-cluster-monitoring-operator-tls podName:234a7600-2e87-4367-a77f-cb2b59ee4b3f nodeName:}" failed. No retries permitted until 2026-08-05 17:33:33.619716749 +0000 UTC m=+39.932568092 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/234a7600-2e87-4367-a77f-cb2b59ee4b3f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-js46d" (UID: "234a7600-2e87-4367-a77f-cb2b59ee4b3f") : secret "cluster-monitoring-operator-tls" not found
Aug 05 17:33:33.120425 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.120299    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af7ba770-5123-4eb7-a8f8-c023fdf96fad-trusted-ca-bundle\") pod \"insights-operator-77696685b-56tqj\" (UID: \"af7ba770-5123-4eb7-a8f8-c023fdf96fad\") " pod="openshift-insights/insights-operator-77696685b-56tqj"
Aug 05 17:33:33.120425 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.120370    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/23c8edfb-7426-4ea8-acfe-edd9154b4b70-ca-trust-extracted\") pod \"image-registry-74466bdff7-mzc64\" (UID: \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\") " pod="openshift-image-registry/image-registry-74466bdff7-mzc64"
Aug 05 17:33:33.120857 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.120465    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/af7ba770-5123-4eb7-a8f8-c023fdf96fad-snapshots\") pod \"insights-operator-77696685b-56tqj\" (UID: \"af7ba770-5123-4eb7-a8f8-c023fdf96fad\") " pod="openshift-insights/insights-operator-77696685b-56tqj"
Aug 05 17:33:33.120857 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.120532    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/234a7600-2e87-4367-a77f-cb2b59ee4b3f-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-js46d\" (UID: \"234a7600-2e87-4367-a77f-cb2b59ee4b3f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-js46d"
Aug 05 17:33:33.120857 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.120593    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/23c8edfb-7426-4ea8-acfe-edd9154b4b70-trusted-ca\") pod \"image-registry-74466bdff7-mzc64\" (UID: \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\") " pod="openshift-image-registry/image-registry-74466bdff7-mzc64"
Aug 05 17:33:33.122462 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.122404    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/23c8edfb-7426-4ea8-acfe-edd9154b4b70-image-registry-private-configuration\") pod \"image-registry-74466bdff7-mzc64\" (UID: \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\") " pod="openshift-image-registry/image-registry-74466bdff7-mzc64"
Aug 05 17:33:33.123746 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.123693    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/af7ba770-5123-4eb7-a8f8-c023fdf96fad-serving-cert\") pod \"insights-operator-77696685b-56tqj\" (UID: \"af7ba770-5123-4eb7-a8f8-c023fdf96fad\") " pod="openshift-insights/insights-operator-77696685b-56tqj"
Aug 05 17:33:33.125524 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.125384    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/23c8edfb-7426-4ea8-acfe-edd9154b4b70-installation-pull-secrets\") pod \"image-registry-74466bdff7-mzc64\" (UID: \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\") " pod="openshift-image-registry/image-registry-74466bdff7-mzc64"
Aug 05 17:33:33.133521 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.133493    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23c8edfb-7426-4ea8-acfe-edd9154b4b70-bound-sa-token\") pod \"image-registry-74466bdff7-mzc64\" (UID: \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\") " pod="openshift-image-registry/image-registry-74466bdff7-mzc64"
Aug 05 17:33:33.135014 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.134986    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wpxs\" (UniqueName: \"kubernetes.io/projected/23c8edfb-7426-4ea8-acfe-edd9154b4b70-kube-api-access-6wpxs\") pod \"image-registry-74466bdff7-mzc64\" (UID: \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\") " pod="openshift-image-registry/image-registry-74466bdff7-mzc64"
Aug 05 17:33:33.136307 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.136258    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tswpb\" (UniqueName: \"kubernetes.io/projected/af7ba770-5123-4eb7-a8f8-c023fdf96fad-kube-api-access-tswpb\") pod \"insights-operator-77696685b-56tqj\" (UID: \"af7ba770-5123-4eb7-a8f8-c023fdf96fad\") " pod="openshift-insights/insights-operator-77696685b-56tqj"
Aug 05 17:33:33.137422 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.137333    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chbtk\" (UniqueName: \"kubernetes.io/projected/234a7600-2e87-4367-a77f-cb2b59ee4b3f-kube-api-access-chbtk\") pod \"cluster-monitoring-operator-6f55c4f58d-js46d\" (UID: \"234a7600-2e87-4367-a77f-cb2b59ee4b3f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-js46d"
Aug 05 17:33:33.236582 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.236541    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-jkg89"]
Aug 05 17:33:33.240029 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.239805    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-rvhhd"]
Aug 05 17:33:33.240869 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:33:33.240842    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcae69257_293c_4fcd_a177_ff098d535a99.slice/crio-eee880ea29c99d7737a14add66af871bf517a243b398f07d58651ca710f5a46f WatchSource:0}: Error finding container eee880ea29c99d7737a14add66af871bf517a243b398f07d58651ca710f5a46f: Status 404 returned error can't find the container with id eee880ea29c99d7737a14add66af871bf517a243b398f07d58651ca710f5a46f
Aug 05 17:33:33.255922 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.255899    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-56tqj"
Aug 05 17:33:33.257075 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:33:33.257045    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf70154f9_6dbd_460a_9d64_cac2d7aea5b4.slice/crio-fbc2d02de6170e53d61c296f86ffd8ccd5242a6d6b8fc664c9f82e0a55cd74e7 WatchSource:0}: Error finding container fbc2d02de6170e53d61c296f86ffd8ccd5242a6d6b8fc664c9f82e0a55cd74e7: Status 404 returned error can't find the container with id fbc2d02de6170e53d61c296f86ffd8ccd5242a6d6b8fc664c9f82e0a55cd74e7
Aug 05 17:33:33.293267 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.293209    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-c48lr"]
Aug 05 17:33:33.299165 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:33:33.299125    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08c73da4_a7f6_40e1_b6be_6b9284fd4875.slice/crio-c3b6b0cdfe9729074104677b56e4785909da37484267b4c9aafb897a11137ed5 WatchSource:0}: Error finding container c3b6b0cdfe9729074104677b56e4785909da37484267b4c9aafb897a11137ed5: Status 404 returned error can't find the container with id c3b6b0cdfe9729074104677b56e4785909da37484267b4c9aafb897a11137ed5
Aug 05 17:33:33.419199 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.419167    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-56tqj"]
Aug 05 17:33:33.422609 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.422584    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/909a96ea-ff5f-464a-bac0-5040d12b5625-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-9hwtc\" (UID: \"909a96ea-ff5f-464a-bac0-5040d12b5625\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-9hwtc"
Aug 05 17:33:33.422723 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:33.422708    2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Aug 05 17:33:33.422777 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:33.422768    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/909a96ea-ff5f-464a-bac0-5040d12b5625-samples-operator-tls podName:909a96ea-ff5f-464a-bac0-5040d12b5625 nodeName:}" failed. No retries permitted until 2026-08-05 17:33:34.42275109 +0000 UTC m=+40.735602431 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/909a96ea-ff5f-464a-bac0-5040d12b5625-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-9hwtc" (UID: "909a96ea-ff5f-464a-bac0-5040d12b5625") : secret "samples-operator-tls" not found
Aug 05 17:33:33.497168 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.497136    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-c48lr" event={"ID":"08c73da4-a7f6-40e1-b6be-6b9284fd4875","Type":"ContainerStarted","Data":"c3b6b0cdfe9729074104677b56e4785909da37484267b4c9aafb897a11137ed5"}
Aug 05 17:33:33.500957 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.500921    2558 generic.go:356] "Generic (PLEG): container finished" podID="e38f44f9-8de8-4953-a874-97f4ddba3451" containerID="3b6eaa302902ecbbebf1135f6380f44eaf00cd123aed50eb7d2fb41d1d4e5241" exitCode=0
Aug 05 17:33:33.501097 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.501001    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-trjvx" event={"ID":"e38f44f9-8de8-4953-a874-97f4ddba3451","Type":"ContainerDied","Data":"3b6eaa302902ecbbebf1135f6380f44eaf00cd123aed50eb7d2fb41d1d4e5241"}
Aug 05 17:33:33.502567 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.502543    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-jkg89" event={"ID":"cae69257-293c-4fcd-a177-ff098d535a99","Type":"ContainerStarted","Data":"eee880ea29c99d7737a14add66af871bf517a243b398f07d58651ca710f5a46f"}
Aug 05 17:33:33.503770 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.503750    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-rvhhd" event={"ID":"f70154f9-6dbd-460a-9d64-cac2d7aea5b4","Type":"ContainerStarted","Data":"fbc2d02de6170e53d61c296f86ffd8ccd5242a6d6b8fc664c9f82e0a55cd74e7"}
Aug 05 17:33:33.625197 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.624786    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23c8edfb-7426-4ea8-acfe-edd9154b4b70-registry-tls\") pod \"image-registry-74466bdff7-mzc64\" (UID: \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\") " pod="openshift-image-registry/image-registry-74466bdff7-mzc64"
Aug 05 17:33:33.625197 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:33.624889    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 17:33:33.625197 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:33.624907    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74466bdff7-mzc64: secret "image-registry-tls" not found
Aug 05 17:33:33.625197 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.624914    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/234a7600-2e87-4367-a77f-cb2b59ee4b3f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-js46d\" (UID: \"234a7600-2e87-4367-a77f-cb2b59ee4b3f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-js46d"
Aug 05 17:33:33.625197 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:33.624966    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23c8edfb-7426-4ea8-acfe-edd9154b4b70-registry-tls podName:23c8edfb-7426-4ea8-acfe-edd9154b4b70 nodeName:}" failed. No retries permitted until 2026-08-05 17:33:34.624947863 +0000 UTC m=+40.937799227 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/23c8edfb-7426-4ea8-acfe-edd9154b4b70-registry-tls") pod "image-registry-74466bdff7-mzc64" (UID: "23c8edfb-7426-4ea8-acfe-edd9154b4b70") : secret "image-registry-tls" not found
Aug 05 17:33:33.625197 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:33.625027    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 05 17:33:33.625197 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:33.625078    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/234a7600-2e87-4367-a77f-cb2b59ee4b3f-cluster-monitoring-operator-tls podName:234a7600-2e87-4367-a77f-cb2b59ee4b3f nodeName:}" failed. No retries permitted until 2026-08-05 17:33:34.625066105 +0000 UTC m=+40.937917446 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/234a7600-2e87-4367-a77f-cb2b59ee4b3f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-js46d" (UID: "234a7600-2e87-4367-a77f-cb2b59ee4b3f") : secret "cluster-monitoring-operator-tls" not found
Aug 05 17:33:33.726058 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:33.726025    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/20a85ae0-3338-4063-923a-3f69efab43ff-metrics-tls\") pod \"dns-default-nldnk\" (UID: \"20a85ae0-3338-4063-923a-3f69efab43ff\") " pod="openshift-dns/dns-default-nldnk"
Aug 05 17:33:33.726504 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:33.726179    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 17:33:33.726504 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:33.726255    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a85ae0-3338-4063-923a-3f69efab43ff-metrics-tls podName:20a85ae0-3338-4063-923a-3f69efab43ff nodeName:}" failed. No retries permitted until 2026-08-05 17:33:37.72624146 +0000 UTC m=+44.039092819 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/20a85ae0-3338-4063-923a-3f69efab43ff-metrics-tls") pod "dns-default-nldnk" (UID: "20a85ae0-3338-4063-923a-3f69efab43ff") : secret "dns-default-metrics-tls" not found
Aug 05 17:33:34.204124 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:33:34.204096    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf7ba770_5123_4eb7_a8f8_c023fdf96fad.slice/crio-83e679ad3f5af8b608739c1e2e98ecc6a326baf3b5cfb602f198e11dbfe33a98 WatchSource:0}: Error finding container 83e679ad3f5af8b608739c1e2e98ecc6a326baf3b5cfb602f198e11dbfe33a98: Status 404 returned error can't find the container with id 83e679ad3f5af8b608739c1e2e98ecc6a326baf3b5cfb602f198e11dbfe33a98
Aug 05 17:33:34.432787 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:34.432740    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/909a96ea-ff5f-464a-bac0-5040d12b5625-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-9hwtc\" (UID: \"909a96ea-ff5f-464a-bac0-5040d12b5625\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-9hwtc"
Aug 05 17:33:34.432980 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:34.432935    2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Aug 05 17:33:34.433032 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:34.433020    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/909a96ea-ff5f-464a-bac0-5040d12b5625-samples-operator-tls podName:909a96ea-ff5f-464a-bac0-5040d12b5625 nodeName:}" failed. No retries permitted until 2026-08-05 17:33:36.432996601 +0000 UTC m=+42.745847965 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/909a96ea-ff5f-464a-bac0-5040d12b5625-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-9hwtc" (UID: "909a96ea-ff5f-464a-bac0-5040d12b5625") : secret "samples-operator-tls" not found
Aug 05 17:33:34.509175 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:34.509083    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-trjvx" event={"ID":"e38f44f9-8de8-4953-a874-97f4ddba3451","Type":"ContainerStarted","Data":"7cd559b3ec44deac06218694f8fbe16d3396b6ba7fd51e6312268d3ce339ba06"}
Aug 05 17:33:34.510139 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:34.510112    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-56tqj" event={"ID":"af7ba770-5123-4eb7-a8f8-c023fdf96fad","Type":"ContainerStarted","Data":"83e679ad3f5af8b608739c1e2e98ecc6a326baf3b5cfb602f198e11dbfe33a98"}
Aug 05 17:33:34.534573 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:34.534521    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-trjvx" podStartSLOduration=8.369694857 podStartE2EDuration="39.53450295s" totalImagesPullingTime="31.164808093s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:32:55 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:33:34.534415513 +0000 UTC m=+40.847266875" watchObservedRunningTime="2026-08-05 17:33:34.53450295 +0000 UTC m=+40.847354313"
Aug 05 17:33:34.634452 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:34.634426    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23c8edfb-7426-4ea8-acfe-edd9154b4b70-registry-tls\") pod \"image-registry-74466bdff7-mzc64\" (UID: \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\") " pod="openshift-image-registry/image-registry-74466bdff7-mzc64"
Aug 05 17:33:34.634585 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:34.634536    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/234a7600-2e87-4367-a77f-cb2b59ee4b3f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-js46d\" (UID: \"234a7600-2e87-4367-a77f-cb2b59ee4b3f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-js46d"
Aug 05 17:33:34.634676 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:34.634655    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 17:33:34.634735 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:34.634680    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74466bdff7-mzc64: secret "image-registry-tls" not found
Aug 05 17:33:34.634782 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:34.634744    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23c8edfb-7426-4ea8-acfe-edd9154b4b70-registry-tls podName:23c8edfb-7426-4ea8-acfe-edd9154b4b70 nodeName:}" failed. No retries permitted until 2026-08-05 17:33:36.634725188 +0000 UTC m=+42.947576547 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/23c8edfb-7426-4ea8-acfe-edd9154b4b70-registry-tls") pod "image-registry-74466bdff7-mzc64" (UID: "23c8edfb-7426-4ea8-acfe-edd9154b4b70") : secret "image-registry-tls" not found
Aug 05 17:33:34.634782 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:34.634768    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 05 17:33:34.634854 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:34.634803    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/234a7600-2e87-4367-a77f-cb2b59ee4b3f-cluster-monitoring-operator-tls podName:234a7600-2e87-4367-a77f-cb2b59ee4b3f nodeName:}" failed. No retries permitted until 2026-08-05 17:33:36.634793035 +0000 UTC m=+42.947644375 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/234a7600-2e87-4367-a77f-cb2b59ee4b3f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-js46d" (UID: "234a7600-2e87-4367-a77f-cb2b59ee4b3f") : secret "cluster-monitoring-operator-tls" not found
Aug 05 17:33:35.516939 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:35.516037    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ll8qf" event={"ID":"43fc005c-77a6-4226-8938-b8f123e9dae6","Type":"ContainerStarted","Data":"1f9e4506529e46f8151b809b2964cb7261bf9cfc0f0de1e19ac47e2e24d1d9c4"}
Aug 05 17:33:35.537763 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:35.537701    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ll8qf" podStartSLOduration=3.778557734 podStartE2EDuration="6.537682921s" totalImagesPullingTime="2.759125187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:33:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:33:35.537480685 +0000 UTC m=+41.850332052" watchObservedRunningTime="2026-08-05 17:33:35.537682921 +0000 UTC m=+41.850534286"
Aug 05 17:33:36.450764 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:36.450726    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/909a96ea-ff5f-464a-bac0-5040d12b5625-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-9hwtc\" (UID: \"909a96ea-ff5f-464a-bac0-5040d12b5625\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-9hwtc"
Aug 05 17:33:36.450967 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:36.450901    2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Aug 05 17:33:36.451028 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:36.450983    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/909a96ea-ff5f-464a-bac0-5040d12b5625-samples-operator-tls podName:909a96ea-ff5f-464a-bac0-5040d12b5625 nodeName:}" failed. No retries permitted until 2026-08-05 17:33:40.450966458 +0000 UTC m=+46.763817800 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/909a96ea-ff5f-464a-bac0-5040d12b5625-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-9hwtc" (UID: "909a96ea-ff5f-464a-bac0-5040d12b5625") : secret "samples-operator-tls" not found
Aug 05 17:33:36.652581 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:36.652536    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23c8edfb-7426-4ea8-acfe-edd9154b4b70-registry-tls\") pod \"image-registry-74466bdff7-mzc64\" (UID: \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\") " pod="openshift-image-registry/image-registry-74466bdff7-mzc64"
Aug 05 17:33:36.652990 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:36.652640    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/234a7600-2e87-4367-a77f-cb2b59ee4b3f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-js46d\" (UID: \"234a7600-2e87-4367-a77f-cb2b59ee4b3f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-js46d"
Aug 05 17:33:36.652990 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:36.652715    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 17:33:36.652990 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:36.652739    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 05 17:33:36.652990 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:36.652740    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74466bdff7-mzc64: secret "image-registry-tls" not found
Aug 05 17:33:36.652990 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:36.652813    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/234a7600-2e87-4367-a77f-cb2b59ee4b3f-cluster-monitoring-operator-tls podName:234a7600-2e87-4367-a77f-cb2b59ee4b3f nodeName:}" failed. No retries permitted until 2026-08-05 17:33:40.652792404 +0000 UTC m=+46.965643754 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/234a7600-2e87-4367-a77f-cb2b59ee4b3f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-js46d" (UID: "234a7600-2e87-4367-a77f-cb2b59ee4b3f") : secret "cluster-monitoring-operator-tls" not found
Aug 05 17:33:36.652990 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:36.652834    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23c8edfb-7426-4ea8-acfe-edd9154b4b70-registry-tls podName:23c8edfb-7426-4ea8-acfe-edd9154b4b70 nodeName:}" failed. No retries permitted until 2026-08-05 17:33:40.652824177 +0000 UTC m=+46.965675518 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/23c8edfb-7426-4ea8-acfe-edd9154b4b70-registry-tls") pod "image-registry-74466bdff7-mzc64" (UID: "23c8edfb-7426-4ea8-acfe-edd9154b4b70") : secret "image-registry-tls" not found
Aug 05 17:33:37.763246 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:37.763185    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/20a85ae0-3338-4063-923a-3f69efab43ff-metrics-tls\") pod \"dns-default-nldnk\" (UID: \"20a85ae0-3338-4063-923a-3f69efab43ff\") " pod="openshift-dns/dns-default-nldnk"
Aug 05 17:33:37.763643 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:37.763348    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 17:33:37.763643 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:37.763413    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a85ae0-3338-4063-923a-3f69efab43ff-metrics-tls podName:20a85ae0-3338-4063-923a-3f69efab43ff nodeName:}" failed. No retries permitted until 2026-08-05 17:33:45.763397819 +0000 UTC m=+52.076249160 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/20a85ae0-3338-4063-923a-3f69efab43ff-metrics-tls") pod "dns-default-nldnk" (UID: "20a85ae0-3338-4063-923a-3f69efab43ff") : secret "dns-default-metrics-tls" not found
Aug 05 17:33:38.526705 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:38.526398    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-c48lr" event={"ID":"08c73da4-a7f6-40e1-b6be-6b9284fd4875","Type":"ContainerStarted","Data":"97b9349a3584bca75e440797dd89e1ac62285d553dd6913912a73cf39b4760b6"}
Aug 05 17:33:38.528047 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:38.528005    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-56tqj" event={"ID":"af7ba770-5123-4eb7-a8f8-c023fdf96fad","Type":"ContainerStarted","Data":"5ebf5d3091a827a5d71d0984e7380c0849abcd7d79c1448c3075cdcdc4942e07"}
Aug 05 17:33:38.529601 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:38.529580    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-jkg89" event={"ID":"cae69257-293c-4fcd-a177-ff098d535a99","Type":"ContainerStarted","Data":"756be01f1cc5730b9755e0539a2e5a09ae930307c56f9e74c038470f692b9a5e"}
Aug 05 17:33:38.531213 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:38.531193    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-rvhhd" event={"ID":"f70154f9-6dbd-460a-9d64-cac2d7aea5b4","Type":"ContainerStarted","Data":"26a8e9330f8ca3ebdffbabcfec886af3be68e69d7b7d0bc00f45ba0d690e71fb"}
Aug 05 17:33:38.546457 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:38.546406    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-c48lr" podStartSLOduration=1.68699757 podStartE2EDuration="6.546390553s" totalImagesPullingTime="4.859392983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:33:38.545021331 +0000 UTC m=+44.857872695" watchObservedRunningTime="2026-08-05 17:33:38.546390553 +0000 UTC m=+44.859241911"
Aug 05 17:33:38.569308 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:38.569248    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-77696685b-56tqj" podStartSLOduration=2.620459252 podStartE2EDuration="6.569204992s" totalImagesPullingTime="3.94874574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:33:38.56801198 +0000 UTC m=+44.880863344" watchObservedRunningTime="2026-08-05 17:33:38.569204992 +0000 UTC m=+44.882056335"
Aug 05 17:33:38.590408 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:38.590360    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-jkg89" podStartSLOduration=1.7423007830000001 podStartE2EDuration="6.590344879s" totalImagesPullingTime="4.848044096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:33:38.589548709 +0000 UTC m=+44.902400073" watchObservedRunningTime="2026-08-05 17:33:38.590344879 +0000 UTC m=+44.903196241"
Aug 05 17:33:38.609713 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:38.609669    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-rvhhd" podStartSLOduration=1.71393252 podStartE2EDuration="6.609647831s" totalImagesPullingTime="4.895715311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:33:38.609467089 +0000 UTC m=+44.922318454" watchObservedRunningTime="2026-08-05 17:33:38.609647831 +0000 UTC m=+44.922499195"
Aug 05 17:33:39.418999 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:39.418962    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-s8g9k"]
Aug 05 17:33:39.442269 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:39.442209    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-s8g9k"]
Aug 05 17:33:39.442470 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:39.442388    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-s8g9k"
Aug 05 17:33:39.445532 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:39.445308    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-b9t6s\""
Aug 05 17:33:39.445532 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:39.445341    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Aug 05 17:33:39.445837 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:39.445817    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Aug 05 17:33:39.580635 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:39.580602    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b03322eb-ca70-4709-b434-905903f18686-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s8g9k\" (UID: \"b03322eb-ca70-4709-b434-905903f18686\") " pod="openshift-insights/insights-runtime-extractor-s8g9k"
Aug 05 17:33:39.580814 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:39.580647    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b03322eb-ca70-4709-b434-905903f18686-crio-socket\") pod \"insights-runtime-extractor-s8g9k\" (UID: \"b03322eb-ca70-4709-b434-905903f18686\") " pod="openshift-insights/insights-runtime-extractor-s8g9k"
Aug 05 17:33:39.580814 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:39.580720    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82wvz\" (UniqueName: \"kubernetes.io/projected/b03322eb-ca70-4709-b434-905903f18686-kube-api-access-82wvz\") pod \"insights-runtime-extractor-s8g9k\" (UID: \"b03322eb-ca70-4709-b434-905903f18686\") " pod="openshift-insights/insights-runtime-extractor-s8g9k"
Aug 05 17:33:39.580814 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:39.580749    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b03322eb-ca70-4709-b434-905903f18686-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s8g9k\" (UID: \"b03322eb-ca70-4709-b434-905903f18686\") " pod="openshift-insights/insights-runtime-extractor-s8g9k"
Aug 05 17:33:39.580814 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:39.580801    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b03322eb-ca70-4709-b434-905903f18686-data-volume\") pod \"insights-runtime-extractor-s8g9k\" (UID: \"b03322eb-ca70-4709-b434-905903f18686\") " pod="openshift-insights/insights-runtime-extractor-s8g9k"
Aug 05 17:33:39.681477 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:39.681372    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82wvz\" (UniqueName: \"kubernetes.io/projected/b03322eb-ca70-4709-b434-905903f18686-kube-api-access-82wvz\") pod \"insights-runtime-extractor-s8g9k\" (UID: \"b03322eb-ca70-4709-b434-905903f18686\") " pod="openshift-insights/insights-runtime-extractor-s8g9k"
Aug 05 17:33:39.681660 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:39.681489    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b03322eb-ca70-4709-b434-905903f18686-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s8g9k\" (UID: \"b03322eb-ca70-4709-b434-905903f18686\") " pod="openshift-insights/insights-runtime-extractor-s8g9k"
Aug 05 17:33:39.681660 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:39.681517    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b03322eb-ca70-4709-b434-905903f18686-data-volume\") pod \"insights-runtime-extractor-s8g9k\" (UID: \"b03322eb-ca70-4709-b434-905903f18686\") " pod="openshift-insights/insights-runtime-extractor-s8g9k"
Aug 05 17:33:39.681660 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:39.681594    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 17:33:39.681851 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:39.681682    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b03322eb-ca70-4709-b434-905903f18686-kube-rbac-proxy-cm podName:b03322eb-ca70-4709-b434-905903f18686 nodeName:}" failed. No retries permitted until 2026-08-05 17:33:40.181659984 +0000 UTC m=+46.494511345 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b03322eb-ca70-4709-b434-905903f18686-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s8g9k" (UID: "b03322eb-ca70-4709-b434-905903f18686") : configmap "kube-rbac-proxy" not found
Aug 05 17:33:39.681916 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:39.681860    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b03322eb-ca70-4709-b434-905903f18686-data-volume\") pod \"insights-runtime-extractor-s8g9k\" (UID: \"b03322eb-ca70-4709-b434-905903f18686\") " pod="openshift-insights/insights-runtime-extractor-s8g9k"
Aug 05 17:33:39.681916 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:39.681878    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b03322eb-ca70-4709-b434-905903f18686-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s8g9k\" (UID: \"b03322eb-ca70-4709-b434-905903f18686\") " pod="openshift-insights/insights-runtime-extractor-s8g9k"
Aug 05 17:33:39.682017 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:39.681984    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 17:33:39.682073 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:39.682048    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b03322eb-ca70-4709-b434-905903f18686-crio-socket\") pod \"insights-runtime-extractor-s8g9k\" (UID: \"b03322eb-ca70-4709-b434-905903f18686\") " pod="openshift-insights/insights-runtime-extractor-s8g9k"
Aug 05 17:33:39.682073 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:39.682059    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b03322eb-ca70-4709-b434-905903f18686-insights-runtime-extractor-tls podName:b03322eb-ca70-4709-b434-905903f18686 nodeName:}" failed. No retries permitted until 2026-08-05 17:33:40.182041138 +0000 UTC m=+46.494892492 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b03322eb-ca70-4709-b434-905903f18686-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s8g9k" (UID: "b03322eb-ca70-4709-b434-905903f18686") : secret "insights-runtime-extractor-tls" not found
Aug 05 17:33:39.682214 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:39.682196    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b03322eb-ca70-4709-b434-905903f18686-crio-socket\") pod \"insights-runtime-extractor-s8g9k\" (UID: \"b03322eb-ca70-4709-b434-905903f18686\") " pod="openshift-insights/insights-runtime-extractor-s8g9k"
Aug 05 17:33:39.721621 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:39.721593    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82wvz\" (UniqueName: \"kubernetes.io/projected/b03322eb-ca70-4709-b434-905903f18686-kube-api-access-82wvz\") pod \"insights-runtime-extractor-s8g9k\" (UID: \"b03322eb-ca70-4709-b434-905903f18686\") " pod="openshift-insights/insights-runtime-extractor-s8g9k"
Aug 05 17:33:40.187008 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:40.186972    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b03322eb-ca70-4709-b434-905903f18686-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s8g9k\" (UID: \"b03322eb-ca70-4709-b434-905903f18686\") " pod="openshift-insights/insights-runtime-extractor-s8g9k"
Aug 05 17:33:40.187277 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:40.187068    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b03322eb-ca70-4709-b434-905903f18686-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s8g9k\" (UID: \"b03322eb-ca70-4709-b434-905903f18686\") " pod="openshift-insights/insights-runtime-extractor-s8g9k"
Aug 05 17:33:40.187277 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:40.187104    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 17:33:40.187277 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:40.187170    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b03322eb-ca70-4709-b434-905903f18686-kube-rbac-proxy-cm podName:b03322eb-ca70-4709-b434-905903f18686 nodeName:}" failed. No retries permitted until 2026-08-05 17:33:41.187155801 +0000 UTC m=+47.500007142 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b03322eb-ca70-4709-b434-905903f18686-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s8g9k" (UID: "b03322eb-ca70-4709-b434-905903f18686") : configmap "kube-rbac-proxy" not found
Aug 05 17:33:40.187277 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:40.187175    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 17:33:40.187277 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:40.187214    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b03322eb-ca70-4709-b434-905903f18686-insights-runtime-extractor-tls podName:b03322eb-ca70-4709-b434-905903f18686 nodeName:}" failed. No retries permitted until 2026-08-05 17:33:41.187203105 +0000 UTC m=+47.500054446 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b03322eb-ca70-4709-b434-905903f18686-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s8g9k" (UID: "b03322eb-ca70-4709-b434-905903f18686") : secret "insights-runtime-extractor-tls" not found
Aug 05 17:33:40.489653 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:40.489570    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/909a96ea-ff5f-464a-bac0-5040d12b5625-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-9hwtc\" (UID: \"909a96ea-ff5f-464a-bac0-5040d12b5625\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-9hwtc"
Aug 05 17:33:40.490010 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:40.489689    2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Aug 05 17:33:40.490010 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:40.489742    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/909a96ea-ff5f-464a-bac0-5040d12b5625-samples-operator-tls podName:909a96ea-ff5f-464a-bac0-5040d12b5625 nodeName:}" failed. No retries permitted until 2026-08-05 17:33:48.489729172 +0000 UTC m=+54.802580525 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/909a96ea-ff5f-464a-bac0-5040d12b5625-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-9hwtc" (UID: "909a96ea-ff5f-464a-bac0-5040d12b5625") : secret "samples-operator-tls" not found
Aug 05 17:33:40.691332 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:40.691296    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23c8edfb-7426-4ea8-acfe-edd9154b4b70-registry-tls\") pod \"image-registry-74466bdff7-mzc64\" (UID: \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\") " pod="openshift-image-registry/image-registry-74466bdff7-mzc64"
Aug 05 17:33:40.691506 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:40.691374    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/234a7600-2e87-4367-a77f-cb2b59ee4b3f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-js46d\" (UID: \"234a7600-2e87-4367-a77f-cb2b59ee4b3f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-js46d"
Aug 05 17:33:40.691506 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:40.691448    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 17:33:40.691506 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:40.691469    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74466bdff7-mzc64: secret "image-registry-tls" not found
Aug 05 17:33:40.691506 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:40.691480    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 05 17:33:40.691653 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:40.691525    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23c8edfb-7426-4ea8-acfe-edd9154b4b70-registry-tls podName:23c8edfb-7426-4ea8-acfe-edd9154b4b70 nodeName:}" failed. No retries permitted until 2026-08-05 17:33:48.691509276 +0000 UTC m=+55.004360617 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/23c8edfb-7426-4ea8-acfe-edd9154b4b70-registry-tls") pod "image-registry-74466bdff7-mzc64" (UID: "23c8edfb-7426-4ea8-acfe-edd9154b4b70") : secret "image-registry-tls" not found
Aug 05 17:33:40.691653 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:40.691540    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/234a7600-2e87-4367-a77f-cb2b59ee4b3f-cluster-monitoring-operator-tls podName:234a7600-2e87-4367-a77f-cb2b59ee4b3f nodeName:}" failed. No retries permitted until 2026-08-05 17:33:48.691531892 +0000 UTC m=+55.004383233 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/234a7600-2e87-4367-a77f-cb2b59ee4b3f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-js46d" (UID: "234a7600-2e87-4367-a77f-cb2b59ee4b3f") : secret "cluster-monitoring-operator-tls" not found
Aug 05 17:33:40.767794 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:40.767724    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jmdlw_795a8ab5-035a-4295-a4ea-e7d44991562d/dns-node-resolver/0.log"
Aug 05 17:33:41.195393 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:41.195348    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b03322eb-ca70-4709-b434-905903f18686-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s8g9k\" (UID: \"b03322eb-ca70-4709-b434-905903f18686\") " pod="openshift-insights/insights-runtime-extractor-s8g9k"
Aug 05 17:33:41.195574 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:41.195456    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b03322eb-ca70-4709-b434-905903f18686-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s8g9k\" (UID: \"b03322eb-ca70-4709-b434-905903f18686\") " pod="openshift-insights/insights-runtime-extractor-s8g9k"
Aug 05 17:33:41.195574 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:41.195499    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 17:33:41.195574 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:41.195561    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b03322eb-ca70-4709-b434-905903f18686-insights-runtime-extractor-tls podName:b03322eb-ca70-4709-b434-905903f18686 nodeName:}" failed. No retries permitted until 2026-08-05 17:33:43.195547084 +0000 UTC m=+49.508398427 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b03322eb-ca70-4709-b434-905903f18686-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s8g9k" (UID: "b03322eb-ca70-4709-b434-905903f18686") : secret "insights-runtime-extractor-tls" not found
Aug 05 17:33:41.195708 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:41.195572    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 17:33:41.195708 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:41.195619    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b03322eb-ca70-4709-b434-905903f18686-kube-rbac-proxy-cm podName:b03322eb-ca70-4709-b434-905903f18686 nodeName:}" failed. No retries permitted until 2026-08-05 17:33:43.195607662 +0000 UTC m=+49.508459024 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b03322eb-ca70-4709-b434-905903f18686-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s8g9k" (UID: "b03322eb-ca70-4709-b434-905903f18686") : configmap "kube-rbac-proxy" not found
Aug 05 17:33:41.909395 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:41.909359    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-4jnb4"]
Aug 05 17:33:41.933917 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:41.933879    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-4jnb4"]
Aug 05 17:33:41.934074 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:41.933971    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-4jnb4"
Aug 05 17:33:41.936956 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:41.936928    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Aug 05 17:33:41.936956 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:41.936938    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-k6b8v\""
Aug 05 17:33:41.938242 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:41.938202    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Aug 05 17:33:41.938363 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:41.938251    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Aug 05 17:33:41.938416 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:41.938394    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Aug 05 17:33:41.966371 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:41.966344    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ddzbb_2c932fc3-5567-4183-97ee-36f5359a9a64/node-ca/0.log"
Aug 05 17:33:42.102899 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:42.102856    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/39b9dbc4-73fb-4893-a107-508607a21a7a-signing-key\") pod \"service-ca-98c88fbb5-4jnb4\" (UID: \"39b9dbc4-73fb-4893-a107-508607a21a7a\") " pod="openshift-service-ca/service-ca-98c88fbb5-4jnb4"
Aug 05 17:33:42.103068 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:42.103024    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/39b9dbc4-73fb-4893-a107-508607a21a7a-signing-cabundle\") pod \"service-ca-98c88fbb5-4jnb4\" (UID: \"39b9dbc4-73fb-4893-a107-508607a21a7a\") " pod="openshift-service-ca/service-ca-98c88fbb5-4jnb4"
Aug 05 17:33:42.103068 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:42.103062    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xh2w\" (UniqueName: \"kubernetes.io/projected/39b9dbc4-73fb-4893-a107-508607a21a7a-kube-api-access-6xh2w\") pod \"service-ca-98c88fbb5-4jnb4\" (UID: \"39b9dbc4-73fb-4893-a107-508607a21a7a\") " pod="openshift-service-ca/service-ca-98c88fbb5-4jnb4"
Aug 05 17:33:42.204337 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:42.204263    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xh2w\" (UniqueName: \"kubernetes.io/projected/39b9dbc4-73fb-4893-a107-508607a21a7a-kube-api-access-6xh2w\") pod \"service-ca-98c88fbb5-4jnb4\" (UID: \"39b9dbc4-73fb-4893-a107-508607a21a7a\") " pod="openshift-service-ca/service-ca-98c88fbb5-4jnb4"
Aug 05 17:33:42.204337 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:42.204325    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/39b9dbc4-73fb-4893-a107-508607a21a7a-signing-key\") pod \"service-ca-98c88fbb5-4jnb4\" (UID: \"39b9dbc4-73fb-4893-a107-508607a21a7a\") " pod="openshift-service-ca/service-ca-98c88fbb5-4jnb4"
Aug 05 17:33:42.204546 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:42.204406    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/39b9dbc4-73fb-4893-a107-508607a21a7a-signing-cabundle\") pod \"service-ca-98c88fbb5-4jnb4\" (UID: \"39b9dbc4-73fb-4893-a107-508607a21a7a\") " pod="openshift-service-ca/service-ca-98c88fbb5-4jnb4"
Aug 05 17:33:42.205018 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:42.204999    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/39b9dbc4-73fb-4893-a107-508607a21a7a-signing-cabundle\") pod \"service-ca-98c88fbb5-4jnb4\" (UID: \"39b9dbc4-73fb-4893-a107-508607a21a7a\") " pod="openshift-service-ca/service-ca-98c88fbb5-4jnb4"
Aug 05 17:33:42.206859 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:42.206836    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/39b9dbc4-73fb-4893-a107-508607a21a7a-signing-key\") pod \"service-ca-98c88fbb5-4jnb4\" (UID: \"39b9dbc4-73fb-4893-a107-508607a21a7a\") " pod="openshift-service-ca/service-ca-98c88fbb5-4jnb4"
Aug 05 17:33:42.213304 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:42.213282    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xh2w\" (UniqueName: \"kubernetes.io/projected/39b9dbc4-73fb-4893-a107-508607a21a7a-kube-api-access-6xh2w\") pod \"service-ca-98c88fbb5-4jnb4\" (UID: \"39b9dbc4-73fb-4893-a107-508607a21a7a\") " pod="openshift-service-ca/service-ca-98c88fbb5-4jnb4"
Aug 05 17:33:42.243360 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:42.243339    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-4jnb4"
Aug 05 17:33:42.567360 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:42.567280    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ll8qf_43fc005c-77a6-4226-8938-b8f123e9dae6/serve-healthcheck-canary/0.log"
Aug 05 17:33:42.621255 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:42.621081    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-4jnb4"]
Aug 05 17:33:42.623802 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:33:42.623780    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39b9dbc4_73fb_4893_a107_508607a21a7a.slice/crio-d2b76f24cb99da6b20a4f4a024eb3cf350b238ef201dd9e4a16691c6aaf4c6ee WatchSource:0}: Error finding container d2b76f24cb99da6b20a4f4a024eb3cf350b238ef201dd9e4a16691c6aaf4c6ee: Status 404 returned error can't find the container with id d2b76f24cb99da6b20a4f4a024eb3cf350b238ef201dd9e4a16691c6aaf4c6ee
Aug 05 17:33:43.212905 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:43.212870    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b03322eb-ca70-4709-b434-905903f18686-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s8g9k\" (UID: \"b03322eb-ca70-4709-b434-905903f18686\") " pod="openshift-insights/insights-runtime-extractor-s8g9k"
Aug 05 17:33:43.213254 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:43.212949    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b03322eb-ca70-4709-b434-905903f18686-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s8g9k\" (UID: \"b03322eb-ca70-4709-b434-905903f18686\") " pod="openshift-insights/insights-runtime-extractor-s8g9k"
Aug 05 17:33:43.213254 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:43.213028    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 17:33:43.213254 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:43.213088    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b03322eb-ca70-4709-b434-905903f18686-insights-runtime-extractor-tls podName:b03322eb-ca70-4709-b434-905903f18686 nodeName:}" failed. No retries permitted until 2026-08-05 17:33:47.213074869 +0000 UTC m=+53.525926210 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b03322eb-ca70-4709-b434-905903f18686-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s8g9k" (UID: "b03322eb-ca70-4709-b434-905903f18686") : secret "insights-runtime-extractor-tls" not found
Aug 05 17:33:43.213254 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:43.213089    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 17:33:43.213254 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:43.213155    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b03322eb-ca70-4709-b434-905903f18686-kube-rbac-proxy-cm podName:b03322eb-ca70-4709-b434-905903f18686 nodeName:}" failed. No retries permitted until 2026-08-05 17:33:47.213136228 +0000 UTC m=+53.525987576 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b03322eb-ca70-4709-b434-905903f18686-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s8g9k" (UID: "b03322eb-ca70-4709-b434-905903f18686") : configmap "kube-rbac-proxy" not found
Aug 05 17:33:43.549405 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:43.549304    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-4jnb4" event={"ID":"39b9dbc4-73fb-4893-a107-508607a21a7a","Type":"ContainerStarted","Data":"52b35486aca733b1f332524486d4c44056c5826dd69bf09bdfb3ebe6c114caf4"}
Aug 05 17:33:43.549405 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:43.549364    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-4jnb4" event={"ID":"39b9dbc4-73fb-4893-a107-508607a21a7a","Type":"ContainerStarted","Data":"d2b76f24cb99da6b20a4f4a024eb3cf350b238ef201dd9e4a16691c6aaf4c6ee"}
Aug 05 17:33:43.575026 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:43.574963    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-98c88fbb5-4jnb4" podStartSLOduration=2.574941982 podStartE2EDuration="2.574941982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:33:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:33:43.57327493 +0000 UTC m=+49.886126296" watchObservedRunningTime="2026-08-05 17:33:43.574941982 +0000 UTC m=+49.887793344"
Aug 05 17:33:45.836407 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:45.836372    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/20a85ae0-3338-4063-923a-3f69efab43ff-metrics-tls\") pod \"dns-default-nldnk\" (UID: \"20a85ae0-3338-4063-923a-3f69efab43ff\") " pod="openshift-dns/dns-default-nldnk"
Aug 05 17:33:45.836779 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:45.836519    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 17:33:45.836779 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:45.836579    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a85ae0-3338-4063-923a-3f69efab43ff-metrics-tls podName:20a85ae0-3338-4063-923a-3f69efab43ff nodeName:}" failed. No retries permitted until 2026-08-05 17:34:01.836562005 +0000 UTC m=+68.149413350 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/20a85ae0-3338-4063-923a-3f69efab43ff-metrics-tls") pod "dns-default-nldnk" (UID: "20a85ae0-3338-4063-923a-3f69efab43ff") : secret "dns-default-metrics-tls" not found
Aug 05 17:33:47.248590 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:47.248552    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b03322eb-ca70-4709-b434-905903f18686-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s8g9k\" (UID: \"b03322eb-ca70-4709-b434-905903f18686\") " pod="openshift-insights/insights-runtime-extractor-s8g9k"
Aug 05 17:33:47.249069 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:47.248636    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b03322eb-ca70-4709-b434-905903f18686-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s8g9k\" (UID: \"b03322eb-ca70-4709-b434-905903f18686\") " pod="openshift-insights/insights-runtime-extractor-s8g9k"
Aug 05 17:33:47.249069 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:47.248712    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 17:33:47.249069 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:47.248782    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b03322eb-ca70-4709-b434-905903f18686-insights-runtime-extractor-tls podName:b03322eb-ca70-4709-b434-905903f18686 nodeName:}" failed. No retries permitted until 2026-08-05 17:33:55.248767178 +0000 UTC m=+61.561618518 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b03322eb-ca70-4709-b434-905903f18686-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s8g9k" (UID: "b03322eb-ca70-4709-b434-905903f18686") : secret "insights-runtime-extractor-tls" not found
Aug 05 17:33:47.259013 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:47.258986    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b03322eb-ca70-4709-b434-905903f18686-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s8g9k\" (UID: \"b03322eb-ca70-4709-b434-905903f18686\") " pod="openshift-insights/insights-runtime-extractor-s8g9k"
Aug 05 17:33:48.558508 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:48.558467    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/909a96ea-ff5f-464a-bac0-5040d12b5625-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-9hwtc\" (UID: \"909a96ea-ff5f-464a-bac0-5040d12b5625\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-9hwtc"
Aug 05 17:33:48.561081 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:48.561057    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/909a96ea-ff5f-464a-bac0-5040d12b5625-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-9hwtc\" (UID: \"909a96ea-ff5f-464a-bac0-5040d12b5625\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-9hwtc"
Aug 05 17:33:48.649724 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:48.649686    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-9hwtc"
Aug 05 17:33:48.759983 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:48.759955    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23c8edfb-7426-4ea8-acfe-edd9154b4b70-registry-tls\") pod \"image-registry-74466bdff7-mzc64\" (UID: \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\") " pod="openshift-image-registry/image-registry-74466bdff7-mzc64"
Aug 05 17:33:48.760160 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:48.760056    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/234a7600-2e87-4367-a77f-cb2b59ee4b3f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-js46d\" (UID: \"234a7600-2e87-4367-a77f-cb2b59ee4b3f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-js46d"
Aug 05 17:33:48.760254 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:48.760184    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 05 17:33:48.760317 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:33:48.760284    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/234a7600-2e87-4367-a77f-cb2b59ee4b3f-cluster-monitoring-operator-tls podName:234a7600-2e87-4367-a77f-cb2b59ee4b3f nodeName:}" failed. No retries permitted until 2026-08-05 17:34:04.760263225 +0000 UTC m=+71.073114571 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/234a7600-2e87-4367-a77f-cb2b59ee4b3f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-js46d" (UID: "234a7600-2e87-4367-a77f-cb2b59ee4b3f") : secret "cluster-monitoring-operator-tls" not found
Aug 05 17:33:48.763206 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:48.763181    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23c8edfb-7426-4ea8-acfe-edd9154b4b70-registry-tls\") pod \"image-registry-74466bdff7-mzc64\" (UID: \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\") " pod="openshift-image-registry/image-registry-74466bdff7-mzc64"
Aug 05 17:33:48.805163 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:48.805128    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-9hwtc"]
Aug 05 17:33:48.873829 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:48.873810    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74466bdff7-mzc64"
Aug 05 17:33:49.017568 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:49.017486    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74466bdff7-mzc64"]
Aug 05 17:33:49.019533 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:33:49.019505    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23c8edfb_7426_4ea8_acfe_edd9154b4b70.slice/crio-691b403fa1296c59e35398163c768f089219274dbfbd221f003139638dbcf82d WatchSource:0}: Error finding container 691b403fa1296c59e35398163c768f089219274dbfbd221f003139638dbcf82d: Status 404 returned error can't find the container with id 691b403fa1296c59e35398163c768f089219274dbfbd221f003139638dbcf82d
Aug 05 17:33:49.571903 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:49.571864    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74466bdff7-mzc64" event={"ID":"23c8edfb-7426-4ea8-acfe-edd9154b4b70","Type":"ContainerStarted","Data":"f108aff090618e88ec0b9c9ac7de4051bbb9ac3649074d4374b849612e299b94"}
Aug 05 17:33:49.572388 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:49.571932    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74466bdff7-mzc64" event={"ID":"23c8edfb-7426-4ea8-acfe-edd9154b4b70","Type":"ContainerStarted","Data":"691b403fa1296c59e35398163c768f089219274dbfbd221f003139638dbcf82d"}
Aug 05 17:33:49.572388 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:49.572001    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-74466bdff7-mzc64"
Aug 05 17:33:49.573499 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:49.573463    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-9hwtc" event={"ID":"909a96ea-ff5f-464a-bac0-5040d12b5625","Type":"ContainerStarted","Data":"d97cd185dcdfd99fdf09e87ec1f0c62ad157d87680cb9ea8d96c9e8c799e3e2f"}
Aug 05 17:33:49.595148 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:49.595094    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-74466bdff7-mzc64" podStartSLOduration=17.595078335 podStartE2EDuration="17.595078335s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:33:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:33:49.593167121 +0000 UTC m=+55.906018523" watchObservedRunningTime="2026-08-05 17:33:49.595078335 +0000 UTC m=+55.907929719"
Aug 05 17:33:51.583327 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:51.583289    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-9hwtc" event={"ID":"909a96ea-ff5f-464a-bac0-5040d12b5625","Type":"ContainerStarted","Data":"5badd0d11cb65f7e80ce39f768fac4585240fe0c85edb31a150917529851c7ad"}
Aug 05 17:33:51.583721 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:51.583354    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-9hwtc" event={"ID":"909a96ea-ff5f-464a-bac0-5040d12b5625","Type":"ContainerStarted","Data":"16feaf1a59b371e8bb0bedb38eeee8f15c2ac1e39c1e057f4c4d580054028d0a"}
Aug 05 17:33:51.607609 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:51.607568    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-9hwtc" podStartSLOduration=17.824156493 podStartE2EDuration="19.607553346s" totalImagesPullingTime="1.783396853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:33:51.607357698 +0000 UTC m=+57.920209062" watchObservedRunningTime="2026-08-05 17:33:51.607553346 +0000 UTC m=+57.920404709"
Aug 05 17:33:55.308320 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:55.308279    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b03322eb-ca70-4709-b434-905903f18686-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s8g9k\" (UID: \"b03322eb-ca70-4709-b434-905903f18686\") " pod="openshift-insights/insights-runtime-extractor-s8g9k"
Aug 05 17:33:55.310750 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:55.310730    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b03322eb-ca70-4709-b434-905903f18686-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s8g9k\" (UID: \"b03322eb-ca70-4709-b434-905903f18686\") " pod="openshift-insights/insights-runtime-extractor-s8g9k"
Aug 05 17:33:55.357973 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:55.357941    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-b9t6s\""
Aug 05 17:33:55.365418 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:55.365397    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-s8g9k"
Aug 05 17:33:55.483257 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:55.483205    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6vqmd"
Aug 05 17:33:55.516252 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:55.516193    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-s8g9k"]
Aug 05 17:33:55.596483 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:55.596456    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s8g9k" event={"ID":"b03322eb-ca70-4709-b434-905903f18686","Type":"ContainerStarted","Data":"822d62f4a28bb33b6e747c91b6fd2e6c71e45798f93cdeff4ae971f7e4383b2c"}
Aug 05 17:33:56.601492 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:56.601410    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s8g9k" event={"ID":"b03322eb-ca70-4709-b434-905903f18686","Type":"ContainerStarted","Data":"7a54054e3ed1e75eabace84bc292165f1e33846497328f615646c73951182e21"}
Aug 05 17:33:56.601492 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:56.601465    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s8g9k" event={"ID":"b03322eb-ca70-4709-b434-905903f18686","Type":"ContainerStarted","Data":"2104dcbc81fdd18e54a9a9ad128b2f55dcd26fa13331c878ee4979a40660a158"}
Aug 05 17:33:58.609531 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:58.609490    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s8g9k" event={"ID":"b03322eb-ca70-4709-b434-905903f18686","Type":"ContainerStarted","Data":"c302ddd17e024655d1648b4175a7ab4dc3c92eda6d86988584b480c6174c66bf"}
Aug 05 17:33:58.632189 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:33:58.632140    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-s8g9k" podStartSLOduration=17.679898599 podStartE2EDuration="19.632123911s" totalImagesPullingTime="1.952225312s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:33:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:33:58.630406282 +0000 UTC m=+64.943257645" watchObservedRunningTime="2026-08-05 17:33:58.632123911 +0000 UTC m=+64.944975274"
Aug 05 17:34:00.047408 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:00.047357    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83867a5e-d4bd-4da7-a6e4-e129d0f300a9-metrics-certs\") pod \"network-metrics-daemon-rwwxz\" (UID: \"83867a5e-d4bd-4da7-a6e4-e129d0f300a9\") " pod="openshift-multus/network-metrics-daemon-rwwxz"
Aug 05 17:34:00.047853 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:00.047452    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d79df3a4-4b86-4acd-9884-c9d745b6b79b-original-pull-secret\") pod \"global-pull-secret-syncer-vth7m\" (UID: \"d79df3a4-4b86-4acd-9884-c9d745b6b79b\") " pod="kube-system/global-pull-secret-syncer-vth7m"
Aug 05 17:34:00.050271 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:00.050250    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 05 17:34:00.050378 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:00.050253    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 05 17:34:00.060965 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:00.060935    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83867a5e-d4bd-4da7-a6e4-e129d0f300a9-metrics-certs\") pod \"network-metrics-daemon-rwwxz\" (UID: \"83867a5e-d4bd-4da7-a6e4-e129d0f300a9\") " pod="openshift-multus/network-metrics-daemon-rwwxz"
Aug 05 17:34:00.060965 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:00.060947    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d79df3a4-4b86-4acd-9884-c9d745b6b79b-original-pull-secret\") pod \"global-pull-secret-syncer-vth7m\" (UID: \"d79df3a4-4b86-4acd-9884-c9d745b6b79b\") " pod="kube-system/global-pull-secret-syncer-vth7m"
Aug 05 17:34:00.148268 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:00.148212    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhth2\" (UniqueName: \"kubernetes.io/projected/cd100b0f-a2de-4036-a21a-4412e02fa15f-kube-api-access-lhth2\") pod \"network-check-target-dnr6s\" (UID: \"cd100b0f-a2de-4036-a21a-4412e02fa15f\") " pod="openshift-network-diagnostics/network-check-target-dnr6s"
Aug 05 17:34:00.151266 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:00.151250    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 05 17:34:00.161864 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:00.161842    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 05 17:34:00.172072 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:00.172044    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhth2\" (UniqueName: \"kubernetes.io/projected/cd100b0f-a2de-4036-a21a-4412e02fa15f-kube-api-access-lhth2\") pod \"network-check-target-dnr6s\" (UID: \"cd100b0f-a2de-4036-a21a-4412e02fa15f\") " pod="openshift-network-diagnostics/network-check-target-dnr6s"
Aug 05 17:34:00.263263 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:00.263232    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dt589\""
Aug 05 17:34:00.269931 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:00.269913    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bbv86\""
Aug 05 17:34:00.270091 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:00.270079    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dnr6s"
Aug 05 17:34:00.273400 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:00.273382    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vth7m"
Aug 05 17:34:00.277656 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:00.277634    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rwwxz"
Aug 05 17:34:00.433908 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:00.433874    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vth7m"]
Aug 05 17:34:00.437541 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:34:00.437511    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd79df3a4_4b86_4acd_9884_c9d745b6b79b.slice/crio-8b17487c4fbefe98506dc685163ee8306ff9e4c99c002bf8d6e314ede9a83a77 WatchSource:0}: Error finding container 8b17487c4fbefe98506dc685163ee8306ff9e4c99c002bf8d6e314ede9a83a77: Status 404 returned error can't find the container with id 8b17487c4fbefe98506dc685163ee8306ff9e4c99c002bf8d6e314ede9a83a77
Aug 05 17:34:00.618015 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:00.617929    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vth7m" event={"ID":"d79df3a4-4b86-4acd-9884-c9d745b6b79b","Type":"ContainerStarted","Data":"8b17487c4fbefe98506dc685163ee8306ff9e4c99c002bf8d6e314ede9a83a77"}
Aug 05 17:34:00.646403 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:00.646366    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rwwxz"]
Aug 05 17:34:00.650445 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:34:00.650421    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83867a5e_d4bd_4da7_a6e4_e129d0f300a9.slice/crio-3b6f4fc425831497c676c6d75c5e59620c8693b47270df60f7a3dcfc204e0558 WatchSource:0}: Error finding container 3b6f4fc425831497c676c6d75c5e59620c8693b47270df60f7a3dcfc204e0558: Status 404 returned error can't find the container with id 3b6f4fc425831497c676c6d75c5e59620c8693b47270df60f7a3dcfc204e0558
Aug 05 17:34:00.655014 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:00.654992    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dnr6s"]
Aug 05 17:34:00.658921 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:34:00.658898    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd100b0f_a2de_4036_a21a_4412e02fa15f.slice/crio-7264fc2a61527120e74bb81d100df0a7ee4e35189b7e4149d2e1bc82b8dbc902 WatchSource:0}: Error finding container 7264fc2a61527120e74bb81d100df0a7ee4e35189b7e4149d2e1bc82b8dbc902: Status 404 returned error can't find the container with id 7264fc2a61527120e74bb81d100df0a7ee4e35189b7e4149d2e1bc82b8dbc902
Aug 05 17:34:01.624380 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:01.624338    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rwwxz" event={"ID":"83867a5e-d4bd-4da7-a6e4-e129d0f300a9","Type":"ContainerStarted","Data":"3b6f4fc425831497c676c6d75c5e59620c8693b47270df60f7a3dcfc204e0558"}
Aug 05 17:34:01.625476 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:01.625450    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dnr6s" event={"ID":"cd100b0f-a2de-4036-a21a-4412e02fa15f","Type":"ContainerStarted","Data":"7264fc2a61527120e74bb81d100df0a7ee4e35189b7e4149d2e1bc82b8dbc902"}
Aug 05 17:34:01.863527 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:01.863496    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/20a85ae0-3338-4063-923a-3f69efab43ff-metrics-tls\") pod \"dns-default-nldnk\" (UID: \"20a85ae0-3338-4063-923a-3f69efab43ff\") " pod="openshift-dns/dns-default-nldnk"
Aug 05 17:34:01.866743 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:01.866717    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/20a85ae0-3338-4063-923a-3f69efab43ff-metrics-tls\") pod \"dns-default-nldnk\" (UID: \"20a85ae0-3338-4063-923a-3f69efab43ff\") " pod="openshift-dns/dns-default-nldnk"
Aug 05 17:34:02.119997 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:02.119963    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-59qnw\""
Aug 05 17:34:02.128205 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:02.128019    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nldnk"
Aug 05 17:34:02.339417 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:02.339372    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nldnk"]
Aug 05 17:34:02.631144 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:02.631047    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nldnk" event={"ID":"20a85ae0-3338-4063-923a-3f69efab43ff","Type":"ContainerStarted","Data":"0c874a9278118b71fbabed260e6e84149320ff93afbe5d04d3aa60bb1dbe2e4f"}
Aug 05 17:34:02.633877 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:02.633842    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rwwxz" event={"ID":"83867a5e-d4bd-4da7-a6e4-e129d0f300a9","Type":"ContainerStarted","Data":"28ca3f2acb770d80638966d838193c6c41aeaf9dbc5726b549f675af86fa157f"}
Aug 05 17:34:02.634017 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:02.633899    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rwwxz" event={"ID":"83867a5e-d4bd-4da7-a6e4-e129d0f300a9","Type":"ContainerStarted","Data":"6ecd297ad3f8f5023ccbfd8f061a54993f3496a674e654a4e6e39157c132ccb0"}
Aug 05 17:34:02.657618 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:02.657558    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rwwxz" podStartSLOduration=66.455531015 podStartE2EDuration="1m7.657515614s" totalImagesPullingTime="1.201984599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:32:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:34:02.655518321 +0000 UTC m=+68.968369676" watchObservedRunningTime="2026-08-05 17:34:02.657515614 +0000 UTC m=+68.970366979"
Aug 05 17:34:04.788755 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:04.788712    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/234a7600-2e87-4367-a77f-cb2b59ee4b3f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-js46d\" (UID: \"234a7600-2e87-4367-a77f-cb2b59ee4b3f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-js46d"
Aug 05 17:34:04.792119 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:04.792086    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/234a7600-2e87-4367-a77f-cb2b59ee4b3f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-js46d\" (UID: \"234a7600-2e87-4367-a77f-cb2b59ee4b3f\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-js46d"
Aug 05 17:34:05.041777 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:05.041697    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-z4g6p\""
Aug 05 17:34:05.049513 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:05.049482    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-js46d"
Aug 05 17:34:06.123460 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.123285    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-st5bm"]
Aug 05 17:34:06.128150 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.127827    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-st5bm"
Aug 05 17:34:06.156139 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.156103    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Aug 05 17:34:06.160097 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.158892    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mgv27\""
Aug 05 17:34:06.160097 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.159290    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Aug 05 17:34:06.166180 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:34:06.166128    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod234a7600_2e87_4367_a77f_cb2b59ee4b3f.slice/crio-fee77b5e9a059bc5ae1cba334c9261ef7f3b2be6cb1084e3d9c5c4ee951a2ddc WatchSource:0}: Error finding container fee77b5e9a059bc5ae1cba334c9261ef7f3b2be6cb1084e3d9c5c4ee951a2ddc: Status 404 returned error can't find the container with id fee77b5e9a059bc5ae1cba334c9261ef7f3b2be6cb1084e3d9c5c4ee951a2ddc
Aug 05 17:34:06.172110 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.172086    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74466bdff7-mzc64"]
Aug 05 17:34:06.175736 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.175496    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-589695976-c9456"]
Aug 05 17:34:06.177423 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.177313    2558 patch_prober.go:28] interesting pod/image-registry-74466bdff7-mzc64 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Aug 05 17:34:06.177423 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.177361    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-74466bdff7-mzc64" podUID="23c8edfb-7426-4ea8-acfe-edd9154b4b70" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 05 17:34:06.179699 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.179681    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-js46d"]
Aug 05 17:34:06.179790 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.179719    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-st5bm"]
Aug 05 17:34:06.179867 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.179793    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-589695976-c9456"
Aug 05 17:34:06.187123 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.187068    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Aug 05 17:34:06.187945 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.187889    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Aug 05 17:34:06.188074 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.187956    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Aug 05 17:34:06.188185 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.187775    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-qspmd\""
Aug 05 17:34:06.188405 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.188388    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Aug 05 17:34:06.198782 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.198761    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/604187ee-64f0-4d2f-8a2c-15995ec0c181-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-st5bm\" (UID: \"604187ee-64f0-4d2f-8a2c-15995ec0c181\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-st5bm"
Aug 05 17:34:06.198865 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.198821    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/604187ee-64f0-4d2f-8a2c-15995ec0c181-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-st5bm\" (UID: \"604187ee-64f0-4d2f-8a2c-15995ec0c181\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-st5bm"
Aug 05 17:34:06.221189 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.221128    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-589695976-c9456"]
Aug 05 17:34:06.253856 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.253829    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-77c974ffcf-cqxb5"]
Aug 05 17:34:06.259464 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.259438    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-cqxb5"
Aug 05 17:34:06.266299 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.266277    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Aug 05 17:34:06.266556 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.266540    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Aug 05 17:34:06.274108 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.274081    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-7zmg8\""
Aug 05 17:34:06.274263 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.274201    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-cqxb5"]
Aug 05 17:34:06.299443 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.299409    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5bdb039e-7e6f-4f3b-acdf-63b95e8059a2-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-589695976-c9456\" (UID: \"5bdb039e-7e6f-4f3b-acdf-63b95e8059a2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-589695976-c9456"
Aug 05 17:34:06.299624 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.299459    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzspc\" (UniqueName: \"kubernetes.io/projected/5bdb039e-7e6f-4f3b-acdf-63b95e8059a2-kube-api-access-fzspc\") pod \"managed-serviceaccount-addon-agent-589695976-c9456\" (UID: \"5bdb039e-7e6f-4f3b-acdf-63b95e8059a2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-589695976-c9456"
Aug 05 17:34:06.299624 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.299481    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvvp6\" (UniqueName: \"kubernetes.io/projected/737b8b76-932b-4c5c-9e50-98731d108570-kube-api-access-gvvp6\") pod \"downloads-77c974ffcf-cqxb5\" (UID: \"737b8b76-932b-4c5c-9e50-98731d108570\") " pod="openshift-console/downloads-77c974ffcf-cqxb5"
Aug 05 17:34:06.299624 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.299574    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/604187ee-64f0-4d2f-8a2c-15995ec0c181-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-st5bm\" (UID: \"604187ee-64f0-4d2f-8a2c-15995ec0c181\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-st5bm"
Aug 05 17:34:06.299790 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.299621    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/604187ee-64f0-4d2f-8a2c-15995ec0c181-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-st5bm\" (UID: \"604187ee-64f0-4d2f-8a2c-15995ec0c181\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-st5bm"
Aug 05 17:34:06.300285 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.300266    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/604187ee-64f0-4d2f-8a2c-15995ec0c181-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-st5bm\" (UID: \"604187ee-64f0-4d2f-8a2c-15995ec0c181\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-st5bm"
Aug 05 17:34:06.302149 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.302129    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/604187ee-64f0-4d2f-8a2c-15995ec0c181-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-st5bm\" (UID: \"604187ee-64f0-4d2f-8a2c-15995ec0c181\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-st5bm"
Aug 05 17:34:06.327108 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.327073    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6bc9d45fc9-ggtj6"]
Aug 05 17:34:06.330175 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.330160    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bc9d45fc9-ggtj6"
Aug 05 17:34:06.396954 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.396780    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bc9d45fc9-ggtj6"]
Aug 05 17:34:06.400615 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.400588    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88df594f-dffc-4de0-be71-135cb8d646a3-bound-sa-token\") pod \"image-registry-6bc9d45fc9-ggtj6\" (UID: \"88df594f-dffc-4de0-be71-135cb8d646a3\") " pod="openshift-image-registry/image-registry-6bc9d45fc9-ggtj6"
Aug 05 17:34:06.400736 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.400621    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/88df594f-dffc-4de0-be71-135cb8d646a3-trusted-ca\") pod \"image-registry-6bc9d45fc9-ggtj6\" (UID: \"88df594f-dffc-4de0-be71-135cb8d646a3\") " pod="openshift-image-registry/image-registry-6bc9d45fc9-ggtj6"
Aug 05 17:34:06.400736 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.400643    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5bdb039e-7e6f-4f3b-acdf-63b95e8059a2-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-589695976-c9456\" (UID: \"5bdb039e-7e6f-4f3b-acdf-63b95e8059a2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-589695976-c9456"
Aug 05 17:34:06.400736 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.400689    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/88df594f-dffc-4de0-be71-135cb8d646a3-registry-tls\") pod \"image-registry-6bc9d45fc9-ggtj6\" (UID: \"88df594f-dffc-4de0-be71-135cb8d646a3\") " pod="openshift-image-registry/image-registry-6bc9d45fc9-ggtj6"
Aug 05 17:34:06.400855 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.400758    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4s8l\" (UniqueName: \"kubernetes.io/projected/88df594f-dffc-4de0-be71-135cb8d646a3-kube-api-access-v4s8l\") pod \"image-registry-6bc9d45fc9-ggtj6\" (UID: \"88df594f-dffc-4de0-be71-135cb8d646a3\") " pod="openshift-image-registry/image-registry-6bc9d45fc9-ggtj6"
Aug 05 17:34:06.400890 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.400873    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/88df594f-dffc-4de0-be71-135cb8d646a3-registry-certificates\") pod \"image-registry-6bc9d45fc9-ggtj6\" (UID: \"88df594f-dffc-4de0-be71-135cb8d646a3\") " pod="openshift-image-registry/image-registry-6bc9d45fc9-ggtj6"
Aug 05 17:34:06.400929 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.400906    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/88df594f-dffc-4de0-be71-135cb8d646a3-ca-trust-extracted\") pod \"image-registry-6bc9d45fc9-ggtj6\" (UID: \"88df594f-dffc-4de0-be71-135cb8d646a3\") " pod="openshift-image-registry/image-registry-6bc9d45fc9-ggtj6"
Aug 05 17:34:06.400963 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.400937    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/88df594f-dffc-4de0-be71-135cb8d646a3-image-registry-private-configuration\") pod \"image-registry-6bc9d45fc9-ggtj6\" (UID: \"88df594f-dffc-4de0-be71-135cb8d646a3\") " pod="openshift-image-registry/image-registry-6bc9d45fc9-ggtj6"
Aug 05 17:34:06.401013 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.400980    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzspc\" (UniqueName: \"kubernetes.io/projected/5bdb039e-7e6f-4f3b-acdf-63b95e8059a2-kube-api-access-fzspc\") pod \"managed-serviceaccount-addon-agent-589695976-c9456\" (UID: \"5bdb039e-7e6f-4f3b-acdf-63b95e8059a2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-589695976-c9456"
Aug 05 17:34:06.401067 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.401039    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvvp6\" (UniqueName: \"kubernetes.io/projected/737b8b76-932b-4c5c-9e50-98731d108570-kube-api-access-gvvp6\") pod \"downloads-77c974ffcf-cqxb5\" (UID: \"737b8b76-932b-4c5c-9e50-98731d108570\") " pod="openshift-console/downloads-77c974ffcf-cqxb5"
Aug 05 17:34:06.401121 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.401109    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/88df594f-dffc-4de0-be71-135cb8d646a3-installation-pull-secrets\") pod \"image-registry-6bc9d45fc9-ggtj6\" (UID: \"88df594f-dffc-4de0-be71-135cb8d646a3\") " pod="openshift-image-registry/image-registry-6bc9d45fc9-ggtj6"
Aug 05 17:34:06.403343 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.403319    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5bdb039e-7e6f-4f3b-acdf-63b95e8059a2-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-589695976-c9456\" (UID: \"5bdb039e-7e6f-4f3b-acdf-63b95e8059a2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-589695976-c9456"
Aug 05 17:34:06.417714 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.417693    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzspc\" (UniqueName: \"kubernetes.io/projected/5bdb039e-7e6f-4f3b-acdf-63b95e8059a2-kube-api-access-fzspc\") pod \"managed-serviceaccount-addon-agent-589695976-c9456\" (UID: \"5bdb039e-7e6f-4f3b-acdf-63b95e8059a2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-589695976-c9456"
Aug 05 17:34:06.420049 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.420032    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvvp6\" (UniqueName: \"kubernetes.io/projected/737b8b76-932b-4c5c-9e50-98731d108570-kube-api-access-gvvp6\") pod \"downloads-77c974ffcf-cqxb5\" (UID: \"737b8b76-932b-4c5c-9e50-98731d108570\") " pod="openshift-console/downloads-77c974ffcf-cqxb5"
Aug 05 17:34:06.440940 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.440878    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-st5bm"
Aug 05 17:34:06.500749 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.500722    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-589695976-c9456"
Aug 05 17:34:06.502014 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.501993    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/88df594f-dffc-4de0-be71-135cb8d646a3-registry-certificates\") pod \"image-registry-6bc9d45fc9-ggtj6\" (UID: \"88df594f-dffc-4de0-be71-135cb8d646a3\") " pod="openshift-image-registry/image-registry-6bc9d45fc9-ggtj6"
Aug 05 17:34:06.502084 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.502024    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/88df594f-dffc-4de0-be71-135cb8d646a3-ca-trust-extracted\") pod \"image-registry-6bc9d45fc9-ggtj6\" (UID: \"88df594f-dffc-4de0-be71-135cb8d646a3\") " pod="openshift-image-registry/image-registry-6bc9d45fc9-ggtj6"
Aug 05 17:34:06.502084 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.502043    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/88df594f-dffc-4de0-be71-135cb8d646a3-image-registry-private-configuration\") pod \"image-registry-6bc9d45fc9-ggtj6\" (UID: \"88df594f-dffc-4de0-be71-135cb8d646a3\") " pod="openshift-image-registry/image-registry-6bc9d45fc9-ggtj6"
Aug 05 17:34:06.502084 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.502078    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/88df594f-dffc-4de0-be71-135cb8d646a3-installation-pull-secrets\") pod \"image-registry-6bc9d45fc9-ggtj6\" (UID: \"88df594f-dffc-4de0-be71-135cb8d646a3\") " pod="openshift-image-registry/image-registry-6bc9d45fc9-ggtj6"
Aug 05 17:34:06.502282 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.502265    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88df594f-dffc-4de0-be71-135cb8d646a3-bound-sa-token\") pod \"image-registry-6bc9d45fc9-ggtj6\" (UID: \"88df594f-dffc-4de0-be71-135cb8d646a3\") " pod="openshift-image-registry/image-registry-6bc9d45fc9-ggtj6"
Aug 05 17:34:06.502333 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.502305    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/88df594f-dffc-4de0-be71-135cb8d646a3-trusted-ca\") pod \"image-registry-6bc9d45fc9-ggtj6\" (UID: \"88df594f-dffc-4de0-be71-135cb8d646a3\") " pod="openshift-image-registry/image-registry-6bc9d45fc9-ggtj6"
Aug 05 17:34:06.502377 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.502333    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/88df594f-dffc-4de0-be71-135cb8d646a3-registry-tls\") pod \"image-registry-6bc9d45fc9-ggtj6\" (UID: \"88df594f-dffc-4de0-be71-135cb8d646a3\") " pod="openshift-image-registry/image-registry-6bc9d45fc9-ggtj6"
Aug 05 17:34:06.502377 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.502358    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4s8l\" (UniqueName: \"kubernetes.io/projected/88df594f-dffc-4de0-be71-135cb8d646a3-kube-api-access-v4s8l\") pod \"image-registry-6bc9d45fc9-ggtj6\" (UID: \"88df594f-dffc-4de0-be71-135cb8d646a3\") " pod="openshift-image-registry/image-registry-6bc9d45fc9-ggtj6"
Aug 05 17:34:06.502460 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.502437    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/88df594f-dffc-4de0-be71-135cb8d646a3-ca-trust-extracted\") pod \"image-registry-6bc9d45fc9-ggtj6\" (UID: \"88df594f-dffc-4de0-be71-135cb8d646a3\") " pod="openshift-image-registry/image-registry-6bc9d45fc9-ggtj6"
Aug 05 17:34:06.502943 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.502915    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/88df594f-dffc-4de0-be71-135cb8d646a3-registry-certificates\") pod \"image-registry-6bc9d45fc9-ggtj6\" (UID: \"88df594f-dffc-4de0-be71-135cb8d646a3\") " pod="openshift-image-registry/image-registry-6bc9d45fc9-ggtj6"
Aug 05 17:34:06.503408 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.503391    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/88df594f-dffc-4de0-be71-135cb8d646a3-trusted-ca\") pod \"image-registry-6bc9d45fc9-ggtj6\" (UID: \"88df594f-dffc-4de0-be71-135cb8d646a3\") " pod="openshift-image-registry/image-registry-6bc9d45fc9-ggtj6"
Aug 05 17:34:06.505397 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.505281    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/88df594f-dffc-4de0-be71-135cb8d646a3-image-registry-private-configuration\") pod \"image-registry-6bc9d45fc9-ggtj6\" (UID: \"88df594f-dffc-4de0-be71-135cb8d646a3\") " pod="openshift-image-registry/image-registry-6bc9d45fc9-ggtj6"
Aug 05 17:34:06.505532 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.505513    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/88df594f-dffc-4de0-be71-135cb8d646a3-installation-pull-secrets\") pod \"image-registry-6bc9d45fc9-ggtj6\" (UID: \"88df594f-dffc-4de0-be71-135cb8d646a3\") " pod="openshift-image-registry/image-registry-6bc9d45fc9-ggtj6"
Aug 05 17:34:06.505741 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.505723    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/88df594f-dffc-4de0-be71-135cb8d646a3-registry-tls\") pod \"image-registry-6bc9d45fc9-ggtj6\" (UID: \"88df594f-dffc-4de0-be71-135cb8d646a3\") " pod="openshift-image-registry/image-registry-6bc9d45fc9-ggtj6"
Aug 05 17:34:06.516487 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.516459    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88df594f-dffc-4de0-be71-135cb8d646a3-bound-sa-token\") pod \"image-registry-6bc9d45fc9-ggtj6\" (UID: \"88df594f-dffc-4de0-be71-135cb8d646a3\") " pod="openshift-image-registry/image-registry-6bc9d45fc9-ggtj6"
Aug 05 17:34:06.517236 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.517199    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4s8l\" (UniqueName: \"kubernetes.io/projected/88df594f-dffc-4de0-be71-135cb8d646a3-kube-api-access-v4s8l\") pod \"image-registry-6bc9d45fc9-ggtj6\" (UID: \"88df594f-dffc-4de0-be71-135cb8d646a3\") " pod="openshift-image-registry/image-registry-6bc9d45fc9-ggtj6"
Aug 05 17:34:06.571236 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.570860    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-cqxb5"
Aug 05 17:34:06.605455 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.605344    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-st5bm"]
Aug 05 17:34:06.640720 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.640581    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bc9d45fc9-ggtj6"
Aug 05 17:34:06.657864 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.657051    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vth7m" event={"ID":"d79df3a4-4b86-4acd-9884-c9d745b6b79b","Type":"ContainerStarted","Data":"3ba8169436309a5918cc57afc337cc02f6136c72860104bbf4cf167b1144f0d5"}
Aug 05 17:34:06.662409 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.661781    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nldnk" event={"ID":"20a85ae0-3338-4063-923a-3f69efab43ff","Type":"ContainerStarted","Data":"bc04f95bb592ea88a2d2bb82499c93bce570fc74f8367f5cf13570aef4694169"}
Aug 05 17:34:06.662409 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.661854    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nldnk" event={"ID":"20a85ae0-3338-4063-923a-3f69efab43ff","Type":"ContainerStarted","Data":"3d77f4808ad12d6a980daf0a1bf9656400f8d6df3e386abc66b03ed818135369"}
Aug 05 17:34:06.662409 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.661886    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nldnk"
Aug 05 17:34:06.664147 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.664115    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-st5bm" event={"ID":"604187ee-64f0-4d2f-8a2c-15995ec0c181","Type":"ContainerStarted","Data":"94bd745992001d260c2630ad489fde95546ee3dbc176acf34346183cef52537f"}
Aug 05 17:34:06.665529 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.665471    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-js46d" event={"ID":"234a7600-2e87-4367-a77f-cb2b59ee4b3f","Type":"ContainerStarted","Data":"fee77b5e9a059bc5ae1cba334c9261ef7f3b2be6cb1084e3d9c5c4ee951a2ddc"}
Aug 05 17:34:06.667926 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.667663    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dnr6s" event={"ID":"cd100b0f-a2de-4036-a21a-4412e02fa15f","Type":"ContainerStarted","Data":"670b4fe261bfa01b874c2e389a3744bd15407c31104ce6bb6482366910b14a99"}
Aug 05 17:34:06.667926 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.667881    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dnr6s"
Aug 05 17:34:06.684087 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.684057    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-589695976-c9456"]
Aug 05 17:34:06.689491 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.689435    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vth7m" podStartSLOduration=66.194258545 podStartE2EDuration="1m11.689413491s" totalImagesPullingTime="5.495154946s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:32:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:34:06.687637115 +0000 UTC m=+73.000488477" watchObservedRunningTime="2026-08-05 17:34:06.689413491 +0000 UTC m=+73.002264852"
Aug 05 17:34:06.693261 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:34:06.692660    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5bdb039e_7e6f_4f3b_acdf_63b95e8059a2.slice/crio-2e849ceceff15574890430ed85d6c38d1889cc8b5b8ed4656345fb7beb7035f6 WatchSource:0}: Error finding container 2e849ceceff15574890430ed85d6c38d1889cc8b5b8ed4656345fb7beb7035f6: Status 404 returned error can't find the container with id 2e849ceceff15574890430ed85d6c38d1889cc8b5b8ed4656345fb7beb7035f6
Aug 05 17:34:06.709263 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.708978    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dnr6s" podStartSLOduration=66.403306883 podStartE2EDuration="1m11.708958449s" totalImagesPullingTime="5.305651566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:32:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:34:06.707916212 +0000 UTC m=+73.020767577" watchObservedRunningTime="2026-08-05 17:34:06.708958449 +0000 UTC m=+73.021809830"
Aug 05 17:34:06.739452 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.739403    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-nldnk" podStartSLOduration=34.114025615 podStartE2EDuration="37.739385691s" totalImagesPullingTime="3.625360076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:33:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:34:06.739003222 +0000 UTC m=+73.051854584" watchObservedRunningTime="2026-08-05 17:34:06.739385691 +0000 UTC m=+73.052237055"
Aug 05 17:34:06.762930 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.762893    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-cqxb5"]
Aug 05 17:34:06.769507 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:34:06.769469    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod737b8b76_932b_4c5c_9e50_98731d108570.slice/crio-28be497f64653c730e9812ae655aed8fcae3d2efcc69c5bada74cf5116250a09 WatchSource:0}: Error finding container 28be497f64653c730e9812ae655aed8fcae3d2efcc69c5bada74cf5116250a09: Status 404 returned error can't find the container with id 28be497f64653c730e9812ae655aed8fcae3d2efcc69c5bada74cf5116250a09
Aug 05 17:34:06.816078 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:06.816040    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bc9d45fc9-ggtj6"]
Aug 05 17:34:06.819891 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:34:06.819856    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88df594f_dffc_4de0_be71_135cb8d646a3.slice/crio-c338741d298aa057b5f7dd07e8ff3e0597c06e7df2981c2d41e30f3b19aad972 WatchSource:0}: Error finding container c338741d298aa057b5f7dd07e8ff3e0597c06e7df2981c2d41e30f3b19aad972: Status 404 returned error can't find the container with id c338741d298aa057b5f7dd07e8ff3e0597c06e7df2981c2d41e30f3b19aad972
Aug 05 17:34:07.674186 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:07.674113    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-589695976-c9456" event={"ID":"5bdb039e-7e6f-4f3b-acdf-63b95e8059a2","Type":"ContainerStarted","Data":"2e849ceceff15574890430ed85d6c38d1889cc8b5b8ed4656345fb7beb7035f6"}
Aug 05 17:34:07.676356 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:07.676321    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bc9d45fc9-ggtj6" event={"ID":"88df594f-dffc-4de0-be71-135cb8d646a3","Type":"ContainerStarted","Data":"ee5a674554bee90f29866b911ecce7846beabbd5f277cb53af9982aea84896ee"}
Aug 05 17:34:07.676507 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:07.676382    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bc9d45fc9-ggtj6" event={"ID":"88df594f-dffc-4de0-be71-135cb8d646a3","Type":"ContainerStarted","Data":"c338741d298aa057b5f7dd07e8ff3e0597c06e7df2981c2d41e30f3b19aad972"}
Aug 05 17:34:07.677066 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:07.677040    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6bc9d45fc9-ggtj6"
Aug 05 17:34:07.681774 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:07.681749    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-cqxb5" event={"ID":"737b8b76-932b-4c5c-9e50-98731d108570","Type":"ContainerStarted","Data":"28be497f64653c730e9812ae655aed8fcae3d2efcc69c5bada74cf5116250a09"}
Aug 05 17:34:08.703170 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:08.702788    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-st5bm" event={"ID":"604187ee-64f0-4d2f-8a2c-15995ec0c181","Type":"ContainerStarted","Data":"0f70f09a95b62395278b9b1e008cbfac60e4cc92c31ab47871138735a4dbeaa3"}
Aug 05 17:34:08.706289 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:08.706215    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-js46d" event={"ID":"234a7600-2e87-4367-a77f-cb2b59ee4b3f","Type":"ContainerStarted","Data":"9562daf1960ea74507f1e34f41d02a32a2ae47dd45f4254f59fa4dd632f47ff4"}
Aug 05 17:34:08.726261 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:08.726186    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-f77f48c6d-st5bm" podStartSLOduration=0.90307584 podStartE2EDuration="2.726168495s" totalImagesPullingTime="1.823092655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:34:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:34:08.724689084 +0000 UTC m=+75.037540448" watchObservedRunningTime="2026-08-05 17:34:08.726168495 +0000 UTC m=+75.039019867"
Aug 05 17:34:08.726448 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:08.726294    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6bc9d45fc9-ggtj6" podStartSLOduration=2.726287426 podStartE2EDuration="2.726287426s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:34:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:34:07.721430512 +0000 UTC m=+74.034281877" watchObservedRunningTime="2026-08-05 17:34:08.726287426 +0000 UTC m=+75.039138791"
Aug 05 17:34:11.721259 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:11.721195    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-589695976-c9456" event={"ID":"5bdb039e-7e6f-4f3b-acdf-63b95e8059a2","Type":"ContainerStarted","Data":"9810d883d19c4f73ecb3380a98913d167536e0de5e437d6b38516fe830d018b8"}
Aug 05 17:34:11.738734 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:11.738673    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-js46d" podStartSLOduration=37.471420072 podStartE2EDuration="39.738652813s" totalImagesPullingTime="2.267232741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:34:08.758238281 +0000 UTC m=+75.071089638" watchObservedRunningTime="2026-08-05 17:34:11.738652813 +0000 UTC m=+78.051504176"
Aug 05 17:34:11.739028 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:11.738999    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-589695976-c9456" podStartSLOduration=1.079770714 podStartE2EDuration="5.738991159s" totalImagesPullingTime="4.659220445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:34:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:34:11.73820732 +0000 UTC m=+78.051058683" watchObservedRunningTime="2026-08-05 17:34:11.738991159 +0000 UTC m=+78.051842523"
Aug 05 17:34:16.177468 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:16.177352    2558 patch_prober.go:28] interesting pod/image-registry-74466bdff7-mzc64 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Aug 05 17:34:16.177468 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:16.177417    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-74466bdff7-mzc64" podUID="23c8edfb-7426-4ea8-acfe-edd9154b4b70" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 05 17:34:16.683670 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:16.683633    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nldnk"
Aug 05 17:34:17.533281 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:17.533240    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pvsdv"]
Aug 05 17:34:17.538468 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:17.538440    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pvsdv"
Aug 05 17:34:17.541621 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:17.541598    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Aug 05 17:34:17.542028 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:17.541743    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Aug 05 17:34:17.542028 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:17.541859    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-p8psp\""
Aug 05 17:34:17.542193 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:17.542070    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Aug 05 17:34:17.542806 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:17.542785    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Aug 05 17:34:17.608772 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:17.608736    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fea7f803-b3c1-49ba-9f5e-6827ee10c813-node-exporter-tls\") pod \"node-exporter-pvsdv\" (UID: \"fea7f803-b3c1-49ba-9f5e-6827ee10c813\") " pod="openshift-monitoring/node-exporter-pvsdv"
Aug 05 17:34:17.608772 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:17.608781    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fea7f803-b3c1-49ba-9f5e-6827ee10c813-node-exporter-textfile\") pod \"node-exporter-pvsdv\" (UID: \"fea7f803-b3c1-49ba-9f5e-6827ee10c813\") " pod="openshift-monitoring/node-exporter-pvsdv"
Aug 05 17:34:17.608969 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:17.608882    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fea7f803-b3c1-49ba-9f5e-6827ee10c813-sys\") pod \"node-exporter-pvsdv\" (UID: \"fea7f803-b3c1-49ba-9f5e-6827ee10c813\") " pod="openshift-monitoring/node-exporter-pvsdv"
Aug 05 17:34:17.608969 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:17.608919    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgbkn\" (UniqueName: \"kubernetes.io/projected/fea7f803-b3c1-49ba-9f5e-6827ee10c813-kube-api-access-cgbkn\") pod \"node-exporter-pvsdv\" (UID: \"fea7f803-b3c1-49ba-9f5e-6827ee10c813\") " pod="openshift-monitoring/node-exporter-pvsdv"
Aug 05 17:34:17.609038 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:17.608967    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fea7f803-b3c1-49ba-9f5e-6827ee10c813-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pvsdv\" (UID: \"fea7f803-b3c1-49ba-9f5e-6827ee10c813\") " pod="openshift-monitoring/node-exporter-pvsdv"
Aug 05 17:34:17.609038 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:17.608997    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fea7f803-b3c1-49ba-9f5e-6827ee10c813-node-exporter-wtmp\") pod \"node-exporter-pvsdv\" (UID: \"fea7f803-b3c1-49ba-9f5e-6827ee10c813\") " pod="openshift-monitoring/node-exporter-pvsdv"
Aug 05 17:34:17.609038 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:17.609028    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fea7f803-b3c1-49ba-9f5e-6827ee10c813-root\") pod \"node-exporter-pvsdv\" (UID: \"fea7f803-b3c1-49ba-9f5e-6827ee10c813\") " pod="openshift-monitoring/node-exporter-pvsdv"
Aug 05 17:34:17.609152 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:17.609063    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fea7f803-b3c1-49ba-9f5e-6827ee10c813-metrics-client-ca\") pod \"node-exporter-pvsdv\" (UID: \"fea7f803-b3c1-49ba-9f5e-6827ee10c813\") " pod="openshift-monitoring/node-exporter-pvsdv"
Aug 05 17:34:17.609152 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:17.609098    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fea7f803-b3c1-49ba-9f5e-6827ee10c813-node-exporter-accelerators-collector-config\") pod \"node-exporter-pvsdv\" (UID: \"fea7f803-b3c1-49ba-9f5e-6827ee10c813\") " pod="openshift-monitoring/node-exporter-pvsdv"
Aug 05 17:34:17.709513 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:17.709478    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fea7f803-b3c1-49ba-9f5e-6827ee10c813-node-exporter-accelerators-collector-config\") pod \"node-exporter-pvsdv\" (UID: \"fea7f803-b3c1-49ba-9f5e-6827ee10c813\") " pod="openshift-monitoring/node-exporter-pvsdv"
Aug 05 17:34:17.709695 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:17.709535    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fea7f803-b3c1-49ba-9f5e-6827ee10c813-node-exporter-tls\") pod \"node-exporter-pvsdv\" (UID: \"fea7f803-b3c1-49ba-9f5e-6827ee10c813\") " pod="openshift-monitoring/node-exporter-pvsdv"
Aug 05 17:34:17.709695 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:34:17.709644    2558 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Aug 05 17:34:17.709813 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:34:17.709707    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fea7f803-b3c1-49ba-9f5e-6827ee10c813-node-exporter-tls podName:fea7f803-b3c1-49ba-9f5e-6827ee10c813 nodeName:}" failed. No retries permitted until 2026-08-05 17:34:18.20968578 +0000 UTC m=+84.522537135 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/fea7f803-b3c1-49ba-9f5e-6827ee10c813-node-exporter-tls") pod "node-exporter-pvsdv" (UID: "fea7f803-b3c1-49ba-9f5e-6827ee10c813") : secret "node-exporter-tls" not found
Aug 05 17:34:17.710644 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:17.709922    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fea7f803-b3c1-49ba-9f5e-6827ee10c813-node-exporter-textfile\") pod \"node-exporter-pvsdv\" (UID: \"fea7f803-b3c1-49ba-9f5e-6827ee10c813\") " pod="openshift-monitoring/node-exporter-pvsdv"
Aug 05 17:34:17.710644 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:17.710001    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fea7f803-b3c1-49ba-9f5e-6827ee10c813-sys\") pod \"node-exporter-pvsdv\" (UID: \"fea7f803-b3c1-49ba-9f5e-6827ee10c813\") " pod="openshift-monitoring/node-exporter-pvsdv"
Aug 05 17:34:17.710644 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:17.710030    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgbkn\" (UniqueName: \"kubernetes.io/projected/fea7f803-b3c1-49ba-9f5e-6827ee10c813-kube-api-access-cgbkn\") pod \"node-exporter-pvsdv\" (UID: \"fea7f803-b3c1-49ba-9f5e-6827ee10c813\") " pod="openshift-monitoring/node-exporter-pvsdv"
Aug 05 17:34:17.710644 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:17.710079    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fea7f803-b3c1-49ba-9f5e-6827ee10c813-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pvsdv\" (UID: \"fea7f803-b3c1-49ba-9f5e-6827ee10c813\") " pod="openshift-monitoring/node-exporter-pvsdv"
Aug 05 17:34:17.710644 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:17.710109    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fea7f803-b3c1-49ba-9f5e-6827ee10c813-node-exporter-wtmp\") pod \"node-exporter-pvsdv\" (UID: \"fea7f803-b3c1-49ba-9f5e-6827ee10c813\") " pod="openshift-monitoring/node-exporter-pvsdv"
Aug 05 17:34:17.710644 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:17.710143    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fea7f803-b3c1-49ba-9f5e-6827ee10c813-root\") pod \"node-exporter-pvsdv\" (UID: \"fea7f803-b3c1-49ba-9f5e-6827ee10c813\") " pod="openshift-monitoring/node-exporter-pvsdv"
Aug 05 17:34:17.710644 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:17.710171    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fea7f803-b3c1-49ba-9f5e-6827ee10c813-metrics-client-ca\") pod \"node-exporter-pvsdv\" (UID: \"fea7f803-b3c1-49ba-9f5e-6827ee10c813\") " pod="openshift-monitoring/node-exporter-pvsdv"
Aug 05 17:34:17.710644 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:17.710175    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fea7f803-b3c1-49ba-9f5e-6827ee10c813-node-exporter-accelerators-collector-config\") pod \"node-exporter-pvsdv\" (UID: \"fea7f803-b3c1-49ba-9f5e-6827ee10c813\") " pod="openshift-monitoring/node-exporter-pvsdv"
Aug 05 17:34:17.710644 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:17.710269    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fea7f803-b3c1-49ba-9f5e-6827ee10c813-node-exporter-textfile\") pod \"node-exporter-pvsdv\" (UID: \"fea7f803-b3c1-49ba-9f5e-6827ee10c813\") " pod="openshift-monitoring/node-exporter-pvsdv"
Aug 05 17:34:17.710644 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:17.710339    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fea7f803-b3c1-49ba-9f5e-6827ee10c813-root\") pod \"node-exporter-pvsdv\" (UID: \"fea7f803-b3c1-49ba-9f5e-6827ee10c813\") " pod="openshift-monitoring/node-exporter-pvsdv"
Aug 05 17:34:17.710644 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:17.710356    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fea7f803-b3c1-49ba-9f5e-6827ee10c813-node-exporter-wtmp\") pod \"node-exporter-pvsdv\" (UID: \"fea7f803-b3c1-49ba-9f5e-6827ee10c813\") " pod="openshift-monitoring/node-exporter-pvsdv"
Aug 05 17:34:17.710644 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:17.710389    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fea7f803-b3c1-49ba-9f5e-6827ee10c813-sys\") pod \"node-exporter-pvsdv\" (UID: \"fea7f803-b3c1-49ba-9f5e-6827ee10c813\") " pod="openshift-monitoring/node-exporter-pvsdv"
Aug 05 17:34:17.711343 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:17.710793    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fea7f803-b3c1-49ba-9f5e-6827ee10c813-metrics-client-ca\") pod \"node-exporter-pvsdv\" (UID: \"fea7f803-b3c1-49ba-9f5e-6827ee10c813\") " pod="openshift-monitoring/node-exporter-pvsdv"
Aug 05 17:34:17.713103 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:17.713082    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fea7f803-b3c1-49ba-9f5e-6827ee10c813-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pvsdv\" (UID: \"fea7f803-b3c1-49ba-9f5e-6827ee10c813\") " pod="openshift-monitoring/node-exporter-pvsdv"
Aug 05 17:34:17.720343 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:17.720322    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgbkn\" (UniqueName: \"kubernetes.io/projected/fea7f803-b3c1-49ba-9f5e-6827ee10c813-kube-api-access-cgbkn\") pod \"node-exporter-pvsdv\" (UID: \"fea7f803-b3c1-49ba-9f5e-6827ee10c813\") " pod="openshift-monitoring/node-exporter-pvsdv"
Aug 05 17:34:18.216058 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:18.216017    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fea7f803-b3c1-49ba-9f5e-6827ee10c813-node-exporter-tls\") pod \"node-exporter-pvsdv\" (UID: \"fea7f803-b3c1-49ba-9f5e-6827ee10c813\") " pod="openshift-monitoring/node-exporter-pvsdv"
Aug 05 17:34:18.218732 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:18.218706    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fea7f803-b3c1-49ba-9f5e-6827ee10c813-node-exporter-tls\") pod \"node-exporter-pvsdv\" (UID: \"fea7f803-b3c1-49ba-9f5e-6827ee10c813\") " pod="openshift-monitoring/node-exporter-pvsdv"
Aug 05 17:34:18.450967 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:18.450932    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pvsdv"
Aug 05 17:34:23.553393 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:34:23.553359    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfea7f803_b3c1_49ba_9f5e_6827ee10c813.slice/crio-28e9d19f512be3f5f5991dd0bd4f420eaad04abbfdcd99c2fd2b5bee0168c751 WatchSource:0}: Error finding container 28e9d19f512be3f5f5991dd0bd4f420eaad04abbfdcd99c2fd2b5bee0168c751: Status 404 returned error can't find the container with id 28e9d19f512be3f5f5991dd0bd4f420eaad04abbfdcd99c2fd2b5bee0168c751
Aug 05 17:34:23.770708 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:23.770671    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pvsdv" event={"ID":"fea7f803-b3c1-49ba-9f5e-6827ee10c813","Type":"ContainerStarted","Data":"28e9d19f512be3f5f5991dd0bd4f420eaad04abbfdcd99c2fd2b5bee0168c751"}
Aug 05 17:34:24.776858 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:24.776817    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-cqxb5" event={"ID":"737b8b76-932b-4c5c-9e50-98731d108570","Type":"ContainerStarted","Data":"995452935c5403899e8f4251f6c1fa41b9a7794daf944240df770a0aceb5202a"}
Aug 05 17:34:24.777455 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:24.777428    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-77c974ffcf-cqxb5"
Aug 05 17:34:24.793767 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:24.793736    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-77c974ffcf-cqxb5"
Aug 05 17:34:24.807115 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:24.807062    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-77c974ffcf-cqxb5" podStartSLOduration=1.413328299 podStartE2EDuration="18.807042275s" totalImagesPullingTime="17.393713976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:34:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:34:24.804573609 +0000 UTC m=+91.117424997" watchObservedRunningTime="2026-08-05 17:34:24.807042275 +0000 UTC m=+91.119893656"
Aug 05 17:34:25.783742 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:25.783704    2558 generic.go:356] "Generic (PLEG): container finished" podID="fea7f803-b3c1-49ba-9f5e-6827ee10c813" containerID="971624249bd348afd170936c2e3a2395915977f08cc9820c0549820370d8772e" exitCode=0
Aug 05 17:34:25.784244 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:25.783808    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pvsdv" event={"ID":"fea7f803-b3c1-49ba-9f5e-6827ee10c813","Type":"ContainerDied","Data":"971624249bd348afd170936c2e3a2395915977f08cc9820c0549820370d8772e"}
Aug 05 17:34:26.178369 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:26.178339    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-74466bdff7-mzc64"
Aug 05 17:34:26.790958 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:26.790917    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pvsdv" event={"ID":"fea7f803-b3c1-49ba-9f5e-6827ee10c813","Type":"ContainerStarted","Data":"b05be7c35bab459c50d677bc32cf1580c73fd99b96abc988028fe4292cda0e9f"}
Aug 05 17:34:26.791478 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:26.790984    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pvsdv" event={"ID":"fea7f803-b3c1-49ba-9f5e-6827ee10c813","Type":"ContainerStarted","Data":"1a70019c77b3a2ebad3b36190f60c7bba9b63ef1012a9cffeada95c2bc395f20"}
Aug 05 17:34:26.820015 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:26.819957    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pvsdv" podStartSLOduration=8.159732476 podStartE2EDuration="9.819940741s" totalImagesPullingTime="1.554914973s" totalInitContainerRuntime="105.293292ms" isStatefulPod=true podCreationTimestamp="2026-08-05 17:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:34:26.819310597 +0000 UTC m=+93.132161959" watchObservedRunningTime="2026-08-05 17:34:26.819940741 +0000 UTC m=+93.132792103"
Aug 05 17:34:29.715125 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:29.715094    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6bc9d45fc9-ggtj6"
Aug 05 17:34:31.195913 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:31.195840    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-74466bdff7-mzc64" podUID="23c8edfb-7426-4ea8-acfe-edd9154b4b70" containerName="registry" containerID="cri-o://f108aff090618e88ec0b9c9ac7de4051bbb9ac3649074d4374b849612e299b94" gracePeriod=30
Aug 05 17:34:31.491777 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:31.491747    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74466bdff7-mzc64"
Aug 05 17:34:31.639057 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:31.639015    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wpxs\" (UniqueName: \"kubernetes.io/projected/23c8edfb-7426-4ea8-acfe-edd9154b4b70-kube-api-access-6wpxs\") pod \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\" (UID: \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\") "
Aug 05 17:34:31.639255 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:31.639083    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/23c8edfb-7426-4ea8-acfe-edd9154b4b70-installation-pull-secrets\") pod \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\" (UID: \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\") "
Aug 05 17:34:31.639255 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:31.639120    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23c8edfb-7426-4ea8-acfe-edd9154b4b70-registry-tls\") pod \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\" (UID: \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\") "
Aug 05 17:34:31.639255 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:31.639234    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23c8edfb-7426-4ea8-acfe-edd9154b4b70-bound-sa-token\") pod \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\" (UID: \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\") "
Aug 05 17:34:31.639435 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:31.639301    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/23c8edfb-7426-4ea8-acfe-edd9154b4b70-trusted-ca\") pod \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\" (UID: \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\") "
Aug 05 17:34:31.639435 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:31.639333    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/23c8edfb-7426-4ea8-acfe-edd9154b4b70-registry-certificates\") pod \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\" (UID: \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\") "
Aug 05 17:34:31.639435 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:31.639376    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/23c8edfb-7426-4ea8-acfe-edd9154b4b70-ca-trust-extracted\") pod \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\" (UID: \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\") "
Aug 05 17:34:31.639435 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:31.639410    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/23c8edfb-7426-4ea8-acfe-edd9154b4b70-image-registry-private-configuration\") pod \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\" (UID: \"23c8edfb-7426-4ea8-acfe-edd9154b4b70\") "
Aug 05 17:34:31.639950 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:31.639778    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23c8edfb-7426-4ea8-acfe-edd9154b4b70-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "23c8edfb-7426-4ea8-acfe-edd9154b4b70" (UID: "23c8edfb-7426-4ea8-acfe-edd9154b4b70"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:34:31.642702 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:31.640186    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23c8edfb-7426-4ea8-acfe-edd9154b4b70-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "23c8edfb-7426-4ea8-acfe-edd9154b4b70" (UID: "23c8edfb-7426-4ea8-acfe-edd9154b4b70"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:34:31.645612 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:31.645360    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23c8edfb-7426-4ea8-acfe-edd9154b4b70-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "23c8edfb-7426-4ea8-acfe-edd9154b4b70" (UID: "23c8edfb-7426-4ea8-acfe-edd9154b4b70"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:34:31.645860 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:31.645628    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23c8edfb-7426-4ea8-acfe-edd9154b4b70-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "23c8edfb-7426-4ea8-acfe-edd9154b4b70" (UID: "23c8edfb-7426-4ea8-acfe-edd9154b4b70"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:34:31.645860 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:31.645752    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23c8edfb-7426-4ea8-acfe-edd9154b4b70-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "23c8edfb-7426-4ea8-acfe-edd9154b4b70" (UID: "23c8edfb-7426-4ea8-acfe-edd9154b4b70"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:34:31.645860 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:31.645796    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23c8edfb-7426-4ea8-acfe-edd9154b4b70-kube-api-access-6wpxs" (OuterVolumeSpecName: "kube-api-access-6wpxs") pod "23c8edfb-7426-4ea8-acfe-edd9154b4b70" (UID: "23c8edfb-7426-4ea8-acfe-edd9154b4b70"). InnerVolumeSpecName "kube-api-access-6wpxs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:34:31.645995 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:31.645877    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23c8edfb-7426-4ea8-acfe-edd9154b4b70-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "23c8edfb-7426-4ea8-acfe-edd9154b4b70" (UID: "23c8edfb-7426-4ea8-acfe-edd9154b4b70"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:34:31.651124 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:31.651093    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23c8edfb-7426-4ea8-acfe-edd9154b4b70-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "23c8edfb-7426-4ea8-acfe-edd9154b4b70" (UID: "23c8edfb-7426-4ea8-acfe-edd9154b4b70"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:34:31.740405 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:31.740315    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/23c8edfb-7426-4ea8-acfe-edd9154b4b70-trusted-ca\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:34:31.740405 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:31.740351    2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/23c8edfb-7426-4ea8-acfe-edd9154b4b70-registry-certificates\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:34:31.740405 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:31.740365    2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/23c8edfb-7426-4ea8-acfe-edd9154b4b70-ca-trust-extracted\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:34:31.740405 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:31.740380    2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/23c8edfb-7426-4ea8-acfe-edd9154b4b70-image-registry-private-configuration\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:34:31.740405 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:31.740394    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wpxs\" (UniqueName: \"kubernetes.io/projected/23c8edfb-7426-4ea8-acfe-edd9154b4b70-kube-api-access-6wpxs\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:34:31.740726 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:31.740415    2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/23c8edfb-7426-4ea8-acfe-edd9154b4b70-installation-pull-secrets\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:34:31.740726 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:31.740428    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/23c8edfb-7426-4ea8-acfe-edd9154b4b70-registry-tls\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:34:31.740726 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:31.740440    2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/23c8edfb-7426-4ea8-acfe-edd9154b4b70-bound-sa-token\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:34:31.813838 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:31.813804    2558 generic.go:356] "Generic (PLEG): container finished" podID="23c8edfb-7426-4ea8-acfe-edd9154b4b70" containerID="f108aff090618e88ec0b9c9ac7de4051bbb9ac3649074d4374b849612e299b94" exitCode=0
Aug 05 17:34:31.814019 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:31.813868    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74466bdff7-mzc64"
Aug 05 17:34:31.814019 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:31.813879    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74466bdff7-mzc64" event={"ID":"23c8edfb-7426-4ea8-acfe-edd9154b4b70","Type":"ContainerDied","Data":"f108aff090618e88ec0b9c9ac7de4051bbb9ac3649074d4374b849612e299b94"}
Aug 05 17:34:31.814019 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:31.813925    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74466bdff7-mzc64" event={"ID":"23c8edfb-7426-4ea8-acfe-edd9154b4b70","Type":"ContainerDied","Data":"691b403fa1296c59e35398163c768f089219274dbfbd221f003139638dbcf82d"}
Aug 05 17:34:31.814019 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:31.813946    2558 scope.go:117] "RemoveContainer" containerID="f108aff090618e88ec0b9c9ac7de4051bbb9ac3649074d4374b849612e299b94"
Aug 05 17:34:31.834630 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:31.834604    2558 scope.go:117] "RemoveContainer" containerID="f108aff090618e88ec0b9c9ac7de4051bbb9ac3649074d4374b849612e299b94"
Aug 05 17:34:31.834957 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:34:31.834929    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f108aff090618e88ec0b9c9ac7de4051bbb9ac3649074d4374b849612e299b94\": container with ID starting with f108aff090618e88ec0b9c9ac7de4051bbb9ac3649074d4374b849612e299b94 not found: ID does not exist" containerID="f108aff090618e88ec0b9c9ac7de4051bbb9ac3649074d4374b849612e299b94"
Aug 05 17:34:31.835019 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:31.834975    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f108aff090618e88ec0b9c9ac7de4051bbb9ac3649074d4374b849612e299b94"} err="failed to get container status \"f108aff090618e88ec0b9c9ac7de4051bbb9ac3649074d4374b849612e299b94\": rpc error: code = NotFound desc = could not find container \"f108aff090618e88ec0b9c9ac7de4051bbb9ac3649074d4374b849612e299b94\": container with ID starting with f108aff090618e88ec0b9c9ac7de4051bbb9ac3649074d4374b849612e299b94 not found: ID does not exist"
Aug 05 17:34:31.837870 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:31.837849    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74466bdff7-mzc64"]
Aug 05 17:34:31.842344 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:31.842323    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-74466bdff7-mzc64"]
Aug 05 17:34:32.257583 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:32.257543    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23c8edfb-7426-4ea8-acfe-edd9154b4b70" path="/var/lib/kubelet/pods/23c8edfb-7426-4ea8-acfe-edd9154b4b70/volumes"
Aug 05 17:34:37.684726 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:37.684690    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dnr6s"
Aug 05 17:34:53.892026 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:53.891992    2558 generic.go:356] "Generic (PLEG): container finished" podID="af7ba770-5123-4eb7-a8f8-c023fdf96fad" containerID="5ebf5d3091a827a5d71d0984e7380c0849abcd7d79c1448c3075cdcdc4942e07" exitCode=0
Aug 05 17:34:53.892450 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:53.892063    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-56tqj" event={"ID":"af7ba770-5123-4eb7-a8f8-c023fdf96fad","Type":"ContainerDied","Data":"5ebf5d3091a827a5d71d0984e7380c0849abcd7d79c1448c3075cdcdc4942e07"}
Aug 05 17:34:53.892450 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:53.892417    2558 scope.go:117] "RemoveContainer" containerID="5ebf5d3091a827a5d71d0984e7380c0849abcd7d79c1448c3075cdcdc4942e07"
Aug 05 17:34:54.897541 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:34:54.897500    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-56tqj" event={"ID":"af7ba770-5123-4eb7-a8f8-c023fdf96fad","Type":"ContainerStarted","Data":"fa5908fd4e611032a175e4281926f6cf63f727c93fc2a62bb8c51de640402736"}
Aug 05 17:35:04.934662 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:04.934625    2558 generic.go:356] "Generic (PLEG): container finished" podID="08c73da4-a7f6-40e1-b6be-6b9284fd4875" containerID="97b9349a3584bca75e440797dd89e1ac62285d553dd6913912a73cf39b4760b6" exitCode=0
Aug 05 17:35:04.935200 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:04.934694    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-c48lr" event={"ID":"08c73da4-a7f6-40e1-b6be-6b9284fd4875","Type":"ContainerDied","Data":"97b9349a3584bca75e440797dd89e1ac62285d553dd6913912a73cf39b4760b6"}
Aug 05 17:35:04.935200 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:04.935126    2558 scope.go:117] "RemoveContainer" containerID="97b9349a3584bca75e440797dd89e1ac62285d553dd6913912a73cf39b4760b6"
Aug 05 17:35:04.936433 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:04.936409    2558 generic.go:356] "Generic (PLEG): container finished" podID="f70154f9-6dbd-460a-9d64-cac2d7aea5b4" containerID="26a8e9330f8ca3ebdffbabcfec886af3be68e69d7b7d0bc00f45ba0d690e71fb" exitCode=0
Aug 05 17:35:04.936526 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:04.936455    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-rvhhd" event={"ID":"f70154f9-6dbd-460a-9d64-cac2d7aea5b4","Type":"ContainerDied","Data":"26a8e9330f8ca3ebdffbabcfec886af3be68e69d7b7d0bc00f45ba0d690e71fb"}
Aug 05 17:35:04.936720 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:04.936708    2558 scope.go:117] "RemoveContainer" containerID="26a8e9330f8ca3ebdffbabcfec886af3be68e69d7b7d0bc00f45ba0d690e71fb"
Aug 05 17:35:05.945035 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:05.944142    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-c48lr" event={"ID":"08c73da4-a7f6-40e1-b6be-6b9284fd4875","Type":"ContainerStarted","Data":"91ed6163de16839709c10d91092aba5867baf16ac659c1d99e52a54340e7ac24"}
Aug 05 17:35:05.947879 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:05.947854    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-rvhhd" event={"ID":"f70154f9-6dbd-460a-9d64-cac2d7aea5b4","Type":"ContainerStarted","Data":"11765814b5c57a09b828c245a6b14d439293486282d5a82a7b4b0eed39ff5201"}
Aug 05 17:35:41.938182 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:41.938135    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-697f7486dc-ctxw8"]
Aug 05 17:35:41.938729 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:41.938477    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23c8edfb-7426-4ea8-acfe-edd9154b4b70" containerName="registry"
Aug 05 17:35:41.938729 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:41.938491    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="23c8edfb-7426-4ea8-acfe-edd9154b4b70" containerName="registry"
Aug 05 17:35:41.938729 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:41.938551    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="23c8edfb-7426-4ea8-acfe-edd9154b4b70" containerName="registry"
Aug 05 17:35:41.940535 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:41.940520    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-697f7486dc-ctxw8"
Aug 05 17:35:41.944131 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:41.944107    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Aug 05 17:35:41.944380 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:41.944357    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Aug 05 17:35:41.944473 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:41.944382    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Aug 05 17:35:41.944473 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:41.944395    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Aug 05 17:35:41.944724 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:41.944708    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Aug 05 17:35:41.946749 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:41.946726    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-qcpp7\""
Aug 05 17:35:41.950518 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:41.950502    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Aug 05 17:35:41.967095 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:41.967066    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-697f7486dc-ctxw8"]
Aug 05 17:35:42.068028 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:42.067987    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3fd11c9f-fb19-4e92-9bce-71c111824bec-federate-client-tls\") pod \"telemeter-client-697f7486dc-ctxw8\" (UID: \"3fd11c9f-fb19-4e92-9bce-71c111824bec\") " pod="openshift-monitoring/telemeter-client-697f7486dc-ctxw8"
Aug 05 17:35:42.068028 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:42.068035    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fd11c9f-fb19-4e92-9bce-71c111824bec-serving-certs-ca-bundle\") pod \"telemeter-client-697f7486dc-ctxw8\" (UID: \"3fd11c9f-fb19-4e92-9bce-71c111824bec\") " pod="openshift-monitoring/telemeter-client-697f7486dc-ctxw8"
Aug 05 17:35:42.068280 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:42.068055    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fd11c9f-fb19-4e92-9bce-71c111824bec-telemeter-trusted-ca-bundle\") pod \"telemeter-client-697f7486dc-ctxw8\" (UID: \"3fd11c9f-fb19-4e92-9bce-71c111824bec\") " pod="openshift-monitoring/telemeter-client-697f7486dc-ctxw8"
Aug 05 17:35:42.068280 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:42.068077    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3fd11c9f-fb19-4e92-9bce-71c111824bec-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-697f7486dc-ctxw8\" (UID: \"3fd11c9f-fb19-4e92-9bce-71c111824bec\") " pod="openshift-monitoring/telemeter-client-697f7486dc-ctxw8"
Aug 05 17:35:42.068280 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:42.068140    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kxbx\" (UniqueName: \"kubernetes.io/projected/3fd11c9f-fb19-4e92-9bce-71c111824bec-kube-api-access-7kxbx\") pod \"telemeter-client-697f7486dc-ctxw8\" (UID: \"3fd11c9f-fb19-4e92-9bce-71c111824bec\") " pod="openshift-monitoring/telemeter-client-697f7486dc-ctxw8"
Aug 05 17:35:42.068280 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:42.068192    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fd11c9f-fb19-4e92-9bce-71c111824bec-metrics-client-ca\") pod \"telemeter-client-697f7486dc-ctxw8\" (UID: \"3fd11c9f-fb19-4e92-9bce-71c111824bec\") " pod="openshift-monitoring/telemeter-client-697f7486dc-ctxw8"
Aug 05 17:35:42.068280 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:42.068260    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3fd11c9f-fb19-4e92-9bce-71c111824bec-telemeter-client-tls\") pod \"telemeter-client-697f7486dc-ctxw8\" (UID: \"3fd11c9f-fb19-4e92-9bce-71c111824bec\") " pod="openshift-monitoring/telemeter-client-697f7486dc-ctxw8"
Aug 05 17:35:42.068439 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:42.068296    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3fd11c9f-fb19-4e92-9bce-71c111824bec-secret-telemeter-client\") pod \"telemeter-client-697f7486dc-ctxw8\" (UID: \"3fd11c9f-fb19-4e92-9bce-71c111824bec\") " pod="openshift-monitoring/telemeter-client-697f7486dc-ctxw8"
Aug 05 17:35:42.168997 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:42.168939    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fd11c9f-fb19-4e92-9bce-71c111824bec-serving-certs-ca-bundle\") pod \"telemeter-client-697f7486dc-ctxw8\" (UID: \"3fd11c9f-fb19-4e92-9bce-71c111824bec\") " pod="openshift-monitoring/telemeter-client-697f7486dc-ctxw8"
Aug 05 17:35:42.168997 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:42.168996    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fd11c9f-fb19-4e92-9bce-71c111824bec-telemeter-trusted-ca-bundle\") pod \"telemeter-client-697f7486dc-ctxw8\" (UID: \"3fd11c9f-fb19-4e92-9bce-71c111824bec\") " pod="openshift-monitoring/telemeter-client-697f7486dc-ctxw8"
Aug 05 17:35:42.169261 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:42.169025    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3fd11c9f-fb19-4e92-9bce-71c111824bec-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-697f7486dc-ctxw8\" (UID: \"3fd11c9f-fb19-4e92-9bce-71c111824bec\") " pod="openshift-monitoring/telemeter-client-697f7486dc-ctxw8"
Aug 05 17:35:42.169261 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:42.169053    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kxbx\" (UniqueName: \"kubernetes.io/projected/3fd11c9f-fb19-4e92-9bce-71c111824bec-kube-api-access-7kxbx\") pod \"telemeter-client-697f7486dc-ctxw8\" (UID: \"3fd11c9f-fb19-4e92-9bce-71c111824bec\") " pod="openshift-monitoring/telemeter-client-697f7486dc-ctxw8"
Aug 05 17:35:42.169363 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:42.169258    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fd11c9f-fb19-4e92-9bce-71c111824bec-metrics-client-ca\") pod \"telemeter-client-697f7486dc-ctxw8\" (UID: \"3fd11c9f-fb19-4e92-9bce-71c111824bec\") " pod="openshift-monitoring/telemeter-client-697f7486dc-ctxw8"
Aug 05 17:35:42.169363 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:42.169313    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3fd11c9f-fb19-4e92-9bce-71c111824bec-telemeter-client-tls\") pod \"telemeter-client-697f7486dc-ctxw8\" (UID: \"3fd11c9f-fb19-4e92-9bce-71c111824bec\") " pod="openshift-monitoring/telemeter-client-697f7486dc-ctxw8"
Aug 05 17:35:42.169464 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:42.169363    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3fd11c9f-fb19-4e92-9bce-71c111824bec-secret-telemeter-client\") pod \"telemeter-client-697f7486dc-ctxw8\" (UID: \"3fd11c9f-fb19-4e92-9bce-71c111824bec\") " pod="openshift-monitoring/telemeter-client-697f7486dc-ctxw8"
Aug 05 17:35:42.169464 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:42.169412    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3fd11c9f-fb19-4e92-9bce-71c111824bec-federate-client-tls\") pod \"telemeter-client-697f7486dc-ctxw8\" (UID: \"3fd11c9f-fb19-4e92-9bce-71c111824bec\") " pod="openshift-monitoring/telemeter-client-697f7486dc-ctxw8"
Aug 05 17:35:42.169825 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:42.169798    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fd11c9f-fb19-4e92-9bce-71c111824bec-serving-certs-ca-bundle\") pod \"telemeter-client-697f7486dc-ctxw8\" (UID: \"3fd11c9f-fb19-4e92-9bce-71c111824bec\") " pod="openshift-monitoring/telemeter-client-697f7486dc-ctxw8"
Aug 05 17:35:42.170141 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:42.170117    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3fd11c9f-fb19-4e92-9bce-71c111824bec-telemeter-trusted-ca-bundle\") pod \"telemeter-client-697f7486dc-ctxw8\" (UID: \"3fd11c9f-fb19-4e92-9bce-71c111824bec\") " pod="openshift-monitoring/telemeter-client-697f7486dc-ctxw8"
Aug 05 17:35:42.170269 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:42.169981    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3fd11c9f-fb19-4e92-9bce-71c111824bec-metrics-client-ca\") pod \"telemeter-client-697f7486dc-ctxw8\" (UID: \"3fd11c9f-fb19-4e92-9bce-71c111824bec\") " pod="openshift-monitoring/telemeter-client-697f7486dc-ctxw8"
Aug 05 17:35:42.171747 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:42.171725    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3fd11c9f-fb19-4e92-9bce-71c111824bec-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-697f7486dc-ctxw8\" (UID: \"3fd11c9f-fb19-4e92-9bce-71c111824bec\") " pod="openshift-monitoring/telemeter-client-697f7486dc-ctxw8"
Aug 05 17:35:42.171939 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:42.171921    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3fd11c9f-fb19-4e92-9bce-71c111824bec-telemeter-client-tls\") pod \"telemeter-client-697f7486dc-ctxw8\" (UID: \"3fd11c9f-fb19-4e92-9bce-71c111824bec\") " pod="openshift-monitoring/telemeter-client-697f7486dc-ctxw8"
Aug 05 17:35:42.172301 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:42.172285    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3fd11c9f-fb19-4e92-9bce-71c111824bec-federate-client-tls\") pod \"telemeter-client-697f7486dc-ctxw8\" (UID: \"3fd11c9f-fb19-4e92-9bce-71c111824bec\") " pod="openshift-monitoring/telemeter-client-697f7486dc-ctxw8"
Aug 05 17:35:42.172346 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:42.172330    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3fd11c9f-fb19-4e92-9bce-71c111824bec-secret-telemeter-client\") pod \"telemeter-client-697f7486dc-ctxw8\" (UID: \"3fd11c9f-fb19-4e92-9bce-71c111824bec\") " pod="openshift-monitoring/telemeter-client-697f7486dc-ctxw8"
Aug 05 17:35:42.178092 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:42.178068    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kxbx\" (UniqueName: \"kubernetes.io/projected/3fd11c9f-fb19-4e92-9bce-71c111824bec-kube-api-access-7kxbx\") pod \"telemeter-client-697f7486dc-ctxw8\" (UID: \"3fd11c9f-fb19-4e92-9bce-71c111824bec\") " pod="openshift-monitoring/telemeter-client-697f7486dc-ctxw8"
Aug 05 17:35:42.250426 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:42.250328    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-697f7486dc-ctxw8"
Aug 05 17:35:42.425878 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:42.425842    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-697f7486dc-ctxw8"]
Aug 05 17:35:42.430093 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:35:42.430067    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fd11c9f_fb19_4e92_9bce_71c111824bec.slice/crio-1a7705792e8642904b9c56c2eadeeb49fe8ac67055fa0df7c45b5d3515c70fa9 WatchSource:0}: Error finding container 1a7705792e8642904b9c56c2eadeeb49fe8ac67055fa0df7c45b5d3515c70fa9: Status 404 returned error can't find the container with id 1a7705792e8642904b9c56c2eadeeb49fe8ac67055fa0df7c45b5d3515c70fa9
Aug 05 17:35:43.082669 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:43.082630    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-697f7486dc-ctxw8" event={"ID":"3fd11c9f-fb19-4e92-9bce-71c111824bec","Type":"ContainerStarted","Data":"1a7705792e8642904b9c56c2eadeeb49fe8ac67055fa0df7c45b5d3515c70fa9"}
Aug 05 17:35:45.091857 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:45.091813    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-697f7486dc-ctxw8" event={"ID":"3fd11c9f-fb19-4e92-9bce-71c111824bec","Type":"ContainerStarted","Data":"0100df7c0ae86f991e3bb7a0ba309b2501dc210137dc90ba539fed14b8c7e5f0"}
Aug 05 17:35:47.101869 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:47.101831    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-697f7486dc-ctxw8" event={"ID":"3fd11c9f-fb19-4e92-9bce-71c111824bec","Type":"ContainerStarted","Data":"d243e43ea72b9631a7887f04b01a7201705e5957bbf8109d1c12e2e76a239d31"}
Aug 05 17:35:47.102497 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:47.101895    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-697f7486dc-ctxw8" event={"ID":"3fd11c9f-fb19-4e92-9bce-71c111824bec","Type":"ContainerStarted","Data":"b246d2dc9c7d8c2afcf687ca87ff1ff1f78f6d406ff6ec1942ab211e9cf01862"}
Aug 05 17:35:47.134150 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:35:47.134087    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-697f7486dc-ctxw8" podStartSLOduration=2.35870197 podStartE2EDuration="6.134065639s" totalImagesPullingTime="3.775363669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:35:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:35:47.132290888 +0000 UTC m=+173.445142251" watchObservedRunningTime="2026-08-05 17:35:47.134065639 +0000 UTC m=+173.446917003"
Aug 05 17:37:51.745831 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:37:51.745790    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cctls"]
Aug 05 17:37:51.749468 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:37:51.749452    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cctls"
Aug 05 17:37:51.752440 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:37:51.752417    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Aug 05 17:37:51.753532 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:37:51.753514    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g85sx\""
Aug 05 17:37:51.753630 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:37:51.753514    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Aug 05 17:37:51.762248 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:37:51.762210    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cctls"]
Aug 05 17:37:51.866565 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:37:51.866523    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ac8ff10-fa50-47bb-a9c0-88019f33847a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cctls\" (UID: \"2ac8ff10-fa50-47bb-a9c0-88019f33847a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cctls"
Aug 05 17:37:51.866755 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:37:51.866588    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxsp9\" (UniqueName: \"kubernetes.io/projected/2ac8ff10-fa50-47bb-a9c0-88019f33847a-kube-api-access-nxsp9\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cctls\" (UID: \"2ac8ff10-fa50-47bb-a9c0-88019f33847a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cctls"
Aug 05 17:37:51.866755 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:37:51.866609    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ac8ff10-fa50-47bb-a9c0-88019f33847a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cctls\" (UID: \"2ac8ff10-fa50-47bb-a9c0-88019f33847a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cctls"
Aug 05 17:37:51.967540 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:37:51.967503    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxsp9\" (UniqueName: \"kubernetes.io/projected/2ac8ff10-fa50-47bb-a9c0-88019f33847a-kube-api-access-nxsp9\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cctls\" (UID: \"2ac8ff10-fa50-47bb-a9c0-88019f33847a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cctls"
Aug 05 17:37:51.967540 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:37:51.967542    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ac8ff10-fa50-47bb-a9c0-88019f33847a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cctls\" (UID: \"2ac8ff10-fa50-47bb-a9c0-88019f33847a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cctls"
Aug 05 17:37:51.967722 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:37:51.967605    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ac8ff10-fa50-47bb-a9c0-88019f33847a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cctls\" (UID: \"2ac8ff10-fa50-47bb-a9c0-88019f33847a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cctls"
Aug 05 17:37:51.968015 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:37:51.967996    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ac8ff10-fa50-47bb-a9c0-88019f33847a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cctls\" (UID: \"2ac8ff10-fa50-47bb-a9c0-88019f33847a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cctls"
Aug 05 17:37:51.968056 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:37:51.968026    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ac8ff10-fa50-47bb-a9c0-88019f33847a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cctls\" (UID: \"2ac8ff10-fa50-47bb-a9c0-88019f33847a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cctls"
Aug 05 17:37:51.976958 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:37:51.976927    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxsp9\" (UniqueName: \"kubernetes.io/projected/2ac8ff10-fa50-47bb-a9c0-88019f33847a-kube-api-access-nxsp9\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cctls\" (UID: \"2ac8ff10-fa50-47bb-a9c0-88019f33847a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cctls"
Aug 05 17:37:52.058683 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:37:52.058586    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cctls"
Aug 05 17:37:52.191884 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:37:52.191745    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cctls"]
Aug 05 17:37:52.194455 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:37:52.194427    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ac8ff10_fa50_47bb_a9c0_88019f33847a.slice/crio-79764917caafad46c3cff8817d7ce543f3d0f3ce90592f139c6f00c5ef560f60 WatchSource:0}: Error finding container 79764917caafad46c3cff8817d7ce543f3d0f3ce90592f139c6f00c5ef560f60: Status 404 returned error can't find the container with id 79764917caafad46c3cff8817d7ce543f3d0f3ce90592f139c6f00c5ef560f60
Aug 05 17:37:52.549830 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:37:52.549786    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cctls" event={"ID":"2ac8ff10-fa50-47bb-a9c0-88019f33847a","Type":"ContainerStarted","Data":"79764917caafad46c3cff8817d7ce543f3d0f3ce90592f139c6f00c5ef560f60"}
Aug 05 17:37:54.128609 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:37:54.128583    2558 kubelet.go:1648] "Image garbage collection succeeded"
Aug 05 17:37:58.575734 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:37:58.575639    2558 generic.go:356] "Generic (PLEG): container finished" podID="2ac8ff10-fa50-47bb-a9c0-88019f33847a" containerID="e5560a9a9cc3c4efd5768f243544aef84dbbafc9325c23ed72211813280d9a2b" exitCode=0
Aug 05 17:37:58.575734 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:37:58.575708    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cctls" event={"ID":"2ac8ff10-fa50-47bb-a9c0-88019f33847a","Type":"ContainerDied","Data":"e5560a9a9cc3c4efd5768f243544aef84dbbafc9325c23ed72211813280d9a2b"}
Aug 05 17:37:58.576852 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:37:58.576838    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 17:38:02.599018 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:02.598979    2558 generic.go:356] "Generic (PLEG): container finished" podID="2ac8ff10-fa50-47bb-a9c0-88019f33847a" containerID="0da094585f851211ae03e83cd94b6b1c87d8e3b537605651e6e37b9d054636c8" exitCode=0
Aug 05 17:38:02.599450 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:02.599026    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cctls" event={"ID":"2ac8ff10-fa50-47bb-a9c0-88019f33847a","Type":"ContainerDied","Data":"0da094585f851211ae03e83cd94b6b1c87d8e3b537605651e6e37b9d054636c8"}
Aug 05 17:38:09.629642 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:09.629601    2558 generic.go:356] "Generic (PLEG): container finished" podID="2ac8ff10-fa50-47bb-a9c0-88019f33847a" containerID="7e21c3d9bbafb5d48dbaa5e3bba9f376841c628076b252faadf867857b78daef" exitCode=0
Aug 05 17:38:09.630066 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:09.629678    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cctls" event={"ID":"2ac8ff10-fa50-47bb-a9c0-88019f33847a","Type":"ContainerDied","Data":"7e21c3d9bbafb5d48dbaa5e3bba9f376841c628076b252faadf867857b78daef"}
Aug 05 17:38:10.761338 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:10.761298    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cctls"
Aug 05 17:38:10.929906 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:10.929871    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nxsp9\" (UniqueName: \"kubernetes.io/projected/2ac8ff10-fa50-47bb-a9c0-88019f33847a-kube-api-access-nxsp9\") pod \"2ac8ff10-fa50-47bb-a9c0-88019f33847a\" (UID: \"2ac8ff10-fa50-47bb-a9c0-88019f33847a\") "
Aug 05 17:38:10.930097 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:10.929933    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ac8ff10-fa50-47bb-a9c0-88019f33847a-util\") pod \"2ac8ff10-fa50-47bb-a9c0-88019f33847a\" (UID: \"2ac8ff10-fa50-47bb-a9c0-88019f33847a\") "
Aug 05 17:38:10.930097 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:10.929966    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ac8ff10-fa50-47bb-a9c0-88019f33847a-bundle\") pod \"2ac8ff10-fa50-47bb-a9c0-88019f33847a\" (UID: \"2ac8ff10-fa50-47bb-a9c0-88019f33847a\") "
Aug 05 17:38:10.930739 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:10.930651    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ac8ff10-fa50-47bb-a9c0-88019f33847a-bundle" (OuterVolumeSpecName: "bundle") pod "2ac8ff10-fa50-47bb-a9c0-88019f33847a" (UID: "2ac8ff10-fa50-47bb-a9c0-88019f33847a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:38:10.932254 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:10.932211    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ac8ff10-fa50-47bb-a9c0-88019f33847a-kube-api-access-nxsp9" (OuterVolumeSpecName: "kube-api-access-nxsp9") pod "2ac8ff10-fa50-47bb-a9c0-88019f33847a" (UID: "2ac8ff10-fa50-47bb-a9c0-88019f33847a"). InnerVolumeSpecName "kube-api-access-nxsp9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:38:10.934478 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:10.934445    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ac8ff10-fa50-47bb-a9c0-88019f33847a-util" (OuterVolumeSpecName: "util") pod "2ac8ff10-fa50-47bb-a9c0-88019f33847a" (UID: "2ac8ff10-fa50-47bb-a9c0-88019f33847a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:38:11.030824 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:11.030786    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nxsp9\" (UniqueName: \"kubernetes.io/projected/2ac8ff10-fa50-47bb-a9c0-88019f33847a-kube-api-access-nxsp9\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:38:11.030824 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:11.030819    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2ac8ff10-fa50-47bb-a9c0-88019f33847a-util\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:38:11.030824 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:11.030831    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2ac8ff10-fa50-47bb-a9c0-88019f33847a-bundle\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:38:11.638676 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:11.638640    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cctls" event={"ID":"2ac8ff10-fa50-47bb-a9c0-88019f33847a","Type":"ContainerDied","Data":"79764917caafad46c3cff8817d7ce543f3d0f3ce90592f139c6f00c5ef560f60"}
Aug 05 17:38:11.638876 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:11.638699    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="79764917caafad46c3cff8817d7ce543f3d0f3ce90592f139c6f00c5ef560f60"
Aug 05 17:38:11.638876 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:11.638737    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cctls"
Aug 05 17:38:15.302206 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:15.302171    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mp2lg"]
Aug 05 17:38:15.302611 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:15.302515    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ac8ff10-fa50-47bb-a9c0-88019f33847a" containerName="util"
Aug 05 17:38:15.302611 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:15.302527    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ac8ff10-fa50-47bb-a9c0-88019f33847a" containerName="util"
Aug 05 17:38:15.302611 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:15.302534    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ac8ff10-fa50-47bb-a9c0-88019f33847a" containerName="extract"
Aug 05 17:38:15.302611 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:15.302540    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ac8ff10-fa50-47bb-a9c0-88019f33847a" containerName="extract"
Aug 05 17:38:15.302611 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:15.302549    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ac8ff10-fa50-47bb-a9c0-88019f33847a" containerName="pull"
Aug 05 17:38:15.302611 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:15.302556    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ac8ff10-fa50-47bb-a9c0-88019f33847a" containerName="pull"
Aug 05 17:38:15.302611 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:15.302605    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ac8ff10-fa50-47bb-a9c0-88019f33847a" containerName="extract"
Aug 05 17:38:15.304552 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:15.304531    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mp2lg"
Aug 05 17:38:15.307986 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:15.307961    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Aug 05 17:38:15.308106 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:15.308087    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-24g2k\""
Aug 05 17:38:15.309024 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:15.309010    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Aug 05 17:38:15.341832 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:15.341801    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mp2lg"]
Aug 05 17:38:15.467827 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:15.467793    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp5f8\" (UniqueName: \"kubernetes.io/projected/ca24d7dc-e6fa-4fd5-8d73-7a1fa744d046-kube-api-access-xp5f8\") pod \"cert-manager-operator-controller-manager-55c444bf86-mp2lg\" (UID: \"ca24d7dc-e6fa-4fd5-8d73-7a1fa744d046\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mp2lg"
Aug 05 17:38:15.468027 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:15.467847    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca24d7dc-e6fa-4fd5-8d73-7a1fa744d046-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-mp2lg\" (UID: \"ca24d7dc-e6fa-4fd5-8d73-7a1fa744d046\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mp2lg"
Aug 05 17:38:15.568392 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:15.568317    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca24d7dc-e6fa-4fd5-8d73-7a1fa744d046-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-mp2lg\" (UID: \"ca24d7dc-e6fa-4fd5-8d73-7a1fa744d046\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mp2lg"
Aug 05 17:38:15.568392 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:15.568377    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp5f8\" (UniqueName: \"kubernetes.io/projected/ca24d7dc-e6fa-4fd5-8d73-7a1fa744d046-kube-api-access-xp5f8\") pod \"cert-manager-operator-controller-manager-55c444bf86-mp2lg\" (UID: \"ca24d7dc-e6fa-4fd5-8d73-7a1fa744d046\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mp2lg"
Aug 05 17:38:15.568699 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:15.568679    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca24d7dc-e6fa-4fd5-8d73-7a1fa744d046-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-mp2lg\" (UID: \"ca24d7dc-e6fa-4fd5-8d73-7a1fa744d046\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mp2lg"
Aug 05 17:38:15.577648 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:15.577614    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp5f8\" (UniqueName: \"kubernetes.io/projected/ca24d7dc-e6fa-4fd5-8d73-7a1fa744d046-kube-api-access-xp5f8\") pod \"cert-manager-operator-controller-manager-55c444bf86-mp2lg\" (UID: \"ca24d7dc-e6fa-4fd5-8d73-7a1fa744d046\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mp2lg"
Aug 05 17:38:15.613600 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:15.613554    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mp2lg"
Aug 05 17:38:15.764414 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:15.764382    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mp2lg"]
Aug 05 17:38:15.767289 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:38:15.767262    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca24d7dc_e6fa_4fd5_8d73_7a1fa744d046.slice/crio-84f05f4cb5406783f49e3e7f683564bde4313dcb7dac9c73eba9400a282a4575 WatchSource:0}: Error finding container 84f05f4cb5406783f49e3e7f683564bde4313dcb7dac9c73eba9400a282a4575: Status 404 returned error can't find the container with id 84f05f4cb5406783f49e3e7f683564bde4313dcb7dac9c73eba9400a282a4575
Aug 05 17:38:16.662585 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:16.662547    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mp2lg" event={"ID":"ca24d7dc-e6fa-4fd5-8d73-7a1fa744d046","Type":"ContainerStarted","Data":"84f05f4cb5406783f49e3e7f683564bde4313dcb7dac9c73eba9400a282a4575"}
Aug 05 17:38:19.677945 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:19.677910    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mp2lg" event={"ID":"ca24d7dc-e6fa-4fd5-8d73-7a1fa744d046","Type":"ContainerStarted","Data":"54f48a2581dfcd047413589b25dab2302b7ae8be1a0b24da167ce272f5fef2b6"}
Aug 05 17:38:19.707686 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:19.707637    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mp2lg" podStartSLOduration=1.11600638 podStartE2EDuration="4.707620091s" totalImagesPullingTime="3.591613711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:38:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:38:19.704854156 +0000 UTC m=+326.017705520" watchObservedRunningTime="2026-08-05 17:38:19.707620091 +0000 UTC m=+326.020471453"
Aug 05 17:38:20.486109 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:20.486062    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvchr7"]
Aug 05 17:38:20.489370 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:20.489350    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvchr7"
Aug 05 17:38:20.492110 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:20.492089    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Aug 05 17:38:20.492279 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:20.492135    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Aug 05 17:38:20.493283 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:20.493262    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g85sx\""
Aug 05 17:38:20.502371 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:20.502339    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvchr7"]
Aug 05 17:38:20.611913 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:20.611882    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b34a2a21-1b53-4e73-b15e-52c065cdf5f4-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvchr7\" (UID: \"b34a2a21-1b53-4e73-b15e-52c065cdf5f4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvchr7"
Aug 05 17:38:20.612110 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:20.611934    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxtwv\" (UniqueName: \"kubernetes.io/projected/b34a2a21-1b53-4e73-b15e-52c065cdf5f4-kube-api-access-kxtwv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvchr7\" (UID: \"b34a2a21-1b53-4e73-b15e-52c065cdf5f4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvchr7"
Aug 05 17:38:20.612110 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:20.612027    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b34a2a21-1b53-4e73-b15e-52c065cdf5f4-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvchr7\" (UID: \"b34a2a21-1b53-4e73-b15e-52c065cdf5f4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvchr7"
Aug 05 17:38:20.713415 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:20.713378    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b34a2a21-1b53-4e73-b15e-52c065cdf5f4-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvchr7\" (UID: \"b34a2a21-1b53-4e73-b15e-52c065cdf5f4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvchr7"
Aug 05 17:38:20.713905 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:20.713445    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b34a2a21-1b53-4e73-b15e-52c065cdf5f4-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvchr7\" (UID: \"b34a2a21-1b53-4e73-b15e-52c065cdf5f4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvchr7"
Aug 05 17:38:20.713905 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:20.713508    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxtwv\" (UniqueName: \"kubernetes.io/projected/b34a2a21-1b53-4e73-b15e-52c065cdf5f4-kube-api-access-kxtwv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvchr7\" (UID: \"b34a2a21-1b53-4e73-b15e-52c065cdf5f4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvchr7"
Aug 05 17:38:20.713905 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:20.713828    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b34a2a21-1b53-4e73-b15e-52c065cdf5f4-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvchr7\" (UID: \"b34a2a21-1b53-4e73-b15e-52c065cdf5f4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvchr7"
Aug 05 17:38:20.713905 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:20.713869    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b34a2a21-1b53-4e73-b15e-52c065cdf5f4-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvchr7\" (UID: \"b34a2a21-1b53-4e73-b15e-52c065cdf5f4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvchr7"
Aug 05 17:38:20.725421 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:20.725385    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxtwv\" (UniqueName: \"kubernetes.io/projected/b34a2a21-1b53-4e73-b15e-52c065cdf5f4-kube-api-access-kxtwv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvchr7\" (UID: \"b34a2a21-1b53-4e73-b15e-52c065cdf5f4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvchr7"
Aug 05 17:38:20.799418 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:20.799323    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvchr7"
Aug 05 17:38:20.941660 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:20.941630    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvchr7"]
Aug 05 17:38:20.943950 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:38:20.943925    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb34a2a21_1b53_4e73_b15e_52c065cdf5f4.slice/crio-f8dc406e92a0cf5846be45bfba0e6f41c7cbcf61f1d216413dbdda885b3245d2 WatchSource:0}: Error finding container f8dc406e92a0cf5846be45bfba0e6f41c7cbcf61f1d216413dbdda885b3245d2: Status 404 returned error can't find the container with id f8dc406e92a0cf5846be45bfba0e6f41c7cbcf61f1d216413dbdda885b3245d2
Aug 05 17:38:21.688013 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:21.687979    2558 generic.go:356] "Generic (PLEG): container finished" podID="b34a2a21-1b53-4e73-b15e-52c065cdf5f4" containerID="4c72bc007cd9c9bdc7b40e5b272c59f86d22cb498cbf62d3f5e4f5794ebe3e0e" exitCode=0
Aug 05 17:38:21.688190 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:21.688045    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvchr7" event={"ID":"b34a2a21-1b53-4e73-b15e-52c065cdf5f4","Type":"ContainerDied","Data":"4c72bc007cd9c9bdc7b40e5b272c59f86d22cb498cbf62d3f5e4f5794ebe3e0e"}
Aug 05 17:38:21.688190 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:21.688087    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvchr7" event={"ID":"b34a2a21-1b53-4e73-b15e-52c065cdf5f4","Type":"ContainerStarted","Data":"f8dc406e92a0cf5846be45bfba0e6f41c7cbcf61f1d216413dbdda885b3245d2"}
Aug 05 17:38:24.643164 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:24.643125    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-q2m77"]
Aug 05 17:38:24.645204 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:24.645188    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-q2m77"
Aug 05 17:38:24.646405 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:24.646379    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/924ed159-5520-443b-9152-6987e28e8ee5-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-q2m77\" (UID: \"924ed159-5520-443b-9152-6987e28e8ee5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-q2m77"
Aug 05 17:38:24.646524 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:24.646471    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjxw4\" (UniqueName: \"kubernetes.io/projected/924ed159-5520-443b-9152-6987e28e8ee5-kube-api-access-zjxw4\") pod \"cert-manager-webhook-6486ffd997-q2m77\" (UID: \"924ed159-5520-443b-9152-6987e28e8ee5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-q2m77"
Aug 05 17:38:24.650258 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:24.650234    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Aug 05 17:38:24.650365 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:24.650237    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-kplv4\""
Aug 05 17:38:24.651454 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:24.651436    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Aug 05 17:38:24.662130 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:24.662103    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-q2m77"]
Aug 05 17:38:24.747120 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:24.747079    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjxw4\" (UniqueName: \"kubernetes.io/projected/924ed159-5520-443b-9152-6987e28e8ee5-kube-api-access-zjxw4\") pod \"cert-manager-webhook-6486ffd997-q2m77\" (UID: \"924ed159-5520-443b-9152-6987e28e8ee5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-q2m77"
Aug 05 17:38:24.747340 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:24.747137    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/924ed159-5520-443b-9152-6987e28e8ee5-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-q2m77\" (UID: \"924ed159-5520-443b-9152-6987e28e8ee5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-q2m77"
Aug 05 17:38:24.756812 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:24.756778    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/924ed159-5520-443b-9152-6987e28e8ee5-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-q2m77\" (UID: \"924ed159-5520-443b-9152-6987e28e8ee5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-q2m77"
Aug 05 17:38:24.756980 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:24.756961    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjxw4\" (UniqueName: \"kubernetes.io/projected/924ed159-5520-443b-9152-6987e28e8ee5-kube-api-access-zjxw4\") pod \"cert-manager-webhook-6486ffd997-q2m77\" (UID: \"924ed159-5520-443b-9152-6987e28e8ee5\") " pod="cert-manager/cert-manager-webhook-6486ffd997-q2m77"
Aug 05 17:38:24.955073 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:24.955033    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-q2m77"
Aug 05 17:38:25.108508 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:25.108473    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-q2m77"]
Aug 05 17:38:25.111694 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:38:25.111666    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod924ed159_5520_443b_9152_6987e28e8ee5.slice/crio-f1594a120aafe0fd2ebbf81e01d4e92761b6bf5649a6da7034fb2a832eb9e591 WatchSource:0}: Error finding container f1594a120aafe0fd2ebbf81e01d4e92761b6bf5649a6da7034fb2a832eb9e591: Status 404 returned error can't find the container with id f1594a120aafe0fd2ebbf81e01d4e92761b6bf5649a6da7034fb2a832eb9e591
Aug 05 17:38:25.708049 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:25.708013    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-q2m77" event={"ID":"924ed159-5520-443b-9152-6987e28e8ee5","Type":"ContainerStarted","Data":"f1594a120aafe0fd2ebbf81e01d4e92761b6bf5649a6da7034fb2a832eb9e591"}
Aug 05 17:38:30.734839 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:30.734795    2558 generic.go:356] "Generic (PLEG): container finished" podID="b34a2a21-1b53-4e73-b15e-52c065cdf5f4" containerID="0c770e1d8e8e524c542d66c2a3c38ce76366677d24bbbd6978bf320958869bfb" exitCode=0
Aug 05 17:38:30.735325 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:30.734887    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvchr7" event={"ID":"b34a2a21-1b53-4e73-b15e-52c065cdf5f4","Type":"ContainerDied","Data":"0c770e1d8e8e524c542d66c2a3c38ce76366677d24bbbd6978bf320958869bfb"}
Aug 05 17:38:30.736579 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:30.736555    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-q2m77" event={"ID":"924ed159-5520-443b-9152-6987e28e8ee5","Type":"ContainerStarted","Data":"84552bbca1ab6fdd5b5401ceb34a1858d3188c7b84e054f272fd81713ee9ba82"}
Aug 05 17:38:30.736686 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:30.736609    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-q2m77"
Aug 05 17:38:30.792571 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:30.792515    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-q2m77" podStartSLOduration=1.780502357 podStartE2EDuration="6.792492762s" totalImagesPullingTime="5.011990405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:38:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:38:30.791160222 +0000 UTC m=+337.104011586" watchObservedRunningTime="2026-08-05 17:38:30.792492762 +0000 UTC m=+337.105344126"
Aug 05 17:38:31.748864 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:31.748822    2558 generic.go:356] "Generic (PLEG): container finished" podID="b34a2a21-1b53-4e73-b15e-52c065cdf5f4" containerID="2b716b414b0c8bbd07ae5d22edf26ba4d3b8d6b604cb712956ec1899d738cf48" exitCode=0
Aug 05 17:38:31.749299 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:31.748904    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvchr7" event={"ID":"b34a2a21-1b53-4e73-b15e-52c065cdf5f4","Type":"ContainerDied","Data":"2b716b414b0c8bbd07ae5d22edf26ba4d3b8d6b604cb712956ec1899d738cf48"}
Aug 05 17:38:32.879363 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:32.879337    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvchr7"
Aug 05 17:38:32.902840 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:32.902811    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxtwv\" (UniqueName: \"kubernetes.io/projected/b34a2a21-1b53-4e73-b15e-52c065cdf5f4-kube-api-access-kxtwv\") pod \"b34a2a21-1b53-4e73-b15e-52c065cdf5f4\" (UID: \"b34a2a21-1b53-4e73-b15e-52c065cdf5f4\") "
Aug 05 17:38:32.903001 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:32.902866    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b34a2a21-1b53-4e73-b15e-52c065cdf5f4-util\") pod \"b34a2a21-1b53-4e73-b15e-52c065cdf5f4\" (UID: \"b34a2a21-1b53-4e73-b15e-52c065cdf5f4\") "
Aug 05 17:38:32.903001 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:32.902944    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b34a2a21-1b53-4e73-b15e-52c065cdf5f4-bundle\") pod \"b34a2a21-1b53-4e73-b15e-52c065cdf5f4\" (UID: \"b34a2a21-1b53-4e73-b15e-52c065cdf5f4\") "
Aug 05 17:38:32.903456 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:32.903423    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b34a2a21-1b53-4e73-b15e-52c065cdf5f4-bundle" (OuterVolumeSpecName: "bundle") pod "b34a2a21-1b53-4e73-b15e-52c065cdf5f4" (UID: "b34a2a21-1b53-4e73-b15e-52c065cdf5f4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:38:32.905254 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:32.905212    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b34a2a21-1b53-4e73-b15e-52c065cdf5f4-kube-api-access-kxtwv" (OuterVolumeSpecName: "kube-api-access-kxtwv") pod "b34a2a21-1b53-4e73-b15e-52c065cdf5f4" (UID: "b34a2a21-1b53-4e73-b15e-52c065cdf5f4"). InnerVolumeSpecName "kube-api-access-kxtwv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:38:32.908620 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:32.908595    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b34a2a21-1b53-4e73-b15e-52c065cdf5f4-util" (OuterVolumeSpecName: "util") pod "b34a2a21-1b53-4e73-b15e-52c065cdf5f4" (UID: "b34a2a21-1b53-4e73-b15e-52c065cdf5f4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:38:33.003908 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:33.003858    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxtwv\" (UniqueName: \"kubernetes.io/projected/b34a2a21-1b53-4e73-b15e-52c065cdf5f4-kube-api-access-kxtwv\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:38:33.003908 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:33.003895    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b34a2a21-1b53-4e73-b15e-52c065cdf5f4-util\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:38:33.003908 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:33.003910    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b34a2a21-1b53-4e73-b15e-52c065cdf5f4-bundle\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:38:33.760365 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:33.760333    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvchr7"
Aug 05 17:38:33.760536 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:33.760327    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvchr7" event={"ID":"b34a2a21-1b53-4e73-b15e-52c065cdf5f4","Type":"ContainerDied","Data":"f8dc406e92a0cf5846be45bfba0e6f41c7cbcf61f1d216413dbdda885b3245d2"}
Aug 05 17:38:33.760536 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:33.760459    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f8dc406e92a0cf5846be45bfba0e6f41c7cbcf61f1d216413dbdda885b3245d2"
Aug 05 17:38:36.751688 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:36.751651    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-q2m77"
Aug 05 17:38:37.752472 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:37.752438    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mntxn"]
Aug 05 17:38:37.752856 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:37.752716    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b34a2a21-1b53-4e73-b15e-52c065cdf5f4" containerName="pull"
Aug 05 17:38:37.752856 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:37.752726    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b34a2a21-1b53-4e73-b15e-52c065cdf5f4" containerName="pull"
Aug 05 17:38:37.752856 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:37.752734    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b34a2a21-1b53-4e73-b15e-52c065cdf5f4" containerName="extract"
Aug 05 17:38:37.752856 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:37.752740    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b34a2a21-1b53-4e73-b15e-52c065cdf5f4" containerName="extract"
Aug 05 17:38:37.752856 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:37.752747    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b34a2a21-1b53-4e73-b15e-52c065cdf5f4" containerName="util"
Aug 05 17:38:37.752856 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:37.752752    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b34a2a21-1b53-4e73-b15e-52c065cdf5f4" containerName="util"
Aug 05 17:38:37.752856 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:37.752811    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b34a2a21-1b53-4e73-b15e-52c065cdf5f4" containerName="extract"
Aug 05 17:38:37.759957 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:37.759934    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mntxn"
Aug 05 17:38:37.763365 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:37.763339    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Aug 05 17:38:37.764395 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:37.764378    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-dqbst\""
Aug 05 17:38:37.764455 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:37.764413    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Aug 05 17:38:37.771494 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:37.771470    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mntxn"]
Aug 05 17:38:37.837988 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:37.837949    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc6rb\" (UniqueName: \"kubernetes.io/projected/57824f95-97b1-4ca7-b06d-1e754cc116bb-kube-api-access-zc6rb\") pod \"openshift-lws-operator-fd8ccff4c-mntxn\" (UID: \"57824f95-97b1-4ca7-b06d-1e754cc116bb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mntxn"
Aug 05 17:38:37.838177 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:37.838010    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57824f95-97b1-4ca7-b06d-1e754cc116bb-tmp\") pod \"openshift-lws-operator-fd8ccff4c-mntxn\" (UID: \"57824f95-97b1-4ca7-b06d-1e754cc116bb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mntxn"
Aug 05 17:38:37.939207 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:37.939162    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zc6rb\" (UniqueName: \"kubernetes.io/projected/57824f95-97b1-4ca7-b06d-1e754cc116bb-kube-api-access-zc6rb\") pod \"openshift-lws-operator-fd8ccff4c-mntxn\" (UID: \"57824f95-97b1-4ca7-b06d-1e754cc116bb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mntxn"
Aug 05 17:38:37.939406 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:37.939241    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57824f95-97b1-4ca7-b06d-1e754cc116bb-tmp\") pod \"openshift-lws-operator-fd8ccff4c-mntxn\" (UID: \"57824f95-97b1-4ca7-b06d-1e754cc116bb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mntxn"
Aug 05 17:38:37.939581 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:37.939561    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57824f95-97b1-4ca7-b06d-1e754cc116bb-tmp\") pod \"openshift-lws-operator-fd8ccff4c-mntxn\" (UID: \"57824f95-97b1-4ca7-b06d-1e754cc116bb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mntxn"
Aug 05 17:38:37.951631 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:37.951597    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc6rb\" (UniqueName: \"kubernetes.io/projected/57824f95-97b1-4ca7-b06d-1e754cc116bb-kube-api-access-zc6rb\") pod \"openshift-lws-operator-fd8ccff4c-mntxn\" (UID: \"57824f95-97b1-4ca7-b06d-1e754cc116bb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mntxn"
Aug 05 17:38:38.069366 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:38.069275    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mntxn"
Aug 05 17:38:38.217238 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:38.217108    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mntxn"]
Aug 05 17:38:38.219926 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:38:38.219900    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57824f95_97b1_4ca7_b06d_1e754cc116bb.slice/crio-5aed3abc396d96cc2a05b9d920c3bbf9cbe822e900176189c3e5d5e7385b275c WatchSource:0}: Error finding container 5aed3abc396d96cc2a05b9d920c3bbf9cbe822e900176189c3e5d5e7385b275c: Status 404 returned error can't find the container with id 5aed3abc396d96cc2a05b9d920c3bbf9cbe822e900176189c3e5d5e7385b275c
Aug 05 17:38:38.783384 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:38.783349    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mntxn" event={"ID":"57824f95-97b1-4ca7-b06d-1e754cc116bb","Type":"ContainerStarted","Data":"5aed3abc396d96cc2a05b9d920c3bbf9cbe822e900176189c3e5d5e7385b275c"}
Aug 05 17:38:40.795233 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:40.795194    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mntxn" event={"ID":"57824f95-97b1-4ca7-b06d-1e754cc116bb","Type":"ContainerStarted","Data":"630cbd69985f6244cc793c2c3a1817517e1edf97fe7150f46818571a4b2a1440"}
Aug 05 17:38:40.816633 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:40.816579    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mntxn" podStartSLOduration=1.806476253 podStartE2EDuration="3.816563859s" totalImagesPullingTime="2.010087606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:38:40.815192746 +0000 UTC m=+347.128044111" watchObservedRunningTime="2026-08-05 17:38:40.816563859 +0000 UTC m=+347.129415221"
Aug 05 17:38:43.559817 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:43.559778    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjrdn"]
Aug 05 17:38:43.582088 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:43.582056    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjrdn"]
Aug 05 17:38:43.582256 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:43.582179    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjrdn"
Aug 05 17:38:43.585358 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:43.585337    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Aug 05 17:38:43.585615 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:43.585601    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g85sx\""
Aug 05 17:38:43.586652 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:43.586633    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Aug 05 17:38:43.681213 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:43.681178    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e139e7b-837f-44c8-a297-bafe3da8d9e5-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjrdn\" (UID: \"6e139e7b-837f-44c8-a297-bafe3da8d9e5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjrdn"
Aug 05 17:38:43.681213 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:43.681234    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pb4l\" (UniqueName: \"kubernetes.io/projected/6e139e7b-837f-44c8-a297-bafe3da8d9e5-kube-api-access-2pb4l\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjrdn\" (UID: \"6e139e7b-837f-44c8-a297-bafe3da8d9e5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjrdn"
Aug 05 17:38:43.681448 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:43.681308    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e139e7b-837f-44c8-a297-bafe3da8d9e5-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjrdn\" (UID: \"6e139e7b-837f-44c8-a297-bafe3da8d9e5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjrdn"
Aug 05 17:38:43.782482 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:43.782436    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e139e7b-837f-44c8-a297-bafe3da8d9e5-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjrdn\" (UID: \"6e139e7b-837f-44c8-a297-bafe3da8d9e5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjrdn"
Aug 05 17:38:43.782652 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:43.782526    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e139e7b-837f-44c8-a297-bafe3da8d9e5-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjrdn\" (UID: \"6e139e7b-837f-44c8-a297-bafe3da8d9e5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjrdn"
Aug 05 17:38:43.782652 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:43.782550    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pb4l\" (UniqueName: \"kubernetes.io/projected/6e139e7b-837f-44c8-a297-bafe3da8d9e5-kube-api-access-2pb4l\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjrdn\" (UID: \"6e139e7b-837f-44c8-a297-bafe3da8d9e5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjrdn"
Aug 05 17:38:43.782915 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:43.782891    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e139e7b-837f-44c8-a297-bafe3da8d9e5-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjrdn\" (UID: \"6e139e7b-837f-44c8-a297-bafe3da8d9e5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjrdn"
Aug 05 17:38:43.782915 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:43.782907    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e139e7b-837f-44c8-a297-bafe3da8d9e5-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjrdn\" (UID: \"6e139e7b-837f-44c8-a297-bafe3da8d9e5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjrdn"
Aug 05 17:38:43.791904 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:43.791867    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pb4l\" (UniqueName: \"kubernetes.io/projected/6e139e7b-837f-44c8-a297-bafe3da8d9e5-kube-api-access-2pb4l\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjrdn\" (UID: \"6e139e7b-837f-44c8-a297-bafe3da8d9e5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjrdn"
Aug 05 17:38:43.891700 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:43.891612    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjrdn"
Aug 05 17:38:44.046250 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:44.046206    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjrdn"]
Aug 05 17:38:44.049176 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:38:44.049142    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e139e7b_837f_44c8_a297_bafe3da8d9e5.slice/crio-814708601dc8990909e70dd500a338384c79cdf7050cf3f2feb2fc1f8cdecc8b WatchSource:0}: Error finding container 814708601dc8990909e70dd500a338384c79cdf7050cf3f2feb2fc1f8cdecc8b: Status 404 returned error can't find the container with id 814708601dc8990909e70dd500a338384c79cdf7050cf3f2feb2fc1f8cdecc8b
Aug 05 17:38:44.814489 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:44.814461    2558 generic.go:356] "Generic (PLEG): container finished" podID="6e139e7b-837f-44c8-a297-bafe3da8d9e5" containerID="45bf830c14973d0cf1bf2e6e9af116cdb2dae566eb4e5f11e3fc5ab7e0d29caf" exitCode=0
Aug 05 17:38:44.814856 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:44.814505    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjrdn" event={"ID":"6e139e7b-837f-44c8-a297-bafe3da8d9e5","Type":"ContainerDied","Data":"45bf830c14973d0cf1bf2e6e9af116cdb2dae566eb4e5f11e3fc5ab7e0d29caf"}
Aug 05 17:38:44.814856 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:44.814540    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjrdn" event={"ID":"6e139e7b-837f-44c8-a297-bafe3da8d9e5","Type":"ContainerStarted","Data":"814708601dc8990909e70dd500a338384c79cdf7050cf3f2feb2fc1f8cdecc8b"}
Aug 05 17:38:45.820920 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:45.820882    2558 generic.go:356] "Generic (PLEG): container finished" podID="6e139e7b-837f-44c8-a297-bafe3da8d9e5" containerID="3c08d650cc393fbe13165b944a63fb83be93b5f737e831c54636590cafd21ae1" exitCode=0
Aug 05 17:38:45.821410 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:45.820937    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjrdn" event={"ID":"6e139e7b-837f-44c8-a297-bafe3da8d9e5","Type":"ContainerDied","Data":"3c08d650cc393fbe13165b944a63fb83be93b5f737e831c54636590cafd21ae1"}
Aug 05 17:38:46.827577 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:46.827544    2558 generic.go:356] "Generic (PLEG): container finished" podID="6e139e7b-837f-44c8-a297-bafe3da8d9e5" containerID="3752131eaf51f5398c5aeb78828a3c784d674d92848e2343279d939e6504f0df" exitCode=0
Aug 05 17:38:46.827961 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:46.827630    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjrdn" event={"ID":"6e139e7b-837f-44c8-a297-bafe3da8d9e5","Type":"ContainerDied","Data":"3752131eaf51f5398c5aeb78828a3c784d674d92848e2343279d939e6504f0df"}
Aug 05 17:38:47.961047 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:47.961026    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjrdn"
Aug 05 17:38:48.017435 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:48.017403    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e139e7b-837f-44c8-a297-bafe3da8d9e5-util\") pod \"6e139e7b-837f-44c8-a297-bafe3da8d9e5\" (UID: \"6e139e7b-837f-44c8-a297-bafe3da8d9e5\") "
Aug 05 17:38:48.017586 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:48.017451    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pb4l\" (UniqueName: \"kubernetes.io/projected/6e139e7b-837f-44c8-a297-bafe3da8d9e5-kube-api-access-2pb4l\") pod \"6e139e7b-837f-44c8-a297-bafe3da8d9e5\" (UID: \"6e139e7b-837f-44c8-a297-bafe3da8d9e5\") "
Aug 05 17:38:48.017586 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:48.017490    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e139e7b-837f-44c8-a297-bafe3da8d9e5-bundle\") pod \"6e139e7b-837f-44c8-a297-bafe3da8d9e5\" (UID: \"6e139e7b-837f-44c8-a297-bafe3da8d9e5\") "
Aug 05 17:38:48.018238 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:48.018192    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e139e7b-837f-44c8-a297-bafe3da8d9e5-bundle" (OuterVolumeSpecName: "bundle") pod "6e139e7b-837f-44c8-a297-bafe3da8d9e5" (UID: "6e139e7b-837f-44c8-a297-bafe3da8d9e5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:38:48.019737 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:48.019704    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e139e7b-837f-44c8-a297-bafe3da8d9e5-kube-api-access-2pb4l" (OuterVolumeSpecName: "kube-api-access-2pb4l") pod "6e139e7b-837f-44c8-a297-bafe3da8d9e5" (UID: "6e139e7b-837f-44c8-a297-bafe3da8d9e5"). InnerVolumeSpecName "kube-api-access-2pb4l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:38:48.023274 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:48.023250    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e139e7b-837f-44c8-a297-bafe3da8d9e5-util" (OuterVolumeSpecName: "util") pod "6e139e7b-837f-44c8-a297-bafe3da8d9e5" (UID: "6e139e7b-837f-44c8-a297-bafe3da8d9e5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:38:48.118540 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:48.118453    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e139e7b-837f-44c8-a297-bafe3da8d9e5-util\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:38:48.118540 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:48.118485    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pb4l\" (UniqueName: \"kubernetes.io/projected/6e139e7b-837f-44c8-a297-bafe3da8d9e5-kube-api-access-2pb4l\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:38:48.118540 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:48.118494    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e139e7b-837f-44c8-a297-bafe3da8d9e5-bundle\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:38:48.838399 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:48.838370    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjrdn"
Aug 05 17:38:48.838579 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:48.838370    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjrdn" event={"ID":"6e139e7b-837f-44c8-a297-bafe3da8d9e5","Type":"ContainerDied","Data":"814708601dc8990909e70dd500a338384c79cdf7050cf3f2feb2fc1f8cdecc8b"}
Aug 05 17:38:48.838579 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:38:48.838489    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="814708601dc8990909e70dd500a338384c79cdf7050cf3f2feb2fc1f8cdecc8b"
Aug 05 17:39:01.323421 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:01.323388    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-856dccdfcf-2xgt8"]
Aug 05 17:39:01.323885 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:01.323856    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e139e7b-837f-44c8-a297-bafe3da8d9e5" containerName="util"
Aug 05 17:39:01.323885 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:01.323874    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e139e7b-837f-44c8-a297-bafe3da8d9e5" containerName="util"
Aug 05 17:39:01.324014 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:01.323886    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e139e7b-837f-44c8-a297-bafe3da8d9e5" containerName="extract"
Aug 05 17:39:01.324014 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:01.323895    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e139e7b-837f-44c8-a297-bafe3da8d9e5" containerName="extract"
Aug 05 17:39:01.324014 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:01.323907    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e139e7b-837f-44c8-a297-bafe3da8d9e5" containerName="pull"
Aug 05 17:39:01.324014 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:01.323915    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e139e7b-837f-44c8-a297-bafe3da8d9e5" containerName="pull"
Aug 05 17:39:01.324014 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:01.323995    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e139e7b-837f-44c8-a297-bafe3da8d9e5" containerName="extract"
Aug 05 17:39:01.332554 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:01.332523    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-856dccdfcf-2xgt8"
Aug 05 17:39:01.342137 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:01.342116    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Aug 05 17:39:01.342426 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:01.342406    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Aug 05 17:39:01.342519 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:01.342470    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Aug 05 17:39:01.342631 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:01.342613    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xmkgp\""
Aug 05 17:39:01.343410 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:01.343395    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Aug 05 17:39:01.349786 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:01.349767    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-856dccdfcf-2xgt8"]
Aug 05 17:39:01.440683 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:01.440644    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c995a756-05ef-4947-90b4-74d4559c7b7a-tmp\") pod \"opendatahub-operator-controller-manager-856dccdfcf-2xgt8\" (UID: \"c995a756-05ef-4947-90b4-74d4559c7b7a\") " pod="opendatahub/opendatahub-operator-controller-manager-856dccdfcf-2xgt8"
Aug 05 17:39:01.440886 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:01.440703    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c995a756-05ef-4947-90b4-74d4559c7b7a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-856dccdfcf-2xgt8\" (UID: \"c995a756-05ef-4947-90b4-74d4559c7b7a\") " pod="opendatahub/opendatahub-operator-controller-manager-856dccdfcf-2xgt8"
Aug 05 17:39:01.440886 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:01.440789    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c995a756-05ef-4947-90b4-74d4559c7b7a-manifests\") pod \"opendatahub-operator-controller-manager-856dccdfcf-2xgt8\" (UID: \"c995a756-05ef-4947-90b4-74d4559c7b7a\") " pod="opendatahub/opendatahub-operator-controller-manager-856dccdfcf-2xgt8"
Aug 05 17:39:01.440886 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:01.440839    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c995a756-05ef-4947-90b4-74d4559c7b7a-webhook-cert\") pod \"opendatahub-operator-controller-manager-856dccdfcf-2xgt8\" (UID: \"c995a756-05ef-4947-90b4-74d4559c7b7a\") " pod="opendatahub/opendatahub-operator-controller-manager-856dccdfcf-2xgt8"
Aug 05 17:39:01.440886 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:01.440877    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzhjb\" (UniqueName: \"kubernetes.io/projected/c995a756-05ef-4947-90b4-74d4559c7b7a-kube-api-access-dzhjb\") pod \"opendatahub-operator-controller-manager-856dccdfcf-2xgt8\" (UID: \"c995a756-05ef-4947-90b4-74d4559c7b7a\") " pod="opendatahub/opendatahub-operator-controller-manager-856dccdfcf-2xgt8"
Aug 05 17:39:01.541564 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:01.541524    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c995a756-05ef-4947-90b4-74d4559c7b7a-tmp\") pod \"opendatahub-operator-controller-manager-856dccdfcf-2xgt8\" (UID: \"c995a756-05ef-4947-90b4-74d4559c7b7a\") " pod="opendatahub/opendatahub-operator-controller-manager-856dccdfcf-2xgt8"
Aug 05 17:39:01.541564 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:01.541569    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c995a756-05ef-4947-90b4-74d4559c7b7a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-856dccdfcf-2xgt8\" (UID: \"c995a756-05ef-4947-90b4-74d4559c7b7a\") " pod="opendatahub/opendatahub-operator-controller-manager-856dccdfcf-2xgt8"
Aug 05 17:39:01.541828 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:01.541589    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c995a756-05ef-4947-90b4-74d4559c7b7a-manifests\") pod \"opendatahub-operator-controller-manager-856dccdfcf-2xgt8\" (UID: \"c995a756-05ef-4947-90b4-74d4559c7b7a\") " pod="opendatahub/opendatahub-operator-controller-manager-856dccdfcf-2xgt8"
Aug 05 17:39:01.541828 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:01.541609    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c995a756-05ef-4947-90b4-74d4559c7b7a-webhook-cert\") pod \"opendatahub-operator-controller-manager-856dccdfcf-2xgt8\" (UID: \"c995a756-05ef-4947-90b4-74d4559c7b7a\") " pod="opendatahub/opendatahub-operator-controller-manager-856dccdfcf-2xgt8"
Aug 05 17:39:01.541828 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:01.541632    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzhjb\" (UniqueName: \"kubernetes.io/projected/c995a756-05ef-4947-90b4-74d4559c7b7a-kube-api-access-dzhjb\") pod \"opendatahub-operator-controller-manager-856dccdfcf-2xgt8\" (UID: \"c995a756-05ef-4947-90b4-74d4559c7b7a\") " pod="opendatahub/opendatahub-operator-controller-manager-856dccdfcf-2xgt8"
Aug 05 17:39:01.542072 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:01.542048    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c995a756-05ef-4947-90b4-74d4559c7b7a-manifests\") pod \"opendatahub-operator-controller-manager-856dccdfcf-2xgt8\" (UID: \"c995a756-05ef-4947-90b4-74d4559c7b7a\") " pod="opendatahub/opendatahub-operator-controller-manager-856dccdfcf-2xgt8"
Aug 05 17:39:01.544001 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:01.543979    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c995a756-05ef-4947-90b4-74d4559c7b7a-tmp\") pod \"opendatahub-operator-controller-manager-856dccdfcf-2xgt8\" (UID: \"c995a756-05ef-4947-90b4-74d4559c7b7a\") " pod="opendatahub/opendatahub-operator-controller-manager-856dccdfcf-2xgt8"
Aug 05 17:39:01.544205 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:01.544187    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c995a756-05ef-4947-90b4-74d4559c7b7a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-856dccdfcf-2xgt8\" (UID: \"c995a756-05ef-4947-90b4-74d4559c7b7a\") " pod="opendatahub/opendatahub-operator-controller-manager-856dccdfcf-2xgt8"
Aug 05 17:39:01.544259 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:01.544236    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c995a756-05ef-4947-90b4-74d4559c7b7a-webhook-cert\") pod \"opendatahub-operator-controller-manager-856dccdfcf-2xgt8\" (UID: \"c995a756-05ef-4947-90b4-74d4559c7b7a\") " pod="opendatahub/opendatahub-operator-controller-manager-856dccdfcf-2xgt8"
Aug 05 17:39:01.550780 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:01.550757    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzhjb\" (UniqueName: \"kubernetes.io/projected/c995a756-05ef-4947-90b4-74d4559c7b7a-kube-api-access-dzhjb\") pod \"opendatahub-operator-controller-manager-856dccdfcf-2xgt8\" (UID: \"c995a756-05ef-4947-90b4-74d4559c7b7a\") " pod="opendatahub/opendatahub-operator-controller-manager-856dccdfcf-2xgt8"
Aug 05 17:39:01.642211 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:01.642116    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-856dccdfcf-2xgt8"
Aug 05 17:39:01.814065 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:01.814008    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-856dccdfcf-2xgt8"]
Aug 05 17:39:01.816402 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:39:01.816375    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc995a756_05ef_4947_90b4_74d4559c7b7a.slice/crio-32d4cface030697dcf9afc7c7f740948ddfbb8a371f4691d37eed37623f21be8 WatchSource:0}: Error finding container 32d4cface030697dcf9afc7c7f740948ddfbb8a371f4691d37eed37623f21be8: Status 404 returned error can't find the container with id 32d4cface030697dcf9afc7c7f740948ddfbb8a371f4691d37eed37623f21be8
Aug 05 17:39:01.897191 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:01.897103    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-856dccdfcf-2xgt8" event={"ID":"c995a756-05ef-4947-90b4-74d4559c7b7a","Type":"ContainerStarted","Data":"32d4cface030697dcf9afc7c7f740948ddfbb8a371f4691d37eed37623f21be8"}
Aug 05 17:39:05.924138 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:05.924097    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-856dccdfcf-2xgt8" event={"ID":"c995a756-05ef-4947-90b4-74d4559c7b7a","Type":"ContainerStarted","Data":"23a4ead87ec0e781eed316f9c5aee73b565d46ef8c3ed3f8998b77c0dd4cb30c"}
Aug 05 17:39:06.930824 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:06.930788    2558 generic.go:356] "Generic (PLEG): container finished" podID="c995a756-05ef-4947-90b4-74d4559c7b7a" containerID="23a4ead87ec0e781eed316f9c5aee73b565d46ef8c3ed3f8998b77c0dd4cb30c" exitCode=0
Aug 05 17:39:06.931216 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:06.930845    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-856dccdfcf-2xgt8" event={"ID":"c995a756-05ef-4947-90b4-74d4559c7b7a","Type":"ContainerDied","Data":"23a4ead87ec0e781eed316f9c5aee73b565d46ef8c3ed3f8998b77c0dd4cb30c"}
Aug 05 17:39:07.938400 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:07.938367    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-856dccdfcf-2xgt8" event={"ID":"c995a756-05ef-4947-90b4-74d4559c7b7a","Type":"ContainerStarted","Data":"b689ebb9ecec74b5ac6bc3da2fa87403fb981bfc1745dbfdb4532c7bd3ce59a9"}
Aug 05 17:39:07.938840 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:07.938493    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-856dccdfcf-2xgt8"
Aug 05 17:39:07.991621 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:07.991521    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-856dccdfcf-2xgt8" podStartSLOduration=2.142886001 podStartE2EDuration="6.991499511s" totalImagesPullingTime="3.805859331s" totalInitContainerRuntime="1.042754179s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:39:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:39:07.991209945 +0000 UTC m=+374.304061307" watchObservedRunningTime="2026-08-05 17:39:07.991499511 +0000 UTC m=+374.304350852"
Aug 05 17:39:18.945795 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:18.945764    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-856dccdfcf-2xgt8"
Aug 05 17:39:22.759838 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:22.759803    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-57558c7678-t6dn8"]
Aug 05 17:39:22.764293 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:22.764273    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-57558c7678-t6dn8"
Aug 05 17:39:22.770060 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:22.770035    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Aug 05 17:39:22.770319 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:22.770296    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Aug 05 17:39:22.770866 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:22.770693    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Aug 05 17:39:22.771536 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:22.771253    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Aug 05 17:39:22.787731 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:22.787699    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-57558c7678-t6dn8"]
Aug 05 17:39:22.921767 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:22.921731    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vxpw\" (UniqueName: \"kubernetes.io/projected/973aa2f2-95d7-4e1b-928a-6ca453988c91-kube-api-access-5vxpw\") pod \"kube-auth-proxy-57558c7678-t6dn8\" (UID: \"973aa2f2-95d7-4e1b-928a-6ca453988c91\") " pod="openshift-ingress/kube-auth-proxy-57558c7678-t6dn8"
Aug 05 17:39:22.921927 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:22.921781    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/973aa2f2-95d7-4e1b-928a-6ca453988c91-tmp\") pod \"kube-auth-proxy-57558c7678-t6dn8\" (UID: \"973aa2f2-95d7-4e1b-928a-6ca453988c91\") " pod="openshift-ingress/kube-auth-proxy-57558c7678-t6dn8"
Aug 05 17:39:22.921927 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:22.921886    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/973aa2f2-95d7-4e1b-928a-6ca453988c91-tls-certs\") pod \"kube-auth-proxy-57558c7678-t6dn8\" (UID: \"973aa2f2-95d7-4e1b-928a-6ca453988c91\") " pod="openshift-ingress/kube-auth-proxy-57558c7678-t6dn8"
Aug 05 17:39:22.972939 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:22.972901    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-pkqgh"]
Aug 05 17:39:22.976155 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:22.976137    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-pkqgh"
Aug 05 17:39:22.979495 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:22.979474    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-29rvp\""
Aug 05 17:39:22.979610 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:22.979594    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Aug 05 17:39:23.002780 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:23.002750    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-pkqgh"]
Aug 05 17:39:23.023385 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:23.023309    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/973aa2f2-95d7-4e1b-928a-6ca453988c91-tls-certs\") pod \"kube-auth-proxy-57558c7678-t6dn8\" (UID: \"973aa2f2-95d7-4e1b-928a-6ca453988c91\") " pod="openshift-ingress/kube-auth-proxy-57558c7678-t6dn8"
Aug 05 17:39:23.023385 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:23.023356    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vxpw\" (UniqueName: \"kubernetes.io/projected/973aa2f2-95d7-4e1b-928a-6ca453988c91-kube-api-access-5vxpw\") pod \"kube-auth-proxy-57558c7678-t6dn8\" (UID: \"973aa2f2-95d7-4e1b-928a-6ca453988c91\") " pod="openshift-ingress/kube-auth-proxy-57558c7678-t6dn8"
Aug 05 17:39:23.023385 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:23.023377    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/973aa2f2-95d7-4e1b-928a-6ca453988c91-tmp\") pod \"kube-auth-proxy-57558c7678-t6dn8\" (UID: \"973aa2f2-95d7-4e1b-928a-6ca453988c91\") " pod="openshift-ingress/kube-auth-proxy-57558c7678-t6dn8"
Aug 05 17:39:23.025834 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:23.025811    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/973aa2f2-95d7-4e1b-928a-6ca453988c91-tmp\") pod \"kube-auth-proxy-57558c7678-t6dn8\" (UID: \"973aa2f2-95d7-4e1b-928a-6ca453988c91\") " pod="openshift-ingress/kube-auth-proxy-57558c7678-t6dn8"
Aug 05 17:39:23.026161 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:23.026129    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/973aa2f2-95d7-4e1b-928a-6ca453988c91-tls-certs\") pod \"kube-auth-proxy-57558c7678-t6dn8\" (UID: \"973aa2f2-95d7-4e1b-928a-6ca453988c91\") " pod="openshift-ingress/kube-auth-proxy-57558c7678-t6dn8"
Aug 05 17:39:23.041073 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:23.041047    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vxpw\" (UniqueName: \"kubernetes.io/projected/973aa2f2-95d7-4e1b-928a-6ca453988c91-kube-api-access-5vxpw\") pod \"kube-auth-proxy-57558c7678-t6dn8\" (UID: \"973aa2f2-95d7-4e1b-928a-6ca453988c91\") " pod="openshift-ingress/kube-auth-proxy-57558c7678-t6dn8"
Aug 05 17:39:23.074850 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:23.074814    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-57558c7678-t6dn8"
Aug 05 17:39:23.124584 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:23.124528    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9qkm\" (UniqueName: \"kubernetes.io/projected/d1d22d83-ab2e-42c8-8ccf-6833b79b95f5-kube-api-access-j9qkm\") pod \"odh-model-controller-7998c67dc4-pkqgh\" (UID: \"d1d22d83-ab2e-42c8-8ccf-6833b79b95f5\") " pod="opendatahub/odh-model-controller-7998c67dc4-pkqgh"
Aug 05 17:39:23.124758 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:23.124608    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d1d22d83-ab2e-42c8-8ccf-6833b79b95f5-cert\") pod \"odh-model-controller-7998c67dc4-pkqgh\" (UID: \"d1d22d83-ab2e-42c8-8ccf-6833b79b95f5\") " pod="opendatahub/odh-model-controller-7998c67dc4-pkqgh"
Aug 05 17:39:23.226125 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:23.226067    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9qkm\" (UniqueName: \"kubernetes.io/projected/d1d22d83-ab2e-42c8-8ccf-6833b79b95f5-kube-api-access-j9qkm\") pod \"odh-model-controller-7998c67dc4-pkqgh\" (UID: \"d1d22d83-ab2e-42c8-8ccf-6833b79b95f5\") " pod="opendatahub/odh-model-controller-7998c67dc4-pkqgh"
Aug 05 17:39:23.226125 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:23.226123    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d1d22d83-ab2e-42c8-8ccf-6833b79b95f5-cert\") pod \"odh-model-controller-7998c67dc4-pkqgh\" (UID: \"d1d22d83-ab2e-42c8-8ccf-6833b79b95f5\") " pod="opendatahub/odh-model-controller-7998c67dc4-pkqgh"
Aug 05 17:39:23.226383 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:39:23.226265    2558 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Aug 05 17:39:23.226383 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:39:23.226333    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1d22d83-ab2e-42c8-8ccf-6833b79b95f5-cert podName:d1d22d83-ab2e-42c8-8ccf-6833b79b95f5 nodeName:}" failed. No retries permitted until 2026-08-05 17:39:23.726311741 +0000 UTC m=+390.039163084 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d1d22d83-ab2e-42c8-8ccf-6833b79b95f5-cert") pod "odh-model-controller-7998c67dc4-pkqgh" (UID: "d1d22d83-ab2e-42c8-8ccf-6833b79b95f5") : secret "odh-model-controller-webhook-cert" not found
Aug 05 17:39:23.234116 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:23.234087    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-57558c7678-t6dn8"]
Aug 05 17:39:23.237264 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:39:23.237239    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod973aa2f2_95d7_4e1b_928a_6ca453988c91.slice/crio-a4314a0fb59c9098bf11325c8dcf57a400d38ce268218176281572fe45b1cb8e WatchSource:0}: Error finding container a4314a0fb59c9098bf11325c8dcf57a400d38ce268218176281572fe45b1cb8e: Status 404 returned error can't find the container with id a4314a0fb59c9098bf11325c8dcf57a400d38ce268218176281572fe45b1cb8e
Aug 05 17:39:23.238179 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:23.238161    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9qkm\" (UniqueName: \"kubernetes.io/projected/d1d22d83-ab2e-42c8-8ccf-6833b79b95f5-kube-api-access-j9qkm\") pod \"odh-model-controller-7998c67dc4-pkqgh\" (UID: \"d1d22d83-ab2e-42c8-8ccf-6833b79b95f5\") " pod="opendatahub/odh-model-controller-7998c67dc4-pkqgh"
Aug 05 17:39:23.730278 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:23.730215    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d1d22d83-ab2e-42c8-8ccf-6833b79b95f5-cert\") pod \"odh-model-controller-7998c67dc4-pkqgh\" (UID: \"d1d22d83-ab2e-42c8-8ccf-6833b79b95f5\") " pod="opendatahub/odh-model-controller-7998c67dc4-pkqgh"
Aug 05 17:39:23.733041 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:23.733010    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d1d22d83-ab2e-42c8-8ccf-6833b79b95f5-cert\") pod \"odh-model-controller-7998c67dc4-pkqgh\" (UID: \"d1d22d83-ab2e-42c8-8ccf-6833b79b95f5\") " pod="opendatahub/odh-model-controller-7998c67dc4-pkqgh"
Aug 05 17:39:23.887088 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:23.887051    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-pkqgh"
Aug 05 17:39:23.984311 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:23.983761    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zpn52"]
Aug 05 17:39:24.014959 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.008147    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-zpn52"
Aug 05 17:39:24.014959 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.009579    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zpn52"]
Aug 05 17:39:24.014959 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.013342    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-lqkhz\""
Aug 05 17:39:24.014959 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.013557    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Aug 05 17:39:24.026785 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.026692    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-57558c7678-t6dn8" event={"ID":"973aa2f2-95d7-4e1b-928a-6ca453988c91","Type":"ContainerStarted","Data":"a4314a0fb59c9098bf11325c8dcf57a400d38ce268218176281572fe45b1cb8e"}
Aug 05 17:39:24.133913 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.133692    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nhxx\" (UniqueName: \"kubernetes.io/projected/82c5c71e-9b28-4dd7-9048-2c50db39791b-kube-api-access-6nhxx\") pod \"model-serving-api-54d89bd5fc-zpn52\" (UID: \"82c5c71e-9b28-4dd7-9048-2c50db39791b\") " pod="opendatahub/model-serving-api-54d89bd5fc-zpn52"
Aug 05 17:39:24.133913 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.133864    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82c5c71e-9b28-4dd7-9048-2c50db39791b-tls-certs\") pod \"model-serving-api-54d89bd5fc-zpn52\" (UID: \"82c5c71e-9b28-4dd7-9048-2c50db39791b\") " pod="opendatahub/model-serving-api-54d89bd5fc-zpn52"
Aug 05 17:39:24.235586 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.235499    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82c5c71e-9b28-4dd7-9048-2c50db39791b-tls-certs\") pod \"model-serving-api-54d89bd5fc-zpn52\" (UID: \"82c5c71e-9b28-4dd7-9048-2c50db39791b\") " pod="opendatahub/model-serving-api-54d89bd5fc-zpn52"
Aug 05 17:39:24.235586 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.235568    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nhxx\" (UniqueName: \"kubernetes.io/projected/82c5c71e-9b28-4dd7-9048-2c50db39791b-kube-api-access-6nhxx\") pod \"model-serving-api-54d89bd5fc-zpn52\" (UID: \"82c5c71e-9b28-4dd7-9048-2c50db39791b\") " pod="opendatahub/model-serving-api-54d89bd5fc-zpn52"
Aug 05 17:39:24.238683 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.238653    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82c5c71e-9b28-4dd7-9048-2c50db39791b-tls-certs\") pod \"model-serving-api-54d89bd5fc-zpn52\" (UID: \"82c5c71e-9b28-4dd7-9048-2c50db39791b\") " pod="opendatahub/model-serving-api-54d89bd5fc-zpn52"
Aug 05 17:39:24.245728 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.245696    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nhxx\" (UniqueName: \"kubernetes.io/projected/82c5c71e-9b28-4dd7-9048-2c50db39791b-kube-api-access-6nhxx\") pod \"model-serving-api-54d89bd5fc-zpn52\" (UID: \"82c5c71e-9b28-4dd7-9048-2c50db39791b\") " pod="opendatahub/model-serving-api-54d89bd5fc-zpn52"
Aug 05 17:39:24.288621 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.288580    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-pkqgh"]
Aug 05 17:39:24.328481 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.328438    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-zpn52"
Aug 05 17:39:24.459466 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.459426    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fqll5"]
Aug 05 17:39:24.468613 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.464182    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fqll5"
Aug 05 17:39:24.471384 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.469072    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Aug 05 17:39:24.471384 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.469326    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Aug 05 17:39:24.471384 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.469482    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Aug 05 17:39:24.471384 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.469589    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-9rhln\""
Aug 05 17:39:24.471384 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.469481    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Aug 05 17:39:24.485866 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.485801    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fqll5"]
Aug 05 17:39:24.534381 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.534296    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zpn52"]
Aug 05 17:39:24.537503 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.537475    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51459352-d82f-4ea7-bf08-7a1a179ed199-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-fqll5\" (UID: \"51459352-d82f-4ea7-bf08-7a1a179ed199\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fqll5"
Aug 05 17:39:24.537674 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.537517    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/51459352-d82f-4ea7-bf08-7a1a179ed199-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-fqll5\" (UID: \"51459352-d82f-4ea7-bf08-7a1a179ed199\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fqll5"
Aug 05 17:39:24.537674 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.537596    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/51459352-d82f-4ea7-bf08-7a1a179ed199-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-fqll5\" (UID: \"51459352-d82f-4ea7-bf08-7a1a179ed199\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fqll5"
Aug 05 17:39:24.537674 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.537621    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/51459352-d82f-4ea7-bf08-7a1a179ed199-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-fqll5\" (UID: \"51459352-d82f-4ea7-bf08-7a1a179ed199\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fqll5"
Aug 05 17:39:24.537674 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.537648    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmw8t\" (UniqueName: \"kubernetes.io/projected/51459352-d82f-4ea7-bf08-7a1a179ed199-kube-api-access-vmw8t\") pod \"istiod-openshift-gateway-7b7995d5cd-fqll5\" (UID: \"51459352-d82f-4ea7-bf08-7a1a179ed199\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fqll5"
Aug 05 17:39:24.537886 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.537675    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/51459352-d82f-4ea7-bf08-7a1a179ed199-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-fqll5\" (UID: \"51459352-d82f-4ea7-bf08-7a1a179ed199\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fqll5"
Aug 05 17:39:24.537886 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.537703    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/51459352-d82f-4ea7-bf08-7a1a179ed199-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-fqll5\" (UID: \"51459352-d82f-4ea7-bf08-7a1a179ed199\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fqll5"
Aug 05 17:39:24.537989 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:39:24.537881    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82c5c71e_9b28_4dd7_9048_2c50db39791b.slice/crio-bd81c0dc5244b578f41ded4e11f21d258af321551551d46b1c6fdea070a69a8c WatchSource:0}: Error finding container bd81c0dc5244b578f41ded4e11f21d258af321551551d46b1c6fdea070a69a8c: Status 404 returned error can't find the container with id bd81c0dc5244b578f41ded4e11f21d258af321551551d46b1c6fdea070a69a8c
Aug 05 17:39:24.639244 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.639188    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/51459352-d82f-4ea7-bf08-7a1a179ed199-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-fqll5\" (UID: \"51459352-d82f-4ea7-bf08-7a1a179ed199\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fqll5"
Aug 05 17:39:24.639430 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.639260    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/51459352-d82f-4ea7-bf08-7a1a179ed199-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-fqll5\" (UID: \"51459352-d82f-4ea7-bf08-7a1a179ed199\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fqll5"
Aug 05 17:39:24.639430 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.639293    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmw8t\" (UniqueName: \"kubernetes.io/projected/51459352-d82f-4ea7-bf08-7a1a179ed199-kube-api-access-vmw8t\") pod \"istiod-openshift-gateway-7b7995d5cd-fqll5\" (UID: \"51459352-d82f-4ea7-bf08-7a1a179ed199\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fqll5"
Aug 05 17:39:24.639430 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.639331    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/51459352-d82f-4ea7-bf08-7a1a179ed199-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-fqll5\" (UID: \"51459352-d82f-4ea7-bf08-7a1a179ed199\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fqll5"
Aug 05 17:39:24.639430 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.639365    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/51459352-d82f-4ea7-bf08-7a1a179ed199-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-fqll5\" (UID: \"51459352-d82f-4ea7-bf08-7a1a179ed199\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fqll5"
Aug 05 17:39:24.639602 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.639468    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51459352-d82f-4ea7-bf08-7a1a179ed199-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-fqll5\" (UID: \"51459352-d82f-4ea7-bf08-7a1a179ed199\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fqll5"
Aug 05 17:39:24.639602 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.639494    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/51459352-d82f-4ea7-bf08-7a1a179ed199-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-fqll5\" (UID: \"51459352-d82f-4ea7-bf08-7a1a179ed199\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fqll5"
Aug 05 17:39:24.640958 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.640927    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/51459352-d82f-4ea7-bf08-7a1a179ed199-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-fqll5\" (UID: \"51459352-d82f-4ea7-bf08-7a1a179ed199\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fqll5"
Aug 05 17:39:24.643065 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.643023    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/51459352-d82f-4ea7-bf08-7a1a179ed199-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-fqll5\" (UID: \"51459352-d82f-4ea7-bf08-7a1a179ed199\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fqll5"
Aug 05 17:39:24.643584 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.643187    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/51459352-d82f-4ea7-bf08-7a1a179ed199-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-fqll5\" (UID: \"51459352-d82f-4ea7-bf08-7a1a179ed199\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fqll5"
Aug 05 17:39:24.643584 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.643544    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/51459352-d82f-4ea7-bf08-7a1a179ed199-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-fqll5\" (UID: \"51459352-d82f-4ea7-bf08-7a1a179ed199\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fqll5"
Aug 05 17:39:24.643979 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.643958    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/51459352-d82f-4ea7-bf08-7a1a179ed199-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-fqll5\" (UID: \"51459352-d82f-4ea7-bf08-7a1a179ed199\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fqll5"
Aug 05 17:39:24.654661 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.654636    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmw8t\" (UniqueName: \"kubernetes.io/projected/51459352-d82f-4ea7-bf08-7a1a179ed199-kube-api-access-vmw8t\") pod \"istiod-openshift-gateway-7b7995d5cd-fqll5\" (UID: \"51459352-d82f-4ea7-bf08-7a1a179ed199\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fqll5"
Aug 05 17:39:24.655068 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.655047    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51459352-d82f-4ea7-bf08-7a1a179ed199-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-fqll5\" (UID: \"51459352-d82f-4ea7-bf08-7a1a179ed199\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fqll5"
Aug 05 17:39:24.783648 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.783315    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fqll5"
Aug 05 17:39:24.967119 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:24.967038    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fqll5"]
Aug 05 17:39:25.035279 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:25.035193    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-pkqgh" event={"ID":"d1d22d83-ab2e-42c8-8ccf-6833b79b95f5","Type":"ContainerStarted","Data":"7289c506e8cd28e7e329d6261a72519d73db4b75c01a28108f91428b95a1168f"}
Aug 05 17:39:25.036726 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:25.036665    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-zpn52" event={"ID":"82c5c71e-9b28-4dd7-9048-2c50db39791b","Type":"ContainerStarted","Data":"bd81c0dc5244b578f41ded4e11f21d258af321551551d46b1c6fdea070a69a8c"}
Aug 05 17:39:26.619731 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:39:26.619687    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51459352_d82f_4ea7_bf08_7a1a179ed199.slice/crio-876e154175a18374798589170b15bbd03e35e4e62e970b2f4c00a5a1c40a0ea7 WatchSource:0}: Error finding container 876e154175a18374798589170b15bbd03e35e4e62e970b2f4c00a5a1c40a0ea7: Status 404 returned error can't find the container with id 876e154175a18374798589170b15bbd03e35e4e62e970b2f4c00a5a1c40a0ea7
Aug 05 17:39:27.049995 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:27.049951    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fqll5" event={"ID":"51459352-d82f-4ea7-bf08-7a1a179ed199","Type":"ContainerStarted","Data":"876e154175a18374798589170b15bbd03e35e4e62e970b2f4c00a5a1c40a0ea7"}
Aug 05 17:39:29.063075 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:29.063031    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-57558c7678-t6dn8" event={"ID":"973aa2f2-95d7-4e1b-928a-6ca453988c91","Type":"ContainerStarted","Data":"f6d4c8f1324c64eb6864847ee7c7946ce68986bbf896ab9fc99fc60a5acfeda5"}
Aug 05 17:39:29.064586 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:29.064558    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-zpn52" event={"ID":"82c5c71e-9b28-4dd7-9048-2c50db39791b","Type":"ContainerStarted","Data":"30dc566af5fb1e358fe04849e2f8884bbad8ce814e527e138356fce6aa24479f"}
Aug 05 17:39:29.064699 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:29.064671    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-zpn52"
Aug 05 17:39:29.066289 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:29.066206    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-pkqgh" event={"ID":"d1d22d83-ab2e-42c8-8ccf-6833b79b95f5","Type":"ContainerStarted","Data":"9aee6757f0c0d7379b70a4ac9ec23d70501d91c7050f552ef72545698b8c3f22"}
Aug 05 17:39:29.066585 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:29.066564    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-pkqgh"
Aug 05 17:39:29.081364 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:29.081320    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-57558c7678-t6dn8" podStartSLOduration=2.324071853 podStartE2EDuration="7.081305656s" totalImagesPullingTime="4.757233803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:39:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:39:29.080545173 +0000 UTC m=+395.393396538" watchObservedRunningTime="2026-08-05 17:39:29.081305656 +0000 UTC m=+395.394157018"
Aug 05 17:39:29.125972 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:29.125912    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-pkqgh" podStartSLOduration=2.971828367 podStartE2EDuration="7.125889123s" totalImagesPullingTime="4.154060756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:39:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:39:29.124519882 +0000 UTC m=+395.437371245" watchObservedRunningTime="2026-08-05 17:39:29.125889123 +0000 UTC m=+395.438740486"
Aug 05 17:39:29.126166 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:29.126034    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-zpn52" podStartSLOduration=2.17608998 podStartE2EDuration="6.126025345s" totalImagesPullingTime="3.949935365s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:39:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:39:29.106377317 +0000 UTC m=+395.419228679" watchObservedRunningTime="2026-08-05 17:39:29.126025345 +0000 UTC m=+395.438876709"
Aug 05 17:39:30.064118 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:30.064087    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 05 17:39:30.064412 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:30.064150    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 05 17:39:31.078163 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:31.078123    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fqll5" event={"ID":"51459352-d82f-4ea7-bf08-7a1a179ed199","Type":"ContainerStarted","Data":"1c43afe1dfaa8d6d5cd9f371ee26ff3cb94a26d0b5022de5bc03f7819eb0ce65"}
Aug 05 17:39:31.078607 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:31.078185    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fqll5"
Aug 05 17:39:31.080082 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:31.080053    2558 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-fqll5 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 05 17:39:31.080192 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:31.080113    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fqll5" podUID="51459352-d82f-4ea7-bf08-7a1a179ed199" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 05 17:39:31.109997 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:31.109945    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fqll5" podStartSLOduration=3.668194198 podStartE2EDuration="7.109931342s" totalImagesPullingTime="3.441737144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:39:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:39:31.107181685 +0000 UTC m=+397.420033047" watchObservedRunningTime="2026-08-05 17:39:31.109931342 +0000 UTC m=+397.422782705"
Aug 05 17:39:32.083409 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:32.083355    2558 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-fqll5 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 05 17:39:32.083779 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:32.083435    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fqll5" podUID="51459352-d82f-4ea7-bf08-7a1a179ed199" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 05 17:39:32.508186 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:32.508152    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d"]
Aug 05 17:39:32.512018 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:32.511995    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d"
Aug 05 17:39:32.516448 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:32.516425    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-tjwn6\""
Aug 05 17:39:32.538248 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:32.538193    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d"]
Aug 05 17:39:32.619277 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:32.619217    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d6c6c86-3828-429b-9c43-fc6727894e36-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d\" (UID: \"2d6c6c86-3828-429b-9c43-fc6727894e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d"
Aug 05 17:39:32.619441 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:32.619286    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d6c6c86-3828-429b-9c43-fc6727894e36-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d\" (UID: \"2d6c6c86-3828-429b-9c43-fc6727894e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d"
Aug 05 17:39:32.619441 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:32.619334    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d6c6c86-3828-429b-9c43-fc6727894e36-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d\" (UID: \"2d6c6c86-3828-429b-9c43-fc6727894e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d"
Aug 05 17:39:32.619441 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:32.619369    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d6c6c86-3828-429b-9c43-fc6727894e36-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d\" (UID: \"2d6c6c86-3828-429b-9c43-fc6727894e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d"
Aug 05 17:39:32.619441 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:32.619385    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d6c6c86-3828-429b-9c43-fc6727894e36-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d\" (UID: \"2d6c6c86-3828-429b-9c43-fc6727894e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d"
Aug 05 17:39:32.619441 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:32.619424    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d6c6c86-3828-429b-9c43-fc6727894e36-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d\" (UID: \"2d6c6c86-3828-429b-9c43-fc6727894e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d"
Aug 05 17:39:32.619669 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:32.619543    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d6c6c86-3828-429b-9c43-fc6727894e36-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d\" (UID: \"2d6c6c86-3828-429b-9c43-fc6727894e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d"
Aug 05 17:39:32.619669 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:32.619602    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2s2s\" (UniqueName: \"kubernetes.io/projected/2d6c6c86-3828-429b-9c43-fc6727894e36-kube-api-access-c2s2s\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d\" (UID: \"2d6c6c86-3828-429b-9c43-fc6727894e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d"
Aug 05 17:39:32.619669 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:32.619665    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d6c6c86-3828-429b-9c43-fc6727894e36-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d\" (UID: \"2d6c6c86-3828-429b-9c43-fc6727894e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d"
Aug 05 17:39:32.720956 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:32.720918    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d6c6c86-3828-429b-9c43-fc6727894e36-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d\" (UID: \"2d6c6c86-3828-429b-9c43-fc6727894e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d"
Aug 05 17:39:32.720956 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:32.720957    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d6c6c86-3828-429b-9c43-fc6727894e36-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d\" (UID: \"2d6c6c86-3828-429b-9c43-fc6727894e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d"
Aug 05 17:39:32.721213 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:32.720973    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d6c6c86-3828-429b-9c43-fc6727894e36-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d\" (UID: \"2d6c6c86-3828-429b-9c43-fc6727894e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d"
Aug 05 17:39:32.721213 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:32.720999    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d6c6c86-3828-429b-9c43-fc6727894e36-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d\" (UID: \"2d6c6c86-3828-429b-9c43-fc6727894e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d"
Aug 05 17:39:32.721213 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:32.721031    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d6c6c86-3828-429b-9c43-fc6727894e36-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d\" (UID: \"2d6c6c86-3828-429b-9c43-fc6727894e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d"
Aug 05 17:39:32.721213 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:32.721068    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2s2s\" (UniqueName: \"kubernetes.io/projected/2d6c6c86-3828-429b-9c43-fc6727894e36-kube-api-access-c2s2s\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d\" (UID: \"2d6c6c86-3828-429b-9c43-fc6727894e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d"
Aug 05 17:39:32.721520 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:32.721197    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d6c6c86-3828-429b-9c43-fc6727894e36-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d\" (UID: \"2d6c6c86-3828-429b-9c43-fc6727894e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d"
Aug 05 17:39:32.721520 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:32.721486    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d6c6c86-3828-429b-9c43-fc6727894e36-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d\" (UID: \"2d6c6c86-3828-429b-9c43-fc6727894e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d"
Aug 05 17:39:32.721615 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:32.721533    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d6c6c86-3828-429b-9c43-fc6727894e36-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d\" (UID: \"2d6c6c86-3828-429b-9c43-fc6727894e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d"
Aug 05 17:39:32.721615 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:32.721587    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d6c6c86-3828-429b-9c43-fc6727894e36-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d\" (UID: \"2d6c6c86-3828-429b-9c43-fc6727894e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d"
Aug 05 17:39:32.721699 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:32.721615    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d6c6c86-3828-429b-9c43-fc6727894e36-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d\" (UID: \"2d6c6c86-3828-429b-9c43-fc6727894e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d"
Aug 05 17:39:32.721831 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:32.721807    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d6c6c86-3828-429b-9c43-fc6727894e36-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d\" (UID: \"2d6c6c86-3828-429b-9c43-fc6727894e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d"
Aug 05 17:39:32.722164 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:32.721891    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d6c6c86-3828-429b-9c43-fc6727894e36-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d\" (UID: \"2d6c6c86-3828-429b-9c43-fc6727894e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d"
Aug 05 17:39:32.722277 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:32.721957    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d6c6c86-3828-429b-9c43-fc6727894e36-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d\" (UID: \"2d6c6c86-3828-429b-9c43-fc6727894e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d"
Aug 05 17:39:32.723730 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:32.723700    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d6c6c86-3828-429b-9c43-fc6727894e36-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d\" (UID: \"2d6c6c86-3828-429b-9c43-fc6727894e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d"
Aug 05 17:39:32.723994 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:32.723971    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d6c6c86-3828-429b-9c43-fc6727894e36-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d\" (UID: \"2d6c6c86-3828-429b-9c43-fc6727894e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d"
Aug 05 17:39:32.734589 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:32.734567    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d6c6c86-3828-429b-9c43-fc6727894e36-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d\" (UID: \"2d6c6c86-3828-429b-9c43-fc6727894e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d"
Aug 05 17:39:32.734853 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:32.734829    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2s2s\" (UniqueName: \"kubernetes.io/projected/2d6c6c86-3828-429b-9c43-fc6727894e36-kube-api-access-c2s2s\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d\" (UID: \"2d6c6c86-3828-429b-9c43-fc6727894e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d"
Aug 05 17:39:32.825830 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:32.825739    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d"
Aug 05 17:39:32.985075 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:32.985047    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d"]
Aug 05 17:39:32.987012 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:39:32.986982    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d6c6c86_3828_429b_9c43_fc6727894e36.slice/crio-bc6f0372e196003da5065e4436fd79f5b6bb21488773f09b0838fb9a17ae4aaf WatchSource:0}: Error finding container bc6f0372e196003da5065e4436fd79f5b6bb21488773f09b0838fb9a17ae4aaf: Status 404 returned error can't find the container with id bc6f0372e196003da5065e4436fd79f5b6bb21488773f09b0838fb9a17ae4aaf
Aug 05 17:39:33.088995 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:33.088907    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d" event={"ID":"2d6c6c86-3828-429b-9c43-fc6727894e36","Type":"ContainerStarted","Data":"bc6f0372e196003da5065e4436fd79f5b6bb21488773f09b0838fb9a17ae4aaf"}
Aug 05 17:39:35.084399 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:35.084366    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fqll5"
Aug 05 17:39:35.717874 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:35.717833    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 05 17:39:35.717972 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:35.717897    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 05 17:39:35.717972 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:35.717925    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 05 17:39:35.781676 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:35.781644    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-xzf7w"]
Aug 05 17:39:35.787770 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:35.787746    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xzf7w"
Aug 05 17:39:35.793652 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:35.793609    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Aug 05 17:39:35.793875 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:35.793860    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-jl6l9\""
Aug 05 17:39:35.800835 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:35.800812    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-qr69q"]
Aug 05 17:39:35.805486 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:35.805467    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qr69q"
Aug 05 17:39:35.809032 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:35.808800    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-wbjmc\""
Aug 05 17:39:35.810598 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:35.810575    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-xzf7w"]
Aug 05 17:39:35.810954 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:35.810940    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Aug 05 17:39:35.833457 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:35.832104    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-qr69q"]
Aug 05 17:39:35.850570 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:35.850292    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f365d586-28c7-416b-92cb-0f7df80abaa9-cert\") pod \"kserve-controller-manager-d6f4b65b8-xzf7w\" (UID: \"f365d586-28c7-416b-92cb-0f7df80abaa9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xzf7w"
Aug 05 17:39:35.850570 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:35.850347    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz27x\" (UniqueName: \"kubernetes.io/projected/f365d586-28c7-416b-92cb-0f7df80abaa9-kube-api-access-lz27x\") pod \"kserve-controller-manager-d6f4b65b8-xzf7w\" (UID: \"f365d586-28c7-416b-92cb-0f7df80abaa9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xzf7w"
Aug 05 17:39:35.850570 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:35.850380    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69d8e66b-b6d9-4ff6-92a5-5de71aa13d1e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-qr69q\" (UID: \"69d8e66b-b6d9-4ff6-92a5-5de71aa13d1e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qr69q"
Aug 05 17:39:35.850570 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:35.850427    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn84r\" (UniqueName: \"kubernetes.io/projected/69d8e66b-b6d9-4ff6-92a5-5de71aa13d1e-kube-api-access-xn84r\") pod \"llmisvc-controller-manager-777c6bd7d5-qr69q\" (UID: \"69d8e66b-b6d9-4ff6-92a5-5de71aa13d1e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qr69q"
Aug 05 17:39:35.951419 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:35.951381    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f365d586-28c7-416b-92cb-0f7df80abaa9-cert\") pod \"kserve-controller-manager-d6f4b65b8-xzf7w\" (UID: \"f365d586-28c7-416b-92cb-0f7df80abaa9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xzf7w"
Aug 05 17:39:35.951718 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:35.951439    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz27x\" (UniqueName: \"kubernetes.io/projected/f365d586-28c7-416b-92cb-0f7df80abaa9-kube-api-access-lz27x\") pod \"kserve-controller-manager-d6f4b65b8-xzf7w\" (UID: \"f365d586-28c7-416b-92cb-0f7df80abaa9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xzf7w"
Aug 05 17:39:35.951718 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:35.951470    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69d8e66b-b6d9-4ff6-92a5-5de71aa13d1e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-qr69q\" (UID: \"69d8e66b-b6d9-4ff6-92a5-5de71aa13d1e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qr69q"
Aug 05 17:39:35.951718 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:35.951516    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn84r\" (UniqueName: \"kubernetes.io/projected/69d8e66b-b6d9-4ff6-92a5-5de71aa13d1e-kube-api-access-xn84r\") pod \"llmisvc-controller-manager-777c6bd7d5-qr69q\" (UID: \"69d8e66b-b6d9-4ff6-92a5-5de71aa13d1e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qr69q"
Aug 05 17:39:35.951718 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:39:35.951579    2558 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Aug 05 17:39:35.951718 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:39:35.951695    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f365d586-28c7-416b-92cb-0f7df80abaa9-cert podName:f365d586-28c7-416b-92cb-0f7df80abaa9 nodeName:}" failed. No retries permitted until 2026-08-05 17:39:36.451655578 +0000 UTC m=+402.764506934 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f365d586-28c7-416b-92cb-0f7df80abaa9-cert") pod "kserve-controller-manager-d6f4b65b8-xzf7w" (UID: "f365d586-28c7-416b-92cb-0f7df80abaa9") : secret "kserve-webhook-server-cert" not found
Aug 05 17:39:35.955074 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:35.955045    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69d8e66b-b6d9-4ff6-92a5-5de71aa13d1e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-qr69q\" (UID: \"69d8e66b-b6d9-4ff6-92a5-5de71aa13d1e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qr69q"
Aug 05 17:39:35.963881 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:35.963801    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz27x\" (UniqueName: \"kubernetes.io/projected/f365d586-28c7-416b-92cb-0f7df80abaa9-kube-api-access-lz27x\") pod \"kserve-controller-manager-d6f4b65b8-xzf7w\" (UID: \"f365d586-28c7-416b-92cb-0f7df80abaa9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xzf7w"
Aug 05 17:39:35.963881 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:35.963837    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn84r\" (UniqueName: \"kubernetes.io/projected/69d8e66b-b6d9-4ff6-92a5-5de71aa13d1e-kube-api-access-xn84r\") pod \"llmisvc-controller-manager-777c6bd7d5-qr69q\" (UID: \"69d8e66b-b6d9-4ff6-92a5-5de71aa13d1e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qr69q"
Aug 05 17:39:36.106936 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:36.106835    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d" event={"ID":"2d6c6c86-3828-429b-9c43-fc6727894e36","Type":"ContainerStarted","Data":"92a402a5090c370167736df88b4a30f4e389052fc76891d0a2fcdd71fe88447c"}
Aug 05 17:39:36.123729 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:36.123697    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qr69q"
Aug 05 17:39:36.169555 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:36.169491    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d" podStartSLOduration=1.441175329 podStartE2EDuration="4.169469972s" totalImagesPullingTime="2.728294643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:39:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:39:36.168015937 +0000 UTC m=+402.480867308" watchObservedRunningTime="2026-08-05 17:39:36.169469972 +0000 UTC m=+402.482321335"
Aug 05 17:39:36.281690 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:36.281664    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-qr69q"]
Aug 05 17:39:36.284129 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:39:36.284097    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod69d8e66b_b6d9_4ff6_92a5_5de71aa13d1e.slice/crio-b3c343145e680f6cb04998a12f1326830e0f1b8d0d1fb6c20101977e008d58e7 WatchSource:0}: Error finding container b3c343145e680f6cb04998a12f1326830e0f1b8d0d1fb6c20101977e008d58e7: Status 404 returned error can't find the container with id b3c343145e680f6cb04998a12f1326830e0f1b8d0d1fb6c20101977e008d58e7
Aug 05 17:39:36.456378 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:36.456345    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f365d586-28c7-416b-92cb-0f7df80abaa9-cert\") pod \"kserve-controller-manager-d6f4b65b8-xzf7w\" (UID: \"f365d586-28c7-416b-92cb-0f7df80abaa9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xzf7w"
Aug 05 17:39:36.456603 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:39:36.456489    2558 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Aug 05 17:39:36.456603 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:39:36.456555    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f365d586-28c7-416b-92cb-0f7df80abaa9-cert podName:f365d586-28c7-416b-92cb-0f7df80abaa9 nodeName:}" failed. No retries permitted until 2026-08-05 17:39:37.456538411 +0000 UTC m=+403.769389753 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f365d586-28c7-416b-92cb-0f7df80abaa9-cert") pod "kserve-controller-manager-d6f4b65b8-xzf7w" (UID: "f365d586-28c7-416b-92cb-0f7df80abaa9") : secret "kserve-webhook-server-cert" not found
Aug 05 17:39:36.826436 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:36.826351    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d"
Aug 05 17:39:36.830995 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:36.830969    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d"
Aug 05 17:39:37.112728 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:37.112644    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qr69q" event={"ID":"69d8e66b-b6d9-4ff6-92a5-5de71aa13d1e","Type":"ContainerStarted","Data":"b3c343145e680f6cb04998a12f1326830e0f1b8d0d1fb6c20101977e008d58e7"}
Aug 05 17:39:37.113088 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:37.112860    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d"
Aug 05 17:39:37.113772 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:37.113755    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d"
Aug 05 17:39:37.466642 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:37.466593    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f365d586-28c7-416b-92cb-0f7df80abaa9-cert\") pod \"kserve-controller-manager-d6f4b65b8-xzf7w\" (UID: \"f365d586-28c7-416b-92cb-0f7df80abaa9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xzf7w"
Aug 05 17:39:37.469530 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:37.469270    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f365d586-28c7-416b-92cb-0f7df80abaa9-cert\") pod \"kserve-controller-manager-d6f4b65b8-xzf7w\" (UID: \"f365d586-28c7-416b-92cb-0f7df80abaa9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xzf7w"
Aug 05 17:39:37.599556 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:37.599523    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xzf7w"
Aug 05 17:39:37.884498 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:37.884460    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-xzf7w"]
Aug 05 17:39:37.975849 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:39:37.975808    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf365d586_28c7_416b_92cb_0f7df80abaa9.slice/crio-12fbded34393aad2d896f3acce95cb458d6ce884ef3f9657c99ffbfac5d0dd9b WatchSource:0}: Error finding container 12fbded34393aad2d896f3acce95cb458d6ce884ef3f9657c99ffbfac5d0dd9b: Status 404 returned error can't find the container with id 12fbded34393aad2d896f3acce95cb458d6ce884ef3f9657c99ffbfac5d0dd9b
Aug 05 17:39:38.119357 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:38.119273    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xzf7w" event={"ID":"f365d586-28c7-416b-92cb-0f7df80abaa9","Type":"ContainerStarted","Data":"12fbded34393aad2d896f3acce95cb458d6ce884ef3f9657c99ffbfac5d0dd9b"}
Aug 05 17:39:39.751055 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:39.751021    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fqll5"]
Aug 05 17:39:39.751506 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:39.751272    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fqll5" podUID="51459352-d82f-4ea7-bf08-7a1a179ed199" containerName="discovery" containerID="cri-o://1c43afe1dfaa8d6d5cd9f371ee26ff3cb94a26d0b5022de5bc03f7819eb0ce65" gracePeriod=30
Aug 05 17:39:40.022912 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:40.022874    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fqll5"
Aug 05 17:39:40.075600 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:40.075570    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-zpn52"
Aug 05 17:39:40.093026 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:40.092992    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/51459352-d82f-4ea7-bf08-7a1a179ed199-local-certs\") pod \"51459352-d82f-4ea7-bf08-7a1a179ed199\" (UID: \"51459352-d82f-4ea7-bf08-7a1a179ed199\") "
Aug 05 17:39:40.093271 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:40.093034    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmw8t\" (UniqueName: \"kubernetes.io/projected/51459352-d82f-4ea7-bf08-7a1a179ed199-kube-api-access-vmw8t\") pod \"51459352-d82f-4ea7-bf08-7a1a179ed199\" (UID: \"51459352-d82f-4ea7-bf08-7a1a179ed199\") "
Aug 05 17:39:40.093271 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:40.093084    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/51459352-d82f-4ea7-bf08-7a1a179ed199-istio-csr-dns-cert\") pod \"51459352-d82f-4ea7-bf08-7a1a179ed199\" (UID: \"51459352-d82f-4ea7-bf08-7a1a179ed199\") "
Aug 05 17:39:40.093271 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:40.093119    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/51459352-d82f-4ea7-bf08-7a1a179ed199-cacerts\") pod \"51459352-d82f-4ea7-bf08-7a1a179ed199\" (UID: \"51459352-d82f-4ea7-bf08-7a1a179ed199\") "
Aug 05 17:39:40.093271 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:40.093194    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/51459352-d82f-4ea7-bf08-7a1a179ed199-istio-csr-ca-configmap\") pod \"51459352-d82f-4ea7-bf08-7a1a179ed199\" (UID: \"51459352-d82f-4ea7-bf08-7a1a179ed199\") "
Aug 05 17:39:40.093271 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:40.093241    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51459352-d82f-4ea7-bf08-7a1a179ed199-istio-token\") pod \"51459352-d82f-4ea7-bf08-7a1a179ed199\" (UID: \"51459352-d82f-4ea7-bf08-7a1a179ed199\") "
Aug 05 17:39:40.093906 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:40.093378    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/51459352-d82f-4ea7-bf08-7a1a179ed199-istio-kubeconfig\") pod \"51459352-d82f-4ea7-bf08-7a1a179ed199\" (UID: \"51459352-d82f-4ea7-bf08-7a1a179ed199\") "
Aug 05 17:39:40.093906 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:40.093681    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51459352-d82f-4ea7-bf08-7a1a179ed199-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "51459352-d82f-4ea7-bf08-7a1a179ed199" (UID: "51459352-d82f-4ea7-bf08-7a1a179ed199"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:39:40.093906 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:40.093776    2558 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/51459352-d82f-4ea7-bf08-7a1a179ed199-istio-csr-ca-configmap\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:39:40.096808 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:40.096777    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51459352-d82f-4ea7-bf08-7a1a179ed199-local-certs" (OuterVolumeSpecName: "local-certs") pod "51459352-d82f-4ea7-bf08-7a1a179ed199" (UID: "51459352-d82f-4ea7-bf08-7a1a179ed199"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:39:40.097311 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:40.097281    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51459352-d82f-4ea7-bf08-7a1a179ed199-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "51459352-d82f-4ea7-bf08-7a1a179ed199" (UID: "51459352-d82f-4ea7-bf08-7a1a179ed199"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:39:40.097419 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:40.097278    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51459352-d82f-4ea7-bf08-7a1a179ed199-istio-token" (OuterVolumeSpecName: "istio-token") pod "51459352-d82f-4ea7-bf08-7a1a179ed199" (UID: "51459352-d82f-4ea7-bf08-7a1a179ed199"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:39:40.097419 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:40.097325    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51459352-d82f-4ea7-bf08-7a1a179ed199-cacerts" (OuterVolumeSpecName: "cacerts") pod "51459352-d82f-4ea7-bf08-7a1a179ed199" (UID: "51459352-d82f-4ea7-bf08-7a1a179ed199"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:39:40.097521 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:40.097499    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51459352-d82f-4ea7-bf08-7a1a179ed199-kube-api-access-vmw8t" (OuterVolumeSpecName: "kube-api-access-vmw8t") pod "51459352-d82f-4ea7-bf08-7a1a179ed199" (UID: "51459352-d82f-4ea7-bf08-7a1a179ed199"). InnerVolumeSpecName "kube-api-access-vmw8t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:39:40.097562 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:40.097512    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51459352-d82f-4ea7-bf08-7a1a179ed199-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "51459352-d82f-4ea7-bf08-7a1a179ed199" (UID: "51459352-d82f-4ea7-bf08-7a1a179ed199"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:39:40.131865 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:40.131783    2558 generic.go:356] "Generic (PLEG): container finished" podID="51459352-d82f-4ea7-bf08-7a1a179ed199" containerID="1c43afe1dfaa8d6d5cd9f371ee26ff3cb94a26d0b5022de5bc03f7819eb0ce65" exitCode=0
Aug 05 17:39:40.131865 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:40.131830    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fqll5"
Aug 05 17:39:40.131865 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:40.131836    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fqll5" event={"ID":"51459352-d82f-4ea7-bf08-7a1a179ed199","Type":"ContainerDied","Data":"1c43afe1dfaa8d6d5cd9f371ee26ff3cb94a26d0b5022de5bc03f7819eb0ce65"}
Aug 05 17:39:40.132079 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:40.131905    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fqll5" event={"ID":"51459352-d82f-4ea7-bf08-7a1a179ed199","Type":"ContainerDied","Data":"876e154175a18374798589170b15bbd03e35e4e62e970b2f4c00a5a1c40a0ea7"}
Aug 05 17:39:40.132079 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:40.131936    2558 scope.go:117] "RemoveContainer" containerID="1c43afe1dfaa8d6d5cd9f371ee26ff3cb94a26d0b5022de5bc03f7819eb0ce65"
Aug 05 17:39:40.133964 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:40.133935    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qr69q" event={"ID":"69d8e66b-b6d9-4ff6-92a5-5de71aa13d1e","Type":"ContainerStarted","Data":"149a8a78828743159e43055f13ebc20025aeed12fb0068a2af4fae13119b4076"}
Aug 05 17:39:40.134463 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:40.134432    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qr69q"
Aug 05 17:39:40.186812 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:40.186757    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qr69q" podStartSLOduration=1.871133823 podStartE2EDuration="5.186740209s" totalImagesPullingTime="3.315606386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:39:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:39:40.174046665 +0000 UTC m=+406.486898057" watchObservedRunningTime="2026-08-05 17:39:40.186740209 +0000 UTC m=+406.499591581"
Aug 05 17:39:40.194415 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:40.194342    2558 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/51459352-d82f-4ea7-bf08-7a1a179ed199-istio-kubeconfig\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:39:40.194415 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:40.194371    2558 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/51459352-d82f-4ea7-bf08-7a1a179ed199-local-certs\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:39:40.194415 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:40.194385    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmw8t\" (UniqueName: \"kubernetes.io/projected/51459352-d82f-4ea7-bf08-7a1a179ed199-kube-api-access-vmw8t\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:39:40.194415 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:40.194399    2558 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/51459352-d82f-4ea7-bf08-7a1a179ed199-istio-csr-dns-cert\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:39:40.194415 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:40.194411    2558 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/51459352-d82f-4ea7-bf08-7a1a179ed199-cacerts\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:39:40.194415 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:40.194423    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51459352-d82f-4ea7-bf08-7a1a179ed199-istio-token\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:39:40.204395 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:40.204366    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fqll5"]
Aug 05 17:39:40.223063 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:40.223037    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fqll5"]
Aug 05 17:39:40.256320 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:40.256279    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51459352-d82f-4ea7-bf08-7a1a179ed199" path="/var/lib/kubelet/pods/51459352-d82f-4ea7-bf08-7a1a179ed199/volumes"
Aug 05 17:39:40.592578 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:40.592557    2558 scope.go:117] "RemoveContainer" containerID="1c43afe1dfaa8d6d5cd9f371ee26ff3cb94a26d0b5022de5bc03f7819eb0ce65"
Aug 05 17:39:40.592935 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:39:40.592914    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c43afe1dfaa8d6d5cd9f371ee26ff3cb94a26d0b5022de5bc03f7819eb0ce65\": container with ID starting with 1c43afe1dfaa8d6d5cd9f371ee26ff3cb94a26d0b5022de5bc03f7819eb0ce65 not found: ID does not exist" containerID="1c43afe1dfaa8d6d5cd9f371ee26ff3cb94a26d0b5022de5bc03f7819eb0ce65"
Aug 05 17:39:40.592992 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:40.592945    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c43afe1dfaa8d6d5cd9f371ee26ff3cb94a26d0b5022de5bc03f7819eb0ce65"} err="failed to get container status \"1c43afe1dfaa8d6d5cd9f371ee26ff3cb94a26d0b5022de5bc03f7819eb0ce65\": rpc error: code = NotFound desc = could not find container \"1c43afe1dfaa8d6d5cd9f371ee26ff3cb94a26d0b5022de5bc03f7819eb0ce65\": container with ID starting with 1c43afe1dfaa8d6d5cd9f371ee26ff3cb94a26d0b5022de5bc03f7819eb0ce65 not found: ID does not exist"
Aug 05 17:39:41.081206 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:41.081177    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-pkqgh"
Aug 05 17:39:41.140369 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:41.140337    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xzf7w" event={"ID":"f365d586-28c7-416b-92cb-0f7df80abaa9","Type":"ContainerStarted","Data":"2e6f35526f25f05efed08704e777a9e51e559a13be8f420fbea719b65b31b3ee"}
Aug 05 17:39:41.140525 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:41.140405    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xzf7w"
Aug 05 17:39:41.242602 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:39:41.242549    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xzf7w" podStartSLOduration=3.578361326 podStartE2EDuration="6.242531919s" totalImagesPullingTime="2.664170593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:39:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:39:41.240421544 +0000 UTC m=+407.553272906" watchObservedRunningTime="2026-08-05 17:39:41.242531919 +0000 UTC m=+407.555383281"
Aug 05 17:40:11.143762 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:11.143729    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qr69q"
Aug 05 17:40:12.151639 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:12.151607    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xzf7w"
Aug 05 17:40:26.656921 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:26.656819    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c69rgk"]
Aug 05 17:40:26.657319 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:26.657154    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51459352-d82f-4ea7-bf08-7a1a179ed199" containerName="discovery"
Aug 05 17:40:26.657319 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:26.657166    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="51459352-d82f-4ea7-bf08-7a1a179ed199" containerName="discovery"
Aug 05 17:40:26.657319 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:26.657259    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="51459352-d82f-4ea7-bf08-7a1a179ed199" containerName="discovery"
Aug 05 17:40:26.659634 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:26.659617    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c69rgk"
Aug 05 17:40:26.662484 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:26.662446    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Aug 05 17:40:26.662641 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:26.662493    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Aug 05 17:40:26.662641 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:26.662510    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-g85sx\""
Aug 05 17:40:26.669084 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:26.669059    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c69rgk"]
Aug 05 17:40:26.701804 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:26.701763    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5xzx\" (UniqueName: \"kubernetes.io/projected/7ee591bf-8b2c-4c05-9765-5769039f8671-kube-api-access-b5xzx\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c69rgk\" (UID: \"7ee591bf-8b2c-4c05-9765-5769039f8671\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c69rgk"
Aug 05 17:40:26.701995 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:26.701815    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ee591bf-8b2c-4c05-9765-5769039f8671-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c69rgk\" (UID: \"7ee591bf-8b2c-4c05-9765-5769039f8671\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c69rgk"
Aug 05 17:40:26.701995 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:26.701880    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ee591bf-8b2c-4c05-9765-5769039f8671-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c69rgk\" (UID: \"7ee591bf-8b2c-4c05-9765-5769039f8671\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c69rgk"
Aug 05 17:40:26.754973 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:26.754934    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbsbpsp"]
Aug 05 17:40:26.757741 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:26.757720    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbsbpsp"
Aug 05 17:40:26.768632 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:26.768597    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbsbpsp"]
Aug 05 17:40:26.802655 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:26.802625    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ee591bf-8b2c-4c05-9765-5769039f8671-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c69rgk\" (UID: \"7ee591bf-8b2c-4c05-9765-5769039f8671\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c69rgk"
Aug 05 17:40:26.802862 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:26.802672    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ee591bf-8b2c-4c05-9765-5769039f8671-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c69rgk\" (UID: \"7ee591bf-8b2c-4c05-9765-5769039f8671\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c69rgk"
Aug 05 17:40:26.802862 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:26.802696    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1b7a76f-c902-4a27-a03c-e8ec078584db-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbsbpsp\" (UID: \"c1b7a76f-c902-4a27-a03c-e8ec078584db\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbsbpsp"
Aug 05 17:40:26.802862 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:26.802718    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9ml8\" (UniqueName: \"kubernetes.io/projected/c1b7a76f-c902-4a27-a03c-e8ec078584db-kube-api-access-g9ml8\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbsbpsp\" (UID: \"c1b7a76f-c902-4a27-a03c-e8ec078584db\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbsbpsp"
Aug 05 17:40:26.802862 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:26.802746    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1b7a76f-c902-4a27-a03c-e8ec078584db-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbsbpsp\" (UID: \"c1b7a76f-c902-4a27-a03c-e8ec078584db\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbsbpsp"
Aug 05 17:40:26.802862 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:26.802785    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5xzx\" (UniqueName: \"kubernetes.io/projected/7ee591bf-8b2c-4c05-9765-5769039f8671-kube-api-access-b5xzx\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c69rgk\" (UID: \"7ee591bf-8b2c-4c05-9765-5769039f8671\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c69rgk"
Aug 05 17:40:26.803134 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:26.803016    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ee591bf-8b2c-4c05-9765-5769039f8671-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c69rgk\" (UID: \"7ee591bf-8b2c-4c05-9765-5769039f8671\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c69rgk"
Aug 05 17:40:26.803134 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:26.803091    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ee591bf-8b2c-4c05-9765-5769039f8671-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c69rgk\" (UID: \"7ee591bf-8b2c-4c05-9765-5769039f8671\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c69rgk"
Aug 05 17:40:26.812718 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:26.812681    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5xzx\" (UniqueName: \"kubernetes.io/projected/7ee591bf-8b2c-4c05-9765-5769039f8671-kube-api-access-b5xzx\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c69rgk\" (UID: \"7ee591bf-8b2c-4c05-9765-5769039f8671\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c69rgk"
Aug 05 17:40:26.851998 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:26.851956    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lvqgs"]
Aug 05 17:40:26.855131 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:26.855108    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lvqgs"
Aug 05 17:40:26.864911 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:26.864879    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lvqgs"]
Aug 05 17:40:26.904003 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:26.903955    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1772d50d-230c-4d82-a1ce-89d3798bd744-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lvqgs\" (UID: \"1772d50d-230c-4d82-a1ce-89d3798bd744\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lvqgs"
Aug 05 17:40:26.904184 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:26.904012    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1772d50d-230c-4d82-a1ce-89d3798bd744-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lvqgs\" (UID: \"1772d50d-230c-4d82-a1ce-89d3798bd744\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lvqgs"
Aug 05 17:40:26.904184 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:26.904065    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1b7a76f-c902-4a27-a03c-e8ec078584db-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbsbpsp\" (UID: \"c1b7a76f-c902-4a27-a03c-e8ec078584db\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbsbpsp"
Aug 05 17:40:26.904184 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:26.904096    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72ppl\" (UniqueName: \"kubernetes.io/projected/1772d50d-230c-4d82-a1ce-89d3798bd744-kube-api-access-72ppl\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lvqgs\" (UID: \"1772d50d-230c-4d82-a1ce-89d3798bd744\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lvqgs"
Aug 05 17:40:26.904184 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:26.904125    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9ml8\" (UniqueName: \"kubernetes.io/projected/c1b7a76f-c902-4a27-a03c-e8ec078584db-kube-api-access-g9ml8\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbsbpsp\" (UID: \"c1b7a76f-c902-4a27-a03c-e8ec078584db\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbsbpsp"
Aug 05 17:40:26.904184 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:26.904162    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1b7a76f-c902-4a27-a03c-e8ec078584db-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbsbpsp\" (UID: \"c1b7a76f-c902-4a27-a03c-e8ec078584db\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbsbpsp"
Aug 05 17:40:26.904495 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:26.904468    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1b7a76f-c902-4a27-a03c-e8ec078584db-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbsbpsp\" (UID: \"c1b7a76f-c902-4a27-a03c-e8ec078584db\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbsbpsp"
Aug 05 17:40:26.904569 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:26.904539    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1b7a76f-c902-4a27-a03c-e8ec078584db-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbsbpsp\" (UID: \"c1b7a76f-c902-4a27-a03c-e8ec078584db\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbsbpsp"
Aug 05 17:40:26.912724 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:26.912653    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9ml8\" (UniqueName: \"kubernetes.io/projected/c1b7a76f-c902-4a27-a03c-e8ec078584db-kube-api-access-g9ml8\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbsbpsp\" (UID: \"c1b7a76f-c902-4a27-a03c-e8ec078584db\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbsbpsp"
Aug 05 17:40:26.949645 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:26.949607    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0rtb7p"]
Aug 05 17:40:26.952693 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:26.952673    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0rtb7p"
Aug 05 17:40:26.962424 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:26.962392    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0rtb7p"]
Aug 05 17:40:26.969834 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:26.969806    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c69rgk"
Aug 05 17:40:27.004755 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:27.004719    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bbbdaad-63c9-4769-85ce-71a7d9ef4eba-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0rtb7p\" (UID: \"7bbbdaad-63c9-4769-85ce-71a7d9ef4eba\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0rtb7p"
Aug 05 17:40:27.004755 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:27.004765    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bbbdaad-63c9-4769-85ce-71a7d9ef4eba-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0rtb7p\" (UID: \"7bbbdaad-63c9-4769-85ce-71a7d9ef4eba\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0rtb7p"
Aug 05 17:40:27.005068 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:27.004871    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1772d50d-230c-4d82-a1ce-89d3798bd744-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lvqgs\" (UID: \"1772d50d-230c-4d82-a1ce-89d3798bd744\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lvqgs"
Aug 05 17:40:27.005068 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:27.004908    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq55n\" (UniqueName: \"kubernetes.io/projected/7bbbdaad-63c9-4769-85ce-71a7d9ef4eba-kube-api-access-dq55n\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0rtb7p\" (UID: \"7bbbdaad-63c9-4769-85ce-71a7d9ef4eba\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0rtb7p"
Aug 05 17:40:27.005068 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:27.004931    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1772d50d-230c-4d82-a1ce-89d3798bd744-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lvqgs\" (UID: \"1772d50d-230c-4d82-a1ce-89d3798bd744\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lvqgs"
Aug 05 17:40:27.005068 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:27.004969    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72ppl\" (UniqueName: \"kubernetes.io/projected/1772d50d-230c-4d82-a1ce-89d3798bd744-kube-api-access-72ppl\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lvqgs\" (UID: \"1772d50d-230c-4d82-a1ce-89d3798bd744\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lvqgs"
Aug 05 17:40:27.005582 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:27.005261    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1772d50d-230c-4d82-a1ce-89d3798bd744-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lvqgs\" (UID: \"1772d50d-230c-4d82-a1ce-89d3798bd744\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lvqgs"
Aug 05 17:40:27.005582 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:27.005295    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1772d50d-230c-4d82-a1ce-89d3798bd744-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lvqgs\" (UID: \"1772d50d-230c-4d82-a1ce-89d3798bd744\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lvqgs"
Aug 05 17:40:27.014518 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:27.014486    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72ppl\" (UniqueName: \"kubernetes.io/projected/1772d50d-230c-4d82-a1ce-89d3798bd744-kube-api-access-72ppl\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lvqgs\" (UID: \"1772d50d-230c-4d82-a1ce-89d3798bd744\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lvqgs"
Aug 05 17:40:27.068617 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:27.068579    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbsbpsp"
Aug 05 17:40:27.105451 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:27.105421    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bbbdaad-63c9-4769-85ce-71a7d9ef4eba-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0rtb7p\" (UID: \"7bbbdaad-63c9-4769-85ce-71a7d9ef4eba\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0rtb7p"
Aug 05 17:40:27.105639 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:27.105464    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bbbdaad-63c9-4769-85ce-71a7d9ef4eba-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0rtb7p\" (UID: \"7bbbdaad-63c9-4769-85ce-71a7d9ef4eba\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0rtb7p"
Aug 05 17:40:27.105639 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:27.105509    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq55n\" (UniqueName: \"kubernetes.io/projected/7bbbdaad-63c9-4769-85ce-71a7d9ef4eba-kube-api-access-dq55n\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0rtb7p\" (UID: \"7bbbdaad-63c9-4769-85ce-71a7d9ef4eba\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0rtb7p"
Aug 05 17:40:27.105934 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:27.105905    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bbbdaad-63c9-4769-85ce-71a7d9ef4eba-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0rtb7p\" (UID: \"7bbbdaad-63c9-4769-85ce-71a7d9ef4eba\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0rtb7p"
Aug 05 17:40:27.106011 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:27.105915    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bbbdaad-63c9-4769-85ce-71a7d9ef4eba-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0rtb7p\" (UID: \"7bbbdaad-63c9-4769-85ce-71a7d9ef4eba\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0rtb7p"
Aug 05 17:40:27.115448 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:27.115419    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c69rgk"]
Aug 05 17:40:27.116816 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:40:27.116788    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ee591bf_8b2c_4c05_9765_5769039f8671.slice/crio-8891c78f9bd3d36ab5b94b80fff88dabde310d911ea5f59a100e80553cf9a256 WatchSource:0}: Error finding container 8891c78f9bd3d36ab5b94b80fff88dabde310d911ea5f59a100e80553cf9a256: Status 404 returned error can't find the container with id 8891c78f9bd3d36ab5b94b80fff88dabde310d911ea5f59a100e80553cf9a256
Aug 05 17:40:27.117641 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:27.117613    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq55n\" (UniqueName: \"kubernetes.io/projected/7bbbdaad-63c9-4769-85ce-71a7d9ef4eba-kube-api-access-dq55n\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0rtb7p\" (UID: \"7bbbdaad-63c9-4769-85ce-71a7d9ef4eba\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0rtb7p"
Aug 05 17:40:27.165743 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:27.165493    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lvqgs"
Aug 05 17:40:27.257382 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:27.257350    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbsbpsp"]
Aug 05 17:40:27.259688 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:40:27.259653    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1b7a76f_c902_4a27_a03c_e8ec078584db.slice/crio-a883d1d68a48a994f35e37e2588af362577bef0d881bd96b910367531ffe0417 WatchSource:0}: Error finding container a883d1d68a48a994f35e37e2588af362577bef0d881bd96b910367531ffe0417: Status 404 returned error can't find the container with id a883d1d68a48a994f35e37e2588af362577bef0d881bd96b910367531ffe0417
Aug 05 17:40:27.263815 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:27.263793    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0rtb7p"
Aug 05 17:40:27.355461 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:27.355396    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lvqgs"]
Aug 05 17:40:27.356561 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:40:27.356468    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1772d50d_230c_4d82_a1ce_89d3798bd744.slice/crio-768ef1d713e6eb557addb843d5a074ba01f3abeb944e81889c5f57d674c329df WatchSource:0}: Error finding container 768ef1d713e6eb557addb843d5a074ba01f3abeb944e81889c5f57d674c329df: Status 404 returned error can't find the container with id 768ef1d713e6eb557addb843d5a074ba01f3abeb944e81889c5f57d674c329df
Aug 05 17:40:27.374994 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:27.374955    2558 generic.go:356] "Generic (PLEG): container finished" podID="7ee591bf-8b2c-4c05-9765-5769039f8671" containerID="d1fa7c3c8ec9cf21946ca8f1b5ca8763895ed4bf637673379837af482389ac0f" exitCode=0
Aug 05 17:40:27.375137 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:27.375066    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c69rgk" event={"ID":"7ee591bf-8b2c-4c05-9765-5769039f8671","Type":"ContainerDied","Data":"d1fa7c3c8ec9cf21946ca8f1b5ca8763895ed4bf637673379837af482389ac0f"}
Aug 05 17:40:27.375137 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:27.375118    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c69rgk" event={"ID":"7ee591bf-8b2c-4c05-9765-5769039f8671","Type":"ContainerStarted","Data":"8891c78f9bd3d36ab5b94b80fff88dabde310d911ea5f59a100e80553cf9a256"}
Aug 05 17:40:27.377268 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:27.377211    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lvqgs" event={"ID":"1772d50d-230c-4d82-a1ce-89d3798bd744","Type":"ContainerStarted","Data":"768ef1d713e6eb557addb843d5a074ba01f3abeb944e81889c5f57d674c329df"}
Aug 05 17:40:27.382807 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:27.382139    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbsbpsp" event={"ID":"c1b7a76f-c902-4a27-a03c-e8ec078584db","Type":"ContainerStarted","Data":"17e0e6e5aa6a8b184dbb8056d5b8749cbfbf9a3be03d58245235ab671612c309"}
Aug 05 17:40:27.382807 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:27.382198    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbsbpsp" event={"ID":"c1b7a76f-c902-4a27-a03c-e8ec078584db","Type":"ContainerStarted","Data":"a883d1d68a48a994f35e37e2588af362577bef0d881bd96b910367531ffe0417"}
Aug 05 17:40:27.457171 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:27.454433    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0rtb7p"]
Aug 05 17:40:27.463486 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:40:27.463445    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bbbdaad_63c9_4769_85ce_71a7d9ef4eba.slice/crio-094d712ecffe5e7194dc381b06901cb8ffc18ec49cccd87d2b9da0b11fa227cb WatchSource:0}: Error finding container 094d712ecffe5e7194dc381b06901cb8ffc18ec49cccd87d2b9da0b11fa227cb: Status 404 returned error can't find the container with id 094d712ecffe5e7194dc381b06901cb8ffc18ec49cccd87d2b9da0b11fa227cb
Aug 05 17:40:28.389433 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:28.389399    2558 generic.go:356] "Generic (PLEG): container finished" podID="c1b7a76f-c902-4a27-a03c-e8ec078584db" containerID="17e0e6e5aa6a8b184dbb8056d5b8749cbfbf9a3be03d58245235ab671612c309" exitCode=0
Aug 05 17:40:28.389859 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:28.389475    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbsbpsp" event={"ID":"c1b7a76f-c902-4a27-a03c-e8ec078584db","Type":"ContainerDied","Data":"17e0e6e5aa6a8b184dbb8056d5b8749cbfbf9a3be03d58245235ab671612c309"}
Aug 05 17:40:28.391170 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:28.391148    2558 generic.go:356] "Generic (PLEG): container finished" podID="7bbbdaad-63c9-4769-85ce-71a7d9ef4eba" containerID="d83351696fd1b8cfb477d6daea13508f95a458ed15d55a3798055d6df0aa07e4" exitCode=0
Aug 05 17:40:28.391261 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:28.391236    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0rtb7p" event={"ID":"7bbbdaad-63c9-4769-85ce-71a7d9ef4eba","Type":"ContainerDied","Data":"d83351696fd1b8cfb477d6daea13508f95a458ed15d55a3798055d6df0aa07e4"}
Aug 05 17:40:28.391325 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:28.391288    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0rtb7p" event={"ID":"7bbbdaad-63c9-4769-85ce-71a7d9ef4eba","Type":"ContainerStarted","Data":"094d712ecffe5e7194dc381b06901cb8ffc18ec49cccd87d2b9da0b11fa227cb"}
Aug 05 17:40:28.392971 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:28.392949    2558 generic.go:356] "Generic (PLEG): container finished" podID="1772d50d-230c-4d82-a1ce-89d3798bd744" containerID="ba3ff370933b79f2b91931bf6e19aeb6aa7dc0114d93c06e5b42349c36a859e3" exitCode=0
Aug 05 17:40:28.393045 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:28.392985    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lvqgs" event={"ID":"1772d50d-230c-4d82-a1ce-89d3798bd744","Type":"ContainerDied","Data":"ba3ff370933b79f2b91931bf6e19aeb6aa7dc0114d93c06e5b42349c36a859e3"}
Aug 05 17:40:29.399872 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:29.399836    2558 generic.go:356] "Generic (PLEG): container finished" podID="7ee591bf-8b2c-4c05-9765-5769039f8671" containerID="c965415eb334f8268885ed5cc98e7c3986e10b5717eff88187aa8e76a5f1b14e" exitCode=0
Aug 05 17:40:29.400308 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:29.399923    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c69rgk" event={"ID":"7ee591bf-8b2c-4c05-9765-5769039f8671","Type":"ContainerDied","Data":"c965415eb334f8268885ed5cc98e7c3986e10b5717eff88187aa8e76a5f1b14e"}
Aug 05 17:40:30.407144 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:30.407109    2558 generic.go:356] "Generic (PLEG): container finished" podID="7ee591bf-8b2c-4c05-9765-5769039f8671" containerID="f2a802bea325fc6b9fc32464896dd5ffd9d31b46ddd725200eb2c23b9adf9d2b" exitCode=0
Aug 05 17:40:30.407608 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:30.407198    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c69rgk" event={"ID":"7ee591bf-8b2c-4c05-9765-5769039f8671","Type":"ContainerDied","Data":"f2a802bea325fc6b9fc32464896dd5ffd9d31b46ddd725200eb2c23b9adf9d2b"}
Aug 05 17:40:30.408970 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:30.408947    2558 generic.go:356] "Generic (PLEG): container finished" podID="c1b7a76f-c902-4a27-a03c-e8ec078584db" containerID="32dd8406875a260c38579818f605939e75c0ea971febe428609c47f5417cf6c6" exitCode=0
Aug 05 17:40:30.409066 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:30.409032    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbsbpsp" event={"ID":"c1b7a76f-c902-4a27-a03c-e8ec078584db","Type":"ContainerDied","Data":"32dd8406875a260c38579818f605939e75c0ea971febe428609c47f5417cf6c6"}
Aug 05 17:40:31.416697 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:31.416666    2558 generic.go:356] "Generic (PLEG): container finished" podID="7bbbdaad-63c9-4769-85ce-71a7d9ef4eba" containerID="71e1f1faf7a48789310a52753e1280495ae913cda8c51bd2c9dffb96c66c8546" exitCode=0
Aug 05 17:40:31.417043 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:31.416724    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0rtb7p" event={"ID":"7bbbdaad-63c9-4769-85ce-71a7d9ef4eba","Type":"ContainerDied","Data":"71e1f1faf7a48789310a52753e1280495ae913cda8c51bd2c9dffb96c66c8546"}
Aug 05 17:40:31.420894 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:31.420871    2558 generic.go:356] "Generic (PLEG): container finished" podID="c1b7a76f-c902-4a27-a03c-e8ec078584db" containerID="366ece98c4061a5f42c7a36a553761ed774d70dc46d3fc9df2fbc8c0631a46ea" exitCode=0
Aug 05 17:40:31.420991 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:31.420955    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbsbpsp" event={"ID":"c1b7a76f-c902-4a27-a03c-e8ec078584db","Type":"ContainerDied","Data":"366ece98c4061a5f42c7a36a553761ed774d70dc46d3fc9df2fbc8c0631a46ea"}
Aug 05 17:40:31.570520 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:31.570495    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c69rgk"
Aug 05 17:40:31.642000 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:31.641974    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ee591bf-8b2c-4c05-9765-5769039f8671-bundle\") pod \"7ee591bf-8b2c-4c05-9765-5769039f8671\" (UID: \"7ee591bf-8b2c-4c05-9765-5769039f8671\") "
Aug 05 17:40:31.642079 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:31.642027    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5xzx\" (UniqueName: \"kubernetes.io/projected/7ee591bf-8b2c-4c05-9765-5769039f8671-kube-api-access-b5xzx\") pod \"7ee591bf-8b2c-4c05-9765-5769039f8671\" (UID: \"7ee591bf-8b2c-4c05-9765-5769039f8671\") "
Aug 05 17:40:31.642113 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:31.642076    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ee591bf-8b2c-4c05-9765-5769039f8671-util\") pod \"7ee591bf-8b2c-4c05-9765-5769039f8671\" (UID: \"7ee591bf-8b2c-4c05-9765-5769039f8671\") "
Aug 05 17:40:31.642649 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:31.642623    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ee591bf-8b2c-4c05-9765-5769039f8671-bundle" (OuterVolumeSpecName: "bundle") pod "7ee591bf-8b2c-4c05-9765-5769039f8671" (UID: "7ee591bf-8b2c-4c05-9765-5769039f8671"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:40:31.644063 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:31.644044    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ee591bf-8b2c-4c05-9765-5769039f8671-kube-api-access-b5xzx" (OuterVolumeSpecName: "kube-api-access-b5xzx") pod "7ee591bf-8b2c-4c05-9765-5769039f8671" (UID: "7ee591bf-8b2c-4c05-9765-5769039f8671"). InnerVolumeSpecName "kube-api-access-b5xzx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:40:31.647864 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:31.647836    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ee591bf-8b2c-4c05-9765-5769039f8671-util" (OuterVolumeSpecName: "util") pod "7ee591bf-8b2c-4c05-9765-5769039f8671" (UID: "7ee591bf-8b2c-4c05-9765-5769039f8671"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:40:31.743042 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:31.742993    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ee591bf-8b2c-4c05-9765-5769039f8671-bundle\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:40:31.743042 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:31.743035    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5xzx\" (UniqueName: \"kubernetes.io/projected/7ee591bf-8b2c-4c05-9765-5769039f8671-kube-api-access-b5xzx\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:40:31.743042 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:31.743050    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ee591bf-8b2c-4c05-9765-5769039f8671-util\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:40:32.428110 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:32.428073    2558 generic.go:356] "Generic (PLEG): container finished" podID="1772d50d-230c-4d82-a1ce-89d3798bd744" containerID="d6eb6a8a5ec2d930688cb5ff2c2eda56900e858d02733675d7c3540c4e0fb33e" exitCode=0
Aug 05 17:40:32.428602 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:32.428151    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lvqgs" event={"ID":"1772d50d-230c-4d82-a1ce-89d3798bd744","Type":"ContainerDied","Data":"d6eb6a8a5ec2d930688cb5ff2c2eda56900e858d02733675d7c3540c4e0fb33e"}
Aug 05 17:40:32.430594 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:32.430571    2558 generic.go:356] "Generic (PLEG): container finished" podID="7bbbdaad-63c9-4769-85ce-71a7d9ef4eba" containerID="744e32572d9dd9b3927388abc6cc10f4bfcb213d5004b6e2cdbfcbfbda9aac6b" exitCode=0
Aug 05 17:40:32.430699 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:32.430655    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0rtb7p" event={"ID":"7bbbdaad-63c9-4769-85ce-71a7d9ef4eba","Type":"ContainerDied","Data":"744e32572d9dd9b3927388abc6cc10f4bfcb213d5004b6e2cdbfcbfbda9aac6b"}
Aug 05 17:40:32.432556 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:32.432517    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c69rgk" event={"ID":"7ee591bf-8b2c-4c05-9765-5769039f8671","Type":"ContainerDied","Data":"8891c78f9bd3d36ab5b94b80fff88dabde310d911ea5f59a100e80553cf9a256"}
Aug 05 17:40:32.432648 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:32.432562    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8891c78f9bd3d36ab5b94b80fff88dabde310d911ea5f59a100e80553cf9a256"
Aug 05 17:40:32.432723 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:32.432701    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c69rgk"
Aug 05 17:40:32.578115 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:32.578080    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbsbpsp"
Aug 05 17:40:32.650887 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:32.650850    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1b7a76f-c902-4a27-a03c-e8ec078584db-util\") pod \"c1b7a76f-c902-4a27-a03c-e8ec078584db\" (UID: \"c1b7a76f-c902-4a27-a03c-e8ec078584db\") "
Aug 05 17:40:32.650887 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:32.650894    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g9ml8\" (UniqueName: \"kubernetes.io/projected/c1b7a76f-c902-4a27-a03c-e8ec078584db-kube-api-access-g9ml8\") pod \"c1b7a76f-c902-4a27-a03c-e8ec078584db\" (UID: \"c1b7a76f-c902-4a27-a03c-e8ec078584db\") "
Aug 05 17:40:32.651127 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:32.650949    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1b7a76f-c902-4a27-a03c-e8ec078584db-bundle\") pod \"c1b7a76f-c902-4a27-a03c-e8ec078584db\" (UID: \"c1b7a76f-c902-4a27-a03c-e8ec078584db\") "
Aug 05 17:40:32.651552 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:32.651517    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1b7a76f-c902-4a27-a03c-e8ec078584db-bundle" (OuterVolumeSpecName: "bundle") pod "c1b7a76f-c902-4a27-a03c-e8ec078584db" (UID: "c1b7a76f-c902-4a27-a03c-e8ec078584db"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:40:32.653408 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:32.653385    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1b7a76f-c902-4a27-a03c-e8ec078584db-kube-api-access-g9ml8" (OuterVolumeSpecName: "kube-api-access-g9ml8") pod "c1b7a76f-c902-4a27-a03c-e8ec078584db" (UID: "c1b7a76f-c902-4a27-a03c-e8ec078584db"). InnerVolumeSpecName "kube-api-access-g9ml8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:40:32.751875 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:32.751834    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1b7a76f-c902-4a27-a03c-e8ec078584db-bundle\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:40:32.751875 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:32.751865    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9ml8\" (UniqueName: \"kubernetes.io/projected/c1b7a76f-c902-4a27-a03c-e8ec078584db-kube-api-access-g9ml8\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:40:32.963048 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:32.962974    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1b7a76f-c902-4a27-a03c-e8ec078584db-util" (OuterVolumeSpecName: "util") pod "c1b7a76f-c902-4a27-a03c-e8ec078584db" (UID: "c1b7a76f-c902-4a27-a03c-e8ec078584db"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:40:33.053919 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:33.053865    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1b7a76f-c902-4a27-a03c-e8ec078584db-util\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:40:33.440133 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:33.440104    2558 generic.go:356] "Generic (PLEG): container finished" podID="1772d50d-230c-4d82-a1ce-89d3798bd744" containerID="82b7fd3badaacff57edf440eb6151808a705d4e78fb86fc51c39d6d58cb602a5" exitCode=0
Aug 05 17:40:33.440580 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:33.440192    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lvqgs" event={"ID":"1772d50d-230c-4d82-a1ce-89d3798bd744","Type":"ContainerDied","Data":"82b7fd3badaacff57edf440eb6151808a705d4e78fb86fc51c39d6d58cb602a5"}
Aug 05 17:40:33.442065 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:33.442043    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbsbpsp"
Aug 05 17:40:33.442169 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:33.442058    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbsbpsp" event={"ID":"c1b7a76f-c902-4a27-a03c-e8ec078584db","Type":"ContainerDied","Data":"a883d1d68a48a994f35e37e2588af362577bef0d881bd96b910367531ffe0417"}
Aug 05 17:40:33.442169 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:33.442099    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a883d1d68a48a994f35e37e2588af362577bef0d881bd96b910367531ffe0417"
Aug 05 17:40:33.581504 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:33.581476    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0rtb7p"
Aug 05 17:40:33.658573 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:33.658518    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bbbdaad-63c9-4769-85ce-71a7d9ef4eba-util\") pod \"7bbbdaad-63c9-4769-85ce-71a7d9ef4eba\" (UID: \"7bbbdaad-63c9-4769-85ce-71a7d9ef4eba\") "
Aug 05 17:40:33.658767 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:33.658627    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bbbdaad-63c9-4769-85ce-71a7d9ef4eba-bundle\") pod \"7bbbdaad-63c9-4769-85ce-71a7d9ef4eba\" (UID: \"7bbbdaad-63c9-4769-85ce-71a7d9ef4eba\") "
Aug 05 17:40:33.658767 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:33.658669    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dq55n\" (UniqueName: \"kubernetes.io/projected/7bbbdaad-63c9-4769-85ce-71a7d9ef4eba-kube-api-access-dq55n\") pod \"7bbbdaad-63c9-4769-85ce-71a7d9ef4eba\" (UID: \"7bbbdaad-63c9-4769-85ce-71a7d9ef4eba\") "
Aug 05 17:40:33.659072 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:33.659039    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bbbdaad-63c9-4769-85ce-71a7d9ef4eba-bundle" (OuterVolumeSpecName: "bundle") pod "7bbbdaad-63c9-4769-85ce-71a7d9ef4eba" (UID: "7bbbdaad-63c9-4769-85ce-71a7d9ef4eba"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:40:33.661074 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:33.661038    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bbbdaad-63c9-4769-85ce-71a7d9ef4eba-kube-api-access-dq55n" (OuterVolumeSpecName: "kube-api-access-dq55n") pod "7bbbdaad-63c9-4769-85ce-71a7d9ef4eba" (UID: "7bbbdaad-63c9-4769-85ce-71a7d9ef4eba"). InnerVolumeSpecName "kube-api-access-dq55n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:40:33.663057 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:33.663028    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bbbdaad-63c9-4769-85ce-71a7d9ef4eba-util" (OuterVolumeSpecName: "util") pod "7bbbdaad-63c9-4769-85ce-71a7d9ef4eba" (UID: "7bbbdaad-63c9-4769-85ce-71a7d9ef4eba"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:40:33.759499 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:33.759409    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7bbbdaad-63c9-4769-85ce-71a7d9ef4eba-bundle\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:40:33.759499 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:33.759439    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dq55n\" (UniqueName: \"kubernetes.io/projected/7bbbdaad-63c9-4769-85ce-71a7d9ef4eba-kube-api-access-dq55n\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:40:33.759499 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:33.759449    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7bbbdaad-63c9-4769-85ce-71a7d9ef4eba-util\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:40:34.451804 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:34.451772    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0rtb7p"
Aug 05 17:40:34.451804 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:34.451798    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0rtb7p" event={"ID":"7bbbdaad-63c9-4769-85ce-71a7d9ef4eba","Type":"ContainerDied","Data":"094d712ecffe5e7194dc381b06901cb8ffc18ec49cccd87d2b9da0b11fa227cb"}
Aug 05 17:40:34.452257 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:34.451857    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="094d712ecffe5e7194dc381b06901cb8ffc18ec49cccd87d2b9da0b11fa227cb"
Aug 05 17:40:34.588798 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:34.588767    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lvqgs"
Aug 05 17:40:34.667722 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:34.667686    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1772d50d-230c-4d82-a1ce-89d3798bd744-util\") pod \"1772d50d-230c-4d82-a1ce-89d3798bd744\" (UID: \"1772d50d-230c-4d82-a1ce-89d3798bd744\") "
Aug 05 17:40:34.667722 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:34.667723    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1772d50d-230c-4d82-a1ce-89d3798bd744-bundle\") pod \"1772d50d-230c-4d82-a1ce-89d3798bd744\" (UID: \"1772d50d-230c-4d82-a1ce-89d3798bd744\") "
Aug 05 17:40:34.667976 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:34.667743    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72ppl\" (UniqueName: \"kubernetes.io/projected/1772d50d-230c-4d82-a1ce-89d3798bd744-kube-api-access-72ppl\") pod \"1772d50d-230c-4d82-a1ce-89d3798bd744\" (UID: \"1772d50d-230c-4d82-a1ce-89d3798bd744\") "
Aug 05 17:40:34.668505 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:34.668476    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1772d50d-230c-4d82-a1ce-89d3798bd744-bundle" (OuterVolumeSpecName: "bundle") pod "1772d50d-230c-4d82-a1ce-89d3798bd744" (UID: "1772d50d-230c-4d82-a1ce-89d3798bd744"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:40:34.670009 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:34.669979    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1772d50d-230c-4d82-a1ce-89d3798bd744-kube-api-access-72ppl" (OuterVolumeSpecName: "kube-api-access-72ppl") pod "1772d50d-230c-4d82-a1ce-89d3798bd744" (UID: "1772d50d-230c-4d82-a1ce-89d3798bd744"). InnerVolumeSpecName "kube-api-access-72ppl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:40:34.672693 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:34.672664    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1772d50d-230c-4d82-a1ce-89d3798bd744-util" (OuterVolumeSpecName: "util") pod "1772d50d-230c-4d82-a1ce-89d3798bd744" (UID: "1772d50d-230c-4d82-a1ce-89d3798bd744"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:40:34.769100 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:34.769060    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1772d50d-230c-4d82-a1ce-89d3798bd744-util\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:40:34.769100 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:34.769096    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1772d50d-230c-4d82-a1ce-89d3798bd744-bundle\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:40:34.769347 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:34.769111    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72ppl\" (UniqueName: \"kubernetes.io/projected/1772d50d-230c-4d82-a1ce-89d3798bd744-kube-api-access-72ppl\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:40:35.460019 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:35.459989    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lvqgs"
Aug 05 17:40:35.460412 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:35.460016    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lvqgs" event={"ID":"1772d50d-230c-4d82-a1ce-89d3798bd744","Type":"ContainerDied","Data":"768ef1d713e6eb557addb843d5a074ba01f3abeb944e81889c5f57d674c329df"}
Aug 05 17:40:35.460412 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:35.460076    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="768ef1d713e6eb557addb843d5a074ba01f3abeb944e81889c5f57d674c329df"
Aug 05 17:40:44.004130 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:44.004083    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-76c6h"]
Aug 05 17:40:44.004623 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:44.004477    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1b7a76f-c902-4a27-a03c-e8ec078584db" containerName="util"
Aug 05 17:40:44.004623 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:44.004494    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1b7a76f-c902-4a27-a03c-e8ec078584db" containerName="util"
Aug 05 17:40:44.004623 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:44.004504    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bbbdaad-63c9-4769-85ce-71a7d9ef4eba" containerName="util"
Aug 05 17:40:44.004623 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:44.004509    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bbbdaad-63c9-4769-85ce-71a7d9ef4eba" containerName="util"
Aug 05 17:40:44.004623 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:44.004515    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bbbdaad-63c9-4769-85ce-71a7d9ef4eba" containerName="pull"
Aug 05 17:40:44.004623 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:44.004520    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bbbdaad-63c9-4769-85ce-71a7d9ef4eba" containerName="pull"
Aug 05 17:40:44.004623 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:44.004531    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1b7a76f-c902-4a27-a03c-e8ec078584db" containerName="pull"
Aug 05 17:40:44.004623 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:44.004536    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1b7a76f-c902-4a27-a03c-e8ec078584db" containerName="pull"
Aug 05 17:40:44.004623 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:44.004543    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1b7a76f-c902-4a27-a03c-e8ec078584db" containerName="extract"
Aug 05 17:40:44.004623 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:44.004549    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1b7a76f-c902-4a27-a03c-e8ec078584db" containerName="extract"
Aug 05 17:40:44.004623 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:44.004559    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ee591bf-8b2c-4c05-9765-5769039f8671" containerName="extract"
Aug 05 17:40:44.004623 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:44.004567    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ee591bf-8b2c-4c05-9765-5769039f8671" containerName="extract"
Aug 05 17:40:44.004623 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:44.004575    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1772d50d-230c-4d82-a1ce-89d3798bd744" containerName="pull"
Aug 05 17:40:44.004623 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:44.004581    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1772d50d-230c-4d82-a1ce-89d3798bd744" containerName="pull"
Aug 05 17:40:44.004623 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:44.004591    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bbbdaad-63c9-4769-85ce-71a7d9ef4eba" containerName="extract"
Aug 05 17:40:44.004623 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:44.004596    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bbbdaad-63c9-4769-85ce-71a7d9ef4eba" containerName="extract"
Aug 05 17:40:44.004623 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:44.004603    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1772d50d-230c-4d82-a1ce-89d3798bd744" containerName="extract"
Aug 05 17:40:44.004623 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:44.004608    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1772d50d-230c-4d82-a1ce-89d3798bd744" containerName="extract"
Aug 05 17:40:44.004623 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:44.004615    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ee591bf-8b2c-4c05-9765-5769039f8671" containerName="util"
Aug 05 17:40:44.004623 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:44.004620    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ee591bf-8b2c-4c05-9765-5769039f8671" containerName="util"
Aug 05 17:40:44.004623 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:44.004625    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ee591bf-8b2c-4c05-9765-5769039f8671" containerName="pull"
Aug 05 17:40:44.004623 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:44.004630    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ee591bf-8b2c-4c05-9765-5769039f8671" containerName="pull"
Aug 05 17:40:44.004623 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:44.004636    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1772d50d-230c-4d82-a1ce-89d3798bd744" containerName="util"
Aug 05 17:40:44.005300 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:44.004644    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1772d50d-230c-4d82-a1ce-89d3798bd744" containerName="util"
Aug 05 17:40:44.005300 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:44.004700    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ee591bf-8b2c-4c05-9765-5769039f8671" containerName="extract"
Aug 05 17:40:44.005300 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:44.004711    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1b7a76f-c902-4a27-a03c-e8ec078584db" containerName="extract"
Aug 05 17:40:44.005300 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:44.004717    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1772d50d-230c-4d82-a1ce-89d3798bd744" containerName="extract"
Aug 05 17:40:44.005300 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:44.004726    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bbbdaad-63c9-4769-85ce-71a7d9ef4eba" containerName="extract"
Aug 05 17:40:44.009197 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:44.009177    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-76c6h"
Aug 05 17:40:44.012421 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:44.012402    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Aug 05 17:40:44.013095 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:44.013074    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-5wrjv\""
Aug 05 17:40:44.013168 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:44.013121    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Aug 05 17:40:44.020803 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:44.020769    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-76c6h"]
Aug 05 17:40:44.052722 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:44.052677    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4qdb\" (UniqueName: \"kubernetes.io/projected/e4c51705-69ca-4bdf-8ea1-ac673019c877-kube-api-access-d4qdb\") pod \"authorino-operator-68d88948d8-76c6h\" (UID: \"e4c51705-69ca-4bdf-8ea1-ac673019c877\") " pod="kuadrant-system/authorino-operator-68d88948d8-76c6h"
Aug 05 17:40:44.153905 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:44.153864    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4qdb\" (UniqueName: \"kubernetes.io/projected/e4c51705-69ca-4bdf-8ea1-ac673019c877-kube-api-access-d4qdb\") pod \"authorino-operator-68d88948d8-76c6h\" (UID: \"e4c51705-69ca-4bdf-8ea1-ac673019c877\") " pod="kuadrant-system/authorino-operator-68d88948d8-76c6h"
Aug 05 17:40:44.163305 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:44.163270    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4qdb\" (UniqueName: \"kubernetes.io/projected/e4c51705-69ca-4bdf-8ea1-ac673019c877-kube-api-access-d4qdb\") pod \"authorino-operator-68d88948d8-76c6h\" (UID: \"e4c51705-69ca-4bdf-8ea1-ac673019c877\") " pod="kuadrant-system/authorino-operator-68d88948d8-76c6h"
Aug 05 17:40:44.319763 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:44.319677    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-76c6h"
Aug 05 17:40:44.467058 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:44.467025    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-76c6h"]
Aug 05 17:40:44.470343 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:40:44.470309    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4c51705_69ca_4bdf_8ea1_ac673019c877.slice/crio-61157cadc051f34f90fedf427ae1a8144808a0dbfa2148ab6069b04fb5329c75 WatchSource:0}: Error finding container 61157cadc051f34f90fedf427ae1a8144808a0dbfa2148ab6069b04fb5329c75: Status 404 returned error can't find the container with id 61157cadc051f34f90fedf427ae1a8144808a0dbfa2148ab6069b04fb5329c75
Aug 05 17:40:44.507599 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:44.507563    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-76c6h" event={"ID":"e4c51705-69ca-4bdf-8ea1-ac673019c877","Type":"ContainerStarted","Data":"61157cadc051f34f90fedf427ae1a8144808a0dbfa2148ab6069b04fb5329c75"}
Aug 05 17:40:46.257007 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:46.256973    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jwjdq"]
Aug 05 17:40:46.266008 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:46.265977    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jwjdq"
Aug 05 17:40:46.269212 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:46.269180    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-ttj9w\""
Aug 05 17:40:46.280683 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:46.280625    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jwjdq"]
Aug 05 17:40:46.375746 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:46.375706    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptn62\" (UniqueName: \"kubernetes.io/projected/5b8b30ab-6c2d-48d9-be12-77196b3ccc27-kube-api-access-ptn62\") pod \"limitador-operator-controller-manager-6c549b6d85-jwjdq\" (UID: \"5b8b30ab-6c2d-48d9-be12-77196b3ccc27\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jwjdq"
Aug 05 17:40:46.476758 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:46.476717    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptn62\" (UniqueName: \"kubernetes.io/projected/5b8b30ab-6c2d-48d9-be12-77196b3ccc27-kube-api-access-ptn62\") pod \"limitador-operator-controller-manager-6c549b6d85-jwjdq\" (UID: \"5b8b30ab-6c2d-48d9-be12-77196b3ccc27\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jwjdq"
Aug 05 17:40:46.494558 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:46.494522    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptn62\" (UniqueName: \"kubernetes.io/projected/5b8b30ab-6c2d-48d9-be12-77196b3ccc27-kube-api-access-ptn62\") pod \"limitador-operator-controller-manager-6c549b6d85-jwjdq\" (UID: \"5b8b30ab-6c2d-48d9-be12-77196b3ccc27\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jwjdq"
Aug 05 17:40:46.580214 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:46.580128    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jwjdq"
Aug 05 17:40:47.095941 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:47.095912    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jwjdq"]
Aug 05 17:40:47.096592 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:40:47.096563    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b8b30ab_6c2d_48d9_be12_77196b3ccc27.slice/crio-e15e91f6e66513f5c86bdc50373f821d03c24bbeb915b1a6d534c577c261d8f7 WatchSource:0}: Error finding container e15e91f6e66513f5c86bdc50373f821d03c24bbeb915b1a6d534c577c261d8f7: Status 404 returned error can't find the container with id e15e91f6e66513f5c86bdc50373f821d03c24bbeb915b1a6d534c577c261d8f7
Aug 05 17:40:47.526632 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:47.526592    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jwjdq" event={"ID":"5b8b30ab-6c2d-48d9-be12-77196b3ccc27","Type":"ContainerStarted","Data":"e15e91f6e66513f5c86bdc50373f821d03c24bbeb915b1a6d534c577c261d8f7"}
Aug 05 17:40:47.528271 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:47.528244    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-76c6h" event={"ID":"e4c51705-69ca-4bdf-8ea1-ac673019c877","Type":"ContainerStarted","Data":"f9d8ebbcceff90df20d526515eceb3b789b2e60bb77f175a7802fb7fa6c041c4"}
Aug 05 17:40:47.528388 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:47.528319    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-76c6h"
Aug 05 17:40:47.550755 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:47.550703    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-76c6h" podStartSLOduration=2.005266293 podStartE2EDuration="4.55068628s" totalImagesPullingTime="2.545419987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:40:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:40:47.547561028 +0000 UTC m=+473.860412391" watchObservedRunningTime="2026-08-05 17:40:47.55068628 +0000 UTC m=+473.863537642"
Aug 05 17:40:49.540076 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:49.540043    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jwjdq" event={"ID":"5b8b30ab-6c2d-48d9-be12-77196b3ccc27","Type":"ContainerStarted","Data":"55bc66f489492eb46539df6120afffe7252b40142c6a90baa30d74a991616605"}
Aug 05 17:40:49.540478 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:49.540159    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jwjdq"
Aug 05 17:40:49.563566 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:49.563510    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jwjdq" podStartSLOduration=1.328798374 podStartE2EDuration="3.563494733s" totalImagesPullingTime="2.234696359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:40:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:40:49.560994866 +0000 UTC m=+475.873846229" watchObservedRunningTime="2026-08-05 17:40:49.563494733 +0000 UTC m=+475.876346096"
Aug 05 17:40:50.546598 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:50.546568    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-gldq8"]
Aug 05 17:40:50.549995 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:50.549977    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-gldq8"
Aug 05 17:40:50.552907 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:50.552887    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hfkjp\""
Aug 05 17:40:50.563741 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:50.563714    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-gldq8"]
Aug 05 17:40:50.616696 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:50.616661    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbjlx\" (UniqueName: \"kubernetes.io/projected/d8f751f4-464f-4c98-b15f-2b6d7ad511f7-kube-api-access-cbjlx\") pod \"kuadrant-operator-controller-manager-58fc56757c-gldq8\" (UID: \"d8f751f4-464f-4c98-b15f-2b6d7ad511f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-gldq8"
Aug 05 17:40:50.616881 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:50.616741    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d8f751f4-464f-4c98-b15f-2b6d7ad511f7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-gldq8\" (UID: \"d8f751f4-464f-4c98-b15f-2b6d7ad511f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-gldq8"
Aug 05 17:40:50.718318 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:50.718266    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d8f751f4-464f-4c98-b15f-2b6d7ad511f7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-gldq8\" (UID: \"d8f751f4-464f-4c98-b15f-2b6d7ad511f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-gldq8"
Aug 05 17:40:50.718504 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:50.718340    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbjlx\" (UniqueName: \"kubernetes.io/projected/d8f751f4-464f-4c98-b15f-2b6d7ad511f7-kube-api-access-cbjlx\") pod \"kuadrant-operator-controller-manager-58fc56757c-gldq8\" (UID: \"d8f751f4-464f-4c98-b15f-2b6d7ad511f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-gldq8"
Aug 05 17:40:50.718682 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:50.718659    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d8f751f4-464f-4c98-b15f-2b6d7ad511f7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-gldq8\" (UID: \"d8f751f4-464f-4c98-b15f-2b6d7ad511f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-gldq8"
Aug 05 17:40:50.731750 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:50.731726    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbjlx\" (UniqueName: \"kubernetes.io/projected/d8f751f4-464f-4c98-b15f-2b6d7ad511f7-kube-api-access-cbjlx\") pod \"kuadrant-operator-controller-manager-58fc56757c-gldq8\" (UID: \"d8f751f4-464f-4c98-b15f-2b6d7ad511f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-gldq8"
Aug 05 17:40:50.860000 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:50.859905    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-gldq8"
Aug 05 17:40:51.008599 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:51.008566    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-gldq8"]
Aug 05 17:40:51.009462 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:40:51.009437    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8f751f4_464f_4c98_b15f_2b6d7ad511f7.slice/crio-71d97d1464e0e408dc739b390682a69cca764eca21d250a10a093a7beb7bd6cd WatchSource:0}: Error finding container 71d97d1464e0e408dc739b390682a69cca764eca21d250a10a093a7beb7bd6cd: Status 404 returned error can't find the container with id 71d97d1464e0e408dc739b390682a69cca764eca21d250a10a093a7beb7bd6cd
Aug 05 17:40:51.551981 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:51.551944    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-gldq8" event={"ID":"d8f751f4-464f-4c98-b15f-2b6d7ad511f7","Type":"ContainerStarted","Data":"71d97d1464e0e408dc739b390682a69cca764eca21d250a10a093a7beb7bd6cd"}
Aug 05 17:40:58.535351 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:58.535321    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-76c6h"
Aug 05 17:40:58.598006 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:58.597912    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-gldq8" event={"ID":"d8f751f4-464f-4c98-b15f-2b6d7ad511f7","Type":"ContainerStarted","Data":"2a305e8c5c9d25435f355d81df269059b336ce3611d6544b3ce2dcee4d76e8e2"}
Aug 05 17:40:58.598144 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:58.598022    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-gldq8"
Aug 05 17:40:58.623722 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:40:58.623669    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-gldq8" podStartSLOduration=1.304467808 podStartE2EDuration="8.623652565s" totalImagesPullingTime="7.319184757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:40:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:40:58.621483235 +0000 UTC m=+484.934334597" watchObservedRunningTime="2026-08-05 17:40:58.623652565 +0000 UTC m=+484.936503927"
Aug 05 17:41:00.547463 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:00.547432    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jwjdq"
Aug 05 17:41:01.218505 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:01.218461    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-j2z9l"]
Aug 05 17:41:01.223512 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:01.223488    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-j2z9l"
Aug 05 17:41:01.226396 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:01.226358    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Aug 05 17:41:01.226524 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:01.226509    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Aug 05 17:41:01.226574 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:01.226512    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vfp92\""
Aug 05 17:41:01.233872 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:01.233849    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-j2z9l"]
Aug 05 17:41:01.313057 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:01.313022    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f8b745e5-e2da-4453-bbdc-6fe0304abbab-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-j2z9l\" (UID: \"f8b745e5-e2da-4453-bbdc-6fe0304abbab\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-j2z9l"
Aug 05 17:41:01.313278 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:01.313067    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psdtj\" (UniqueName: \"kubernetes.io/projected/f8b745e5-e2da-4453-bbdc-6fe0304abbab-kube-api-access-psdtj\") pod \"kuadrant-console-plugin-598f86468b-j2z9l\" (UID: \"f8b745e5-e2da-4453-bbdc-6fe0304abbab\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-j2z9l"
Aug 05 17:41:01.313278 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:01.313162    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f8b745e5-e2da-4453-bbdc-6fe0304abbab-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-j2z9l\" (UID: \"f8b745e5-e2da-4453-bbdc-6fe0304abbab\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-j2z9l"
Aug 05 17:41:01.414119 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:01.414084    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f8b745e5-e2da-4453-bbdc-6fe0304abbab-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-j2z9l\" (UID: \"f8b745e5-e2da-4453-bbdc-6fe0304abbab\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-j2z9l"
Aug 05 17:41:01.414306 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:01.414134    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f8b745e5-e2da-4453-bbdc-6fe0304abbab-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-j2z9l\" (UID: \"f8b745e5-e2da-4453-bbdc-6fe0304abbab\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-j2z9l"
Aug 05 17:41:01.414306 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:01.414263    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psdtj\" (UniqueName: \"kubernetes.io/projected/f8b745e5-e2da-4453-bbdc-6fe0304abbab-kube-api-access-psdtj\") pod \"kuadrant-console-plugin-598f86468b-j2z9l\" (UID: \"f8b745e5-e2da-4453-bbdc-6fe0304abbab\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-j2z9l"
Aug 05 17:41:01.414877 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:01.414860    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f8b745e5-e2da-4453-bbdc-6fe0304abbab-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-j2z9l\" (UID: \"f8b745e5-e2da-4453-bbdc-6fe0304abbab\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-j2z9l"
Aug 05 17:41:01.416784 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:01.416752    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f8b745e5-e2da-4453-bbdc-6fe0304abbab-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-j2z9l\" (UID: \"f8b745e5-e2da-4453-bbdc-6fe0304abbab\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-j2z9l"
Aug 05 17:41:01.423614 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:01.423593    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psdtj\" (UniqueName: \"kubernetes.io/projected/f8b745e5-e2da-4453-bbdc-6fe0304abbab-kube-api-access-psdtj\") pod \"kuadrant-console-plugin-598f86468b-j2z9l\" (UID: \"f8b745e5-e2da-4453-bbdc-6fe0304abbab\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-j2z9l"
Aug 05 17:41:01.534057 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:01.533959    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-j2z9l"
Aug 05 17:41:01.679833 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:01.679807    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-j2z9l"]
Aug 05 17:41:01.681431 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:41:01.681401    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf8b745e5_e2da_4453_bbdc_6fe0304abbab.slice/crio-86eddee821f92813a49e4fde8273be9d5bd68c2a6b462a9289d8ba20f607cf25 WatchSource:0}: Error finding container 86eddee821f92813a49e4fde8273be9d5bd68c2a6b462a9289d8ba20f607cf25: Status 404 returned error can't find the container with id 86eddee821f92813a49e4fde8273be9d5bd68c2a6b462a9289d8ba20f607cf25
Aug 05 17:41:02.626524 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:02.626445    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-j2z9l" event={"ID":"f8b745e5-e2da-4453-bbdc-6fe0304abbab","Type":"ContainerStarted","Data":"86eddee821f92813a49e4fde8273be9d5bd68c2a6b462a9289d8ba20f607cf25"}
Aug 05 17:41:06.652286 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:06.652254    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-j2z9l" event={"ID":"f8b745e5-e2da-4453-bbdc-6fe0304abbab","Type":"ContainerStarted","Data":"1912c23207534342e37780129c1ecf051c5be819362a6c35366498222f998c56"}
Aug 05 17:41:06.672295 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:06.672242    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-j2z9l" podStartSLOduration=0.928472694 podStartE2EDuration="5.672211697s" totalImagesPullingTime="4.743739003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:41:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:41:06.669865601 +0000 UTC m=+492.982716965" watchObservedRunningTime="2026-08-05 17:41:06.672211697 +0000 UTC m=+492.985063084"
Aug 05 17:41:09.606678 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:09.606646    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-gldq8"
Aug 05 17:41:11.266971 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.266932    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-gldq8"]
Aug 05 17:41:11.267450 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.267191    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-gldq8" podUID="d8f751f4-464f-4c98-b15f-2b6d7ad511f7" containerName="manager" containerID="cri-o://2a305e8c5c9d25435f355d81df269059b336ce3611d6544b3ce2dcee4d76e8e2" gracePeriod=2
Aug 05 17:41:11.273080 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.273053    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-gldq8"]
Aug 05 17:41:11.295933 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.295895    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2vvjw"]
Aug 05 17:41:11.296551 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.296529    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8f751f4-464f-4c98-b15f-2b6d7ad511f7" containerName="manager"
Aug 05 17:41:11.296599 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.296557    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8f751f4-464f-4c98-b15f-2b6d7ad511f7" containerName="manager"
Aug 05 17:41:11.296679 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.296667    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8f751f4-464f-4c98-b15f-2b6d7ad511f7" containerName="manager"
Aug 05 17:41:11.300047 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.300025    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2vvjw"
Aug 05 17:41:11.302605 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:41:11.302579    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-gldq8\" is forbidden: User \"system:node:ip-10-0-129-136.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-136.ec2.internal' and this object" podUID="d8f751f4-464f-4c98-b15f-2b6d7ad511f7" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-gldq8"
Aug 05 17:41:11.305023 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.304994    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed3878d7-4743-474e-b31f-45753709f463-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-2vvjw\" (UID: \"ed3878d7-4743-474e-b31f-45753709f463\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2vvjw"
Aug 05 17:41:11.305132 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.305064    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b25b\" (UniqueName: \"kubernetes.io/projected/ed3878d7-4743-474e-b31f-45753709f463-kube-api-access-4b25b\") pod \"kuadrant-operator-controller-manager-58fc56757c-2vvjw\" (UID: \"ed3878d7-4743-474e-b31f-45753709f463\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2vvjw"
Aug 05 17:41:11.317697 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.317662    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2vvjw"]
Aug 05 17:41:11.331627 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.331598    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jwjdq"]
Aug 05 17:41:11.331801 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.331781    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jwjdq" podUID="5b8b30ab-6c2d-48d9-be12-77196b3ccc27" containerName="manager" containerID="cri-o://55bc66f489492eb46539df6120afffe7252b40142c6a90baa30d74a991616605" gracePeriod=2
Aug 05 17:41:11.342940 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.342912    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jwjdq"]
Aug 05 17:41:11.346288 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:41:11.346251    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-gldq8\" is forbidden: User \"system:node:ip-10-0-129-136.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-136.ec2.internal' and this object" podUID="d8f751f4-464f-4c98-b15f-2b6d7ad511f7" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-gldq8"
Aug 05 17:41:11.348491 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:41:11.348465    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-jwjdq\" is forbidden: User \"system:node:ip-10-0-129-136.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-136.ec2.internal' and this object" podUID="5b8b30ab-6c2d-48d9-be12-77196b3ccc27" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jwjdq"
Aug 05 17:41:11.360573 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.360549    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-txv6b"]
Aug 05 17:41:11.360903 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.360892    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b8b30ab-6c2d-48d9-be12-77196b3ccc27" containerName="manager"
Aug 05 17:41:11.360951 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.360905    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b8b30ab-6c2d-48d9-be12-77196b3ccc27" containerName="manager"
Aug 05 17:41:11.360985 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.360977    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b8b30ab-6c2d-48d9-be12-77196b3ccc27" containerName="manager"
Aug 05 17:41:11.364062 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.364043    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-txv6b"
Aug 05 17:41:11.366735 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:41:11.366709    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-gldq8\" is forbidden: User \"system:node:ip-10-0-129-136.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-136.ec2.internal' and this object" podUID="d8f751f4-464f-4c98-b15f-2b6d7ad511f7" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-gldq8"
Aug 05 17:41:11.378979 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.378950    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-txv6b"]
Aug 05 17:41:11.394432 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:41:11.394384    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-jwjdq\" is forbidden: User \"system:node:ip-10-0-129-136.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-136.ec2.internal' and this object" podUID="5b8b30ab-6c2d-48d9-be12-77196b3ccc27" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jwjdq"
Aug 05 17:41:11.406042 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.406012    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd25s\" (UniqueName: \"kubernetes.io/projected/ced5df6b-25c4-4fcb-8f2b-1ac65335989c-kube-api-access-sd25s\") pod \"limitador-operator-controller-manager-6c549b6d85-txv6b\" (UID: \"ced5df6b-25c4-4fcb-8f2b-1ac65335989c\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-txv6b"
Aug 05 17:41:11.406197 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.406070    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed3878d7-4743-474e-b31f-45753709f463-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-2vvjw\" (UID: \"ed3878d7-4743-474e-b31f-45753709f463\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2vvjw"
Aug 05 17:41:11.406301 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.406282    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b25b\" (UniqueName: \"kubernetes.io/projected/ed3878d7-4743-474e-b31f-45753709f463-kube-api-access-4b25b\") pod \"kuadrant-operator-controller-manager-58fc56757c-2vvjw\" (UID: \"ed3878d7-4743-474e-b31f-45753709f463\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2vvjw"
Aug 05 17:41:11.406473 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.406454    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed3878d7-4743-474e-b31f-45753709f463-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-2vvjw\" (UID: \"ed3878d7-4743-474e-b31f-45753709f463\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2vvjw"
Aug 05 17:41:11.415480 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.415459    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b25b\" (UniqueName: \"kubernetes.io/projected/ed3878d7-4743-474e-b31f-45753709f463-kube-api-access-4b25b\") pod \"kuadrant-operator-controller-manager-58fc56757c-2vvjw\" (UID: \"ed3878d7-4743-474e-b31f-45753709f463\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2vvjw"
Aug 05 17:41:11.507001 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.506969    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd25s\" (UniqueName: \"kubernetes.io/projected/ced5df6b-25c4-4fcb-8f2b-1ac65335989c-kube-api-access-sd25s\") pod \"limitador-operator-controller-manager-6c549b6d85-txv6b\" (UID: \"ced5df6b-25c4-4fcb-8f2b-1ac65335989c\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-txv6b"
Aug 05 17:41:11.517958 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.517775    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd25s\" (UniqueName: \"kubernetes.io/projected/ced5df6b-25c4-4fcb-8f2b-1ac65335989c-kube-api-access-sd25s\") pod \"limitador-operator-controller-manager-6c549b6d85-txv6b\" (UID: \"ced5df6b-25c4-4fcb-8f2b-1ac65335989c\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-txv6b"
Aug 05 17:41:11.565014 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.564995    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-gldq8"
Aug 05 17:41:11.567566 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:41:11.567535    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-gldq8\" is forbidden: User \"system:node:ip-10-0-129-136.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-136.ec2.internal' and this object" podUID="d8f751f4-464f-4c98-b15f-2b6d7ad511f7" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-gldq8"
Aug 05 17:41:11.569614 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:41:11.569580    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-jwjdq\" is forbidden: User \"system:node:ip-10-0-129-136.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-136.ec2.internal' and this object" podUID="5b8b30ab-6c2d-48d9-be12-77196b3ccc27" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jwjdq"
Aug 05 17:41:11.570818 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.570803    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jwjdq"
Aug 05 17:41:11.572892 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:41:11.572872    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-gldq8\" is forbidden: User \"system:node:ip-10-0-129-136.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-136.ec2.internal' and this object" podUID="d8f751f4-464f-4c98-b15f-2b6d7ad511f7" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-gldq8"
Aug 05 17:41:11.574936 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:41:11.574915    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-jwjdq\" is forbidden: User \"system:node:ip-10-0-129-136.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-136.ec2.internal' and this object" podUID="5b8b30ab-6c2d-48d9-be12-77196b3ccc27" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jwjdq"
Aug 05 17:41:11.607472 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.607442    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d8f751f4-464f-4c98-b15f-2b6d7ad511f7-extensions-socket-volume\") pod \"d8f751f4-464f-4c98-b15f-2b6d7ad511f7\" (UID: \"d8f751f4-464f-4c98-b15f-2b6d7ad511f7\") "
Aug 05 17:41:11.607552 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.607498    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptn62\" (UniqueName: \"kubernetes.io/projected/5b8b30ab-6c2d-48d9-be12-77196b3ccc27-kube-api-access-ptn62\") pod \"5b8b30ab-6c2d-48d9-be12-77196b3ccc27\" (UID: \"5b8b30ab-6c2d-48d9-be12-77196b3ccc27\") "
Aug 05 17:41:11.607552 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.607519    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbjlx\" (UniqueName: \"kubernetes.io/projected/d8f751f4-464f-4c98-b15f-2b6d7ad511f7-kube-api-access-cbjlx\") pod \"d8f751f4-464f-4c98-b15f-2b6d7ad511f7\" (UID: \"d8f751f4-464f-4c98-b15f-2b6d7ad511f7\") "
Aug 05 17:41:11.608007 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.607985    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8f751f4-464f-4c98-b15f-2b6d7ad511f7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d8f751f4-464f-4c98-b15f-2b6d7ad511f7" (UID: "d8f751f4-464f-4c98-b15f-2b6d7ad511f7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:41:11.609879 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.609859    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b8b30ab-6c2d-48d9-be12-77196b3ccc27-kube-api-access-ptn62" (OuterVolumeSpecName: "kube-api-access-ptn62") pod "5b8b30ab-6c2d-48d9-be12-77196b3ccc27" (UID: "5b8b30ab-6c2d-48d9-be12-77196b3ccc27"). InnerVolumeSpecName "kube-api-access-ptn62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:41:11.609952 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.609894    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8f751f4-464f-4c98-b15f-2b6d7ad511f7-kube-api-access-cbjlx" (OuterVolumeSpecName: "kube-api-access-cbjlx") pod "d8f751f4-464f-4c98-b15f-2b6d7ad511f7" (UID: "d8f751f4-464f-4c98-b15f-2b6d7ad511f7"). InnerVolumeSpecName "kube-api-access-cbjlx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:41:11.641535 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.641509    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2vvjw"
Aug 05 17:41:11.680539 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.680508    2558 generic.go:356] "Generic (PLEG): container finished" podID="5b8b30ab-6c2d-48d9-be12-77196b3ccc27" containerID="55bc66f489492eb46539df6120afffe7252b40142c6a90baa30d74a991616605" exitCode=0
Aug 05 17:41:11.680699 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.680556    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jwjdq"
Aug 05 17:41:11.680699 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.680606    2558 scope.go:117] "RemoveContainer" containerID="55bc66f489492eb46539df6120afffe7252b40142c6a90baa30d74a991616605"
Aug 05 17:41:11.682345 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.682264    2558 generic.go:356] "Generic (PLEG): container finished" podID="d8f751f4-464f-4c98-b15f-2b6d7ad511f7" containerID="2a305e8c5c9d25435f355d81df269059b336ce3611d6544b3ce2dcee4d76e8e2" exitCode=0
Aug 05 17:41:11.682480 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.682384    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-gldq8"
Aug 05 17:41:11.684937 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:41:11.684788    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-jwjdq\" is forbidden: User \"system:node:ip-10-0-129-136.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-136.ec2.internal' and this object" podUID="5b8b30ab-6c2d-48d9-be12-77196b3ccc27" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jwjdq"
Aug 05 17:41:11.687148 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:41:11.687125    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-gldq8\" is forbidden: User \"system:node:ip-10-0-129-136.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-136.ec2.internal' and this object" podUID="d8f751f4-464f-4c98-b15f-2b6d7ad511f7" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-gldq8"
Aug 05 17:41:11.691717 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.691701    2558 scope.go:117] "RemoveContainer" containerID="55bc66f489492eb46539df6120afffe7252b40142c6a90baa30d74a991616605"
Aug 05 17:41:11.692027 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:41:11.692006    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55bc66f489492eb46539df6120afffe7252b40142c6a90baa30d74a991616605\": container with ID starting with 55bc66f489492eb46539df6120afffe7252b40142c6a90baa30d74a991616605 not found: ID does not exist" containerID="55bc66f489492eb46539df6120afffe7252b40142c6a90baa30d74a991616605"
Aug 05 17:41:11.692148 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.692032    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55bc66f489492eb46539df6120afffe7252b40142c6a90baa30d74a991616605"} err="failed to get container status \"55bc66f489492eb46539df6120afffe7252b40142c6a90baa30d74a991616605\": rpc error: code = NotFound desc = could not find container \"55bc66f489492eb46539df6120afffe7252b40142c6a90baa30d74a991616605\": container with ID starting with 55bc66f489492eb46539df6120afffe7252b40142c6a90baa30d74a991616605 not found: ID does not exist"
Aug 05 17:41:11.692148 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.692049    2558 scope.go:117] "RemoveContainer" containerID="2a305e8c5c9d25435f355d81df269059b336ce3611d6544b3ce2dcee4d76e8e2"
Aug 05 17:41:11.697642 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:41:11.697442    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-gldq8\" is forbidden: User \"system:node:ip-10-0-129-136.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-136.ec2.internal' and this object" podUID="d8f751f4-464f-4c98-b15f-2b6d7ad511f7" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-gldq8"
Aug 05 17:41:11.700924 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:41:11.700878    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-jwjdq\" is forbidden: User \"system:node:ip-10-0-129-136.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-136.ec2.internal' and this object" podUID="5b8b30ab-6c2d-48d9-be12-77196b3ccc27" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jwjdq"
Aug 05 17:41:11.704491 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:41:11.703882    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-gldq8\" is forbidden: User \"system:node:ip-10-0-129-136.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-136.ec2.internal' and this object" podUID="d8f751f4-464f-4c98-b15f-2b6d7ad511f7" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-gldq8"
Aug 05 17:41:11.704491 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.704211    2558 scope.go:117] "RemoveContainer" containerID="2a305e8c5c9d25435f355d81df269059b336ce3611d6544b3ce2dcee4d76e8e2"
Aug 05 17:41:11.704749 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:41:11.704723    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a305e8c5c9d25435f355d81df269059b336ce3611d6544b3ce2dcee4d76e8e2\": container with ID starting with 2a305e8c5c9d25435f355d81df269059b336ce3611d6544b3ce2dcee4d76e8e2 not found: ID does not exist" containerID="2a305e8c5c9d25435f355d81df269059b336ce3611d6544b3ce2dcee4d76e8e2"
Aug 05 17:41:11.704809 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.704761    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a305e8c5c9d25435f355d81df269059b336ce3611d6544b3ce2dcee4d76e8e2"} err="failed to get container status \"2a305e8c5c9d25435f355d81df269059b336ce3611d6544b3ce2dcee4d76e8e2\": rpc error: code = NotFound desc = could not find container \"2a305e8c5c9d25435f355d81df269059b336ce3611d6544b3ce2dcee4d76e8e2\": container with ID starting with 2a305e8c5c9d25435f355d81df269059b336ce3611d6544b3ce2dcee4d76e8e2 not found: ID does not exist"
Aug 05 17:41:11.706119 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:41:11.706096    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-jwjdq\" is forbidden: User \"system:node:ip-10-0-129-136.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-136.ec2.internal' and this object" podUID="5b8b30ab-6c2d-48d9-be12-77196b3ccc27" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jwjdq"
Aug 05 17:41:11.708605 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.708584    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d8f751f4-464f-4c98-b15f-2b6d7ad511f7-extensions-socket-volume\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:41:11.708605 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.708613    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptn62\" (UniqueName: \"kubernetes.io/projected/5b8b30ab-6c2d-48d9-be12-77196b3ccc27-kube-api-access-ptn62\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:41:11.708758 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.708628    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbjlx\" (UniqueName: \"kubernetes.io/projected/d8f751f4-464f-4c98-b15f-2b6d7ad511f7-kube-api-access-cbjlx\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:41:11.729111 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.729085    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-txv6b"
Aug 05 17:41:11.808165 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.806175    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2vvjw"]
Aug 05 17:41:11.884017 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:11.883988    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-txv6b"]
Aug 05 17:41:11.888737 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:41:11.888707    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podced5df6b_25c4_4fcb_8f2b_1ac65335989c.slice/crio-699eba6296e649c2e6aec05e187c3e6a91f4db4bb3be7cbfde2a5ab00286332f WatchSource:0}: Error finding container 699eba6296e649c2e6aec05e187c3e6a91f4db4bb3be7cbfde2a5ab00286332f: Status 404 returned error can't find the container with id 699eba6296e649c2e6aec05e187c3e6a91f4db4bb3be7cbfde2a5ab00286332f
Aug 05 17:41:12.255418 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:12.255385    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b8b30ab-6c2d-48d9-be12-77196b3ccc27" path="/var/lib/kubelet/pods/5b8b30ab-6c2d-48d9-be12-77196b3ccc27/volumes"
Aug 05 17:41:12.255754 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:12.255741    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8f751f4-464f-4c98-b15f-2b6d7ad511f7" path="/var/lib/kubelet/pods/d8f751f4-464f-4c98-b15f-2b6d7ad511f7/volumes"
Aug 05 17:41:12.689360 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:12.689314    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2vvjw" event={"ID":"ed3878d7-4743-474e-b31f-45753709f463","Type":"ContainerStarted","Data":"0e223aca26310fa3b0b76ec6f87b76965d104b869e66825ed0f2ae6f605723fa"}
Aug 05 17:41:12.689800 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:12.689374    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2vvjw" event={"ID":"ed3878d7-4743-474e-b31f-45753709f463","Type":"ContainerStarted","Data":"8d21dbd4249518ea866ff5dcc9f7938f57881c915374f25b7404275e41869b1a"}
Aug 05 17:41:12.689800 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:12.689486    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2vvjw"
Aug 05 17:41:12.692738 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:12.692714    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-txv6b" event={"ID":"ced5df6b-25c4-4fcb-8f2b-1ac65335989c","Type":"ContainerStarted","Data":"03b4048e0c18a742bf920f51eedb00554c80449b3565956ba90cbec8a9f5b27e"}
Aug 05 17:41:12.692872 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:12.692757    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-txv6b" event={"ID":"ced5df6b-25c4-4fcb-8f2b-1ac65335989c","Type":"ContainerStarted","Data":"699eba6296e649c2e6aec05e187c3e6a91f4db4bb3be7cbfde2a5ab00286332f"}
Aug 05 17:41:12.692872 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:12.692784    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-txv6b"
Aug 05 17:41:12.725723 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:12.725652    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2vvjw" podStartSLOduration=1.7256370300000001 podStartE2EDuration="1.72563703s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:41:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:41:12.723723879 +0000 UTC m=+499.036575241" watchObservedRunningTime="2026-08-05 17:41:12.72563703 +0000 UTC m=+499.038488394"
Aug 05 17:41:12.744797 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:12.744745    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-txv6b" podStartSLOduration=1.744728053 podStartE2EDuration="1.744728053s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:41:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:41:12.743781809 +0000 UTC m=+499.056633173" watchObservedRunningTime="2026-08-05 17:41:12.744728053 +0000 UTC m=+499.057579416"
Aug 05 17:41:23.700671 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:23.700633    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-txv6b"
Aug 05 17:41:23.701244 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:23.701040    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2vvjw"
Aug 05 17:41:26.527844 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:26.527806    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2vvjw"]
Aug 05 17:41:26.528397 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:26.528026    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2vvjw" podUID="ed3878d7-4743-474e-b31f-45753709f463" containerName="manager" containerID="cri-o://0e223aca26310fa3b0b76ec6f87b76965d104b869e66825ed0f2ae6f605723fa" gracePeriod=10
Aug 05 17:41:26.770021 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:26.769991    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2vvjw"
Aug 05 17:41:26.770374 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:26.770352    2558 generic.go:356] "Generic (PLEG): container finished" podID="ed3878d7-4743-474e-b31f-45753709f463" containerID="0e223aca26310fa3b0b76ec6f87b76965d104b869e66825ed0f2ae6f605723fa" exitCode=0
Aug 05 17:41:26.770460 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:26.770432    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2vvjw" event={"ID":"ed3878d7-4743-474e-b31f-45753709f463","Type":"ContainerDied","Data":"0e223aca26310fa3b0b76ec6f87b76965d104b869e66825ed0f2ae6f605723fa"}
Aug 05 17:41:26.770510 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:26.770486    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2vvjw" event={"ID":"ed3878d7-4743-474e-b31f-45753709f463","Type":"ContainerDied","Data":"8d21dbd4249518ea866ff5dcc9f7938f57881c915374f25b7404275e41869b1a"}
Aug 05 17:41:26.770544 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:26.770509    2558 scope.go:117] "RemoveContainer" containerID="0e223aca26310fa3b0b76ec6f87b76965d104b869e66825ed0f2ae6f605723fa"
Aug 05 17:41:26.779330 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:26.779313    2558 scope.go:117] "RemoveContainer" containerID="0e223aca26310fa3b0b76ec6f87b76965d104b869e66825ed0f2ae6f605723fa"
Aug 05 17:41:26.779591 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:41:26.779570    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e223aca26310fa3b0b76ec6f87b76965d104b869e66825ed0f2ae6f605723fa\": container with ID starting with 0e223aca26310fa3b0b76ec6f87b76965d104b869e66825ed0f2ae6f605723fa not found: ID does not exist" containerID="0e223aca26310fa3b0b76ec6f87b76965d104b869e66825ed0f2ae6f605723fa"
Aug 05 17:41:26.779651 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:26.779600    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e223aca26310fa3b0b76ec6f87b76965d104b869e66825ed0f2ae6f605723fa"} err="failed to get container status \"0e223aca26310fa3b0b76ec6f87b76965d104b869e66825ed0f2ae6f605723fa\": rpc error: code = NotFound desc = could not find container \"0e223aca26310fa3b0b76ec6f87b76965d104b869e66825ed0f2ae6f605723fa\": container with ID starting with 0e223aca26310fa3b0b76ec6f87b76965d104b869e66825ed0f2ae6f605723fa not found: ID does not exist"
Aug 05 17:41:26.829475 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:26.829444    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed3878d7-4743-474e-b31f-45753709f463-extensions-socket-volume\") pod \"ed3878d7-4743-474e-b31f-45753709f463\" (UID: \"ed3878d7-4743-474e-b31f-45753709f463\") "
Aug 05 17:41:26.829634 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:26.829542    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4b25b\" (UniqueName: \"kubernetes.io/projected/ed3878d7-4743-474e-b31f-45753709f463-kube-api-access-4b25b\") pod \"ed3878d7-4743-474e-b31f-45753709f463\" (UID: \"ed3878d7-4743-474e-b31f-45753709f463\") "
Aug 05 17:41:26.829844 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:26.829819    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed3878d7-4743-474e-b31f-45753709f463-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ed3878d7-4743-474e-b31f-45753709f463" (UID: "ed3878d7-4743-474e-b31f-45753709f463"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:41:26.831708 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:26.831685    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed3878d7-4743-474e-b31f-45753709f463-kube-api-access-4b25b" (OuterVolumeSpecName: "kube-api-access-4b25b") pod "ed3878d7-4743-474e-b31f-45753709f463" (UID: "ed3878d7-4743-474e-b31f-45753709f463"). InnerVolumeSpecName "kube-api-access-4b25b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:41:26.930373 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:26.930334    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4b25b\" (UniqueName: \"kubernetes.io/projected/ed3878d7-4743-474e-b31f-45753709f463-kube-api-access-4b25b\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:41:26.930373 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:26.930367    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed3878d7-4743-474e-b31f-45753709f463-extensions-socket-volume\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:41:27.777233 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:27.777194    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2vvjw"
Aug 05 17:41:27.800121 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:27.800090    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2vvjw"]
Aug 05 17:41:27.807946 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:27.807918    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2vvjw"]
Aug 05 17:41:28.258382 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:28.256167    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed3878d7-4743-474e-b31f-45753709f463" path="/var/lib/kubelet/pods/ed3878d7-4743-474e-b31f-45753709f463/volumes"
Aug 05 17:41:43.281171 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:43.281137    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh"]
Aug 05 17:41:43.281550 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:43.281511    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed3878d7-4743-474e-b31f-45753709f463" containerName="manager"
Aug 05 17:41:43.281550 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:43.281522    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed3878d7-4743-474e-b31f-45753709f463" containerName="manager"
Aug 05 17:41:43.281639 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:43.281600    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed3878d7-4743-474e-b31f-45753709f463" containerName="manager"
Aug 05 17:41:43.302742 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:43.302709    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh"]
Aug 05 17:41:43.302923 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:43.302835    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh"
Aug 05 17:41:43.305524 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:43.305503    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-qplx9\""
Aug 05 17:41:43.379455 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:43.379421    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-kfjgh\" (UID: \"7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh"
Aug 05 17:41:43.379660 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:43.379495    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtjwg\" (UniqueName: \"kubernetes.io/projected/7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce-kube-api-access-dtjwg\") pod \"maas-default-gateway-openshift-default-5ccb968c66-kfjgh\" (UID: \"7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh"
Aug 05 17:41:43.379660 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:43.379529    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-kfjgh\" (UID: \"7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh"
Aug 05 17:41:43.379660 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:43.379562    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-kfjgh\" (UID: \"7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh"
Aug 05 17:41:43.379660 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:43.379588    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-kfjgh\" (UID: \"7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh"
Aug 05 17:41:43.379660 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:43.379617    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-kfjgh\" (UID: \"7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh"
Aug 05 17:41:43.379879 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:43.379686    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-kfjgh\" (UID: \"7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh"
Aug 05 17:41:43.379879 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:43.379714    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-kfjgh\" (UID: \"7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh"
Aug 05 17:41:43.379879 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:43.379768    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-kfjgh\" (UID: \"7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh"
Aug 05 17:41:43.480780 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:43.480752    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-kfjgh\" (UID: \"7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh"
Aug 05 17:41:43.480780 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:43.480786    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-kfjgh\" (UID: \"7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh"
Aug 05 17:41:43.481004 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:43.480804    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-kfjgh\" (UID: \"7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh"
Aug 05 17:41:43.481004 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:43.480834    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-kfjgh\" (UID: \"7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh"
Aug 05 17:41:43.481004 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:43.480893    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtjwg\" (UniqueName: \"kubernetes.io/projected/7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce-kube-api-access-dtjwg\") pod \"maas-default-gateway-openshift-default-5ccb968c66-kfjgh\" (UID: \"7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh"
Aug 05 17:41:43.481004 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:43.480921    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-kfjgh\" (UID: \"7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh"
Aug 05 17:41:43.481004 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:43.480950    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-kfjgh\" (UID: \"7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh"
Aug 05 17:41:43.481004 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:43.480973    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-kfjgh\" (UID: \"7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh"
Aug 05 17:41:43.481004 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:43.481003    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-kfjgh\" (UID: \"7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh"
Aug 05 17:41:43.481368 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:43.481192    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-kfjgh\" (UID: \"7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh"
Aug 05 17:41:43.481441 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:43.481412    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-kfjgh\" (UID: \"7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh"
Aug 05 17:41:43.481638 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:43.481612    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-kfjgh\" (UID: \"7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh"
Aug 05 17:41:43.481754 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:43.481643    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-kfjgh\" (UID: \"7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh"
Aug 05 17:41:43.481754 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:43.481726    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-kfjgh\" (UID: \"7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh"
Aug 05 17:41:43.483426 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:43.483407    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-kfjgh\" (UID: \"7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh"
Aug 05 17:41:43.483622 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:43.483604    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-kfjgh\" (UID: \"7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh"
Aug 05 17:41:43.493354 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:43.493320    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtjwg\" (UniqueName: \"kubernetes.io/projected/7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce-kube-api-access-dtjwg\") pod \"maas-default-gateway-openshift-default-5ccb968c66-kfjgh\" (UID: \"7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh"
Aug 05 17:41:43.493354 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:43.493349    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-kfjgh\" (UID: \"7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh"
Aug 05 17:41:43.613627 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:43.613534    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh"
Aug 05 17:41:43.760788 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:43.760763    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh"]
Aug 05 17:41:43.762413 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:41:43.762379    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e4f2053_c2dc_4f1e_9769_9046ce9bb3ce.slice/crio-fa1784d955878e2aeef7ce86e60e2f7dcc1ac44c736009468ac463baeace69a7 WatchSource:0}: Error finding container fa1784d955878e2aeef7ce86e60e2f7dcc1ac44c736009468ac463baeace69a7: Status 404 returned error can't find the container with id fa1784d955878e2aeef7ce86e60e2f7dcc1ac44c736009468ac463baeace69a7
Aug 05 17:41:43.764462 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:43.764435    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 05 17:41:43.764524 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:43.764512    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 05 17:41:43.764571 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:43.764542    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 05 17:41:43.865146 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:43.865048    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh" event={"ID":"7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce","Type":"ContainerStarted","Data":"9e9528bd41bf136cd9dd323ed8fa95987152b929974309d948386be4f8893954"}
Aug 05 17:41:43.865146 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:43.865107    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh" event={"ID":"7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce","Type":"ContainerStarted","Data":"fa1784d955878e2aeef7ce86e60e2f7dcc1ac44c736009468ac463baeace69a7"}
Aug 05 17:41:43.889002 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:43.888952    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh" podStartSLOduration=0.888937409 podStartE2EDuration="888.937409ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:41:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:41:43.886062782 +0000 UTC m=+530.198914155" watchObservedRunningTime="2026-08-05 17:41:43.888937409 +0000 UTC m=+530.201788773"
Aug 05 17:41:44.613921 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:44.613881    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh"
Aug 05 17:41:44.615488 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:44.615452    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-kfjgh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Aug 05 17:41:44.615613 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:44.615505    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh" podUID="7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Aug 05 17:41:44.859546 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:44.859511    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-rvknm"]
Aug 05 17:41:44.862941 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:44.862924    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-rvknm"
Aug 05 17:41:44.865552 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:44.865507    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Aug 05 17:41:44.872439 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:44.872411    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-rvknm"]
Aug 05 17:41:44.952081 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:44.952035    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-rvknm"]
Aug 05 17:41:44.996134 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:44.996095    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht7cl\" (UniqueName: \"kubernetes.io/projected/b35273e4-3fd9-460d-9f66-3d29cc65df5e-kube-api-access-ht7cl\") pod \"limitador-limitador-859c4d96d6-rvknm\" (UID: \"b35273e4-3fd9-460d-9f66-3d29cc65df5e\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-rvknm"
Aug 05 17:41:44.996329 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:44.996158    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b35273e4-3fd9-460d-9f66-3d29cc65df5e-config-file\") pod \"limitador-limitador-859c4d96d6-rvknm\" (UID: \"b35273e4-3fd9-460d-9f66-3d29cc65df5e\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-rvknm"
Aug 05 17:41:45.097146 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:45.097106    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b35273e4-3fd9-460d-9f66-3d29cc65df5e-config-file\") pod \"limitador-limitador-859c4d96d6-rvknm\" (UID: \"b35273e4-3fd9-460d-9f66-3d29cc65df5e\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-rvknm"
Aug 05 17:41:45.097327 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:45.097205    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht7cl\" (UniqueName: \"kubernetes.io/projected/b35273e4-3fd9-460d-9f66-3d29cc65df5e-kube-api-access-ht7cl\") pod \"limitador-limitador-859c4d96d6-rvknm\" (UID: \"b35273e4-3fd9-460d-9f66-3d29cc65df5e\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-rvknm"
Aug 05 17:41:45.097746 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:45.097726    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b35273e4-3fd9-460d-9f66-3d29cc65df5e-config-file\") pod \"limitador-limitador-859c4d96d6-rvknm\" (UID: \"b35273e4-3fd9-460d-9f66-3d29cc65df5e\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-rvknm"
Aug 05 17:41:45.106684 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:45.106654    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht7cl\" (UniqueName: \"kubernetes.io/projected/b35273e4-3fd9-460d-9f66-3d29cc65df5e-kube-api-access-ht7cl\") pod \"limitador-limitador-859c4d96d6-rvknm\" (UID: \"b35273e4-3fd9-460d-9f66-3d29cc65df5e\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-rvknm"
Aug 05 17:41:45.174727 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:45.174700    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-rvknm"
Aug 05 17:41:45.317752 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:45.317723    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-rvknm"]
Aug 05 17:41:45.319678 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:41:45.319645    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb35273e4_3fd9_460d_9f66_3d29cc65df5e.slice/crio-4abd72d28f61aa63833ac4f532c38ed0da146d5223cf6a9533e9534aa070a493 WatchSource:0}: Error finding container 4abd72d28f61aa63833ac4f532c38ed0da146d5223cf6a9533e9534aa070a493: Status 404 returned error can't find the container with id 4abd72d28f61aa63833ac4f532c38ed0da146d5223cf6a9533e9534aa070a493
Aug 05 17:41:45.618564 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:45.618492    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh"
Aug 05 17:41:45.836182 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:45.836150    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c548b5d7d-2whlk"]
Aug 05 17:41:45.841114 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:45.841092    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-2whlk"
Aug 05 17:41:45.844082 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:45.844050    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-99fvc\""
Aug 05 17:41:45.846835 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:45.846817    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-2whlk"]
Aug 05 17:41:45.878875 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:45.878797    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-rvknm" event={"ID":"b35273e4-3fd9-460d-9f66-3d29cc65df5e","Type":"ContainerStarted","Data":"4abd72d28f61aa63833ac4f532c38ed0da146d5223cf6a9533e9534aa070a493"}
Aug 05 17:41:45.879138 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:45.879111    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh"
Aug 05 17:41:45.880079 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:45.880063    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh"
Aug 05 17:41:45.904775 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:45.904710    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn7ck\" (UniqueName: \"kubernetes.io/projected/ef44d943-b2ed-455c-a489-4326993c07c4-kube-api-access-kn7ck\") pod \"authorino-c548b5d7d-2whlk\" (UID: \"ef44d943-b2ed-455c-a489-4326993c07c4\") " pod="kuadrant-system/authorino-c548b5d7d-2whlk"
Aug 05 17:41:46.005781 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:46.005740    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn7ck\" (UniqueName: \"kubernetes.io/projected/ef44d943-b2ed-455c-a489-4326993c07c4-kube-api-access-kn7ck\") pod \"authorino-c548b5d7d-2whlk\" (UID: \"ef44d943-b2ed-455c-a489-4326993c07c4\") " pod="kuadrant-system/authorino-c548b5d7d-2whlk"
Aug 05 17:41:46.015362 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:46.015337    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn7ck\" (UniqueName: \"kubernetes.io/projected/ef44d943-b2ed-455c-a489-4326993c07c4-kube-api-access-kn7ck\") pod \"authorino-c548b5d7d-2whlk\" (UID: \"ef44d943-b2ed-455c-a489-4326993c07c4\") " pod="kuadrant-system/authorino-c548b5d7d-2whlk"
Aug 05 17:41:46.152603 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:46.152510    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-2whlk"
Aug 05 17:41:46.294215 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:46.294192    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-2whlk"]
Aug 05 17:41:46.299727 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:41:46.299686    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef44d943_b2ed_455c_a489_4326993c07c4.slice/crio-b63dbcd77733637224914efa1a716c4767b58484938435aa22708abddebc0b8e WatchSource:0}: Error finding container b63dbcd77733637224914efa1a716c4767b58484938435aa22708abddebc0b8e: Status 404 returned error can't find the container with id b63dbcd77733637224914efa1a716c4767b58484938435aa22708abddebc0b8e
Aug 05 17:41:46.886754 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:46.886716    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-2whlk" event={"ID":"ef44d943-b2ed-455c-a489-4326993c07c4","Type":"ContainerStarted","Data":"b63dbcd77733637224914efa1a716c4767b58484938435aa22708abddebc0b8e"}
Aug 05 17:41:47.899529 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:47.899432    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-rvknm" event={"ID":"b35273e4-3fd9-460d-9f66-3d29cc65df5e","Type":"ContainerStarted","Data":"1c508ed1ec172f9897f06cc14b7e9f2b619c44a1072ff5036d16f27e196d2c21"}
Aug 05 17:41:47.899972 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:47.899661    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-rvknm"
Aug 05 17:41:47.919596 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:47.919530    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-859c4d96d6-rvknm" podStartSLOduration=1.756519816 podStartE2EDuration="3.919509201s" totalImagesPullingTime="2.162989385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:41:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:41:47.917761646 +0000 UTC m=+534.230613010" watchObservedRunningTime="2026-08-05 17:41:47.919509201 +0000 UTC m=+534.232360564"
Aug 05 17:41:50.918096 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:50.918062    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-2whlk" event={"ID":"ef44d943-b2ed-455c-a489-4326993c07c4","Type":"ContainerStarted","Data":"245c94cf5ebc77224e678312cc90005212adb114c4b82e9e8037bf5cc637e45e"}
Aug 05 17:41:50.934811 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:50.934756    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c548b5d7d-2whlk" podStartSLOduration=1.804795913 podStartE2EDuration="5.934739128s" totalImagesPullingTime="4.129943215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:41:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:41:50.933013931 +0000 UTC m=+537.245865294" watchObservedRunningTime="2026-08-05 17:41:50.934739128 +0000 UTC m=+537.247590491"
Aug 05 17:41:58.906144 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:41:58.906113    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-rvknm"
Aug 05 17:42:00.197771 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:00.197735    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-rvknm"]
Aug 05 17:42:00.198170 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:00.197913    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-859c4d96d6-rvknm" podUID="b35273e4-3fd9-460d-9f66-3d29cc65df5e" containerName="limitador" containerID="cri-o://1c508ed1ec172f9897f06cc14b7e9f2b619c44a1072ff5036d16f27e196d2c21" gracePeriod=30
Aug 05 17:42:00.974279 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:00.974248    2558 generic.go:356] "Generic (PLEG): container finished" podID="b35273e4-3fd9-460d-9f66-3d29cc65df5e" containerID="1c508ed1ec172f9897f06cc14b7e9f2b619c44a1072ff5036d16f27e196d2c21" exitCode=0
Aug 05 17:42:00.974464 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:00.974315    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-rvknm" event={"ID":"b35273e4-3fd9-460d-9f66-3d29cc65df5e","Type":"ContainerDied","Data":"1c508ed1ec172f9897f06cc14b7e9f2b619c44a1072ff5036d16f27e196d2c21"}
Aug 05 17:42:01.152325 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:01.152299    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-rvknm"
Aug 05 17:42:01.244052 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:01.243950    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b35273e4-3fd9-460d-9f66-3d29cc65df5e-config-file\") pod \"b35273e4-3fd9-460d-9f66-3d29cc65df5e\" (UID: \"b35273e4-3fd9-460d-9f66-3d29cc65df5e\") "
Aug 05 17:42:01.244480 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:01.244062    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ht7cl\" (UniqueName: \"kubernetes.io/projected/b35273e4-3fd9-460d-9f66-3d29cc65df5e-kube-api-access-ht7cl\") pod \"b35273e4-3fd9-460d-9f66-3d29cc65df5e\" (UID: \"b35273e4-3fd9-460d-9f66-3d29cc65df5e\") "
Aug 05 17:42:01.244480 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:01.244381    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b35273e4-3fd9-460d-9f66-3d29cc65df5e-config-file" (OuterVolumeSpecName: "config-file") pod "b35273e4-3fd9-460d-9f66-3d29cc65df5e" (UID: "b35273e4-3fd9-460d-9f66-3d29cc65df5e"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:42:01.246340 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:01.246310    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b35273e4-3fd9-460d-9f66-3d29cc65df5e-kube-api-access-ht7cl" (OuterVolumeSpecName: "kube-api-access-ht7cl") pod "b35273e4-3fd9-460d-9f66-3d29cc65df5e" (UID: "b35273e4-3fd9-460d-9f66-3d29cc65df5e"). InnerVolumeSpecName "kube-api-access-ht7cl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:42:01.345283 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:01.345202    2558 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b35273e4-3fd9-460d-9f66-3d29cc65df5e-config-file\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:42:01.345283 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:01.345278    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ht7cl\" (UniqueName: \"kubernetes.io/projected/b35273e4-3fd9-460d-9f66-3d29cc65df5e-kube-api-access-ht7cl\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:42:01.980540 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:01.980513    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-rvknm"
Aug 05 17:42:01.980540 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:01.980533    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-rvknm" event={"ID":"b35273e4-3fd9-460d-9f66-3d29cc65df5e","Type":"ContainerDied","Data":"4abd72d28f61aa63833ac4f532c38ed0da146d5223cf6a9533e9534aa070a493"}
Aug 05 17:42:01.980769 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:01.980588    2558 scope.go:117] "RemoveContainer" containerID="1c508ed1ec172f9897f06cc14b7e9f2b619c44a1072ff5036d16f27e196d2c21"
Aug 05 17:42:02.002863 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:02.002826    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-rvknm"]
Aug 05 17:42:02.016076 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:02.013363    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-rvknm"]
Aug 05 17:42:02.254428 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:02.254325    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b35273e4-3fd9-460d-9f66-3d29cc65df5e" path="/var/lib/kubelet/pods/b35273e4-3fd9-460d-9f66-3d29cc65df5e/volumes"
Aug 05 17:42:06.444996 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:06.444965    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-cq6kp"]
Aug 05 17:42:06.445427 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:06.445350    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b35273e4-3fd9-460d-9f66-3d29cc65df5e" containerName="limitador"
Aug 05 17:42:06.445427 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:06.445362    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b35273e4-3fd9-460d-9f66-3d29cc65df5e" containerName="limitador"
Aug 05 17:42:06.445510 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:06.445433    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b35273e4-3fd9-460d-9f66-3d29cc65df5e" containerName="limitador"
Aug 05 17:42:06.449776 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:06.449757    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cq6kp"
Aug 05 17:42:06.452687 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:06.452660    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 05 17:42:06.452823 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:06.452695    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-gw9nq\""
Aug 05 17:42:06.452823 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:06.452662    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Aug 05 17:42:06.454032 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:06.454011    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Aug 05 17:42:06.457561 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:06.457538    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-cq6kp"]
Aug 05 17:42:06.489289 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:06.489249    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/fe514b61-fcfc-47a1-a77b-1a6bf1985b62-data\") pod \"postgres-69fb4594cf-cq6kp\" (UID: \"fe514b61-fcfc-47a1-a77b-1a6bf1985b62\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cq6kp"
Aug 05 17:42:06.489611 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:06.489317    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-222nl\" (UniqueName: \"kubernetes.io/projected/fe514b61-fcfc-47a1-a77b-1a6bf1985b62-kube-api-access-222nl\") pod \"postgres-69fb4594cf-cq6kp\" (UID: \"fe514b61-fcfc-47a1-a77b-1a6bf1985b62\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cq6kp"
Aug 05 17:42:06.590376 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:06.590346    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-222nl\" (UniqueName: \"kubernetes.io/projected/fe514b61-fcfc-47a1-a77b-1a6bf1985b62-kube-api-access-222nl\") pod \"postgres-69fb4594cf-cq6kp\" (UID: \"fe514b61-fcfc-47a1-a77b-1a6bf1985b62\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cq6kp"
Aug 05 17:42:06.590542 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:06.590413    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/fe514b61-fcfc-47a1-a77b-1a6bf1985b62-data\") pod \"postgres-69fb4594cf-cq6kp\" (UID: \"fe514b61-fcfc-47a1-a77b-1a6bf1985b62\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cq6kp"
Aug 05 17:42:06.590721 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:06.590705    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/fe514b61-fcfc-47a1-a77b-1a6bf1985b62-data\") pod \"postgres-69fb4594cf-cq6kp\" (UID: \"fe514b61-fcfc-47a1-a77b-1a6bf1985b62\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cq6kp"
Aug 05 17:42:06.599643 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:06.599610    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-222nl\" (UniqueName: \"kubernetes.io/projected/fe514b61-fcfc-47a1-a77b-1a6bf1985b62-kube-api-access-222nl\") pod \"postgres-69fb4594cf-cq6kp\" (UID: \"fe514b61-fcfc-47a1-a77b-1a6bf1985b62\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cq6kp"
Aug 05 17:42:06.761970 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:06.761884    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cq6kp"
Aug 05 17:42:06.901431 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:06.901404    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-cq6kp"]
Aug 05 17:42:06.903658 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:42:06.903623    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe514b61_fcfc_47a1_a77b_1a6bf1985b62.slice/crio-67c049e4579b863a23c6ef8e3d20861e44aceeeb26afd8669e902130eba2afa8 WatchSource:0}: Error finding container 67c049e4579b863a23c6ef8e3d20861e44aceeeb26afd8669e902130eba2afa8: Status 404 returned error can't find the container with id 67c049e4579b863a23c6ef8e3d20861e44aceeeb26afd8669e902130eba2afa8
Aug 05 17:42:07.009146 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:07.009108    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cq6kp" event={"ID":"fe514b61-fcfc-47a1-a77b-1a6bf1985b62","Type":"ContainerStarted","Data":"67c049e4579b863a23c6ef8e3d20861e44aceeeb26afd8669e902130eba2afa8"}
Aug 05 17:42:12.046112 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:12.046072    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cq6kp" event={"ID":"fe514b61-fcfc-47a1-a77b-1a6bf1985b62","Type":"ContainerStarted","Data":"5244f4cf1f97b93eed61a24de62dd2e05acf910be0645d4a92685644a426e27b"}
Aug 05 17:42:12.046594 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:12.046134    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cq6kp"
Aug 05 17:42:12.064033 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:12.063986    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cq6kp" podStartSLOduration=1.065217069 podStartE2EDuration="6.063969678s" totalImagesPullingTime="4.998752609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:42:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:42:12.063784466 +0000 UTC m=+558.376635829" watchObservedRunningTime="2026-08-05 17:42:12.063969678 +0000 UTC m=+558.376821043"
Aug 05 17:42:18.082019 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:18.081990    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cq6kp"
Aug 05 17:42:18.603604 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:18.603571    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-tf5s6"]
Aug 05 17:42:18.607261 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:18.607239    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-tf5s6"
Aug 05 17:42:18.622417 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:18.622383    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-tf5s6"]
Aug 05 17:42:18.693294 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:18.693258    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxcz9\" (UniqueName: \"kubernetes.io/projected/5d0fa1d6-f80b-4bfa-9d3b-a6e79e92bb75-kube-api-access-pxcz9\") pod \"authorino-5dc7ccb5f-tf5s6\" (UID: \"5d0fa1d6-f80b-4bfa-9d3b-a6e79e92bb75\") " pod="kuadrant-system/authorino-5dc7ccb5f-tf5s6"
Aug 05 17:42:18.794488 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:18.794449    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxcz9\" (UniqueName: \"kubernetes.io/projected/5d0fa1d6-f80b-4bfa-9d3b-a6e79e92bb75-kube-api-access-pxcz9\") pod \"authorino-5dc7ccb5f-tf5s6\" (UID: \"5d0fa1d6-f80b-4bfa-9d3b-a6e79e92bb75\") " pod="kuadrant-system/authorino-5dc7ccb5f-tf5s6"
Aug 05 17:42:18.804262 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:18.804212    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxcz9\" (UniqueName: \"kubernetes.io/projected/5d0fa1d6-f80b-4bfa-9d3b-a6e79e92bb75-kube-api-access-pxcz9\") pod \"authorino-5dc7ccb5f-tf5s6\" (UID: \"5d0fa1d6-f80b-4bfa-9d3b-a6e79e92bb75\") " pod="kuadrant-system/authorino-5dc7ccb5f-tf5s6"
Aug 05 17:42:18.807982 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:18.807956    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-tf5s6"]
Aug 05 17:42:18.808265 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:18.808239    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-tf5s6"
Aug 05 17:42:18.841688 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:18.841654    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-755d554b6b-xrfs4"]
Aug 05 17:42:18.845305 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:18.845284    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-755d554b6b-xrfs4"
Aug 05 17:42:18.848141 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:18.848119    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Aug 05 17:42:18.855703 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:18.855676    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-755d554b6b-xrfs4"]
Aug 05 17:42:18.895447 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:18.895414    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/50cd330e-766e-4683-9403-792b76b989cf-tls-cert\") pod \"authorino-755d554b6b-xrfs4\" (UID: \"50cd330e-766e-4683-9403-792b76b989cf\") " pod="kuadrant-system/authorino-755d554b6b-xrfs4"
Aug 05 17:42:18.895602 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:18.895458    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8bcr\" (UniqueName: \"kubernetes.io/projected/50cd330e-766e-4683-9403-792b76b989cf-kube-api-access-g8bcr\") pod \"authorino-755d554b6b-xrfs4\" (UID: \"50cd330e-766e-4683-9403-792b76b989cf\") " pod="kuadrant-system/authorino-755d554b6b-xrfs4"
Aug 05 17:42:18.949067 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:18.949040    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-tf5s6"]
Aug 05 17:42:18.950918 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:42:18.950893    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d0fa1d6_f80b_4bfa_9d3b_a6e79e92bb75.slice/crio-b0d16212c741f87ba81751bbe8f8433ac578a998b8a8569a4b02595df59a4240 WatchSource:0}: Error finding container b0d16212c741f87ba81751bbe8f8433ac578a998b8a8569a4b02595df59a4240: Status 404 returned error can't find the container with id b0d16212c741f87ba81751bbe8f8433ac578a998b8a8569a4b02595df59a4240
Aug 05 17:42:18.996526 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:18.996492    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/50cd330e-766e-4683-9403-792b76b989cf-tls-cert\") pod \"authorino-755d554b6b-xrfs4\" (UID: \"50cd330e-766e-4683-9403-792b76b989cf\") " pod="kuadrant-system/authorino-755d554b6b-xrfs4"
Aug 05 17:42:18.996526 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:18.996530    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8bcr\" (UniqueName: \"kubernetes.io/projected/50cd330e-766e-4683-9403-792b76b989cf-kube-api-access-g8bcr\") pod \"authorino-755d554b6b-xrfs4\" (UID: \"50cd330e-766e-4683-9403-792b76b989cf\") " pod="kuadrant-system/authorino-755d554b6b-xrfs4"
Aug 05 17:42:18.999137 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:18.999114    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/50cd330e-766e-4683-9403-792b76b989cf-tls-cert\") pod \"authorino-755d554b6b-xrfs4\" (UID: \"50cd330e-766e-4683-9403-792b76b989cf\") " pod="kuadrant-system/authorino-755d554b6b-xrfs4"
Aug 05 17:42:19.005166 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:19.005142    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8bcr\" (UniqueName: \"kubernetes.io/projected/50cd330e-766e-4683-9403-792b76b989cf-kube-api-access-g8bcr\") pod \"authorino-755d554b6b-xrfs4\" (UID: \"50cd330e-766e-4683-9403-792b76b989cf\") " pod="kuadrant-system/authorino-755d554b6b-xrfs4"
Aug 05 17:42:19.085373 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:19.085328    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-tf5s6" event={"ID":"5d0fa1d6-f80b-4bfa-9d3b-a6e79e92bb75","Type":"ContainerStarted","Data":"b0d16212c741f87ba81751bbe8f8433ac578a998b8a8569a4b02595df59a4240"}
Aug 05 17:42:19.158338 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:19.158305    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-755d554b6b-xrfs4"
Aug 05 17:42:19.302816 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:19.302791    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-755d554b6b-xrfs4"]
Aug 05 17:42:19.304107 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:42:19.304087    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod50cd330e_766e_4683_9403_792b76b989cf.slice/crio-741bfd7dcdc61f6d74adf2da3c069f04e5ad45379942e099cf3d4d20a06d3101 WatchSource:0}: Error finding container 741bfd7dcdc61f6d74adf2da3c069f04e5ad45379942e099cf3d4d20a06d3101: Status 404 returned error can't find the container with id 741bfd7dcdc61f6d74adf2da3c069f04e5ad45379942e099cf3d4d20a06d3101
Aug 05 17:42:20.093896 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:20.093862    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-755d554b6b-xrfs4" event={"ID":"50cd330e-766e-4683-9403-792b76b989cf","Type":"ContainerStarted","Data":"59c6bf7b25246dce47a577c1fe5617bd62b69c48928a0266649bd83cef5f65c3"}
Aug 05 17:42:20.094426 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:20.093911    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-755d554b6b-xrfs4" event={"ID":"50cd330e-766e-4683-9403-792b76b989cf","Type":"ContainerStarted","Data":"741bfd7dcdc61f6d74adf2da3c069f04e5ad45379942e099cf3d4d20a06d3101"}
Aug 05 17:42:20.095529 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:20.095506    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-tf5s6" event={"ID":"5d0fa1d6-f80b-4bfa-9d3b-a6e79e92bb75","Type":"ContainerStarted","Data":"651fee5d4bc0ba52cc30cd8950c60ee8bcfb0037f668986b1ea6dab29206953c"}
Aug 05 17:42:20.095634 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:20.095591    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5dc7ccb5f-tf5s6" podUID="5d0fa1d6-f80b-4bfa-9d3b-a6e79e92bb75" containerName="authorino" containerID="cri-o://651fee5d4bc0ba52cc30cd8950c60ee8bcfb0037f668986b1ea6dab29206953c" gracePeriod=30
Aug 05 17:42:20.117340 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:20.117293    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-755d554b6b-xrfs4" podStartSLOduration=1.412910336 podStartE2EDuration="2.117276336s" totalImagesPullingTime="704.366ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:42:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:42:20.116102851 +0000 UTC m=+566.428954215" watchObservedRunningTime="2026-08-05 17:42:20.117276336 +0000 UTC m=+566.430127699"
Aug 05 17:42:20.139736 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:20.139675    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5dc7ccb5f-tf5s6" podStartSLOduration=1.512399713 podStartE2EDuration="2.139657692s" totalImagesPullingTime="627.257979ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:42:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:42:20.13870126 +0000 UTC m=+566.451552624" watchObservedRunningTime="2026-08-05 17:42:20.139657692 +0000 UTC m=+566.452509060"
Aug 05 17:42:20.148261 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:20.148195    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-2whlk"]
Aug 05 17:42:20.148526 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:20.148477    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-c548b5d7d-2whlk" podUID="ef44d943-b2ed-455c-a489-4326993c07c4" containerName="authorino" containerID="cri-o://245c94cf5ebc77224e678312cc90005212adb114c4b82e9e8037bf5cc637e45e" gracePeriod=30
Aug 05 17:42:20.416175 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:20.416149    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-tf5s6"
Aug 05 17:42:20.424031 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:20.424008    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-2whlk"
Aug 05 17:42:20.509393 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:20.509355    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kn7ck\" (UniqueName: \"kubernetes.io/projected/ef44d943-b2ed-455c-a489-4326993c07c4-kube-api-access-kn7ck\") pod \"ef44d943-b2ed-455c-a489-4326993c07c4\" (UID: \"ef44d943-b2ed-455c-a489-4326993c07c4\") "
Aug 05 17:42:20.509393 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:20.509396    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxcz9\" (UniqueName: \"kubernetes.io/projected/5d0fa1d6-f80b-4bfa-9d3b-a6e79e92bb75-kube-api-access-pxcz9\") pod \"5d0fa1d6-f80b-4bfa-9d3b-a6e79e92bb75\" (UID: \"5d0fa1d6-f80b-4bfa-9d3b-a6e79e92bb75\") "
Aug 05 17:42:20.511731 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:20.511693    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d0fa1d6-f80b-4bfa-9d3b-a6e79e92bb75-kube-api-access-pxcz9" (OuterVolumeSpecName: "kube-api-access-pxcz9") pod "5d0fa1d6-f80b-4bfa-9d3b-a6e79e92bb75" (UID: "5d0fa1d6-f80b-4bfa-9d3b-a6e79e92bb75"). InnerVolumeSpecName "kube-api-access-pxcz9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:42:20.511731 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:20.511710    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef44d943-b2ed-455c-a489-4326993c07c4-kube-api-access-kn7ck" (OuterVolumeSpecName: "kube-api-access-kn7ck") pod "ef44d943-b2ed-455c-a489-4326993c07c4" (UID: "ef44d943-b2ed-455c-a489-4326993c07c4"). InnerVolumeSpecName "kube-api-access-kn7ck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:42:20.610862 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:20.610779    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kn7ck\" (UniqueName: \"kubernetes.io/projected/ef44d943-b2ed-455c-a489-4326993c07c4-kube-api-access-kn7ck\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:42:20.610862 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:20.610809    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxcz9\" (UniqueName: \"kubernetes.io/projected/5d0fa1d6-f80b-4bfa-9d3b-a6e79e92bb75-kube-api-access-pxcz9\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:42:21.106966 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:21.106930    2558 generic.go:356] "Generic (PLEG): container finished" podID="5d0fa1d6-f80b-4bfa-9d3b-a6e79e92bb75" containerID="651fee5d4bc0ba52cc30cd8950c60ee8bcfb0037f668986b1ea6dab29206953c" exitCode=0
Aug 05 17:42:21.107465 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:21.106988    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-tf5s6"
Aug 05 17:42:21.107465 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:21.107030    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-tf5s6" event={"ID":"5d0fa1d6-f80b-4bfa-9d3b-a6e79e92bb75","Type":"ContainerDied","Data":"651fee5d4bc0ba52cc30cd8950c60ee8bcfb0037f668986b1ea6dab29206953c"}
Aug 05 17:42:21.107465 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:21.107075    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-tf5s6" event={"ID":"5d0fa1d6-f80b-4bfa-9d3b-a6e79e92bb75","Type":"ContainerDied","Data":"b0d16212c741f87ba81751bbe8f8433ac578a998b8a8569a4b02595df59a4240"}
Aug 05 17:42:21.107465 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:21.107095    2558 scope.go:117] "RemoveContainer" containerID="651fee5d4bc0ba52cc30cd8950c60ee8bcfb0037f668986b1ea6dab29206953c"
Aug 05 17:42:21.108533 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:21.108469    2558 generic.go:356] "Generic (PLEG): container finished" podID="ef44d943-b2ed-455c-a489-4326993c07c4" containerID="245c94cf5ebc77224e678312cc90005212adb114c4b82e9e8037bf5cc637e45e" exitCode=0
Aug 05 17:42:21.108533 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:21.108521    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-2whlk"
Aug 05 17:42:21.108664 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:21.108516    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-2whlk" event={"ID":"ef44d943-b2ed-455c-a489-4326993c07c4","Type":"ContainerDied","Data":"245c94cf5ebc77224e678312cc90005212adb114c4b82e9e8037bf5cc637e45e"}
Aug 05 17:42:21.108717 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:21.108661    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-2whlk" event={"ID":"ef44d943-b2ed-455c-a489-4326993c07c4","Type":"ContainerDied","Data":"b63dbcd77733637224914efa1a716c4767b58484938435aa22708abddebc0b8e"}
Aug 05 17:42:21.118616 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:21.118595    2558 scope.go:117] "RemoveContainer" containerID="651fee5d4bc0ba52cc30cd8950c60ee8bcfb0037f668986b1ea6dab29206953c"
Aug 05 17:42:21.119007 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:42:21.118913    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"651fee5d4bc0ba52cc30cd8950c60ee8bcfb0037f668986b1ea6dab29206953c\": container with ID starting with 651fee5d4bc0ba52cc30cd8950c60ee8bcfb0037f668986b1ea6dab29206953c not found: ID does not exist" containerID="651fee5d4bc0ba52cc30cd8950c60ee8bcfb0037f668986b1ea6dab29206953c"
Aug 05 17:42:21.119007 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:21.118942    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"651fee5d4bc0ba52cc30cd8950c60ee8bcfb0037f668986b1ea6dab29206953c"} err="failed to get container status \"651fee5d4bc0ba52cc30cd8950c60ee8bcfb0037f668986b1ea6dab29206953c\": rpc error: code = NotFound desc = could not find container \"651fee5d4bc0ba52cc30cd8950c60ee8bcfb0037f668986b1ea6dab29206953c\": container with ID starting with 651fee5d4bc0ba52cc30cd8950c60ee8bcfb0037f668986b1ea6dab29206953c not found: ID does not exist"
Aug 05 17:42:21.119007 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:21.118958    2558 scope.go:117] "RemoveContainer" containerID="245c94cf5ebc77224e678312cc90005212adb114c4b82e9e8037bf5cc637e45e"
Aug 05 17:42:21.127872 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:21.127853    2558 scope.go:117] "RemoveContainer" containerID="245c94cf5ebc77224e678312cc90005212adb114c4b82e9e8037bf5cc637e45e"
Aug 05 17:42:21.128191 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:42:21.128173    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"245c94cf5ebc77224e678312cc90005212adb114c4b82e9e8037bf5cc637e45e\": container with ID starting with 245c94cf5ebc77224e678312cc90005212adb114c4b82e9e8037bf5cc637e45e not found: ID does not exist" containerID="245c94cf5ebc77224e678312cc90005212adb114c4b82e9e8037bf5cc637e45e"
Aug 05 17:42:21.128315 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:21.128200    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"245c94cf5ebc77224e678312cc90005212adb114c4b82e9e8037bf5cc637e45e"} err="failed to get container status \"245c94cf5ebc77224e678312cc90005212adb114c4b82e9e8037bf5cc637e45e\": rpc error: code = NotFound desc = could not find container \"245c94cf5ebc77224e678312cc90005212adb114c4b82e9e8037bf5cc637e45e\": container with ID starting with 245c94cf5ebc77224e678312cc90005212adb114c4b82e9e8037bf5cc637e45e not found: ID does not exist"
Aug 05 17:42:21.131806 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:21.131780    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-tf5s6"]
Aug 05 17:42:21.134896 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:21.134872    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-tf5s6"]
Aug 05 17:42:21.145978 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:21.145950    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-2whlk"]
Aug 05 17:42:21.149442 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:21.149418    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-2whlk"]
Aug 05 17:42:22.255154 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:22.255124    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d0fa1d6-f80b-4bfa-9d3b-a6e79e92bb75" path="/var/lib/kubelet/pods/5d0fa1d6-f80b-4bfa-9d3b-a6e79e92bb75/volumes"
Aug 05 17:42:22.255544 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:22.255457    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef44d943-b2ed-455c-a489-4326993c07c4" path="/var/lib/kubelet/pods/ef44d943-b2ed-455c-a489-4326993c07c4/volumes"
Aug 05 17:42:24.622750 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:24.622716    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-b687c575c-kzpwn"]
Aug 05 17:42:24.623304 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:24.623286    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d0fa1d6-f80b-4bfa-9d3b-a6e79e92bb75" containerName="authorino"
Aug 05 17:42:24.623399 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:24.623307    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d0fa1d6-f80b-4bfa-9d3b-a6e79e92bb75" containerName="authorino"
Aug 05 17:42:24.623399 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:24.623325    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef44d943-b2ed-455c-a489-4326993c07c4" containerName="authorino"
Aug 05 17:42:24.623399 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:24.623333    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef44d943-b2ed-455c-a489-4326993c07c4" containerName="authorino"
Aug 05 17:42:24.623546 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:24.623438    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef44d943-b2ed-455c-a489-4326993c07c4" containerName="authorino"
Aug 05 17:42:24.623546 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:24.623451    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d0fa1d6-f80b-4bfa-9d3b-a6e79e92bb75" containerName="authorino"
Aug 05 17:42:24.628856 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:24.628832    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b687c575c-kzpwn"
Aug 05 17:42:24.631702 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:24.631678    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Aug 05 17:42:24.631886 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:24.631754    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ssqzs\""
Aug 05 17:42:24.632892 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:24.632874    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Aug 05 17:42:24.639192 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:24.639167    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b687c575c-kzpwn"]
Aug 05 17:42:24.744922 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:24.744891    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svg45\" (UniqueName: \"kubernetes.io/projected/d9985ce7-1d3d-465d-9de5-4c2d91893daf-kube-api-access-svg45\") pod \"maas-controller-b687c575c-kzpwn\" (UID: \"d9985ce7-1d3d-465d-9de5-4c2d91893daf\") " pod="opendatahub/maas-controller-b687c575c-kzpwn"
Aug 05 17:42:24.745117 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:24.744966    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d9985ce7-1d3d-465d-9de5-4c2d91893daf-webhook-cert\") pod \"maas-controller-b687c575c-kzpwn\" (UID: \"d9985ce7-1d3d-465d-9de5-4c2d91893daf\") " pod="opendatahub/maas-controller-b687c575c-kzpwn"
Aug 05 17:42:24.845660 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:24.845618    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svg45\" (UniqueName: \"kubernetes.io/projected/d9985ce7-1d3d-465d-9de5-4c2d91893daf-kube-api-access-svg45\") pod \"maas-controller-b687c575c-kzpwn\" (UID: \"d9985ce7-1d3d-465d-9de5-4c2d91893daf\") " pod="opendatahub/maas-controller-b687c575c-kzpwn"
Aug 05 17:42:24.845930 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:24.845713    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d9985ce7-1d3d-465d-9de5-4c2d91893daf-webhook-cert\") pod \"maas-controller-b687c575c-kzpwn\" (UID: \"d9985ce7-1d3d-465d-9de5-4c2d91893daf\") " pod="opendatahub/maas-controller-b687c575c-kzpwn"
Aug 05 17:42:24.848401 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:24.848379    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d9985ce7-1d3d-465d-9de5-4c2d91893daf-webhook-cert\") pod \"maas-controller-b687c575c-kzpwn\" (UID: \"d9985ce7-1d3d-465d-9de5-4c2d91893daf\") " pod="opendatahub/maas-controller-b687c575c-kzpwn"
Aug 05 17:42:24.854365 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:24.854336    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svg45\" (UniqueName: \"kubernetes.io/projected/d9985ce7-1d3d-465d-9de5-4c2d91893daf-kube-api-access-svg45\") pod \"maas-controller-b687c575c-kzpwn\" (UID: \"d9985ce7-1d3d-465d-9de5-4c2d91893daf\") " pod="opendatahub/maas-controller-b687c575c-kzpwn"
Aug 05 17:42:24.942960 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:24.942920    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b687c575c-kzpwn"
Aug 05 17:42:25.088949 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:25.088751    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b687c575c-kzpwn"]
Aug 05 17:42:25.091784 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:42:25.091753    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9985ce7_1d3d_465d_9de5_4c2d91893daf.slice/crio-1f967e8a1815e22029cdf5ebb48e8e48fbec30367fd2054551caadcf274c2369 WatchSource:0}: Error finding container 1f967e8a1815e22029cdf5ebb48e8e48fbec30367fd2054551caadcf274c2369: Status 404 returned error can't find the container with id 1f967e8a1815e22029cdf5ebb48e8e48fbec30367fd2054551caadcf274c2369
Aug 05 17:42:25.134920 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:25.134878    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b687c575c-kzpwn" event={"ID":"d9985ce7-1d3d-465d-9de5-4c2d91893daf","Type":"ContainerStarted","Data":"1f967e8a1815e22029cdf5ebb48e8e48fbec30367fd2054551caadcf274c2369"}
Aug 05 17:42:28.154658 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:28.154625    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b687c575c-kzpwn" event={"ID":"d9985ce7-1d3d-465d-9de5-4c2d91893daf","Type":"ContainerStarted","Data":"ab77ee090d8bc8a2b6afaf0569c2e20052ae5718f3fa0f82b163d60b12df5054"}
Aug 05 17:42:28.155053 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:28.154729    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-b687c575c-kzpwn"
Aug 05 17:42:28.175180 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:28.175126    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-b687c575c-kzpwn" podStartSLOduration=1.73401004 podStartE2EDuration="4.175107172s" totalImagesPullingTime="2.441097132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:42:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:42:28.173991592 +0000 UTC m=+574.486842957" watchObservedRunningTime="2026-08-05 17:42:28.175107172 +0000 UTC m=+574.487958539"
Aug 05 17:42:38.883624 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:38.883586    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b687c575c-kzpwn"]
Aug 05 17:42:38.884089 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:38.883797    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-b687c575c-kzpwn" podUID="d9985ce7-1d3d-465d-9de5-4c2d91893daf" containerName="manager" containerID="cri-o://ab77ee090d8bc8a2b6afaf0569c2e20052ae5718f3fa0f82b163d60b12df5054" gracePeriod=30
Aug 05 17:42:38.885729 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:38.885706    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-b687c575c-kzpwn"
Aug 05 17:42:39.135356 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:39.135291    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b687c575c-kzpwn"
Aug 05 17:42:39.218559 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:39.218523    2558 generic.go:356] "Generic (PLEG): container finished" podID="d9985ce7-1d3d-465d-9de5-4c2d91893daf" containerID="ab77ee090d8bc8a2b6afaf0569c2e20052ae5718f3fa0f82b163d60b12df5054" exitCode=0
Aug 05 17:42:39.218732 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:39.218577    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b687c575c-kzpwn"
Aug 05 17:42:39.218732 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:39.218616    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b687c575c-kzpwn" event={"ID":"d9985ce7-1d3d-465d-9de5-4c2d91893daf","Type":"ContainerDied","Data":"ab77ee090d8bc8a2b6afaf0569c2e20052ae5718f3fa0f82b163d60b12df5054"}
Aug 05 17:42:39.218732 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:39.218676    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b687c575c-kzpwn" event={"ID":"d9985ce7-1d3d-465d-9de5-4c2d91893daf","Type":"ContainerDied","Data":"1f967e8a1815e22029cdf5ebb48e8e48fbec30367fd2054551caadcf274c2369"}
Aug 05 17:42:39.218732 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:39.218705    2558 scope.go:117] "RemoveContainer" containerID="ab77ee090d8bc8a2b6afaf0569c2e20052ae5718f3fa0f82b163d60b12df5054"
Aug 05 17:42:39.227701 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:39.227679    2558 scope.go:117] "RemoveContainer" containerID="ab77ee090d8bc8a2b6afaf0569c2e20052ae5718f3fa0f82b163d60b12df5054"
Aug 05 17:42:39.227983 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:42:39.227962    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab77ee090d8bc8a2b6afaf0569c2e20052ae5718f3fa0f82b163d60b12df5054\": container with ID starting with ab77ee090d8bc8a2b6afaf0569c2e20052ae5718f3fa0f82b163d60b12df5054 not found: ID does not exist" containerID="ab77ee090d8bc8a2b6afaf0569c2e20052ae5718f3fa0f82b163d60b12df5054"
Aug 05 17:42:39.228060 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:39.227994    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab77ee090d8bc8a2b6afaf0569c2e20052ae5718f3fa0f82b163d60b12df5054"} err="failed to get container status \"ab77ee090d8bc8a2b6afaf0569c2e20052ae5718f3fa0f82b163d60b12df5054\": rpc error: code = NotFound desc = could not find container \"ab77ee090d8bc8a2b6afaf0569c2e20052ae5718f3fa0f82b163d60b12df5054\": container with ID starting with ab77ee090d8bc8a2b6afaf0569c2e20052ae5718f3fa0f82b163d60b12df5054 not found: ID does not exist"
Aug 05 17:42:39.273933 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:39.273902    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svg45\" (UniqueName: \"kubernetes.io/projected/d9985ce7-1d3d-465d-9de5-4c2d91893daf-kube-api-access-svg45\") pod \"d9985ce7-1d3d-465d-9de5-4c2d91893daf\" (UID: \"d9985ce7-1d3d-465d-9de5-4c2d91893daf\") "
Aug 05 17:42:39.273933 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:39.273941    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d9985ce7-1d3d-465d-9de5-4c2d91893daf-webhook-cert\") pod \"d9985ce7-1d3d-465d-9de5-4c2d91893daf\" (UID: \"d9985ce7-1d3d-465d-9de5-4c2d91893daf\") "
Aug 05 17:42:39.276434 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:39.276399    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9985ce7-1d3d-465d-9de5-4c2d91893daf-kube-api-access-svg45" (OuterVolumeSpecName: "kube-api-access-svg45") pod "d9985ce7-1d3d-465d-9de5-4c2d91893daf" (UID: "d9985ce7-1d3d-465d-9de5-4c2d91893daf"). InnerVolumeSpecName "kube-api-access-svg45". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:42:39.276434 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:39.276404    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9985ce7-1d3d-465d-9de5-4c2d91893daf-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d9985ce7-1d3d-465d-9de5-4c2d91893daf" (UID: "d9985ce7-1d3d-465d-9de5-4c2d91893daf"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:42:39.375395 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:39.375357    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svg45\" (UniqueName: \"kubernetes.io/projected/d9985ce7-1d3d-465d-9de5-4c2d91893daf-kube-api-access-svg45\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:42:39.375395 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:39.375387    2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d9985ce7-1d3d-465d-9de5-4c2d91893daf-webhook-cert\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:42:39.541529 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:39.541492    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b687c575c-kzpwn"]
Aug 05 17:42:39.545097 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:39.545069    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-b687c575c-kzpwn"]
Aug 05 17:42:40.255290 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:42:40.255257    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9985ce7-1d3d-465d-9de5-4c2d91893daf" path="/var/lib/kubelet/pods/d9985ce7-1d3d-465d-9de5-4c2d91893daf/volumes"
Aug 05 17:43:11.419624 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:11.419582    2558 generic.go:356] "Generic (PLEG): container finished" podID="7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce" containerID="9e9528bd41bf136cd9dd323ed8fa95987152b929974309d948386be4f8893954" exitCode=0
Aug 05 17:43:11.420081 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:11.419658    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh" event={"ID":"7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce","Type":"ContainerDied","Data":"9e9528bd41bf136cd9dd323ed8fa95987152b929974309d948386be4f8893954"}
Aug 05 17:43:11.420131 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:11.420089    2558 scope.go:117] "RemoveContainer" containerID="9e9528bd41bf136cd9dd323ed8fa95987152b929974309d948386be4f8893954"
Aug 05 17:43:11.421071 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:11.421040    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 05 17:43:11.421167 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:11.421145    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 05 17:43:11.421252 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:11.421194    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 05 17:43:12.427475 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:12.427430    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh" event={"ID":"7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce","Type":"ContainerStarted","Data":"45110917642fbce2e2b29c8a1b9e9d920d7dfb56ad9e5fbe87d1ca43f69d2bbc"}
Aug 05 17:43:12.613974 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:12.613935    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh"
Aug 05 17:43:12.615237 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:12.615194    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-kfjgh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Aug 05 17:43:12.615383 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:12.615280    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh" podUID="7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Aug 05 17:43:13.614194 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:13.614155    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-kfjgh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Aug 05 17:43:13.614652 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:13.614262    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh" podUID="7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Aug 05 17:43:14.614346 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:14.614306    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-kfjgh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Aug 05 17:43:14.614749 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:14.614363    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh" podUID="7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Aug 05 17:43:15.614128 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:15.614091    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-kfjgh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Aug 05 17:43:15.614335 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:15.614148    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh" podUID="7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Aug 05 17:43:15.880183 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:15.880069    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh"
Aug 05 17:43:16.614329 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:16.614290    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-kfjgh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Aug 05 17:43:16.614536 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:16.614349    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh" podUID="7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Aug 05 17:43:17.703617 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:17.703580    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh"
Aug 05 17:43:17.704897 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:17.704879    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-kfjgh"
Aug 05 17:43:18.021621 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:18.021517    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2"]
Aug 05 17:43:18.022181 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:18.022158    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9985ce7-1d3d-465d-9de5-4c2d91893daf" containerName="manager"
Aug 05 17:43:18.022307 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:18.022187    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9985ce7-1d3d-465d-9de5-4c2d91893daf" containerName="manager"
Aug 05 17:43:18.022350 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:18.022333    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9985ce7-1d3d-465d-9de5-4c2d91893daf" containerName="manager"
Aug 05 17:43:18.025728 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:18.025704    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2"
Aug 05 17:43:18.028842 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:18.028818    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-274cz\""
Aug 05 17:43:18.028968 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:18.028865    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Aug 05 17:43:18.029046 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:18.028995    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Aug 05 17:43:18.029046 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:18.029033    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Aug 05 17:43:18.036313 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:18.036291    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2"]
Aug 05 17:43:18.141289 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:18.141215    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0627bfa-bc3b-47f3-8df3-0753dca9a192-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2\" (UID: \"d0627bfa-bc3b-47f3-8df3-0753dca9a192\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2"
Aug 05 17:43:18.141500 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:18.141316    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0627bfa-bc3b-47f3-8df3-0753dca9a192-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2\" (UID: \"d0627bfa-bc3b-47f3-8df3-0753dca9a192\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2"
Aug 05 17:43:18.141500 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:18.141375    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0627bfa-bc3b-47f3-8df3-0753dca9a192-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2\" (UID: \"d0627bfa-bc3b-47f3-8df3-0753dca9a192\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2"
Aug 05 17:43:18.141500 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:18.141415    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0627bfa-bc3b-47f3-8df3-0753dca9a192-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2\" (UID: \"d0627bfa-bc3b-47f3-8df3-0753dca9a192\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2"
Aug 05 17:43:18.141500 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:18.141439    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trvdb\" (UniqueName: \"kubernetes.io/projected/d0627bfa-bc3b-47f3-8df3-0753dca9a192-kube-api-access-trvdb\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2\" (UID: \"d0627bfa-bc3b-47f3-8df3-0753dca9a192\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2"
Aug 05 17:43:18.141500 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:18.141468    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0627bfa-bc3b-47f3-8df3-0753dca9a192-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2\" (UID: \"d0627bfa-bc3b-47f3-8df3-0753dca9a192\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2"
Aug 05 17:43:18.242765 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:18.242721    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0627bfa-bc3b-47f3-8df3-0753dca9a192-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2\" (UID: \"d0627bfa-bc3b-47f3-8df3-0753dca9a192\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2"
Aug 05 17:43:18.242968 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:18.242788    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0627bfa-bc3b-47f3-8df3-0753dca9a192-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2\" (UID: \"d0627bfa-bc3b-47f3-8df3-0753dca9a192\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2"
Aug 05 17:43:18.242968 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:18.242826    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0627bfa-bc3b-47f3-8df3-0753dca9a192-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2\" (UID: \"d0627bfa-bc3b-47f3-8df3-0753dca9a192\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2"
Aug 05 17:43:18.242968 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:18.242850    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trvdb\" (UniqueName: \"kubernetes.io/projected/d0627bfa-bc3b-47f3-8df3-0753dca9a192-kube-api-access-trvdb\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2\" (UID: \"d0627bfa-bc3b-47f3-8df3-0753dca9a192\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2"
Aug 05 17:43:18.242968 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:18.242938    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0627bfa-bc3b-47f3-8df3-0753dca9a192-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2\" (UID: \"d0627bfa-bc3b-47f3-8df3-0753dca9a192\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2"
Aug 05 17:43:18.243181 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:18.243025    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0627bfa-bc3b-47f3-8df3-0753dca9a192-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2\" (UID: \"d0627bfa-bc3b-47f3-8df3-0753dca9a192\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2"
Aug 05 17:43:18.243331 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:18.243310    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0627bfa-bc3b-47f3-8df3-0753dca9a192-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2\" (UID: \"d0627bfa-bc3b-47f3-8df3-0753dca9a192\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2"
Aug 05 17:43:18.243386 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:18.243350    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0627bfa-bc3b-47f3-8df3-0753dca9a192-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2\" (UID: \"d0627bfa-bc3b-47f3-8df3-0753dca9a192\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2"
Aug 05 17:43:18.243386 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:18.243376    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0627bfa-bc3b-47f3-8df3-0753dca9a192-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2\" (UID: \"d0627bfa-bc3b-47f3-8df3-0753dca9a192\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2"
Aug 05 17:43:18.245280 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:18.245258    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0627bfa-bc3b-47f3-8df3-0753dca9a192-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2\" (UID: \"d0627bfa-bc3b-47f3-8df3-0753dca9a192\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2"
Aug 05 17:43:18.245419 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:18.245403    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0627bfa-bc3b-47f3-8df3-0753dca9a192-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2\" (UID: \"d0627bfa-bc3b-47f3-8df3-0753dca9a192\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2"
Aug 05 17:43:18.252058 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:18.252034    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trvdb\" (UniqueName: \"kubernetes.io/projected/d0627bfa-bc3b-47f3-8df3-0753dca9a192-kube-api-access-trvdb\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2\" (UID: \"d0627bfa-bc3b-47f3-8df3-0753dca9a192\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2"
Aug 05 17:43:18.337841 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:18.337746    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2"
Aug 05 17:43:18.493184 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:18.493158    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2"]
Aug 05 17:43:18.495615 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:43:18.495576    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0627bfa_bc3b_47f3_8df3_0753dca9a192.slice/crio-775b838a9b60cad980dacfe03dc96143f242fe2811444a5d839cfc4a8c0430d3 WatchSource:0}: Error finding container 775b838a9b60cad980dacfe03dc96143f242fe2811444a5d839cfc4a8c0430d3: Status 404 returned error can't find the container with id 775b838a9b60cad980dacfe03dc96143f242fe2811444a5d839cfc4a8c0430d3
Aug 05 17:43:18.497353 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:18.497334    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 17:43:19.474438 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:19.474391    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2" event={"ID":"d0627bfa-bc3b-47f3-8df3-0753dca9a192","Type":"ContainerStarted","Data":"775b838a9b60cad980dacfe03dc96143f242fe2811444a5d839cfc4a8c0430d3"}
Aug 05 17:43:20.481600 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:20.481560    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2" event={"ID":"d0627bfa-bc3b-47f3-8df3-0753dca9a192","Type":"ContainerStarted","Data":"4c528bf639f58014cf6897b813ad5fed8e5d691a7be5a07e3977e6540dda7f5d"}
Aug 05 17:43:20.502215 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:20.502161    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2" podStartSLOduration=2.436706011 podStartE2EDuration="3.502143569s" totalImagesPullingTime="1.065437558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:43:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:43:20.500293838 +0000 UTC m=+626.813145225" watchObservedRunningTime="2026-08-05 17:43:20.502143569 +0000 UTC m=+626.814994932"
Aug 05 17:43:26.432660 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:26.432624    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bxk4t"]
Aug 05 17:43:26.436395 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:26.436378    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bxk4t"
Aug 05 17:43:26.439567 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:26.439548    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Aug 05 17:43:26.456728 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:26.456698    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bxk4t"]
Aug 05 17:43:26.521318 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:26.521276    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0338a0db-59ea-44c3-a578-7665fc6e5ce7-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bxk4t\" (UID: \"0338a0db-59ea-44c3-a578-7665fc6e5ce7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bxk4t"
Aug 05 17:43:26.521523 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:26.521340    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0338a0db-59ea-44c3-a578-7665fc6e5ce7-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bxk4t\" (UID: \"0338a0db-59ea-44c3-a578-7665fc6e5ce7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bxk4t"
Aug 05 17:43:26.521523 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:26.521431    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0338a0db-59ea-44c3-a578-7665fc6e5ce7-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bxk4t\" (UID: \"0338a0db-59ea-44c3-a578-7665fc6e5ce7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bxk4t"
Aug 05 17:43:26.521523 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:26.521482    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5s2c\" (UniqueName: \"kubernetes.io/projected/0338a0db-59ea-44c3-a578-7665fc6e5ce7-kube-api-access-w5s2c\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bxk4t\" (UID: \"0338a0db-59ea-44c3-a578-7665fc6e5ce7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bxk4t"
Aug 05 17:43:26.521680 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:26.521523    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0338a0db-59ea-44c3-a578-7665fc6e5ce7-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bxk4t\" (UID: \"0338a0db-59ea-44c3-a578-7665fc6e5ce7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bxk4t"
Aug 05 17:43:26.521680 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:26.521555    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0338a0db-59ea-44c3-a578-7665fc6e5ce7-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bxk4t\" (UID: \"0338a0db-59ea-44c3-a578-7665fc6e5ce7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bxk4t"
Aug 05 17:43:26.622441 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:26.622383    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0338a0db-59ea-44c3-a578-7665fc6e5ce7-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bxk4t\" (UID: \"0338a0db-59ea-44c3-a578-7665fc6e5ce7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bxk4t"
Aug 05 17:43:26.622441 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:26.622446    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0338a0db-59ea-44c3-a578-7665fc6e5ce7-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bxk4t\" (UID: \"0338a0db-59ea-44c3-a578-7665fc6e5ce7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bxk4t"
Aug 05 17:43:26.622706 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:26.622471    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5s2c\" (UniqueName: \"kubernetes.io/projected/0338a0db-59ea-44c3-a578-7665fc6e5ce7-kube-api-access-w5s2c\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bxk4t\" (UID: \"0338a0db-59ea-44c3-a578-7665fc6e5ce7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bxk4t"
Aug 05 17:43:26.622706 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:26.622497    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0338a0db-59ea-44c3-a578-7665fc6e5ce7-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bxk4t\" (UID: \"0338a0db-59ea-44c3-a578-7665fc6e5ce7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bxk4t"
Aug 05 17:43:26.622706 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:26.622516    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0338a0db-59ea-44c3-a578-7665fc6e5ce7-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bxk4t\" (UID: \"0338a0db-59ea-44c3-a578-7665fc6e5ce7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bxk4t"
Aug 05 17:43:26.622706 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:26.622554    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0338a0db-59ea-44c3-a578-7665fc6e5ce7-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bxk4t\" (UID: \"0338a0db-59ea-44c3-a578-7665fc6e5ce7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bxk4t"
Aug 05 17:43:26.622952 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:26.622926    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0338a0db-59ea-44c3-a578-7665fc6e5ce7-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bxk4t\" (UID: \"0338a0db-59ea-44c3-a578-7665fc6e5ce7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bxk4t"
Aug 05 17:43:26.623050 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:26.623023    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0338a0db-59ea-44c3-a578-7665fc6e5ce7-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bxk4t\" (UID: \"0338a0db-59ea-44c3-a578-7665fc6e5ce7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bxk4t"
Aug 05 17:43:26.623104 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:26.623055    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0338a0db-59ea-44c3-a578-7665fc6e5ce7-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bxk4t\" (UID: \"0338a0db-59ea-44c3-a578-7665fc6e5ce7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bxk4t"
Aug 05 17:43:26.625168 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:26.625144    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0338a0db-59ea-44c3-a578-7665fc6e5ce7-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bxk4t\" (UID: \"0338a0db-59ea-44c3-a578-7665fc6e5ce7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bxk4t"
Aug 05 17:43:26.625345 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:26.625288    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0338a0db-59ea-44c3-a578-7665fc6e5ce7-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bxk4t\" (UID: \"0338a0db-59ea-44c3-a578-7665fc6e5ce7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bxk4t"
Aug 05 17:43:26.631457 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:26.631422    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5s2c\" (UniqueName: \"kubernetes.io/projected/0338a0db-59ea-44c3-a578-7665fc6e5ce7-kube-api-access-w5s2c\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bxk4t\" (UID: \"0338a0db-59ea-44c3-a578-7665fc6e5ce7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bxk4t"
Aug 05 17:43:26.747333 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:26.747243    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bxk4t"
Aug 05 17:43:26.889586 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:26.889558    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bxk4t"]
Aug 05 17:43:26.891045 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:43:26.891021    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0338a0db_59ea_44c3_a578_7665fc6e5ce7.slice/crio-b06321fa66b15821a262df31049e8cdbc12917d765c9c3aa6de718b0278b5ddc WatchSource:0}: Error finding container b06321fa66b15821a262df31049e8cdbc12917d765c9c3aa6de718b0278b5ddc: Status 404 returned error can't find the container with id b06321fa66b15821a262df31049e8cdbc12917d765c9c3aa6de718b0278b5ddc
Aug 05 17:43:27.523014 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:27.522969    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bxk4t" event={"ID":"0338a0db-59ea-44c3-a578-7665fc6e5ce7","Type":"ContainerStarted","Data":"ede1c940329386e97717d65024740067b30670f771d22764c4ad70389db8b341"}
Aug 05 17:43:27.523459 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:27.523039    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bxk4t" event={"ID":"0338a0db-59ea-44c3-a578-7665fc6e5ce7","Type":"ContainerStarted","Data":"b06321fa66b15821a262df31049e8cdbc12917d765c9c3aa6de718b0278b5ddc"}
Aug 05 17:43:27.543807 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:27.543754    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bxk4t" podStartSLOduration=1.316860458 podStartE2EDuration="1.543736797s" totalImagesPullingTime="226.876339ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:43:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:43:27.541210919 +0000 UTC m=+633.854062281" watchObservedRunningTime="2026-08-05 17:43:27.543736797 +0000 UTC m=+633.856588159"
Aug 05 17:43:28.338383 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:28.338348    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2"
Aug 05 17:43:28.338586 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:28.338415    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2"
Aug 05 17:43:28.351101 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:28.351075    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2"
Aug 05 17:43:28.540165 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:28.540135    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2"
Aug 05 17:43:36.747467 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:36.747429    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bxk4t"
Aug 05 17:43:36.747926 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:36.747509    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bxk4t"
Aug 05 17:43:36.760417 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:36.760389    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bxk4t"
Aug 05 17:43:37.596098 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:43:37.596072    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bxk4t"
Aug 05 17:44:08.841192 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:44:08.841152    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-7mnqk"]
Aug 05 17:44:08.846061 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:44:08.846039    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7mnqk"
Aug 05 17:44:08.849235 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:44:08.849197    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Aug 05 17:44:08.858618 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:44:08.858596    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-7mnqk"]
Aug 05 17:44:08.924774 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:44:08.924737    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krcgr\" (UniqueName: \"kubernetes.io/projected/8a06cd0b-435f-43fa-bb63-4d4a5e3ffc0e-kube-api-access-krcgr\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7mnqk\" (UID: \"8a06cd0b-435f-43fa-bb63-4d4a5e3ffc0e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7mnqk"
Aug 05 17:44:08.924774 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:44:08.924784    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a06cd0b-435f-43fa-bb63-4d4a5e3ffc0e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7mnqk\" (UID: \"8a06cd0b-435f-43fa-bb63-4d4a5e3ffc0e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7mnqk"
Aug 05 17:44:08.924984 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:44:08.924801    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a06cd0b-435f-43fa-bb63-4d4a5e3ffc0e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7mnqk\" (UID: \"8a06cd0b-435f-43fa-bb63-4d4a5e3ffc0e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7mnqk"
Aug 05 17:44:08.924984 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:44:08.924911    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a06cd0b-435f-43fa-bb63-4d4a5e3ffc0e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7mnqk\" (UID: \"8a06cd0b-435f-43fa-bb63-4d4a5e3ffc0e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7mnqk"
Aug 05 17:44:08.924984 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:44:08.924969    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a06cd0b-435f-43fa-bb63-4d4a5e3ffc0e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7mnqk\" (UID: \"8a06cd0b-435f-43fa-bb63-4d4a5e3ffc0e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7mnqk"
Aug 05 17:44:08.925086 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:44:08.924984    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a06cd0b-435f-43fa-bb63-4d4a5e3ffc0e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7mnqk\" (UID: \"8a06cd0b-435f-43fa-bb63-4d4a5e3ffc0e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7mnqk"
Aug 05 17:44:09.025966 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:44:09.025930    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a06cd0b-435f-43fa-bb63-4d4a5e3ffc0e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7mnqk\" (UID: \"8a06cd0b-435f-43fa-bb63-4d4a5e3ffc0e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7mnqk"
Aug 05 17:44:09.026137 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:44:09.025985    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a06cd0b-435f-43fa-bb63-4d4a5e3ffc0e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7mnqk\" (UID: \"8a06cd0b-435f-43fa-bb63-4d4a5e3ffc0e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7mnqk"
Aug 05 17:44:09.026137 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:44:09.026000    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a06cd0b-435f-43fa-bb63-4d4a5e3ffc0e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7mnqk\" (UID: \"8a06cd0b-435f-43fa-bb63-4d4a5e3ffc0e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7mnqk"
Aug 05 17:44:09.026137 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:44:09.026038    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krcgr\" (UniqueName: \"kubernetes.io/projected/8a06cd0b-435f-43fa-bb63-4d4a5e3ffc0e-kube-api-access-krcgr\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7mnqk\" (UID: \"8a06cd0b-435f-43fa-bb63-4d4a5e3ffc0e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7mnqk"
Aug 05 17:44:09.026137 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:44:09.026059    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a06cd0b-435f-43fa-bb63-4d4a5e3ffc0e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7mnqk\" (UID: \"8a06cd0b-435f-43fa-bb63-4d4a5e3ffc0e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7mnqk"
Aug 05 17:44:09.026137 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:44:09.026074    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a06cd0b-435f-43fa-bb63-4d4a5e3ffc0e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7mnqk\" (UID: \"8a06cd0b-435f-43fa-bb63-4d4a5e3ffc0e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7mnqk"
Aug 05 17:44:09.026468 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:44:09.026443    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a06cd0b-435f-43fa-bb63-4d4a5e3ffc0e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7mnqk\" (UID: \"8a06cd0b-435f-43fa-bb63-4d4a5e3ffc0e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7mnqk"
Aug 05 17:44:09.026511 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:44:09.026493    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a06cd0b-435f-43fa-bb63-4d4a5e3ffc0e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7mnqk\" (UID: \"8a06cd0b-435f-43fa-bb63-4d4a5e3ffc0e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7mnqk"
Aug 05 17:44:09.026578 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:44:09.026554    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a06cd0b-435f-43fa-bb63-4d4a5e3ffc0e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7mnqk\" (UID: \"8a06cd0b-435f-43fa-bb63-4d4a5e3ffc0e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7mnqk"
Aug 05 17:44:09.028519 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:44:09.028496    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a06cd0b-435f-43fa-bb63-4d4a5e3ffc0e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7mnqk\" (UID: \"8a06cd0b-435f-43fa-bb63-4d4a5e3ffc0e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7mnqk"
Aug 05 17:44:09.028665 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:44:09.028648    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a06cd0b-435f-43fa-bb63-4d4a5e3ffc0e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7mnqk\" (UID: \"8a06cd0b-435f-43fa-bb63-4d4a5e3ffc0e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7mnqk"
Aug 05 17:44:09.035409 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:44:09.035385    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krcgr\" (UniqueName: \"kubernetes.io/projected/8a06cd0b-435f-43fa-bb63-4d4a5e3ffc0e-kube-api-access-krcgr\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7mnqk\" (UID: \"8a06cd0b-435f-43fa-bb63-4d4a5e3ffc0e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7mnqk"
Aug 05 17:44:09.156777 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:44:09.156748    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7mnqk"
Aug 05 17:44:09.298628 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:44:09.298606    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-7mnqk"]
Aug 05 17:44:09.300684 ip-10-0-129-136 kubenswrapper[2558]: W0805 17:44:09.300656    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a06cd0b_435f_43fa_bb63_4d4a5e3ffc0e.slice/crio-38d73aacfd9da57dbdbf90582349a876eafa6750836c8797d4f5559b0521cf70 WatchSource:0}: Error finding container 38d73aacfd9da57dbdbf90582349a876eafa6750836c8797d4f5559b0521cf70: Status 404 returned error can't find the container with id 38d73aacfd9da57dbdbf90582349a876eafa6750836c8797d4f5559b0521cf70
Aug 05 17:44:09.769752 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:44:09.769665    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7mnqk" event={"ID":"8a06cd0b-435f-43fa-bb63-4d4a5e3ffc0e","Type":"ContainerStarted","Data":"4f25cf3e9ab4493dd803fa7cab37c1a808d8028f8a589b6321fef1245fbd34d0"}
Aug 05 17:44:09.769752 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:44:09.769724    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7mnqk" event={"ID":"8a06cd0b-435f-43fa-bb63-4d4a5e3ffc0e","Type":"ContainerStarted","Data":"38d73aacfd9da57dbdbf90582349a876eafa6750836c8797d4f5559b0521cf70"}
Aug 05 17:44:09.788598 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:44:09.788548    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7mnqk" podStartSLOduration=1.585228066 podStartE2EDuration="1.788533691s" totalImagesPullingTime="203.305625ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:44:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:44:09.788337128 +0000 UTC m=+676.101188492" watchObservedRunningTime="2026-08-05 17:44:09.788533691 +0000 UTC m=+676.101385054"
Aug 05 17:44:19.157061 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:44:19.157011    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7mnqk"
Aug 05 17:44:19.157695 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:44:19.157092    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7mnqk"
Aug 05 17:44:19.174900 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:44:19.174872    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7mnqk"
Aug 05 17:44:19.841384 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:44:19.841353    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7mnqk"
Aug 05 17:45:30.898890 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:45:30.898853    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-755d554b6b-xrfs4"]
Aug 05 17:45:30.899511 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:45:30.899090    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-755d554b6b-xrfs4" podUID="50cd330e-766e-4683-9403-792b76b989cf" containerName="authorino" containerID="cri-o://59c6bf7b25246dce47a577c1fe5617bd62b69c48928a0266649bd83cef5f65c3" gracePeriod=30
Aug 05 17:45:31.155212 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:45:31.155147    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-755d554b6b-xrfs4"
Aug 05 17:45:31.185510 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:45:31.185484    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/50cd330e-766e-4683-9403-792b76b989cf-tls-cert\") pod \"50cd330e-766e-4683-9403-792b76b989cf\" (UID: \"50cd330e-766e-4683-9403-792b76b989cf\") "
Aug 05 17:45:31.185678 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:45:31.185516    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8bcr\" (UniqueName: \"kubernetes.io/projected/50cd330e-766e-4683-9403-792b76b989cf-kube-api-access-g8bcr\") pod \"50cd330e-766e-4683-9403-792b76b989cf\" (UID: \"50cd330e-766e-4683-9403-792b76b989cf\") "
Aug 05 17:45:31.187618 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:45:31.187583    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50cd330e-766e-4683-9403-792b76b989cf-kube-api-access-g8bcr" (OuterVolumeSpecName: "kube-api-access-g8bcr") pod "50cd330e-766e-4683-9403-792b76b989cf" (UID: "50cd330e-766e-4683-9403-792b76b989cf"). InnerVolumeSpecName "kube-api-access-g8bcr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:45:31.198778 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:45:31.198745    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50cd330e-766e-4683-9403-792b76b989cf-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "50cd330e-766e-4683-9403-792b76b989cf" (UID: "50cd330e-766e-4683-9403-792b76b989cf"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:45:31.250321 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:45:31.250282    2558 generic.go:356] "Generic (PLEG): container finished" podID="50cd330e-766e-4683-9403-792b76b989cf" containerID="59c6bf7b25246dce47a577c1fe5617bd62b69c48928a0266649bd83cef5f65c3" exitCode=0
Aug 05 17:45:31.250523 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:45:31.250331    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-755d554b6b-xrfs4"
Aug 05 17:45:31.250523 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:45:31.250371    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-755d554b6b-xrfs4" event={"ID":"50cd330e-766e-4683-9403-792b76b989cf","Type":"ContainerDied","Data":"59c6bf7b25246dce47a577c1fe5617bd62b69c48928a0266649bd83cef5f65c3"}
Aug 05 17:45:31.250523 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:45:31.250418    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-755d554b6b-xrfs4" event={"ID":"50cd330e-766e-4683-9403-792b76b989cf","Type":"ContainerDied","Data":"741bfd7dcdc61f6d74adf2da3c069f04e5ad45379942e099cf3d4d20a06d3101"}
Aug 05 17:45:31.250523 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:45:31.250440    2558 scope.go:117] "RemoveContainer" containerID="59c6bf7b25246dce47a577c1fe5617bd62b69c48928a0266649bd83cef5f65c3"
Aug 05 17:45:31.260049 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:45:31.260030    2558 scope.go:117] "RemoveContainer" containerID="59c6bf7b25246dce47a577c1fe5617bd62b69c48928a0266649bd83cef5f65c3"
Aug 05 17:45:31.260352 ip-10-0-129-136 kubenswrapper[2558]: E0805 17:45:31.260330    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59c6bf7b25246dce47a577c1fe5617bd62b69c48928a0266649bd83cef5f65c3\": container with ID starting with 59c6bf7b25246dce47a577c1fe5617bd62b69c48928a0266649bd83cef5f65c3 not found: ID does not exist" containerID="59c6bf7b25246dce47a577c1fe5617bd62b69c48928a0266649bd83cef5f65c3"
Aug 05 17:45:31.260409 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:45:31.260361    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59c6bf7b25246dce47a577c1fe5617bd62b69c48928a0266649bd83cef5f65c3"} err="failed to get container status \"59c6bf7b25246dce47a577c1fe5617bd62b69c48928a0266649bd83cef5f65c3\": rpc error: code = NotFound desc = could not find container \"59c6bf7b25246dce47a577c1fe5617bd62b69c48928a0266649bd83cef5f65c3\": container with ID starting with 59c6bf7b25246dce47a577c1fe5617bd62b69c48928a0266649bd83cef5f65c3 not found: ID does not exist"
Aug 05 17:45:31.275908 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:45:31.275874    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-755d554b6b-xrfs4"]
Aug 05 17:45:31.278212 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:45:31.278187    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-755d554b6b-xrfs4"]
Aug 05 17:45:31.286606 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:45:31.286586    2558 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/50cd330e-766e-4683-9403-792b76b989cf-tls-cert\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:45:31.286698 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:45:31.286608    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8bcr\" (UniqueName: \"kubernetes.io/projected/50cd330e-766e-4683-9403-792b76b989cf-kube-api-access-g8bcr\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 17:45:32.255431 ip-10-0-129-136 kubenswrapper[2558]: I0805 17:45:32.255393    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50cd330e-766e-4683-9403-792b76b989cf" path="/var/lib/kubelet/pods/50cd330e-766e-4683-9403-792b76b989cf/volumes"
Aug 05 18:04:05.308468 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:05.308430    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8effb523-ljjdp"]
Aug 05 18:04:05.308908 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:05.308837    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50cd330e-766e-4683-9403-792b76b989cf" containerName="authorino"
Aug 05 18:04:05.308908 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:05.308849    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="50cd330e-766e-4683-9403-792b76b989cf" containerName="authorino"
Aug 05 18:04:05.308981 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:05.308916    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="50cd330e-766e-4683-9403-792b76b989cf" containerName="authorino"
Aug 05 18:04:05.311903 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:05.311885    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8effb523-ljjdp"
Aug 05 18:04:05.314934 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:05.314917    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xn2vw\""
Aug 05 18:04:05.322700 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:05.322677    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8effb523-ljjdp"]
Aug 05 18:04:05.406706 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:05.406672    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fef457a-1165-420b-b0c5-2ac27a414243-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8effb523-ljjdp\" (UID: \"5fef457a-1165-420b-b0c5-2ac27a414243\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8effb523-ljjdp"
Aug 05 18:04:05.507597 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:05.507558    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fef457a-1165-420b-b0c5-2ac27a414243-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8effb523-ljjdp\" (UID: \"5fef457a-1165-420b-b0c5-2ac27a414243\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8effb523-ljjdp"
Aug 05 18:04:05.508204 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:05.508182    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fef457a-1165-420b-b0c5-2ac27a414243-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8effb523-ljjdp\" (UID: \"5fef457a-1165-420b-b0c5-2ac27a414243\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8effb523-ljjdp"
Aug 05 18:04:05.624099 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:05.624012    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8effb523-ljjdp"
Aug 05 18:04:05.774711 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:05.774682    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8effb523-ljjdp"]
Aug 05 18:04:05.777249 ip-10-0-129-136 kubenswrapper[2558]: W0805 18:04:05.777202    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fef457a_1165_420b_b0c5_2ac27a414243.slice/crio-9fbc911c44c40c82862e284542ed6fe66aec75fcf8158b8191508db3d93f0313 WatchSource:0}: Error finding container 9fbc911c44c40c82862e284542ed6fe66aec75fcf8158b8191508db3d93f0313: Status 404 returned error can't find the container with id 9fbc911c44c40c82862e284542ed6fe66aec75fcf8158b8191508db3d93f0313
Aug 05 18:04:05.779140 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:05.779116    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 18:04:06.539842 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:06.539804    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8effb523-ljjdp" event={"ID":"5fef457a-1165-420b-b0c5-2ac27a414243","Type":"ContainerStarted","Data":"9fbc911c44c40c82862e284542ed6fe66aec75fcf8158b8191508db3d93f0313"}
Aug 05 18:04:08.554635 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:08.554587    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8effb523-ljjdp" event={"ID":"5fef457a-1165-420b-b0c5-2ac27a414243","Type":"ContainerStarted","Data":"00756a2d65465190e611958f220accda453ce5fab4d599ea8fd874d75893fad0"}
Aug 05 18:04:08.574726 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:08.574677    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8effb523-ljjdp" podStartSLOduration=1.143884503 podStartE2EDuration="3.574662634s" totalImagesPullingTime="2.430778131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:04:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:04:08.573141136 +0000 UTC m=+1874.885992526" watchObservedRunningTime="2026-08-05 18:04:08.574662634 +0000 UTC m=+1874.887513997"
Aug 05 18:04:09.561771 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:09.561729    2558 generic.go:356] "Generic (PLEG): container finished" podID="5fef457a-1165-420b-b0c5-2ac27a414243" containerID="00756a2d65465190e611958f220accda453ce5fab4d599ea8fd874d75893fad0" exitCode=0
Aug 05 18:04:09.562180 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:09.561815    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8effb523-ljjdp" event={"ID":"5fef457a-1165-420b-b0c5-2ac27a414243","Type":"ContainerDied","Data":"00756a2d65465190e611958f220accda453ce5fab4d599ea8fd874d75893fad0"}
Aug 05 18:04:10.710429 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:10.710394    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8effb523-ljjdp"
Aug 05 18:04:10.858501 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:10.858402    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fef457a-1165-420b-b0c5-2ac27a414243-maas-api-service-ca\") pod \"5fef457a-1165-420b-b0c5-2ac27a414243\" (UID: \"5fef457a-1165-420b-b0c5-2ac27a414243\") "
Aug 05 18:04:10.858825 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:10.858805    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fef457a-1165-420b-b0c5-2ac27a414243-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5fef457a-1165-420b-b0c5-2ac27a414243" (UID: "5fef457a-1165-420b-b0c5-2ac27a414243"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 18:04:10.959344 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:10.959306    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fef457a-1165-420b-b0c5-2ac27a414243-maas-api-service-ca\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:04:11.574665 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:11.574636    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8effb523-ljjdp"
Aug 05 18:04:11.574845 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:11.574672    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8effb523-ljjdp" event={"ID":"5fef457a-1165-420b-b0c5-2ac27a414243","Type":"ContainerDied","Data":"9fbc911c44c40c82862e284542ed6fe66aec75fcf8158b8191508db3d93f0313"}
Aug 05 18:04:11.574845 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:11.574721    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9fbc911c44c40c82862e284542ed6fe66aec75fcf8158b8191508db3d93f0313"
Aug 05 18:04:22.190652 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:22.190558    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8effb523-ljjdp"]
Aug 05 18:04:22.195682 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:22.195658    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8effb523-ljjdp"]
Aug 05 18:04:22.255716 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:22.255678    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fef457a-1165-420b-b0c5-2ac27a414243" path="/var/lib/kubelet/pods/5fef457a-1165-420b-b0c5-2ac27a414243/volumes"
Aug 05 18:04:50.959352 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:50.959305    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e7e381dc-xz67r"]
Aug 05 18:04:50.961953 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:50.959851    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fef457a-1165-420b-b0c5-2ac27a414243" containerName="revoke-keys"
Aug 05 18:04:50.961953 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:50.959866    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fef457a-1165-420b-b0c5-2ac27a414243" containerName="revoke-keys"
Aug 05 18:04:50.961953 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:50.959958    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fef457a-1165-420b-b0c5-2ac27a414243" containerName="revoke-keys"
Aug 05 18:04:50.963087 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:50.963068    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e7e381dc-xz67r"
Aug 05 18:04:50.967889 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:50.967872    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xn2vw\""
Aug 05 18:04:50.985006 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:50.984984    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e7e381dc-xz67r"]
Aug 05 18:04:51.033843 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:51.033813    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f45d5c24-6475-4f1a-a353-5df16c2e1820-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-e7e381dc-xz67r\" (UID: \"f45d5c24-6475-4f1a-a353-5df16c2e1820\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e7e381dc-xz67r"
Aug 05 18:04:51.134868 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:51.134819    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f45d5c24-6475-4f1a-a353-5df16c2e1820-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-e7e381dc-xz67r\" (UID: \"f45d5c24-6475-4f1a-a353-5df16c2e1820\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e7e381dc-xz67r"
Aug 05 18:04:51.135486 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:51.135466    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f45d5c24-6475-4f1a-a353-5df16c2e1820-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-e7e381dc-xz67r\" (UID: \"f45d5c24-6475-4f1a-a353-5df16c2e1820\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e7e381dc-xz67r"
Aug 05 18:04:51.273286 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:51.273162    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e7e381dc-xz67r"
Aug 05 18:04:51.420736 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:51.420704    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e7e381dc-xz67r"]
Aug 05 18:04:51.421296 ip-10-0-129-136 kubenswrapper[2558]: W0805 18:04:51.421267    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf45d5c24_6475_4f1a_a353_5df16c2e1820.slice/crio-34becd5cfbaa73a9769db08edf854b09b793bf27f521266ad71c2ea5c1731f42 WatchSource:0}: Error finding container 34becd5cfbaa73a9769db08edf854b09b793bf27f521266ad71c2ea5c1731f42: Status 404 returned error can't find the container with id 34becd5cfbaa73a9769db08edf854b09b793bf27f521266ad71c2ea5c1731f42
Aug 05 18:04:51.798437 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:51.798386    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e7e381dc-xz67r" event={"ID":"f45d5c24-6475-4f1a-a353-5df16c2e1820","Type":"ContainerStarted","Data":"f3e8ee6dc2c56d8a40b2d7f8867bd329254a8426a622a1450dc9f2cc0369c052"}
Aug 05 18:04:51.798605 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:51.798458    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e7e381dc-xz67r" event={"ID":"f45d5c24-6475-4f1a-a353-5df16c2e1820","Type":"ContainerStarted","Data":"34becd5cfbaa73a9769db08edf854b09b793bf27f521266ad71c2ea5c1731f42"}
Aug 05 18:04:51.823931 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:51.823885    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e7e381dc-xz67r" podStartSLOduration=1.823870879 podStartE2EDuration="1.823870879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:04:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:04:51.823451423 +0000 UTC m=+1918.136302785" watchObservedRunningTime="2026-08-05 18:04:51.823870879 +0000 UTC m=+1918.136722241"
Aug 05 18:04:52.804815 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:52.804772    2558 generic.go:356] "Generic (PLEG): container finished" podID="f45d5c24-6475-4f1a-a353-5df16c2e1820" containerID="f3e8ee6dc2c56d8a40b2d7f8867bd329254a8426a622a1450dc9f2cc0369c052" exitCode=0
Aug 05 18:04:52.805217 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:52.804856    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e7e381dc-xz67r" event={"ID":"f45d5c24-6475-4f1a-a353-5df16c2e1820","Type":"ContainerDied","Data":"f3e8ee6dc2c56d8a40b2d7f8867bd329254a8426a622a1450dc9f2cc0369c052"}
Aug 05 18:04:53.948055 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:53.948025    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e7e381dc-xz67r"
Aug 05 18:04:54.062337 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:54.062245    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f45d5c24-6475-4f1a-a353-5df16c2e1820-maas-api-service-ca\") pod \"f45d5c24-6475-4f1a-a353-5df16c2e1820\" (UID: \"f45d5c24-6475-4f1a-a353-5df16c2e1820\") "
Aug 05 18:04:54.062646 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:54.062621    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f45d5c24-6475-4f1a-a353-5df16c2e1820-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f45d5c24-6475-4f1a-a353-5df16c2e1820" (UID: "f45d5c24-6475-4f1a-a353-5df16c2e1820"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 18:04:54.163688 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:54.163658    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f45d5c24-6475-4f1a-a353-5df16c2e1820-maas-api-service-ca\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:04:54.818402 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:54.818376    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e7e381dc-xz67r"
Aug 05 18:04:54.818591 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:54.818375    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e7e381dc-xz67r" event={"ID":"f45d5c24-6475-4f1a-a353-5df16c2e1820","Type":"ContainerDied","Data":"34becd5cfbaa73a9769db08edf854b09b793bf27f521266ad71c2ea5c1731f42"}
Aug 05 18:04:54.818591 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:54.818501    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="34becd5cfbaa73a9769db08edf854b09b793bf27f521266ad71c2ea5c1731f42"
Aug 05 18:04:57.907276 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:57.907191    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e7e381dc-xz67r"]
Aug 05 18:04:57.910679 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:57.910651    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e7e381dc-xz67r"]
Aug 05 18:04:58.255281 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:04:58.255184    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f45d5c24-6475-4f1a-a353-5df16c2e1820" path="/var/lib/kubelet/pods/f45d5c24-6475-4f1a-a353-5df16c2e1820/volumes"
Aug 05 18:05:31.936870 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:05:31.936832    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-efc0f562-nrg6l"]
Aug 05 18:05:31.937508 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:05:31.937432    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f45d5c24-6475-4f1a-a353-5df16c2e1820" containerName="revoke-keys"
Aug 05 18:05:31.937508 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:05:31.937451    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f45d5c24-6475-4f1a-a353-5df16c2e1820" containerName="revoke-keys"
Aug 05 18:05:31.937633 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:05:31.937575    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f45d5c24-6475-4f1a-a353-5df16c2e1820" containerName="revoke-keys"
Aug 05 18:05:31.940663 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:05:31.940641    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-efc0f562-nrg6l"
Aug 05 18:05:31.943415 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:05:31.943390    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xn2vw\""
Aug 05 18:05:31.949917 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:05:31.949894    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-efc0f562-nrg6l"]
Aug 05 18:05:32.004838 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:05:32.004800    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/232c133c-3c45-4742-8c74-3bd3e781e79f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-efc0f562-nrg6l\" (UID: \"232c133c-3c45-4742-8c74-3bd3e781e79f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-efc0f562-nrg6l"
Aug 05 18:05:32.106323 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:05:32.106275    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/232c133c-3c45-4742-8c74-3bd3e781e79f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-efc0f562-nrg6l\" (UID: \"232c133c-3c45-4742-8c74-3bd3e781e79f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-efc0f562-nrg6l"
Aug 05 18:05:32.106900 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:05:32.106878    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/232c133c-3c45-4742-8c74-3bd3e781e79f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-efc0f562-nrg6l\" (UID: \"232c133c-3c45-4742-8c74-3bd3e781e79f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-efc0f562-nrg6l"
Aug 05 18:05:32.251982 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:05:32.251892    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-efc0f562-nrg6l"
Aug 05 18:05:32.388459 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:05:32.388432    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-efc0f562-nrg6l"]
Aug 05 18:05:32.389904 ip-10-0-129-136 kubenswrapper[2558]: W0805 18:05:32.389871    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod232c133c_3c45_4742_8c74_3bd3e781e79f.slice/crio-f944e039607a136e1dd4d36e9c3c60992780868100872a991783e8590866a0b4 WatchSource:0}: Error finding container f944e039607a136e1dd4d36e9c3c60992780868100872a991783e8590866a0b4: Status 404 returned error can't find the container with id f944e039607a136e1dd4d36e9c3c60992780868100872a991783e8590866a0b4
Aug 05 18:05:33.036449 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:05:33.036408    2558 generic.go:356] "Generic (PLEG): container finished" podID="232c133c-3c45-4742-8c74-3bd3e781e79f" containerID="956d27ef738008de5117214bd5b84a80edcf575cfcec3dc64f4cce32160839d5" exitCode=0
Aug 05 18:05:33.036812 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:05:33.036495    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-efc0f562-nrg6l" event={"ID":"232c133c-3c45-4742-8c74-3bd3e781e79f","Type":"ContainerDied","Data":"956d27ef738008de5117214bd5b84a80edcf575cfcec3dc64f4cce32160839d5"}
Aug 05 18:05:33.036812 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:05:33.036551    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-efc0f562-nrg6l" event={"ID":"232c133c-3c45-4742-8c74-3bd3e781e79f","Type":"ContainerStarted","Data":"f944e039607a136e1dd4d36e9c3c60992780868100872a991783e8590866a0b4"}
Aug 05 18:05:34.175620 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:05:34.175597    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-efc0f562-nrg6l"
Aug 05 18:05:34.224407 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:05:34.224366    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/232c133c-3c45-4742-8c74-3bd3e781e79f-maas-api-service-ca\") pod \"232c133c-3c45-4742-8c74-3bd3e781e79f\" (UID: \"232c133c-3c45-4742-8c74-3bd3e781e79f\") "
Aug 05 18:05:34.224907 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:05:34.224878    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/232c133c-3c45-4742-8c74-3bd3e781e79f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "232c133c-3c45-4742-8c74-3bd3e781e79f" (UID: "232c133c-3c45-4742-8c74-3bd3e781e79f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 18:05:34.326156 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:05:34.326073    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/232c133c-3c45-4742-8c74-3bd3e781e79f-maas-api-service-ca\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:05:35.049661 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:05:35.049631    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-efc0f562-nrg6l"
Aug 05 18:05:35.049842 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:05:35.049669    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-efc0f562-nrg6l" event={"ID":"232c133c-3c45-4742-8c74-3bd3e781e79f","Type":"ContainerDied","Data":"f944e039607a136e1dd4d36e9c3c60992780868100872a991783e8590866a0b4"}
Aug 05 18:05:35.049842 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:05:35.049716    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f944e039607a136e1dd4d36e9c3c60992780868100872a991783e8590866a0b4"
Aug 05 18:05:43.101811 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:05:43.101773    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-efc0f562-nrg6l"]
Aug 05 18:05:43.105959 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:05:43.105928    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-efc0f562-nrg6l"]
Aug 05 18:05:44.257774 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:05:44.257738    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="232c133c-3c45-4742-8c74-3bd3e781e79f" path="/var/lib/kubelet/pods/232c133c-3c45-4742-8c74-3bd3e781e79f/volumes"
Aug 05 18:06:12.201472 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:06:12.201435    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65feef49-vkxg7"]
Aug 05 18:06:12.201935 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:06:12.201853    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="232c133c-3c45-4742-8c74-3bd3e781e79f" containerName="revoke-keys"
Aug 05 18:06:12.201935 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:06:12.201866    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="232c133c-3c45-4742-8c74-3bd3e781e79f" containerName="revoke-keys"
Aug 05 18:06:12.202014 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:06:12.201941    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="232c133c-3c45-4742-8c74-3bd3e781e79f" containerName="revoke-keys"
Aug 05 18:06:12.205201 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:06:12.205185    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65feef49-vkxg7"
Aug 05 18:06:12.208159 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:06:12.208138    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xn2vw\""
Aug 05 18:06:12.220214 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:06:12.220186    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65feef49-vkxg7"]
Aug 05 18:06:12.278734 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:06:12.278701    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4faea1f9-bf38-4d9b-86d7-e08a3142d320-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-65feef49-vkxg7\" (UID: \"4faea1f9-bf38-4d9b-86d7-e08a3142d320\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65feef49-vkxg7"
Aug 05 18:06:12.379929 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:06:12.379882    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4faea1f9-bf38-4d9b-86d7-e08a3142d320-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-65feef49-vkxg7\" (UID: \"4faea1f9-bf38-4d9b-86d7-e08a3142d320\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65feef49-vkxg7"
Aug 05 18:06:12.380611 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:06:12.380593    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4faea1f9-bf38-4d9b-86d7-e08a3142d320-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-65feef49-vkxg7\" (UID: \"4faea1f9-bf38-4d9b-86d7-e08a3142d320\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65feef49-vkxg7"
Aug 05 18:06:12.515058 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:06:12.514978    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65feef49-vkxg7"
Aug 05 18:06:12.665052 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:06:12.665015    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65feef49-vkxg7"]
Aug 05 18:06:12.666780 ip-10-0-129-136 kubenswrapper[2558]: W0805 18:06:12.666755    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4faea1f9_bf38_4d9b_86d7_e08a3142d320.slice/crio-03d4471d8ffad2ab1520c816740bdddbb6905737d0c1329260bc4b197ad82da9 WatchSource:0}: Error finding container 03d4471d8ffad2ab1520c816740bdddbb6905737d0c1329260bc4b197ad82da9: Status 404 returned error can't find the container with id 03d4471d8ffad2ab1520c816740bdddbb6905737d0c1329260bc4b197ad82da9
Aug 05 18:06:13.267824 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:06:13.267784    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65feef49-vkxg7" event={"ID":"4faea1f9-bf38-4d9b-86d7-e08a3142d320","Type":"ContainerStarted","Data":"98fe7d31816345e32da1b71b237f87f12304eea247543d99ffebc741f028aab5"}
Aug 05 18:06:13.268202 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:06:13.267872    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65feef49-vkxg7" event={"ID":"4faea1f9-bf38-4d9b-86d7-e08a3142d320","Type":"ContainerStarted","Data":"03d4471d8ffad2ab1520c816740bdddbb6905737d0c1329260bc4b197ad82da9"}
Aug 05 18:06:13.289561 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:06:13.289503    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65feef49-vkxg7" podStartSLOduration=1.289489527 podStartE2EDuration="1.289489527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:06:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:06:13.287501148 +0000 UTC m=+1999.600352511" watchObservedRunningTime="2026-08-05 18:06:13.289489527 +0000 UTC m=+1999.602340912"
Aug 05 18:06:14.275265 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:06:14.275208    2558 generic.go:356] "Generic (PLEG): container finished" podID="4faea1f9-bf38-4d9b-86d7-e08a3142d320" containerID="98fe7d31816345e32da1b71b237f87f12304eea247543d99ffebc741f028aab5" exitCode=0
Aug 05 18:06:14.275648 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:06:14.275280    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65feef49-vkxg7" event={"ID":"4faea1f9-bf38-4d9b-86d7-e08a3142d320","Type":"ContainerDied","Data":"98fe7d31816345e32da1b71b237f87f12304eea247543d99ffebc741f028aab5"}
Aug 05 18:06:15.418697 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:06:15.418671    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65feef49-vkxg7"
Aug 05 18:06:15.508727 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:06:15.508695    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4faea1f9-bf38-4d9b-86d7-e08a3142d320-maas-api-service-ca\") pod \"4faea1f9-bf38-4d9b-86d7-e08a3142d320\" (UID: \"4faea1f9-bf38-4d9b-86d7-e08a3142d320\") "
Aug 05 18:06:15.509065 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:06:15.509033    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4faea1f9-bf38-4d9b-86d7-e08a3142d320-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4faea1f9-bf38-4d9b-86d7-e08a3142d320" (UID: "4faea1f9-bf38-4d9b-86d7-e08a3142d320"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 18:06:15.610195 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:06:15.610120    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4faea1f9-bf38-4d9b-86d7-e08a3142d320-maas-api-service-ca\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:06:16.288285 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:06:16.288252    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65feef49-vkxg7" event={"ID":"4faea1f9-bf38-4d9b-86d7-e08a3142d320","Type":"ContainerDied","Data":"03d4471d8ffad2ab1520c816740bdddbb6905737d0c1329260bc4b197ad82da9"}
Aug 05 18:06:16.288285 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:06:16.288282    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65feef49-vkxg7"
Aug 05 18:06:16.288498 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:06:16.288301    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="03d4471d8ffad2ab1520c816740bdddbb6905737d0c1329260bc4b197ad82da9"
Aug 05 18:06:19.255601 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:06:19.255567    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65feef49-vkxg7"]
Aug 05 18:06:19.258046 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:06:19.258023    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-65feef49-vkxg7"]
Aug 05 18:06:20.255152 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:06:20.255115    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4faea1f9-bf38-4d9b-86d7-e08a3142d320" path="/var/lib/kubelet/pods/4faea1f9-bf38-4d9b-86d7-e08a3142d320/volumes"
Aug 05 18:10:54.441478 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:10:54.441449    2558 scope.go:117] "RemoveContainer" containerID="00756a2d65465190e611958f220accda453ce5fab4d599ea8fd874d75893fad0"
Aug 05 18:10:54.450490 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:10:54.450468    2558 scope.go:117] "RemoveContainer" containerID="f3e8ee6dc2c56d8a40b2d7f8867bd329254a8426a622a1450dc9f2cc0369c052"
Aug 05 18:11:54.474970 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:11:54.474890    2558 scope.go:117] "RemoveContainer" containerID="956d27ef738008de5117214bd5b84a80edcf575cfcec3dc64f4cce32160839d5"
Aug 05 18:12:35.466287 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:12:35.466256    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e3b0986-hwnj5"]
Aug 05 18:12:35.466739 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:12:35.466670    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4faea1f9-bf38-4d9b-86d7-e08a3142d320" containerName="revoke-keys"
Aug 05 18:12:35.466739 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:12:35.466683    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4faea1f9-bf38-4d9b-86d7-e08a3142d320" containerName="revoke-keys"
Aug 05 18:12:35.466818 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:12:35.466753    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="4faea1f9-bf38-4d9b-86d7-e08a3142d320" containerName="revoke-keys"
Aug 05 18:12:35.469816 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:12:35.469802    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e3b0986-hwnj5"
Aug 05 18:12:35.472509 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:12:35.472480    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xn2vw\""
Aug 05 18:12:35.478301 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:12:35.478275    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e3b0986-hwnj5"]
Aug 05 18:12:35.539487 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:12:35.539449    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/98da590d-01a4-47b0-ae89-98c60cda40b5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9e3b0986-hwnj5\" (UID: \"98da590d-01a4-47b0-ae89-98c60cda40b5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e3b0986-hwnj5"
Aug 05 18:12:35.640417 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:12:35.640367    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/98da590d-01a4-47b0-ae89-98c60cda40b5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9e3b0986-hwnj5\" (UID: \"98da590d-01a4-47b0-ae89-98c60cda40b5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e3b0986-hwnj5"
Aug 05 18:12:35.641031 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:12:35.641008    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/98da590d-01a4-47b0-ae89-98c60cda40b5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9e3b0986-hwnj5\" (UID: \"98da590d-01a4-47b0-ae89-98c60cda40b5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e3b0986-hwnj5"
Aug 05 18:12:35.781328 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:12:35.781239    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e3b0986-hwnj5"
Aug 05 18:12:35.923523 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:12:35.923500    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e3b0986-hwnj5"]
Aug 05 18:12:35.925663 ip-10-0-129-136 kubenswrapper[2558]: W0805 18:12:35.925635    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98da590d_01a4_47b0_ae89_98c60cda40b5.slice/crio-4a12dd2ab50515fbb63f3d554ad2ebec4ed0281cb45783fac0633acba3ba205f WatchSource:0}: Error finding container 4a12dd2ab50515fbb63f3d554ad2ebec4ed0281cb45783fac0633acba3ba205f: Status 404 returned error can't find the container with id 4a12dd2ab50515fbb63f3d554ad2ebec4ed0281cb45783fac0633acba3ba205f
Aug 05 18:12:36.472816 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:12:36.472773    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e3b0986-hwnj5" event={"ID":"98da590d-01a4-47b0-ae89-98c60cda40b5","Type":"ContainerStarted","Data":"6da9da51bb64ff648641e387d3994f809d176fdcc575da08390e11d5c582e59f"}
Aug 05 18:12:36.473188 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:12:36.472837    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e3b0986-hwnj5" event={"ID":"98da590d-01a4-47b0-ae89-98c60cda40b5","Type":"ContainerStarted","Data":"4a12dd2ab50515fbb63f3d554ad2ebec4ed0281cb45783fac0633acba3ba205f"}
Aug 05 18:12:36.493438 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:12:36.493389    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e3b0986-hwnj5" podStartSLOduration=1.493372894 podStartE2EDuration="1.493372894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:12:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:12:36.490598174 +0000 UTC m=+2382.803449536" watchObservedRunningTime="2026-08-05 18:12:36.493372894 +0000 UTC m=+2382.806224257"
Aug 05 18:12:37.479609 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:12:37.479569    2558 generic.go:356] "Generic (PLEG): container finished" podID="98da590d-01a4-47b0-ae89-98c60cda40b5" containerID="6da9da51bb64ff648641e387d3994f809d176fdcc575da08390e11d5c582e59f" exitCode=0
Aug 05 18:12:37.480004 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:12:37.479652    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e3b0986-hwnj5" event={"ID":"98da590d-01a4-47b0-ae89-98c60cda40b5","Type":"ContainerDied","Data":"6da9da51bb64ff648641e387d3994f809d176fdcc575da08390e11d5c582e59f"}
Aug 05 18:12:38.627643 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:12:38.627612    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e3b0986-hwnj5"
Aug 05 18:12:38.773046 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:12:38.772960    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/98da590d-01a4-47b0-ae89-98c60cda40b5-maas-api-service-ca\") pod \"98da590d-01a4-47b0-ae89-98c60cda40b5\" (UID: \"98da590d-01a4-47b0-ae89-98c60cda40b5\") "
Aug 05 18:12:38.773405 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:12:38.773379    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98da590d-01a4-47b0-ae89-98c60cda40b5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "98da590d-01a4-47b0-ae89-98c60cda40b5" (UID: "98da590d-01a4-47b0-ae89-98c60cda40b5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 18:12:38.874662 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:12:38.874625    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/98da590d-01a4-47b0-ae89-98c60cda40b5-maas-api-service-ca\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:12:39.491451 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:12:39.491418    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e3b0986-hwnj5" event={"ID":"98da590d-01a4-47b0-ae89-98c60cda40b5","Type":"ContainerDied","Data":"4a12dd2ab50515fbb63f3d554ad2ebec4ed0281cb45783fac0633acba3ba205f"}
Aug 05 18:12:39.491666 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:12:39.491476    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4a12dd2ab50515fbb63f3d554ad2ebec4ed0281cb45783fac0633acba3ba205f"
Aug 05 18:12:39.491666 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:12:39.491434    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e3b0986-hwnj5"
Aug 05 18:12:51.153596 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:12:51.153556    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e3b0986-hwnj5"]
Aug 05 18:12:51.158426 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:12:51.158398    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9e3b0986-hwnj5"]
Aug 05 18:12:52.255163 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:12:52.255130    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98da590d-01a4-47b0-ae89-98c60cda40b5" path="/var/lib/kubelet/pods/98da590d-01a4-47b0-ae89-98c60cda40b5/volumes"
Aug 05 18:12:54.497121 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:12:54.497084    2558 scope.go:117] "RemoveContainer" containerID="98fe7d31816345e32da1b71b237f87f12304eea247543d99ffebc741f028aab5"
Aug 05 18:15:00.133921 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:00.133888    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9261d9-29765895-7k52r"]
Aug 05 18:15:00.134404 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:00.134302    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98da590d-01a4-47b0-ae89-98c60cda40b5" containerName="revoke-keys"
Aug 05 18:15:00.134404 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:00.134314    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="98da590d-01a4-47b0-ae89-98c60cda40b5" containerName="revoke-keys"
Aug 05 18:15:00.134404 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:00.134397    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="98da590d-01a4-47b0-ae89-98c60cda40b5" containerName="revoke-keys"
Aug 05 18:15:00.137371 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:00.137354    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9261d9-29765895-7k52r"
Aug 05 18:15:00.140264 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:00.140245    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xn2vw\""
Aug 05 18:15:00.147362 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:00.147337    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9261d9-29765895-7k52r"]
Aug 05 18:15:00.148967 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:00.148951    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9261d9-29765895-7k52r"
Aug 05 18:15:00.292048 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:00.292022    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9261d9-29765895-7k52r"]
Aug 05 18:15:00.293851 ip-10-0-129-136 kubenswrapper[2558]: W0805 18:15:00.293830    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod349c7e7b_88ad_46e7_9e3c_423ef5a539e6.slice/crio-2c1e6ea62d09c8f7eac1717f5525325265392acde97abc0dc94b4b94e3ca772a WatchSource:0}: Error finding container 2c1e6ea62d09c8f7eac1717f5525325265392acde97abc0dc94b4b94e3ca772a: Status 404 returned error can't find the container with id 2c1e6ea62d09c8f7eac1717f5525325265392acde97abc0dc94b4b94e3ca772a
Aug 05 18:15:01.283282 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:01.283242    2558 generic.go:356] "Generic (PLEG): container finished" podID="349c7e7b-88ad-46e7-9e3c-423ef5a539e6" containerID="84493deebe7fe83592d5a205888801605a205f6719dc1318dcdee8202be048fd" exitCode=7
Aug 05 18:15:01.283744 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:01.283336    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9261d9-29765895-7k52r" event={"ID":"349c7e7b-88ad-46e7-9e3c-423ef5a539e6","Type":"ContainerDied","Data":"84493deebe7fe83592d5a205888801605a205f6719dc1318dcdee8202be048fd"}
Aug 05 18:15:01.283744 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:01.283405    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9261d9-29765895-7k52r" event={"ID":"349c7e7b-88ad-46e7-9e3c-423ef5a539e6","Type":"ContainerStarted","Data":"2c1e6ea62d09c8f7eac1717f5525325265392acde97abc0dc94b4b94e3ca772a"}
Aug 05 18:15:01.283744 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:01.283482    2558 scope.go:117] "RemoveContainer" containerID="84493deebe7fe83592d5a205888801605a205f6719dc1318dcdee8202be048fd"
Aug 05 18:15:02.290953 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:02.290917    2558 generic.go:356] "Generic (PLEG): container finished" podID="349c7e7b-88ad-46e7-9e3c-423ef5a539e6" containerID="d6e88953f18d730787166287ef85649309cbe44d9467780520e27cbce9da83c6" exitCode=7
Aug 05 18:15:02.291435 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:02.290958    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9261d9-29765895-7k52r" event={"ID":"349c7e7b-88ad-46e7-9e3c-423ef5a539e6","Type":"ContainerDied","Data":"d6e88953f18d730787166287ef85649309cbe44d9467780520e27cbce9da83c6"}
Aug 05 18:15:02.291435 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:02.291021    2558 scope.go:117] "RemoveContainer" containerID="84493deebe7fe83592d5a205888801605a205f6719dc1318dcdee8202be048fd"
Aug 05 18:15:02.291435 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:02.291157    2558 scope.go:117] "RemoveContainer" containerID="d6e88953f18d730787166287ef85649309cbe44d9467780520e27cbce9da83c6"
Aug 05 18:15:02.291555 ip-10-0-129-136 kubenswrapper[2558]: E0805 18:15:02.291478    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-inf-a-9261d9-29765895-7k52r_odh-ai-gateway-infra(349c7e7b-88ad-46e7-9e3c-423ef5a539e6)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9261d9-29765895-7k52r" podUID="349c7e7b-88ad-46e7-9e3c-423ef5a539e6"
Aug 05 18:15:03.304536 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:03.304505    2558 scope.go:117] "RemoveContainer" containerID="d6e88953f18d730787166287ef85649309cbe44d9467780520e27cbce9da83c6"
Aug 05 18:15:03.304982 ip-10-0-129-136 kubenswrapper[2558]: E0805 18:15:03.304718    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-inf-a-9261d9-29765895-7k52r_odh-ai-gateway-infra(349c7e7b-88ad-46e7-9e3c-423ef5a539e6)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9261d9-29765895-7k52r" podUID="349c7e7b-88ad-46e7-9e3c-423ef5a539e6"
Aug 05 18:15:15.248572 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:15.248535    2558 scope.go:117] "RemoveContainer" containerID="d6e88953f18d730787166287ef85649309cbe44d9467780520e27cbce9da83c6"
Aug 05 18:15:16.378674 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:16.378570    2558 generic.go:356] "Generic (PLEG): container finished" podID="349c7e7b-88ad-46e7-9e3c-423ef5a539e6" containerID="b851201ea6f88e17f4b2684ea1d2f7d855c8988e80100dcc62090c5a0b39a9bf" exitCode=0
Aug 05 18:15:16.378674 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:16.378611    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9261d9-29765895-7k52r" event={"ID":"349c7e7b-88ad-46e7-9e3c-423ef5a539e6","Type":"ContainerDied","Data":"b851201ea6f88e17f4b2684ea1d2f7d855c8988e80100dcc62090c5a0b39a9bf"}
Aug 05 18:15:16.378674 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:16.378674    2558 scope.go:117] "RemoveContainer" containerID="d6e88953f18d730787166287ef85649309cbe44d9467780520e27cbce9da83c6"
Aug 05 18:15:17.409524 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:17.409494    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9261d9-29765895-7k52r"]
Aug 05 18:15:17.530889 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:17.530865    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9261d9-29765895-7k52r"
Aug 05 18:15:18.403919 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:18.403886    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9261d9-29765895-7k52r"
Aug 05 18:15:18.404106 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:18.403922    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9261d9-29765895-7k52r" event={"ID":"349c7e7b-88ad-46e7-9e3c-423ef5a539e6","Type":"ContainerDied","Data":"2c1e6ea62d09c8f7eac1717f5525325265392acde97abc0dc94b4b94e3ca772a"}
Aug 05 18:15:18.404106 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:18.403973    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c1e6ea62d09c8f7eac1717f5525325265392acde97abc0dc94b4b94e3ca772a"
Aug 05 18:15:18.456692 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:18.456657    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9261d9-29765895-7k52r"]
Aug 05 18:15:18.463236 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:18.463196    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9261d9-29765895-7k52r"]
Aug 05 18:15:20.255362 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:20.255322    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="349c7e7b-88ad-46e7-9e3c-423ef5a539e6" path="/var/lib/kubelet/pods/349c7e7b-88ad-46e7-9e3c-423ef5a539e6/volumes"
Aug 05 18:15:29.342959 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:29.342921    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-955c47-7f9cf59c4b-w5k5c"]
Aug 05 18:15:29.343546 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:29.343527    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="349c7e7b-88ad-46e7-9e3c-423ef5a539e6" containerName="cleanup"
Aug 05 18:15:29.343546 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:29.343547    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="349c7e7b-88ad-46e7-9e3c-423ef5a539e6" containerName="cleanup"
Aug 05 18:15:29.343658 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:29.343568    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="349c7e7b-88ad-46e7-9e3c-423ef5a539e6" containerName="cleanup"
Aug 05 18:15:29.343658 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:29.343577    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="349c7e7b-88ad-46e7-9e3c-423ef5a539e6" containerName="cleanup"
Aug 05 18:15:29.343726 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:29.343700    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="349c7e7b-88ad-46e7-9e3c-423ef5a539e6" containerName="cleanup"
Aug 05 18:15:29.343726 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:29.343713    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="349c7e7b-88ad-46e7-9e3c-423ef5a539e6" containerName="cleanup"
Aug 05 18:15:29.343726 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:29.343724    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="349c7e7b-88ad-46e7-9e3c-423ef5a539e6" containerName="cleanup"
Aug 05 18:15:29.347265 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:29.347248    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-955c47-7f9cf59c4b-w5k5c"
Aug 05 18:15:29.350028 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:29.350001    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-955c47-serving-cert\""
Aug 05 18:15:29.350157 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:29.350146    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-jdhhr\""
Aug 05 18:15:29.357783 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:29.357759    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-955c47-7f9cf59c4b-w5k5c"]
Aug 05 18:15:29.417617 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:29.417571    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da6d4bb6-bd37-4804-af15-fa71ebe1f123-openshift-service-ca\") pod \"maas-api-e2e-inf-b-955c47-7f9cf59c4b-w5k5c\" (UID: \"da6d4bb6-bd37-4804-af15-fa71ebe1f123\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-955c47-7f9cf59c4b-w5k5c"
Aug 05 18:15:29.417785 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:29.417637    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da6d4bb6-bd37-4804-af15-fa71ebe1f123-maas-api-tls\") pod \"maas-api-e2e-inf-b-955c47-7f9cf59c4b-w5k5c\" (UID: \"da6d4bb6-bd37-4804-af15-fa71ebe1f123\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-955c47-7f9cf59c4b-w5k5c"
Aug 05 18:15:29.417785 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:29.417667    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c85vb\" (UniqueName: \"kubernetes.io/projected/da6d4bb6-bd37-4804-af15-fa71ebe1f123-kube-api-access-c85vb\") pod \"maas-api-e2e-inf-b-955c47-7f9cf59c4b-w5k5c\" (UID: \"da6d4bb6-bd37-4804-af15-fa71ebe1f123\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-955c47-7f9cf59c4b-w5k5c"
Aug 05 18:15:29.518598 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:29.518564    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da6d4bb6-bd37-4804-af15-fa71ebe1f123-openshift-service-ca\") pod \"maas-api-e2e-inf-b-955c47-7f9cf59c4b-w5k5c\" (UID: \"da6d4bb6-bd37-4804-af15-fa71ebe1f123\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-955c47-7f9cf59c4b-w5k5c"
Aug 05 18:15:29.518797 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:29.518608    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da6d4bb6-bd37-4804-af15-fa71ebe1f123-maas-api-tls\") pod \"maas-api-e2e-inf-b-955c47-7f9cf59c4b-w5k5c\" (UID: \"da6d4bb6-bd37-4804-af15-fa71ebe1f123\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-955c47-7f9cf59c4b-w5k5c"
Aug 05 18:15:29.518797 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:29.518636    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c85vb\" (UniqueName: \"kubernetes.io/projected/da6d4bb6-bd37-4804-af15-fa71ebe1f123-kube-api-access-c85vb\") pod \"maas-api-e2e-inf-b-955c47-7f9cf59c4b-w5k5c\" (UID: \"da6d4bb6-bd37-4804-af15-fa71ebe1f123\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-955c47-7f9cf59c4b-w5k5c"
Aug 05 18:15:29.518797 ip-10-0-129-136 kubenswrapper[2558]: E0805 18:15:29.518746    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-955c47-serving-cert: secret "maas-api-e2e-inf-b-955c47-serving-cert" not found
Aug 05 18:15:29.518987 ip-10-0-129-136 kubenswrapper[2558]: E0805 18:15:29.518821    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da6d4bb6-bd37-4804-af15-fa71ebe1f123-maas-api-tls podName:da6d4bb6-bd37-4804-af15-fa71ebe1f123 nodeName:}" failed. No retries permitted until 2026-08-05 18:15:30.018801156 +0000 UTC m=+2556.331652510 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/da6d4bb6-bd37-4804-af15-fa71ebe1f123-maas-api-tls") pod "maas-api-e2e-inf-b-955c47-7f9cf59c4b-w5k5c" (UID: "da6d4bb6-bd37-4804-af15-fa71ebe1f123") : secret "maas-api-e2e-inf-b-955c47-serving-cert" not found
Aug 05 18:15:29.519325 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:29.519303    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da6d4bb6-bd37-4804-af15-fa71ebe1f123-openshift-service-ca\") pod \"maas-api-e2e-inf-b-955c47-7f9cf59c4b-w5k5c\" (UID: \"da6d4bb6-bd37-4804-af15-fa71ebe1f123\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-955c47-7f9cf59c4b-w5k5c"
Aug 05 18:15:29.528250 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:29.528207    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c85vb\" (UniqueName: \"kubernetes.io/projected/da6d4bb6-bd37-4804-af15-fa71ebe1f123-kube-api-access-c85vb\") pod \"maas-api-e2e-inf-b-955c47-7f9cf59c4b-w5k5c\" (UID: \"da6d4bb6-bd37-4804-af15-fa71ebe1f123\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-955c47-7f9cf59c4b-w5k5c"
Aug 05 18:15:30.009018 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:30.008979    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-955c47-7d49b7dc4-tgjz6"]
Aug 05 18:15:30.009425 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:30.009411    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="349c7e7b-88ad-46e7-9e3c-423ef5a539e6" containerName="cleanup"
Aug 05 18:15:30.009477 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:30.009427    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="349c7e7b-88ad-46e7-9e3c-423ef5a539e6" containerName="cleanup"
Aug 05 18:15:30.012560 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:30.012545    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-955c47-7d49b7dc4-tgjz6"
Aug 05 18:15:30.015459 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:30.015431    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-955c47-dockercfg-5vm5z\""
Aug 05 18:15:30.015596 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:30.015463    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-955c47\""
Aug 05 18:15:30.023033 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:30.023009    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da6d4bb6-bd37-4804-af15-fa71ebe1f123-maas-api-tls\") pod \"maas-api-e2e-inf-b-955c47-7f9cf59c4b-w5k5c\" (UID: \"da6d4bb6-bd37-4804-af15-fa71ebe1f123\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-955c47-7f9cf59c4b-w5k5c"
Aug 05 18:15:30.026152 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:30.026128    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da6d4bb6-bd37-4804-af15-fa71ebe1f123-maas-api-tls\") pod \"maas-api-e2e-inf-b-955c47-7f9cf59c4b-w5k5c\" (UID: \"da6d4bb6-bd37-4804-af15-fa71ebe1f123\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-955c47-7f9cf59c4b-w5k5c"
Aug 05 18:15:30.029316 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:30.029293    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-955c47-7d49b7dc4-tgjz6"]
Aug 05 18:15:30.124456 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:30.124420    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mngvb\" (UniqueName: \"kubernetes.io/projected/7a30628a-38da-4e4a-aefc-fa6b223052b0-kube-api-access-mngvb\") pod \"payload-processing-e2e-inf-b-955c47-7d49b7dc4-tgjz6\" (UID: \"7a30628a-38da-4e4a-aefc-fa6b223052b0\") " pod="openshift-ingress/payload-processing-e2e-inf-b-955c47-7d49b7dc4-tgjz6"
Aug 05 18:15:30.124456 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:30.124457    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a30628a-38da-4e4a-aefc-fa6b223052b0-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-955c47-7d49b7dc4-tgjz6\" (UID: \"7a30628a-38da-4e4a-aefc-fa6b223052b0\") " pod="openshift-ingress/payload-processing-e2e-inf-b-955c47-7d49b7dc4-tgjz6"
Aug 05 18:15:30.225194 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:30.225164    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a30628a-38da-4e4a-aefc-fa6b223052b0-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-955c47-7d49b7dc4-tgjz6\" (UID: \"7a30628a-38da-4e4a-aefc-fa6b223052b0\") " pod="openshift-ingress/payload-processing-e2e-inf-b-955c47-7d49b7dc4-tgjz6"
Aug 05 18:15:30.225398 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:30.225303    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mngvb\" (UniqueName: \"kubernetes.io/projected/7a30628a-38da-4e4a-aefc-fa6b223052b0-kube-api-access-mngvb\") pod \"payload-processing-e2e-inf-b-955c47-7d49b7dc4-tgjz6\" (UID: \"7a30628a-38da-4e4a-aefc-fa6b223052b0\") " pod="openshift-ingress/payload-processing-e2e-inf-b-955c47-7d49b7dc4-tgjz6"
Aug 05 18:15:30.225889 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:30.225868    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a30628a-38da-4e4a-aefc-fa6b223052b0-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-955c47-7d49b7dc4-tgjz6\" (UID: \"7a30628a-38da-4e4a-aefc-fa6b223052b0\") " pod="openshift-ingress/payload-processing-e2e-inf-b-955c47-7d49b7dc4-tgjz6"
Aug 05 18:15:30.234755 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:30.234727    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mngvb\" (UniqueName: \"kubernetes.io/projected/7a30628a-38da-4e4a-aefc-fa6b223052b0-kube-api-access-mngvb\") pod \"payload-processing-e2e-inf-b-955c47-7d49b7dc4-tgjz6\" (UID: \"7a30628a-38da-4e4a-aefc-fa6b223052b0\") " pod="openshift-ingress/payload-processing-e2e-inf-b-955c47-7d49b7dc4-tgjz6"
Aug 05 18:15:30.259094 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:30.259029    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-955c47-7f9cf59c4b-w5k5c"
Aug 05 18:15:30.323095 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:30.323056    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-955c47-7d49b7dc4-tgjz6"
Aug 05 18:15:30.414392 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:30.414350    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-955c47-7f9cf59c4b-w5k5c"]
Aug 05 18:15:30.415996 ip-10-0-129-136 kubenswrapper[2558]: W0805 18:15:30.415971    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda6d4bb6_bd37_4804_af15_fa71ebe1f123.slice/crio-4c10492261521aaa799d026cbe678859f14fb13420125405650a1cd7d4a35ef1 WatchSource:0}: Error finding container 4c10492261521aaa799d026cbe678859f14fb13420125405650a1cd7d4a35ef1: Status 404 returned error can't find the container with id 4c10492261521aaa799d026cbe678859f14fb13420125405650a1cd7d4a35ef1
Aug 05 18:15:30.417456 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:30.417434    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 18:15:30.473299 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:30.473265    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-955c47-7f9cf59c4b-w5k5c" event={"ID":"da6d4bb6-bd37-4804-af15-fa71ebe1f123","Type":"ContainerStarted","Data":"4c10492261521aaa799d026cbe678859f14fb13420125405650a1cd7d4a35ef1"}
Aug 05 18:15:30.474806 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:30.474788    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-955c47-7d49b7dc4-tgjz6"]
Aug 05 18:15:30.476706 ip-10-0-129-136 kubenswrapper[2558]: W0805 18:15:30.476667    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a30628a_38da_4e4a_aefc_fa6b223052b0.slice/crio-d0c6d0e1dd89148b9cafe5058c5d084da5d5df0922e888d2f3820ad2635a0a00 WatchSource:0}: Error finding container d0c6d0e1dd89148b9cafe5058c5d084da5d5df0922e888d2f3820ad2635a0a00: Status 404 returned error can't find the container with id d0c6d0e1dd89148b9cafe5058c5d084da5d5df0922e888d2f3820ad2635a0a00
Aug 05 18:15:31.481961 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:31.481925    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-955c47-7d49b7dc4-tgjz6" event={"ID":"7a30628a-38da-4e4a-aefc-fa6b223052b0","Type":"ContainerStarted","Data":"d0c6d0e1dd89148b9cafe5058c5d084da5d5df0922e888d2f3820ad2635a0a00"}
Aug 05 18:15:33.501631 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:33.501574    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-955c47-7d49b7dc4-tgjz6" event={"ID":"7a30628a-38da-4e4a-aefc-fa6b223052b0","Type":"ContainerStarted","Data":"acef19119a3f3e7b1c3d027215c665b99b8eab2d0962e8fe0e66f42a95df7cce"}
Aug 05 18:15:33.502157 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:33.501771    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-955c47-7d49b7dc4-tgjz6"
Aug 05 18:15:33.503306 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:33.503283    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-955c47-7f9cf59c4b-w5k5c" event={"ID":"da6d4bb6-bd37-4804-af15-fa71ebe1f123","Type":"ContainerStarted","Data":"c612e6d3c771a039ffc4d13068959317033dd947c1e7fda7acabbce0f85371c7"}
Aug 05 18:15:33.503441 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:33.503408    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-955c47-7f9cf59c4b-w5k5c"
Aug 05 18:15:33.525892 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:33.525845    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-955c47-7d49b7dc4-tgjz6" podStartSLOduration=2.5798470399999998 podStartE2EDuration="4.525831014s" totalImagesPullingTime="1.945983974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:15:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:15:33.522490117 +0000 UTC m=+2559.835341479" watchObservedRunningTime="2026-08-05 18:15:33.525831014 +0000 UTC m=+2559.838682377"
Aug 05 18:15:33.555694 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:33.555645    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-955c47-7f9cf59c4b-w5k5c" podStartSLOduration=2.555240151 podStartE2EDuration="4.555629956s" totalImagesPullingTime="2.000389805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:15:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:15:33.553504034 +0000 UTC m=+2559.866355396" watchObservedRunningTime="2026-08-05 18:15:33.555629956 +0000 UTC m=+2559.868481318"
Aug 05 18:15:39.513931 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:39.513904    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-955c47-7f9cf59c4b-w5k5c"
Aug 05 18:15:44.510424 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:15:44.510391    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-955c47-7d49b7dc4-tgjz6"
Aug 05 18:17:08.647598 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:08.647559    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9261d9-579wz"]
Aug 05 18:17:08.651008 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:08.650990    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9261d9-579wz"
Aug 05 18:17:08.653953 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:08.653930    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xn2vw\""
Aug 05 18:17:08.660012 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:08.659984    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9261d9-579wz"]
Aug 05 18:17:08.748156 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:08.748124    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a762c5fc-0624-4fe8-b364-0f31059ae9ea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-9261d9-579wz\" (UID: \"a762c5fc-0624-4fe8-b364-0f31059ae9ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9261d9-579wz"
Aug 05 18:17:08.849239 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:08.849195    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a762c5fc-0624-4fe8-b364-0f31059ae9ea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-9261d9-579wz\" (UID: \"a762c5fc-0624-4fe8-b364-0f31059ae9ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9261d9-579wz"
Aug 05 18:17:08.849879 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:08.849849    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a762c5fc-0624-4fe8-b364-0f31059ae9ea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-9261d9-579wz\" (UID: \"a762c5fc-0624-4fe8-b364-0f31059ae9ea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9261d9-579wz"
Aug 05 18:17:08.964350 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:08.964308    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9261d9-579wz"
Aug 05 18:17:09.111582 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:09.111550    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9261d9-579wz"]
Aug 05 18:17:09.113156 ip-10-0-129-136 kubenswrapper[2558]: W0805 18:17:09.113128    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda762c5fc_0624_4fe8_b364_0f31059ae9ea.slice/crio-000346c92a217ed3cd1afa01fd864a3cf186ed56b06ddfbaa74641354e9d3103 WatchSource:0}: Error finding container 000346c92a217ed3cd1afa01fd864a3cf186ed56b06ddfbaa74641354e9d3103: Status 404 returned error can't find the container with id 000346c92a217ed3cd1afa01fd864a3cf186ed56b06ddfbaa74641354e9d3103
Aug 05 18:17:10.059990 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:10.059901    2558 generic.go:356] "Generic (PLEG): container finished" podID="a762c5fc-0624-4fe8-b364-0f31059ae9ea" containerID="706ba5efa9b49f64d817b4c1e0194cfefe30c62b66f167b59aaf4ac0c8d93679" exitCode=0
Aug 05 18:17:10.060370 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:10.059991    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9261d9-579wz" event={"ID":"a762c5fc-0624-4fe8-b364-0f31059ae9ea","Type":"ContainerDied","Data":"706ba5efa9b49f64d817b4c1e0194cfefe30c62b66f167b59aaf4ac0c8d93679"}
Aug 05 18:17:10.060370 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:10.060042    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9261d9-579wz" event={"ID":"a762c5fc-0624-4fe8-b364-0f31059ae9ea","Type":"ContainerStarted","Data":"000346c92a217ed3cd1afa01fd864a3cf186ed56b06ddfbaa74641354e9d3103"}
Aug 05 18:17:11.206645 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:11.206618    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9261d9-579wz"
Aug 05 18:17:11.272278 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:11.272242    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a762c5fc-0624-4fe8-b364-0f31059ae9ea-maas-api-service-ca\") pod \"a762c5fc-0624-4fe8-b364-0f31059ae9ea\" (UID: \"a762c5fc-0624-4fe8-b364-0f31059ae9ea\") "
Aug 05 18:17:11.272644 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:11.272617    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a762c5fc-0624-4fe8-b364-0f31059ae9ea-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a762c5fc-0624-4fe8-b364-0f31059ae9ea" (UID: "a762c5fc-0624-4fe8-b364-0f31059ae9ea"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 18:17:11.373502 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:11.373411    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a762c5fc-0624-4fe8-b364-0f31059ae9ea-maas-api-service-ca\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:17:12.074721 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:12.074687    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9261d9-579wz"
Aug 05 18:17:12.074889 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:12.074727    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9261d9-579wz" event={"ID":"a762c5fc-0624-4fe8-b364-0f31059ae9ea","Type":"ContainerDied","Data":"000346c92a217ed3cd1afa01fd864a3cf186ed56b06ddfbaa74641354e9d3103"}
Aug 05 18:17:12.074889 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:12.074781    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="000346c92a217ed3cd1afa01fd864a3cf186ed56b06ddfbaa74641354e9d3103"
Aug 05 18:17:19.449900 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:19.449861    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9261d9-579wz"]
Aug 05 18:17:19.452320 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:19.452292    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9261d9-579wz"]
Aug 05 18:17:20.255526 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:20.255492    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a762c5fc-0624-4fe8-b364-0f31059ae9ea" path="/var/lib/kubelet/pods/a762c5fc-0624-4fe8-b364-0f31059ae9ea/volumes"
Aug 05 18:17:26.604250 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:26.604201    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-955c47-qkjwx"]
Aug 05 18:17:26.604675 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:26.604658    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a762c5fc-0624-4fe8-b364-0f31059ae9ea" containerName="revoke-keys"
Aug 05 18:17:26.604721 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:26.604679    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a762c5fc-0624-4fe8-b364-0f31059ae9ea" containerName="revoke-keys"
Aug 05 18:17:26.604763 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:26.604756    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a762c5fc-0624-4fe8-b364-0f31059ae9ea" containerName="revoke-keys"
Aug 05 18:17:26.608059 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:26.608041    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-955c47-qkjwx"
Aug 05 18:17:26.610946 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:26.610921    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xn2vw\""
Aug 05 18:17:26.616366 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:26.616342    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-955c47-qkjwx"]
Aug 05 18:17:26.623557 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:26.623526    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31e3f6db-40a3-455e-8fde-edf2a94e3e3b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-955c47-qkjwx\" (UID: \"31e3f6db-40a3-455e-8fde-edf2a94e3e3b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-955c47-qkjwx"
Aug 05 18:17:26.724828 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:26.724785    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31e3f6db-40a3-455e-8fde-edf2a94e3e3b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-955c47-qkjwx\" (UID: \"31e3f6db-40a3-455e-8fde-edf2a94e3e3b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-955c47-qkjwx"
Aug 05 18:17:26.725464 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:26.725443    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31e3f6db-40a3-455e-8fde-edf2a94e3e3b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-955c47-qkjwx\" (UID: \"31e3f6db-40a3-455e-8fde-edf2a94e3e3b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-955c47-qkjwx"
Aug 05 18:17:26.919700 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:26.919667    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-955c47-qkjwx"
Aug 05 18:17:27.057168 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:27.057140    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-955c47-qkjwx"]
Aug 05 18:17:27.058635 ip-10-0-129-136 kubenswrapper[2558]: W0805 18:17:27.058609    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31e3f6db_40a3_455e_8fde_edf2a94e3e3b.slice/crio-b5d63444311c7038bf97054a170e11fcedb9a6036841e03e26636356d67083c8 WatchSource:0}: Error finding container b5d63444311c7038bf97054a170e11fcedb9a6036841e03e26636356d67083c8: Status 404 returned error can't find the container with id b5d63444311c7038bf97054a170e11fcedb9a6036841e03e26636356d67083c8
Aug 05 18:17:27.165543 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:27.165508    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-955c47-qkjwx" event={"ID":"31e3f6db-40a3-455e-8fde-edf2a94e3e3b","Type":"ContainerStarted","Data":"b5d63444311c7038bf97054a170e11fcedb9a6036841e03e26636356d67083c8"}
Aug 05 18:17:28.173432 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:28.173397    2558 generic.go:356] "Generic (PLEG): container finished" podID="31e3f6db-40a3-455e-8fde-edf2a94e3e3b" containerID="c3d777a1c3f94826eb69bf2c7dde5d060f05806320a664c86cd6de4ccb42c3e5" exitCode=0
Aug 05 18:17:28.173867 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:28.173491    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-955c47-qkjwx" event={"ID":"31e3f6db-40a3-455e-8fde-edf2a94e3e3b","Type":"ContainerDied","Data":"c3d777a1c3f94826eb69bf2c7dde5d060f05806320a664c86cd6de4ccb42c3e5"}
Aug 05 18:17:29.317297 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:29.317271    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-955c47-qkjwx"
Aug 05 18:17:29.350031 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:29.349998    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31e3f6db-40a3-455e-8fde-edf2a94e3e3b-maas-api-service-ca\") pod \"31e3f6db-40a3-455e-8fde-edf2a94e3e3b\" (UID: \"31e3f6db-40a3-455e-8fde-edf2a94e3e3b\") "
Aug 05 18:17:29.350433 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:29.350377    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31e3f6db-40a3-455e-8fde-edf2a94e3e3b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "31e3f6db-40a3-455e-8fde-edf2a94e3e3b" (UID: "31e3f6db-40a3-455e-8fde-edf2a94e3e3b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 18:17:29.451718 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:29.451644    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31e3f6db-40a3-455e-8fde-edf2a94e3e3b-maas-api-service-ca\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:17:30.185957 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:30.185927    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-955c47-qkjwx"
Aug 05 18:17:30.186148 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:30.185929    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-955c47-qkjwx" event={"ID":"31e3f6db-40a3-455e-8fde-edf2a94e3e3b","Type":"ContainerDied","Data":"b5d63444311c7038bf97054a170e11fcedb9a6036841e03e26636356d67083c8"}
Aug 05 18:17:30.186148 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:30.186066    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b5d63444311c7038bf97054a170e11fcedb9a6036841e03e26636356d67083c8"
Aug 05 18:17:37.182652 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:37.182610    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-955c47-7f9cf59c4b-w5k5c"]
Aug 05 18:17:37.183115 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:37.182820    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-955c47-7f9cf59c4b-w5k5c" podUID="da6d4bb6-bd37-4804-af15-fa71ebe1f123" containerName="maas-api" containerID="cri-o://c612e6d3c771a039ffc4d13068959317033dd947c1e7fda7acabbce0f85371c7" gracePeriod=30
Aug 05 18:17:37.221305 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:37.221267    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-955c47-7d49b7dc4-tgjz6"]
Aug 05 18:17:37.221710 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:37.221531    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-955c47-7d49b7dc4-tgjz6" podUID="7a30628a-38da-4e4a-aefc-fa6b223052b0" containerName="payload-processing" containerID="cri-o://acef19119a3f3e7b1c3d027215c665b99b8eab2d0962e8fe0e66f42a95df7cce" gracePeriod=30
Aug 05 18:17:37.354917 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:37.354865    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-955c47-qkjwx"]
Aug 05 18:17:37.359056 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:37.359022    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-955c47-qkjwx"]
Aug 05 18:17:37.476214 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:37.476184    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-955c47-7f9cf59c4b-w5k5c"
Aug 05 18:17:37.512481 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:37.512451    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-955c47-7d49b7dc4-tgjz6"
Aug 05 18:17:37.525170 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:37.525132    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da6d4bb6-bd37-4804-af15-fa71ebe1f123-maas-api-tls\") pod \"da6d4bb6-bd37-4804-af15-fa71ebe1f123\" (UID: \"da6d4bb6-bd37-4804-af15-fa71ebe1f123\") "
Aug 05 18:17:37.525346 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:37.525178    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da6d4bb6-bd37-4804-af15-fa71ebe1f123-openshift-service-ca\") pod \"da6d4bb6-bd37-4804-af15-fa71ebe1f123\" (UID: \"da6d4bb6-bd37-4804-af15-fa71ebe1f123\") "
Aug 05 18:17:37.525346 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:37.525240    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c85vb\" (UniqueName: \"kubernetes.io/projected/da6d4bb6-bd37-4804-af15-fa71ebe1f123-kube-api-access-c85vb\") pod \"da6d4bb6-bd37-4804-af15-fa71ebe1f123\" (UID: \"da6d4bb6-bd37-4804-af15-fa71ebe1f123\") "
Aug 05 18:17:37.525573 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:37.525538    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da6d4bb6-bd37-4804-af15-fa71ebe1f123-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "da6d4bb6-bd37-4804-af15-fa71ebe1f123" (UID: "da6d4bb6-bd37-4804-af15-fa71ebe1f123"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 18:17:37.527607 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:37.527584    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da6d4bb6-bd37-4804-af15-fa71ebe1f123-kube-api-access-c85vb" (OuterVolumeSpecName: "kube-api-access-c85vb") pod "da6d4bb6-bd37-4804-af15-fa71ebe1f123" (UID: "da6d4bb6-bd37-4804-af15-fa71ebe1f123"). InnerVolumeSpecName "kube-api-access-c85vb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 18:17:37.527693 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:37.527608    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da6d4bb6-bd37-4804-af15-fa71ebe1f123-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "da6d4bb6-bd37-4804-af15-fa71ebe1f123" (UID: "da6d4bb6-bd37-4804-af15-fa71ebe1f123"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 18:17:37.626598 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:37.626567    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a30628a-38da-4e4a-aefc-fa6b223052b0-plugins-config-volume\") pod \"7a30628a-38da-4e4a-aefc-fa6b223052b0\" (UID: \"7a30628a-38da-4e4a-aefc-fa6b223052b0\") "
Aug 05 18:17:37.626758 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:37.626621    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mngvb\" (UniqueName: \"kubernetes.io/projected/7a30628a-38da-4e4a-aefc-fa6b223052b0-kube-api-access-mngvb\") pod \"7a30628a-38da-4e4a-aefc-fa6b223052b0\" (UID: \"7a30628a-38da-4e4a-aefc-fa6b223052b0\") "
Aug 05 18:17:37.626799 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:37.626769    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da6d4bb6-bd37-4804-af15-fa71ebe1f123-maas-api-tls\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:17:37.626799 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:37.626779    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da6d4bb6-bd37-4804-af15-fa71ebe1f123-openshift-service-ca\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:17:37.626799 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:37.626790    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c85vb\" (UniqueName: \"kubernetes.io/projected/da6d4bb6-bd37-4804-af15-fa71ebe1f123-kube-api-access-c85vb\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:17:37.627016 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:37.626986    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a30628a-38da-4e4a-aefc-fa6b223052b0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7a30628a-38da-4e4a-aefc-fa6b223052b0" (UID: "7a30628a-38da-4e4a-aefc-fa6b223052b0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 18:17:37.628797 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:37.628779    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a30628a-38da-4e4a-aefc-fa6b223052b0-kube-api-access-mngvb" (OuterVolumeSpecName: "kube-api-access-mngvb") pod "7a30628a-38da-4e4a-aefc-fa6b223052b0" (UID: "7a30628a-38da-4e4a-aefc-fa6b223052b0"). InnerVolumeSpecName "kube-api-access-mngvb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 18:17:37.727740 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:37.727651    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a30628a-38da-4e4a-aefc-fa6b223052b0-plugins-config-volume\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:17:37.727740 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:37.727680    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mngvb\" (UniqueName: \"kubernetes.io/projected/7a30628a-38da-4e4a-aefc-fa6b223052b0-kube-api-access-mngvb\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:17:38.232027 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:38.231997    2558 generic.go:356] "Generic (PLEG): container finished" podID="7a30628a-38da-4e4a-aefc-fa6b223052b0" containerID="acef19119a3f3e7b1c3d027215c665b99b8eab2d0962e8fe0e66f42a95df7cce" exitCode=0
Aug 05 18:17:38.232494 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:38.232041    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-955c47-7d49b7dc4-tgjz6"
Aug 05 18:17:38.232494 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:38.232084    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-955c47-7d49b7dc4-tgjz6" event={"ID":"7a30628a-38da-4e4a-aefc-fa6b223052b0","Type":"ContainerDied","Data":"acef19119a3f3e7b1c3d027215c665b99b8eab2d0962e8fe0e66f42a95df7cce"}
Aug 05 18:17:38.232494 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:38.232137    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-955c47-7d49b7dc4-tgjz6" event={"ID":"7a30628a-38da-4e4a-aefc-fa6b223052b0","Type":"ContainerDied","Data":"d0c6d0e1dd89148b9cafe5058c5d084da5d5df0922e888d2f3820ad2635a0a00"}
Aug 05 18:17:38.232494 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:38.232161    2558 scope.go:117] "RemoveContainer" containerID="acef19119a3f3e7b1c3d027215c665b99b8eab2d0962e8fe0e66f42a95df7cce"
Aug 05 18:17:38.233575 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:38.233558    2558 generic.go:356] "Generic (PLEG): container finished" podID="da6d4bb6-bd37-4804-af15-fa71ebe1f123" containerID="c612e6d3c771a039ffc4d13068959317033dd947c1e7fda7acabbce0f85371c7" exitCode=0
Aug 05 18:17:38.233645 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:38.233592    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-955c47-7f9cf59c4b-w5k5c" event={"ID":"da6d4bb6-bd37-4804-af15-fa71ebe1f123","Type":"ContainerDied","Data":"c612e6d3c771a039ffc4d13068959317033dd947c1e7fda7acabbce0f85371c7"}
Aug 05 18:17:38.233645 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:38.233612    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-955c47-7f9cf59c4b-w5k5c"
Aug 05 18:17:38.233708 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:38.233658    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-955c47-7f9cf59c4b-w5k5c" event={"ID":"da6d4bb6-bd37-4804-af15-fa71ebe1f123","Type":"ContainerDied","Data":"4c10492261521aaa799d026cbe678859f14fb13420125405650a1cd7d4a35ef1"}
Aug 05 18:17:38.242678 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:38.242581    2558 scope.go:117] "RemoveContainer" containerID="acef19119a3f3e7b1c3d027215c665b99b8eab2d0962e8fe0e66f42a95df7cce"
Aug 05 18:17:38.242920 ip-10-0-129-136 kubenswrapper[2558]: E0805 18:17:38.242891    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acef19119a3f3e7b1c3d027215c665b99b8eab2d0962e8fe0e66f42a95df7cce\": container with ID starting with acef19119a3f3e7b1c3d027215c665b99b8eab2d0962e8fe0e66f42a95df7cce not found: ID does not exist" containerID="acef19119a3f3e7b1c3d027215c665b99b8eab2d0962e8fe0e66f42a95df7cce"
Aug 05 18:17:38.243036 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:38.242930    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acef19119a3f3e7b1c3d027215c665b99b8eab2d0962e8fe0e66f42a95df7cce"} err="failed to get container status \"acef19119a3f3e7b1c3d027215c665b99b8eab2d0962e8fe0e66f42a95df7cce\": rpc error: code = NotFound desc = could not find container \"acef19119a3f3e7b1c3d027215c665b99b8eab2d0962e8fe0e66f42a95df7cce\": container with ID starting with acef19119a3f3e7b1c3d027215c665b99b8eab2d0962e8fe0e66f42a95df7cce not found: ID does not exist"
Aug 05 18:17:38.243036 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:38.242954    2558 scope.go:117] "RemoveContainer" containerID="c612e6d3c771a039ffc4d13068959317033dd947c1e7fda7acabbce0f85371c7"
Aug 05 18:17:38.251726 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:38.251712    2558 scope.go:117] "RemoveContainer" containerID="c612e6d3c771a039ffc4d13068959317033dd947c1e7fda7acabbce0f85371c7"
Aug 05 18:17:38.251948 ip-10-0-129-136 kubenswrapper[2558]: E0805 18:17:38.251923    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c612e6d3c771a039ffc4d13068959317033dd947c1e7fda7acabbce0f85371c7\": container with ID starting with c612e6d3c771a039ffc4d13068959317033dd947c1e7fda7acabbce0f85371c7 not found: ID does not exist" containerID="c612e6d3c771a039ffc4d13068959317033dd947c1e7fda7acabbce0f85371c7"
Aug 05 18:17:38.252039 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:38.251956    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c612e6d3c771a039ffc4d13068959317033dd947c1e7fda7acabbce0f85371c7"} err="failed to get container status \"c612e6d3c771a039ffc4d13068959317033dd947c1e7fda7acabbce0f85371c7\": rpc error: code = NotFound desc = could not find container \"c612e6d3c771a039ffc4d13068959317033dd947c1e7fda7acabbce0f85371c7\": container with ID starting with c612e6d3c771a039ffc4d13068959317033dd947c1e7fda7acabbce0f85371c7 not found: ID does not exist"
Aug 05 18:17:38.255061 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:38.255041    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31e3f6db-40a3-455e-8fde-edf2a94e3e3b" path="/var/lib/kubelet/pods/31e3f6db-40a3-455e-8fde-edf2a94e3e3b/volumes"
Aug 05 18:17:38.258415 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:38.258395    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-955c47-7f9cf59c4b-w5k5c"]
Aug 05 18:17:38.262759 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:38.262739    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-955c47-7f9cf59c4b-w5k5c"]
Aug 05 18:17:38.273450 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:38.273432    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-955c47-7d49b7dc4-tgjz6"]
Aug 05 18:17:38.277902 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:38.277883    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-955c47-7d49b7dc4-tgjz6"]
Aug 05 18:17:40.257484 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:40.257449    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a30628a-38da-4e4a-aefc-fa6b223052b0" path="/var/lib/kubelet/pods/7a30628a-38da-4e4a-aefc-fa6b223052b0/volumes"
Aug 05 18:17:40.264644 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:17:40.258760    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da6d4bb6-bd37-4804-af15-fa71ebe1f123" path="/var/lib/kubelet/pods/da6d4bb6-bd37-4804-af15-fa71ebe1f123/volumes"
Aug 05 18:18:18.779023 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:18.778985    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-87a594-798b56b776-fq46x"]
Aug 05 18:18:18.779537 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:18.779393    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31e3f6db-40a3-455e-8fde-edf2a94e3e3b" containerName="revoke-keys"
Aug 05 18:18:18.779537 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:18.779405    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="31e3f6db-40a3-455e-8fde-edf2a94e3e3b" containerName="revoke-keys"
Aug 05 18:18:18.779537 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:18.779419    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a30628a-38da-4e4a-aefc-fa6b223052b0" containerName="payload-processing"
Aug 05 18:18:18.779537 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:18.779425    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a30628a-38da-4e4a-aefc-fa6b223052b0" containerName="payload-processing"
Aug 05 18:18:18.779537 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:18.779448    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da6d4bb6-bd37-4804-af15-fa71ebe1f123" containerName="maas-api"
Aug 05 18:18:18.779537 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:18.779453    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="da6d4bb6-bd37-4804-af15-fa71ebe1f123" containerName="maas-api"
Aug 05 18:18:18.779537 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:18.779511    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="da6d4bb6-bd37-4804-af15-fa71ebe1f123" containerName="maas-api"
Aug 05 18:18:18.779537 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:18.779519    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a30628a-38da-4e4a-aefc-fa6b223052b0" containerName="payload-processing"
Aug 05 18:18:18.779537 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:18.779525    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="31e3f6db-40a3-455e-8fde-edf2a94e3e3b" containerName="revoke-keys"
Aug 05 18:18:18.782789 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:18.782766    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-87a594-798b56b776-fq46x"
Aug 05 18:18:18.785515 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:18.785497    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-87a594-dockercfg-ck79c\""
Aug 05 18:18:18.786042 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:18.786025    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-87a594\""
Aug 05 18:18:18.795308 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:18.795286    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-87a594-798b56b776-fq46x"]
Aug 05 18:18:18.800574 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:18.800551    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dst7q\" (UniqueName: \"kubernetes.io/projected/90012115-376d-4c18-9acd-23e6d383b217-kube-api-access-dst7q\") pod \"payload-pre-processing-e2e-api-b-87a594-798b56b776-fq46x\" (UID: \"90012115-376d-4c18-9acd-23e6d383b217\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-87a594-798b56b776-fq46x"
Aug 05 18:18:18.800664 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:18.800641    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90012115-376d-4c18-9acd-23e6d383b217-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-87a594-798b56b776-fq46x\" (UID: \"90012115-376d-4c18-9acd-23e6d383b217\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-87a594-798b56b776-fq46x"
Aug 05 18:18:18.902030 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:18.901992    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90012115-376d-4c18-9acd-23e6d383b217-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-87a594-798b56b776-fq46x\" (UID: \"90012115-376d-4c18-9acd-23e6d383b217\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-87a594-798b56b776-fq46x"
Aug 05 18:18:18.902238 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:18.902045    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dst7q\" (UniqueName: \"kubernetes.io/projected/90012115-376d-4c18-9acd-23e6d383b217-kube-api-access-dst7q\") pod \"payload-pre-processing-e2e-api-b-87a594-798b56b776-fq46x\" (UID: \"90012115-376d-4c18-9acd-23e6d383b217\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-87a594-798b56b776-fq46x"
Aug 05 18:18:18.902988 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:18.902961    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90012115-376d-4c18-9acd-23e6d383b217-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-87a594-798b56b776-fq46x\" (UID: \"90012115-376d-4c18-9acd-23e6d383b217\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-87a594-798b56b776-fq46x"
Aug 05 18:18:18.911940 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:18.911905    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dst7q\" (UniqueName: \"kubernetes.io/projected/90012115-376d-4c18-9acd-23e6d383b217-kube-api-access-dst7q\") pod \"payload-pre-processing-e2e-api-b-87a594-798b56b776-fq46x\" (UID: \"90012115-376d-4c18-9acd-23e6d383b217\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-87a594-798b56b776-fq46x"
Aug 05 18:18:19.094163 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:19.094063    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-87a594-798b56b776-fq46x"
Aug 05 18:18:19.238664 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:19.238635    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-87a594-798b56b776-fq46x"]
Aug 05 18:18:19.240449 ip-10-0-129-136 kubenswrapper[2558]: W0805 18:18:19.240419    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90012115_376d_4c18_9acd_23e6d383b217.slice/crio-7e906f6fefc8e8f165eb700267690784ddbc62f78aefbd5ef034e981ce8ef5eb WatchSource:0}: Error finding container 7e906f6fefc8e8f165eb700267690784ddbc62f78aefbd5ef034e981ce8ef5eb: Status 404 returned error can't find the container with id 7e906f6fefc8e8f165eb700267690784ddbc62f78aefbd5ef034e981ce8ef5eb
Aug 05 18:18:19.478679 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:19.478630    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-87a594-798b56b776-fq46x" event={"ID":"90012115-376d-4c18-9acd-23e6d383b217","Type":"ContainerStarted","Data":"27fb68d65de4214e04784a4d014854390e74f2b6f36ad498cd0aae8a74426ec2"}
Aug 05 18:18:19.478875 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:19.478729    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-87a594-798b56b776-fq46x" event={"ID":"90012115-376d-4c18-9acd-23e6d383b217","Type":"ContainerStarted","Data":"7e906f6fefc8e8f165eb700267690784ddbc62f78aefbd5ef034e981ce8ef5eb"}
Aug 05 18:18:19.478875 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:19.478758    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-87a594-798b56b776-fq46x"
Aug 05 18:18:19.505750 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:19.505687    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-87a594-798b56b776-fq46x" podStartSLOduration=1.505669766 podStartE2EDuration="1.505669766s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:18:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:18:19.502727396 +0000 UTC m=+2725.815578762" watchObservedRunningTime="2026-08-05 18:18:19.505669766 +0000 UTC m=+2725.818521129"
Aug 05 18:18:30.487903 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:30.487872    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-87a594-798b56b776-fq46x"
Aug 05 18:18:49.976456 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:49.976418    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-acb45a-9x7p5"]
Aug 05 18:18:49.979811 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:49.979794    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-acb45a-9x7p5"
Aug 05 18:18:49.982859 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:49.982836    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xn2vw\""
Aug 05 18:18:49.989581 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:49.989552    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-acb45a-9x7p5"]
Aug 05 18:18:50.099633 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:50.099583    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af82c02d-fa14-4c47-803c-86031ea01bc9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-acb45a-9x7p5\" (UID: \"af82c02d-fa14-4c47-803c-86031ea01bc9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-acb45a-9x7p5"
Aug 05 18:18:50.200648 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:50.200611    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af82c02d-fa14-4c47-803c-86031ea01bc9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-acb45a-9x7p5\" (UID: \"af82c02d-fa14-4c47-803c-86031ea01bc9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-acb45a-9x7p5"
Aug 05 18:18:50.201376 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:50.201356    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af82c02d-fa14-4c47-803c-86031ea01bc9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-acb45a-9x7p5\" (UID: \"af82c02d-fa14-4c47-803c-86031ea01bc9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-acb45a-9x7p5"
Aug 05 18:18:50.292100 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:50.292003    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-acb45a-9x7p5"
Aug 05 18:18:50.434057 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:50.434030    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-acb45a-9x7p5"]
Aug 05 18:18:50.435386 ip-10-0-129-136 kubenswrapper[2558]: W0805 18:18:50.435355    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf82c02d_fa14_4c47_803c_86031ea01bc9.slice/crio-18c8b92fe6e9b3d261c68a2e5aa41aaa6293c1c05fd860b9ffcad9c268fbd1d6 WatchSource:0}: Error finding container 18c8b92fe6e9b3d261c68a2e5aa41aaa6293c1c05fd860b9ffcad9c268fbd1d6: Status 404 returned error can't find the container with id 18c8b92fe6e9b3d261c68a2e5aa41aaa6293c1c05fd860b9ffcad9c268fbd1d6
Aug 05 18:18:50.659890 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:50.659853    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-acb45a-9x7p5" event={"ID":"af82c02d-fa14-4c47-803c-86031ea01bc9","Type":"ContainerStarted","Data":"18c8b92fe6e9b3d261c68a2e5aa41aaa6293c1c05fd860b9ffcad9c268fbd1d6"}
Aug 05 18:18:51.667420 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:51.667385    2558 generic.go:356] "Generic (PLEG): container finished" podID="af82c02d-fa14-4c47-803c-86031ea01bc9" containerID="a10f6db70982dc4e25ff7b114ab32ca47ae6f959d6496357a0820571e4ca7111" exitCode=0
Aug 05 18:18:51.667820 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:51.667476    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-acb45a-9x7p5" event={"ID":"af82c02d-fa14-4c47-803c-86031ea01bc9","Type":"ContainerDied","Data":"a10f6db70982dc4e25ff7b114ab32ca47ae6f959d6496357a0820571e4ca7111"}
Aug 05 18:18:52.804749 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:52.804721    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-acb45a-9x7p5"
Aug 05 18:18:52.924396 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:52.924318    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af82c02d-fa14-4c47-803c-86031ea01bc9-maas-api-service-ca\") pod \"af82c02d-fa14-4c47-803c-86031ea01bc9\" (UID: \"af82c02d-fa14-4c47-803c-86031ea01bc9\") "
Aug 05 18:18:52.924660 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:52.924637    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af82c02d-fa14-4c47-803c-86031ea01bc9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "af82c02d-fa14-4c47-803c-86031ea01bc9" (UID: "af82c02d-fa14-4c47-803c-86031ea01bc9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 18:18:53.025678 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:53.025632    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af82c02d-fa14-4c47-803c-86031ea01bc9-maas-api-service-ca\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:18:53.679808 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:53.679777    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-acb45a-9x7p5"
Aug 05 18:18:53.679997 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:53.679801    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-acb45a-9x7p5" event={"ID":"af82c02d-fa14-4c47-803c-86031ea01bc9","Type":"ContainerDied","Data":"18c8b92fe6e9b3d261c68a2e5aa41aaa6293c1c05fd860b9ffcad9c268fbd1d6"}
Aug 05 18:18:53.679997 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:53.679861    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="18c8b92fe6e9b3d261c68a2e5aa41aaa6293c1c05fd860b9ffcad9c268fbd1d6"
Aug 05 18:18:54.579516 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:18:54.579487    2558 scope.go:117] "RemoveContainer" containerID="6da9da51bb64ff648641e387d3994f809d176fdcc575da08390e11d5c582e59f"
Aug 05 18:19:05.716825 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:05.716788    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-acb45a-9x7p5"]
Aug 05 18:19:05.720718 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:05.720678    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-acb45a-9x7p5"]
Aug 05 18:19:06.255572 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:06.255536    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af82c02d-fa14-4c47-803c-86031ea01bc9" path="/var/lib/kubelet/pods/af82c02d-fa14-4c47-803c-86031ea01bc9/volumes"
Aug 05 18:19:12.840607 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:12.840569    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-87a594-6vlpg"]
Aug 05 18:19:12.841165 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:12.841145    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af82c02d-fa14-4c47-803c-86031ea01bc9" containerName="revoke-keys"
Aug 05 18:19:12.841286 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:12.841168    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="af82c02d-fa14-4c47-803c-86031ea01bc9" containerName="revoke-keys"
Aug 05 18:19:12.841356 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:12.841302    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="af82c02d-fa14-4c47-803c-86031ea01bc9" containerName="revoke-keys"
Aug 05 18:19:12.844508 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:12.844486    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-87a594-6vlpg"
Aug 05 18:19:12.852796 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:12.852776    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xn2vw\""
Aug 05 18:19:12.872153 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:12.872131    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-87a594-6vlpg"]
Aug 05 18:19:12.907891 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:12.907846    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04481cdc-4ce0-4dac-b682-9a5b4e3f72b0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-87a594-6vlpg\" (UID: \"04481cdc-4ce0-4dac-b682-9a5b4e3f72b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-87a594-6vlpg"
Aug 05 18:19:13.009020 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:13.008972    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04481cdc-4ce0-4dac-b682-9a5b4e3f72b0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-87a594-6vlpg\" (UID: \"04481cdc-4ce0-4dac-b682-9a5b4e3f72b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-87a594-6vlpg"
Aug 05 18:19:13.009769 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:13.009742    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04481cdc-4ce0-4dac-b682-9a5b4e3f72b0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-87a594-6vlpg\" (UID: \"04481cdc-4ce0-4dac-b682-9a5b4e3f72b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-87a594-6vlpg"
Aug 05 18:19:13.154709 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:13.154617    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-87a594-6vlpg"
Aug 05 18:19:13.293964 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:13.293934    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-87a594-6vlpg"]
Aug 05 18:19:13.295480 ip-10-0-129-136 kubenswrapper[2558]: W0805 18:19:13.295451    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04481cdc_4ce0_4dac_b682_9a5b4e3f72b0.slice/crio-acbd0f20cffb009c07c8e07845769b7eb086429331a35b5b8268d96a2369bdf2 WatchSource:0}: Error finding container acbd0f20cffb009c07c8e07845769b7eb086429331a35b5b8268d96a2369bdf2: Status 404 returned error can't find the container with id acbd0f20cffb009c07c8e07845769b7eb086429331a35b5b8268d96a2369bdf2
Aug 05 18:19:13.803108 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:13.803024    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-87a594-6vlpg" event={"ID":"04481cdc-4ce0-4dac-b682-9a5b4e3f72b0","Type":"ContainerStarted","Data":"cc23209af31f76d5e0055026efcbaa14a20ea26988f722321b86b6b119773c90"}
Aug 05 18:19:13.803108 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:13.803077    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-87a594-6vlpg" event={"ID":"04481cdc-4ce0-4dac-b682-9a5b4e3f72b0","Type":"ContainerStarted","Data":"acbd0f20cffb009c07c8e07845769b7eb086429331a35b5b8268d96a2369bdf2"}
Aug 05 18:19:13.824183 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:13.824131    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-87a594-6vlpg" podStartSLOduration=1.8241166359999998 podStartE2EDuration="1.824116636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:19:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:19:13.821210161 +0000 UTC m=+2780.134061524" watchObservedRunningTime="2026-08-05 18:19:13.824116636 +0000 UTC m=+2780.136967998"
Aug 05 18:19:14.810100 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:14.810066    2558 generic.go:356] "Generic (PLEG): container finished" podID="04481cdc-4ce0-4dac-b682-9a5b4e3f72b0" containerID="cc23209af31f76d5e0055026efcbaa14a20ea26988f722321b86b6b119773c90" exitCode=0
Aug 05 18:19:14.810531 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:14.810159    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-87a594-6vlpg" event={"ID":"04481cdc-4ce0-4dac-b682-9a5b4e3f72b0","Type":"ContainerDied","Data":"cc23209af31f76d5e0055026efcbaa14a20ea26988f722321b86b6b119773c90"}
Aug 05 18:19:15.952387 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:15.952363    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-87a594-6vlpg"
Aug 05 18:19:16.037499 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:16.037465    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04481cdc-4ce0-4dac-b682-9a5b4e3f72b0-maas-api-service-ca\") pod \"04481cdc-4ce0-4dac-b682-9a5b4e3f72b0\" (UID: \"04481cdc-4ce0-4dac-b682-9a5b4e3f72b0\") "
Aug 05 18:19:16.037850 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:16.037825    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04481cdc-4ce0-4dac-b682-9a5b4e3f72b0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "04481cdc-4ce0-4dac-b682-9a5b4e3f72b0" (UID: "04481cdc-4ce0-4dac-b682-9a5b4e3f72b0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 18:19:16.138670 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:16.138587    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04481cdc-4ce0-4dac-b682-9a5b4e3f72b0-maas-api-service-ca\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:19:16.823653 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:16.823611    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-87a594-6vlpg" event={"ID":"04481cdc-4ce0-4dac-b682-9a5b4e3f72b0","Type":"ContainerDied","Data":"acbd0f20cffb009c07c8e07845769b7eb086429331a35b5b8268d96a2369bdf2"}
Aug 05 18:19:16.823653 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:16.823648    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-87a594-6vlpg"
Aug 05 18:19:16.823866 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:16.823671    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="acbd0f20cffb009c07c8e07845769b7eb086429331a35b5b8268d96a2369bdf2"
Aug 05 18:19:28.408334 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:28.408299    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-87a594-798b56b776-fq46x"]
Aug 05 18:19:28.408979 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:28.408527    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-87a594-798b56b776-fq46x" podUID="90012115-376d-4c18-9acd-23e6d383b217" containerName="payload-pre-processing" containerID="cri-o://27fb68d65de4214e04784a4d014854390e74f2b6f36ad498cd0aae8a74426ec2" gracePeriod=30
Aug 05 18:19:28.561337 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:28.561300    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-87a594-6vlpg"]
Aug 05 18:19:28.563637 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:28.563615    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-87a594-6vlpg"]
Aug 05 18:19:28.669907 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:28.669830    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-87a594-798b56b776-fq46x"
Aug 05 18:19:28.759421 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:28.759391    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90012115-376d-4c18-9acd-23e6d383b217-plugins-config-volume\") pod \"90012115-376d-4c18-9acd-23e6d383b217\" (UID: \"90012115-376d-4c18-9acd-23e6d383b217\") "
Aug 05 18:19:28.759601 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:28.759457    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dst7q\" (UniqueName: \"kubernetes.io/projected/90012115-376d-4c18-9acd-23e6d383b217-kube-api-access-dst7q\") pod \"90012115-376d-4c18-9acd-23e6d383b217\" (UID: \"90012115-376d-4c18-9acd-23e6d383b217\") "
Aug 05 18:19:28.759804 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:28.759778    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90012115-376d-4c18-9acd-23e6d383b217-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "90012115-376d-4c18-9acd-23e6d383b217" (UID: "90012115-376d-4c18-9acd-23e6d383b217"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 18:19:28.761760 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:28.761734    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90012115-376d-4c18-9acd-23e6d383b217-kube-api-access-dst7q" (OuterVolumeSpecName: "kube-api-access-dst7q") pod "90012115-376d-4c18-9acd-23e6d383b217" (UID: "90012115-376d-4c18-9acd-23e6d383b217"). InnerVolumeSpecName "kube-api-access-dst7q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 18:19:28.860403 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:28.860365    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90012115-376d-4c18-9acd-23e6d383b217-plugins-config-volume\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:19:28.860403 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:28.860398    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dst7q\" (UniqueName: \"kubernetes.io/projected/90012115-376d-4c18-9acd-23e6d383b217-kube-api-access-dst7q\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:19:28.893147 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:28.893110    2558 generic.go:356] "Generic (PLEG): container finished" podID="90012115-376d-4c18-9acd-23e6d383b217" containerID="27fb68d65de4214e04784a4d014854390e74f2b6f36ad498cd0aae8a74426ec2" exitCode=0
Aug 05 18:19:28.893330 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:28.893162    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-87a594-798b56b776-fq46x"
Aug 05 18:19:28.893330 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:28.893197    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-87a594-798b56b776-fq46x" event={"ID":"90012115-376d-4c18-9acd-23e6d383b217","Type":"ContainerDied","Data":"27fb68d65de4214e04784a4d014854390e74f2b6f36ad498cd0aae8a74426ec2"}
Aug 05 18:19:28.893330 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:28.893301    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-87a594-798b56b776-fq46x" event={"ID":"90012115-376d-4c18-9acd-23e6d383b217","Type":"ContainerDied","Data":"7e906f6fefc8e8f165eb700267690784ddbc62f78aefbd5ef034e981ce8ef5eb"}
Aug 05 18:19:28.893330 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:28.893329    2558 scope.go:117] "RemoveContainer" containerID="27fb68d65de4214e04784a4d014854390e74f2b6f36ad498cd0aae8a74426ec2"
Aug 05 18:19:28.903131 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:28.903110    2558 scope.go:117] "RemoveContainer" containerID="27fb68d65de4214e04784a4d014854390e74f2b6f36ad498cd0aae8a74426ec2"
Aug 05 18:19:28.903510 ip-10-0-129-136 kubenswrapper[2558]: E0805 18:19:28.903489    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27fb68d65de4214e04784a4d014854390e74f2b6f36ad498cd0aae8a74426ec2\": container with ID starting with 27fb68d65de4214e04784a4d014854390e74f2b6f36ad498cd0aae8a74426ec2 not found: ID does not exist" containerID="27fb68d65de4214e04784a4d014854390e74f2b6f36ad498cd0aae8a74426ec2"
Aug 05 18:19:28.903578 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:28.903522    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27fb68d65de4214e04784a4d014854390e74f2b6f36ad498cd0aae8a74426ec2"} err="failed to get container status \"27fb68d65de4214e04784a4d014854390e74f2b6f36ad498cd0aae8a74426ec2\": rpc error: code = NotFound desc = could not find container \"27fb68d65de4214e04784a4d014854390e74f2b6f36ad498cd0aae8a74426ec2\": container with ID starting with 27fb68d65de4214e04784a4d014854390e74f2b6f36ad498cd0aae8a74426ec2 not found: ID does not exist"
Aug 05 18:19:28.915014 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:28.914986    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-87a594-798b56b776-fq46x"]
Aug 05 18:19:28.920059 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:28.920011    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-87a594-798b56b776-fq46x"]
Aug 05 18:19:30.255635 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:30.255602    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04481cdc-4ce0-4dac-b682-9a5b4e3f72b0" path="/var/lib/kubelet/pods/04481cdc-4ce0-4dac-b682-9a5b4e3f72b0/volumes"
Aug 05 18:19:30.256205 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:19:30.256184    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90012115-376d-4c18-9acd-23e6d383b217" path="/var/lib/kubelet/pods/90012115-376d-4c18-9acd-23e6d383b217/volumes"
Aug 05 18:20:10.278658 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:20:10.278620    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-6fb560-876f85946-svpbk"]
Aug 05 18:20:10.279177 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:20:10.279006    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04481cdc-4ce0-4dac-b682-9a5b4e3f72b0" containerName="revoke-keys"
Aug 05 18:20:10.279177 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:20:10.279017    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="04481cdc-4ce0-4dac-b682-9a5b4e3f72b0" containerName="revoke-keys"
Aug 05 18:20:10.279177 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:20:10.279032    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90012115-376d-4c18-9acd-23e6d383b217" containerName="payload-pre-processing"
Aug 05 18:20:10.279177 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:20:10.279038    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="90012115-376d-4c18-9acd-23e6d383b217" containerName="payload-pre-processing"
Aug 05 18:20:10.279177 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:20:10.279098    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="90012115-376d-4c18-9acd-23e6d383b217" containerName="payload-pre-processing"
Aug 05 18:20:10.279177 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:20:10.279111    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="04481cdc-4ce0-4dac-b682-9a5b4e3f72b0" containerName="revoke-keys"
Aug 05 18:20:10.282180 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:20:10.282163    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-6fb560-876f85946-svpbk"
Aug 05 18:20:10.285044 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:20:10.285020    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-6fb560-dockercfg-h7q6j\""
Aug 05 18:20:10.285044 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:20:10.285038    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-6fb560\""
Aug 05 18:20:10.296766 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:20:10.296741    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-6fb560-876f85946-svpbk"]
Aug 05 18:20:10.450876 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:20:10.450840    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6df7fef8-f524-48a8-989b-e94f732352de-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-6fb560-876f85946-svpbk\" (UID: \"6df7fef8-f524-48a8-989b-e94f732352de\") " pod="openshift-ingress/payload-processing-e2e-shared-b-6fb560-876f85946-svpbk"
Aug 05 18:20:10.450876 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:20:10.450877    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsx7g\" (UniqueName: \"kubernetes.io/projected/6df7fef8-f524-48a8-989b-e94f732352de-kube-api-access-gsx7g\") pod \"payload-processing-e2e-shared-b-6fb560-876f85946-svpbk\" (UID: \"6df7fef8-f524-48a8-989b-e94f732352de\") " pod="openshift-ingress/payload-processing-e2e-shared-b-6fb560-876f85946-svpbk"
Aug 05 18:20:10.551525 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:20:10.551439    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6df7fef8-f524-48a8-989b-e94f732352de-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-6fb560-876f85946-svpbk\" (UID: \"6df7fef8-f524-48a8-989b-e94f732352de\") " pod="openshift-ingress/payload-processing-e2e-shared-b-6fb560-876f85946-svpbk"
Aug 05 18:20:10.551525 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:20:10.551475    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsx7g\" (UniqueName: \"kubernetes.io/projected/6df7fef8-f524-48a8-989b-e94f732352de-kube-api-access-gsx7g\") pod \"payload-processing-e2e-shared-b-6fb560-876f85946-svpbk\" (UID: \"6df7fef8-f524-48a8-989b-e94f732352de\") " pod="openshift-ingress/payload-processing-e2e-shared-b-6fb560-876f85946-svpbk"
Aug 05 18:20:10.552137 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:20:10.552118    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6df7fef8-f524-48a8-989b-e94f732352de-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-6fb560-876f85946-svpbk\" (UID: \"6df7fef8-f524-48a8-989b-e94f732352de\") " pod="openshift-ingress/payload-processing-e2e-shared-b-6fb560-876f85946-svpbk"
Aug 05 18:20:10.559940 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:20:10.559912    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsx7g\" (UniqueName: \"kubernetes.io/projected/6df7fef8-f524-48a8-989b-e94f732352de-kube-api-access-gsx7g\") pod \"payload-processing-e2e-shared-b-6fb560-876f85946-svpbk\" (UID: \"6df7fef8-f524-48a8-989b-e94f732352de\") " pod="openshift-ingress/payload-processing-e2e-shared-b-6fb560-876f85946-svpbk"
Aug 05 18:20:10.592044 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:20:10.592017    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-6fb560-876f85946-svpbk"
Aug 05 18:20:10.730895 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:20:10.730871    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-6fb560-876f85946-svpbk"]
Aug 05 18:20:10.732727 ip-10-0-129-136 kubenswrapper[2558]: W0805 18:20:10.732700    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6df7fef8_f524_48a8_989b_e94f732352de.slice/crio-993f8ffef109e9acb4fff5fe97e3d81efbf2e86c5b208d7f18177a1c8074051e WatchSource:0}: Error finding container 993f8ffef109e9acb4fff5fe97e3d81efbf2e86c5b208d7f18177a1c8074051e: Status 404 returned error can't find the container with id 993f8ffef109e9acb4fff5fe97e3d81efbf2e86c5b208d7f18177a1c8074051e
Aug 05 18:20:11.132833 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:20:11.132799    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-6fb560-876f85946-svpbk" event={"ID":"6df7fef8-f524-48a8-989b-e94f732352de","Type":"ContainerStarted","Data":"46b2eb6e622cd43c52450a262549bb50b37535126c77b29714ad90dad1b3f898"}
Aug 05 18:20:11.133024 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:20:11.132858    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-6fb560-876f85946-svpbk" event={"ID":"6df7fef8-f524-48a8-989b-e94f732352de","Type":"ContainerStarted","Data":"993f8ffef109e9acb4fff5fe97e3d81efbf2e86c5b208d7f18177a1c8074051e"}
Aug 05 18:20:11.133024 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:20:11.132890    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-6fb560-876f85946-svpbk"
Aug 05 18:20:11.162108 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:20:11.162055    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-6fb560-876f85946-svpbk" podStartSLOduration=1.1620404930000001 podStartE2EDuration="1.162040493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:20:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:20:11.160021836 +0000 UTC m=+2837.472873198" watchObservedRunningTime="2026-08-05 18:20:11.162040493 +0000 UTC m=+2837.474891913"
Aug 05 18:20:22.140817 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:20:22.140788    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-6fb560-876f85946-svpbk"
Aug 05 18:21:54.625012 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:21:54.624979    2558 scope.go:117] "RemoveContainer" containerID="b851201ea6f88e17f4b2684ea1d2f7d855c8988e80100dcc62090c5a0b39a9bf"
Aug 05 18:23:54.657629 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:23:54.657548    2558 scope.go:117] "RemoveContainer" containerID="c3d777a1c3f94826eb69bf2c7dde5d060f05806320a664c86cd6de4ccb42c3e5"
Aug 05 18:23:54.667719 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:23:54.667693    2558 scope.go:117] "RemoveContainer" containerID="706ba5efa9b49f64d817b4c1e0194cfefe30c62b66f167b59aaf4ac0c8d93679"
Aug 05 18:24:54.694821 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:24:54.694789    2558 scope.go:117] "RemoveContainer" containerID="a10f6db70982dc4e25ff7b114ab32ca47ae6f959d6496357a0820571e4ca7111"
Aug 05 18:25:54.715701 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:25:54.715666    2558 scope.go:117] "RemoveContainer" containerID="cc23209af31f76d5e0055026efcbaa14a20ea26988f722321b86b6b119773c90"
Aug 05 18:28:27.566044 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:27.565968    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7578-140464051952304"]
Aug 05 18:28:27.569528 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:27.569512    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7578-140464051952304"
Aug 05 18:28:27.572554 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:27.572529    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-6899h\""
Aug 05 18:28:27.575261 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:27.575216    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7578-140464051952304"]
Aug 05 18:28:27.609333 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:27.609309    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r42mh\" (UniqueName: \"kubernetes.io/projected/50c2c378-9d23-4d2b-80c9-c466fb0b6c7e-kube-api-access-r42mh\") pod \"test-curl-7578-140464051952304\" (UID: \"50c2c378-9d23-4d2b-80c9-c466fb0b6c7e\") " pod="opendatahub/test-curl-7578-140464051952304"
Aug 05 18:28:27.709983 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:27.709950    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r42mh\" (UniqueName: \"kubernetes.io/projected/50c2c378-9d23-4d2b-80c9-c466fb0b6c7e-kube-api-access-r42mh\") pod \"test-curl-7578-140464051952304\" (UID: \"50c2c378-9d23-4d2b-80c9-c466fb0b6c7e\") " pod="opendatahub/test-curl-7578-140464051952304"
Aug 05 18:28:27.721170 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:27.721134    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r42mh\" (UniqueName: \"kubernetes.io/projected/50c2c378-9d23-4d2b-80c9-c466fb0b6c7e-kube-api-access-r42mh\") pod \"test-curl-7578-140464051952304\" (UID: \"50c2c378-9d23-4d2b-80c9-c466fb0b6c7e\") " pod="opendatahub/test-curl-7578-140464051952304"
Aug 05 18:28:27.879826 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:27.879738    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7578-140464051952304"
Aug 05 18:28:28.017676 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:28.017647    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7578-140464051952304"]
Aug 05 18:28:28.019434 ip-10-0-129-136 kubenswrapper[2558]: W0805 18:28:28.019408    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod50c2c378_9d23_4d2b_80c9_c466fb0b6c7e.slice/crio-f4257c9fdb03a7013f02a11ebecfa126bb1f991876d42191dc60e610c7a220f5 WatchSource:0}: Error finding container f4257c9fdb03a7013f02a11ebecfa126bb1f991876d42191dc60e610c7a220f5: Status 404 returned error can't find the container with id f4257c9fdb03a7013f02a11ebecfa126bb1f991876d42191dc60e610c7a220f5
Aug 05 18:28:28.020853 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:28.020831    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 18:28:28.966277 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:28.966155    2558 generic.go:356] "Generic (PLEG): container finished" podID="50c2c378-9d23-4d2b-80c9-c466fb0b6c7e" containerID="79921d1fd4a4f53d133b02705fa182611662a5d93bda95d6543b0cd9f13465de" exitCode=0
Aug 05 18:28:28.966277 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:28.966183    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7578-140464051952304" event={"ID":"50c2c378-9d23-4d2b-80c9-c466fb0b6c7e","Type":"ContainerDied","Data":"79921d1fd4a4f53d133b02705fa182611662a5d93bda95d6543b0cd9f13465de"}
Aug 05 18:28:28.966277 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:28.966236    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7578-140464051952304" event={"ID":"50c2c378-9d23-4d2b-80c9-c466fb0b6c7e","Type":"ContainerStarted","Data":"f4257c9fdb03a7013f02a11ebecfa126bb1f991876d42191dc60e610c7a220f5"}
Aug 05 18:28:30.117814 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:30.117789    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7578-140464051952304"
Aug 05 18:28:30.158035 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:30.157981    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7578-140464051952304_50c2c378-9d23-4d2b-80c9-c466fb0b6c7e/test-curl-7578-140464051952304/0.log"
Aug 05 18:28:30.179599 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:30.179569    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7578-140464051952304"]
Aug 05 18:28:30.183536 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:30.183504    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7578-140464051952304"]
Aug 05 18:28:30.232500 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:30.232419    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r42mh\" (UniqueName: \"kubernetes.io/projected/50c2c378-9d23-4d2b-80c9-c466fb0b6c7e-kube-api-access-r42mh\") pod \"50c2c378-9d23-4d2b-80c9-c466fb0b6c7e\" (UID: \"50c2c378-9d23-4d2b-80c9-c466fb0b6c7e\") "
Aug 05 18:28:30.234664 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:30.234635    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50c2c378-9d23-4d2b-80c9-c466fb0b6c7e-kube-api-access-r42mh" (OuterVolumeSpecName: "kube-api-access-r42mh") pod "50c2c378-9d23-4d2b-80c9-c466fb0b6c7e" (UID: "50c2c378-9d23-4d2b-80c9-c466fb0b6c7e"). InnerVolumeSpecName "kube-api-access-r42mh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 18:28:30.254986 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:30.254958    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50c2c378-9d23-4d2b-80c9-c466fb0b6c7e" path="/var/lib/kubelet/pods/50c2c378-9d23-4d2b-80c9-c466fb0b6c7e/volumes"
Aug 05 18:28:30.302419 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:30.302390    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7578-140464051888944"]
Aug 05 18:28:30.302784 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:30.302771    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50c2c378-9d23-4d2b-80c9-c466fb0b6c7e" containerName="test-curl-7578-140464051952304"
Aug 05 18:28:30.302837 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:30.302786    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="50c2c378-9d23-4d2b-80c9-c466fb0b6c7e" containerName="test-curl-7578-140464051952304"
Aug 05 18:28:30.302882 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:30.302867    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="50c2c378-9d23-4d2b-80c9-c466fb0b6c7e" containerName="test-curl-7578-140464051952304"
Aug 05 18:28:30.305981 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:30.305962    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7578-140464051888944"
Aug 05 18:28:30.311893 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:30.311866    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7578-140464051888944"]
Aug 05 18:28:30.333908 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:30.333879    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r42mh\" (UniqueName: \"kubernetes.io/projected/50c2c378-9d23-4d2b-80c9-c466fb0b6c7e-kube-api-access-r42mh\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:28:30.435208 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:30.435169    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7nqw\" (UniqueName: \"kubernetes.io/projected/19117f47-ecb6-411d-845d-8d773d78b38e-kube-api-access-g7nqw\") pod \"test-curl-7578-140464051888944\" (UID: \"19117f47-ecb6-411d-845d-8d773d78b38e\") " pod="opendatahub/test-curl-7578-140464051888944"
Aug 05 18:28:30.535813 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:30.535715    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7nqw\" (UniqueName: \"kubernetes.io/projected/19117f47-ecb6-411d-845d-8d773d78b38e-kube-api-access-g7nqw\") pod \"test-curl-7578-140464051888944\" (UID: \"19117f47-ecb6-411d-845d-8d773d78b38e\") " pod="opendatahub/test-curl-7578-140464051888944"
Aug 05 18:28:30.545670 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:30.545638    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7nqw\" (UniqueName: \"kubernetes.io/projected/19117f47-ecb6-411d-845d-8d773d78b38e-kube-api-access-g7nqw\") pod \"test-curl-7578-140464051888944\" (UID: \"19117f47-ecb6-411d-845d-8d773d78b38e\") " pod="opendatahub/test-curl-7578-140464051888944"
Aug 05 18:28:30.617028 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:30.616995    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7578-140464051888944"
Aug 05 18:28:30.755885 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:30.755859    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7578-140464051888944"]
Aug 05 18:28:30.756950 ip-10-0-129-136 kubenswrapper[2558]: W0805 18:28:30.756924    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod19117f47_ecb6_411d_845d_8d773d78b38e.slice/crio-45ea09a2dd9f3a1812bb29a1271b962536ca3e06ed930fe62e54801b9abb2a5f WatchSource:0}: Error finding container 45ea09a2dd9f3a1812bb29a1271b962536ca3e06ed930fe62e54801b9abb2a5f: Status 404 returned error can't find the container with id 45ea09a2dd9f3a1812bb29a1271b962536ca3e06ed930fe62e54801b9abb2a5f
Aug 05 18:28:30.985426 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:30.985386    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7578-140464051888944" event={"ID":"19117f47-ecb6-411d-845d-8d773d78b38e","Type":"ContainerStarted","Data":"45ea09a2dd9f3a1812bb29a1271b962536ca3e06ed930fe62e54801b9abb2a5f"}
Aug 05 18:28:30.986630 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:30.986609    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7578-140464051952304"
Aug 05 18:28:30.986630 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:30.986624    2558 scope.go:117] "RemoveContainer" containerID="79921d1fd4a4f53d133b02705fa182611662a5d93bda95d6543b0cd9f13465de"
Aug 05 18:28:31.994768 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:31.994732    2558 generic.go:356] "Generic (PLEG): container finished" podID="19117f47-ecb6-411d-845d-8d773d78b38e" containerID="24298bf2d9ed150d7f964dd7e13d19bd92220cb780155f53b8072c4cc8a9573c" exitCode=0
Aug 05 18:28:31.995153 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:31.994820    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7578-140464051888944" event={"ID":"19117f47-ecb6-411d-845d-8d773d78b38e","Type":"ContainerDied","Data":"24298bf2d9ed150d7f964dd7e13d19bd92220cb780155f53b8072c4cc8a9573c"}
Aug 05 18:28:33.144095 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:33.144068    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7578-140464051888944"
Aug 05 18:28:33.167134 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:33.167099    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7578-140464051888944_19117f47-ecb6-411d-845d-8d773d78b38e/test-curl-7578-140464051888944/0.log"
Aug 05 18:28:33.190028 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:33.189996    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7578-140464051888944"]
Aug 05 18:28:33.193952 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:33.193929    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7578-140464051888944"]
Aug 05 18:28:33.264471 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:33.264385    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7nqw\" (UniqueName: \"kubernetes.io/projected/19117f47-ecb6-411d-845d-8d773d78b38e-kube-api-access-g7nqw\") pod \"19117f47-ecb6-411d-845d-8d773d78b38e\" (UID: \"19117f47-ecb6-411d-845d-8d773d78b38e\") "
Aug 05 18:28:33.266649 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:33.266619    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19117f47-ecb6-411d-845d-8d773d78b38e-kube-api-access-g7nqw" (OuterVolumeSpecName: "kube-api-access-g7nqw") pod "19117f47-ecb6-411d-845d-8d773d78b38e" (UID: "19117f47-ecb6-411d-845d-8d773d78b38e"). InnerVolumeSpecName "kube-api-access-g7nqw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 18:28:33.365371 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:33.365328    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7nqw\" (UniqueName: \"kubernetes.io/projected/19117f47-ecb6-411d-845d-8d773d78b38e-kube-api-access-g7nqw\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:28:33.367886 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:33.367863    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7578-140464051935248"]
Aug 05 18:28:33.368289 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:33.368277    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19117f47-ecb6-411d-845d-8d773d78b38e" containerName="test-curl-7578-140464051888944"
Aug 05 18:28:33.368333 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:33.368291    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="19117f47-ecb6-411d-845d-8d773d78b38e" containerName="test-curl-7578-140464051888944"
Aug 05 18:28:33.368365 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:33.368354    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="19117f47-ecb6-411d-845d-8d773d78b38e" containerName="test-curl-7578-140464051888944"
Aug 05 18:28:33.371414 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:33.371399    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7578-140464051935248"
Aug 05 18:28:33.377427 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:33.377402    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7578-140464051935248"]
Aug 05 18:28:33.466655 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:33.466621    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9qmw\" (UniqueName: \"kubernetes.io/projected/267d1e55-15fa-4532-94be-1f177e2ba63c-kube-api-access-z9qmw\") pod \"test-curl-7578-140464051935248\" (UID: \"267d1e55-15fa-4532-94be-1f177e2ba63c\") " pod="opendatahub/test-curl-7578-140464051935248"
Aug 05 18:28:33.567869 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:33.567772    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9qmw\" (UniqueName: \"kubernetes.io/projected/267d1e55-15fa-4532-94be-1f177e2ba63c-kube-api-access-z9qmw\") pod \"test-curl-7578-140464051935248\" (UID: \"267d1e55-15fa-4532-94be-1f177e2ba63c\") " pod="opendatahub/test-curl-7578-140464051935248"
Aug 05 18:28:33.577294 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:33.577265    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9qmw\" (UniqueName: \"kubernetes.io/projected/267d1e55-15fa-4532-94be-1f177e2ba63c-kube-api-access-z9qmw\") pod \"test-curl-7578-140464051935248\" (UID: \"267d1e55-15fa-4532-94be-1f177e2ba63c\") " pod="opendatahub/test-curl-7578-140464051935248"
Aug 05 18:28:33.682879 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:33.682844    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7578-140464051935248"
Aug 05 18:28:33.823272 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:33.823209    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7578-140464051935248"]
Aug 05 18:28:33.824873 ip-10-0-129-136 kubenswrapper[2558]: W0805 18:28:33.824843    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod267d1e55_15fa_4532_94be_1f177e2ba63c.slice/crio-a815d034da31075f32f28f337e01e357f2714d0909dbae41537a5f6452fd25e5 WatchSource:0}: Error finding container a815d034da31075f32f28f337e01e357f2714d0909dbae41537a5f6452fd25e5: Status 404 returned error can't find the container with id a815d034da31075f32f28f337e01e357f2714d0909dbae41537a5f6452fd25e5
Aug 05 18:28:34.007037 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:34.007000    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7578-140464051935248" event={"ID":"267d1e55-15fa-4532-94be-1f177e2ba63c","Type":"ContainerStarted","Data":"a815d034da31075f32f28f337e01e357f2714d0909dbae41537a5f6452fd25e5"}
Aug 05 18:28:34.008368 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:34.008350    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="45ea09a2dd9f3a1812bb29a1271b962536ca3e06ed930fe62e54801b9abb2a5f"
Aug 05 18:28:34.008368 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:34.008355    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7578-140464051888944"
Aug 05 18:28:34.019328 ip-10-0-129-136 kubenswrapper[2558]: E0805 18:28:34.019301    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7578-140464051888944\" is forbidden: User \"system:node:ip-10-0-129-136.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-129-136.ec2.internal' and this object" podUID="19117f47-ecb6-411d-845d-8d773d78b38e" pod="opendatahub/test-curl-7578-140464051888944"
Aug 05 18:28:34.258631 ip-10-0-129-136 kubenswrapper[2558]: E0805 18:28:34.258533    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7578-140464051888944\" is forbidden: User \"system:node:ip-10-0-129-136.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-129-136.ec2.internal' and this object" podUID="19117f47-ecb6-411d-845d-8d773d78b38e" pod="opendatahub/test-curl-7578-140464051888944"
Aug 05 18:28:34.259536 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:34.259512    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19117f47-ecb6-411d-845d-8d773d78b38e" path="/var/lib/kubelet/pods/19117f47-ecb6-411d-845d-8d773d78b38e/volumes"
Aug 05 18:28:35.015736 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:35.015698    2558 generic.go:356] "Generic (PLEG): container finished" podID="267d1e55-15fa-4532-94be-1f177e2ba63c" containerID="a2843290326021874985a70f974fc1e1f6095d45d1ea4a8c74bbd2905f7510ee" exitCode=0
Aug 05 18:28:35.015950 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:35.015745    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7578-140464051935248" event={"ID":"267d1e55-15fa-4532-94be-1f177e2ba63c","Type":"ContainerDied","Data":"a2843290326021874985a70f974fc1e1f6095d45d1ea4a8c74bbd2905f7510ee"}
Aug 05 18:28:36.152486 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:36.152462    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7578-140464051935248"
Aug 05 18:28:36.172626 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:36.172603    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7578-140464051935248_267d1e55-15fa-4532-94be-1f177e2ba63c/test-curl-7578-140464051935248/0.log"
Aug 05 18:28:36.195364 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:36.195331    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7578-140464051935248"]
Aug 05 18:28:36.199172 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:36.199147    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7578-140464051935248"]
Aug 05 18:28:36.290645 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:36.290568    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9qmw\" (UniqueName: \"kubernetes.io/projected/267d1e55-15fa-4532-94be-1f177e2ba63c-kube-api-access-z9qmw\") pod \"267d1e55-15fa-4532-94be-1f177e2ba63c\" (UID: \"267d1e55-15fa-4532-94be-1f177e2ba63c\") "
Aug 05 18:28:36.292827 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:36.292796    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/267d1e55-15fa-4532-94be-1f177e2ba63c-kube-api-access-z9qmw" (OuterVolumeSpecName: "kube-api-access-z9qmw") pod "267d1e55-15fa-4532-94be-1f177e2ba63c" (UID: "267d1e55-15fa-4532-94be-1f177e2ba63c"). InnerVolumeSpecName "kube-api-access-z9qmw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 18:28:36.314176 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:36.314148    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7578-140464051935248"]
Aug 05 18:28:36.314644 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:36.314626    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="267d1e55-15fa-4532-94be-1f177e2ba63c" containerName="test-curl-7578-140464051935248"
Aug 05 18:28:36.314733 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:36.314647    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="267d1e55-15fa-4532-94be-1f177e2ba63c" containerName="test-curl-7578-140464051935248"
Aug 05 18:28:36.314788 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:36.314778    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="267d1e55-15fa-4532-94be-1f177e2ba63c" containerName="test-curl-7578-140464051935248"
Aug 05 18:28:36.317831 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:36.317812    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7578-140464051935248"
Aug 05 18:28:36.325396 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:36.325345    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7578-140464051935248"]
Aug 05 18:28:36.392248 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:36.392180    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n87fq\" (UniqueName: \"kubernetes.io/projected/b1918a84-98e1-4a53-8c11-ee72af4b38f0-kube-api-access-n87fq\") pod \"test-curl-7578-140464051935248\" (UID: \"b1918a84-98e1-4a53-8c11-ee72af4b38f0\") " pod="opendatahub/test-curl-7578-140464051935248"
Aug 05 18:28:36.392430 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:36.392325    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9qmw\" (UniqueName: \"kubernetes.io/projected/267d1e55-15fa-4532-94be-1f177e2ba63c-kube-api-access-z9qmw\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:28:36.492973 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:36.492925    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n87fq\" (UniqueName: \"kubernetes.io/projected/b1918a84-98e1-4a53-8c11-ee72af4b38f0-kube-api-access-n87fq\") pod \"test-curl-7578-140464051935248\" (UID: \"b1918a84-98e1-4a53-8c11-ee72af4b38f0\") " pod="opendatahub/test-curl-7578-140464051935248"
Aug 05 18:28:36.501862 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:36.501829    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n87fq\" (UniqueName: \"kubernetes.io/projected/b1918a84-98e1-4a53-8c11-ee72af4b38f0-kube-api-access-n87fq\") pod \"test-curl-7578-140464051935248\" (UID: \"b1918a84-98e1-4a53-8c11-ee72af4b38f0\") " pod="opendatahub/test-curl-7578-140464051935248"
Aug 05 18:28:36.628087 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:36.628003    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7578-140464051935248"
Aug 05 18:28:36.766560 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:36.766525    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7578-140464051935248"]
Aug 05 18:28:36.770000 ip-10-0-129-136 kubenswrapper[2558]: W0805 18:28:36.769976    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb1918a84_98e1_4a53_8c11_ee72af4b38f0.slice/crio-9d26995cf641e617a923f34967efd0b78a69aa09c12a82f7023d3d169338cc2f WatchSource:0}: Error finding container 9d26995cf641e617a923f34967efd0b78a69aa09c12a82f7023d3d169338cc2f: Status 404 returned error can't find the container with id 9d26995cf641e617a923f34967efd0b78a69aa09c12a82f7023d3d169338cc2f
Aug 05 18:28:37.027933 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:37.027906    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7578-140464051935248" event={"ID":"b1918a84-98e1-4a53-8c11-ee72af4b38f0","Type":"ContainerStarted","Data":"9d26995cf641e617a923f34967efd0b78a69aa09c12a82f7023d3d169338cc2f"}
Aug 05 18:28:37.029118 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:37.029099    2558 scope.go:117] "RemoveContainer" containerID="a2843290326021874985a70f974fc1e1f6095d45d1ea4a8c74bbd2905f7510ee"
Aug 05 18:28:37.029215 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:37.029105    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7578-140464051935248"
Aug 05 18:28:38.042294 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:38.042262    2558 generic.go:356] "Generic (PLEG): container finished" podID="b1918a84-98e1-4a53-8c11-ee72af4b38f0" containerID="62c43efb44cf14fee80bd1dc903913e47b39b326db2b123890cc87a8a2f207ca" exitCode=0
Aug 05 18:28:38.042778 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:38.042363    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7578-140464051935248" event={"ID":"b1918a84-98e1-4a53-8c11-ee72af4b38f0","Type":"ContainerDied","Data":"62c43efb44cf14fee80bd1dc903913e47b39b326db2b123890cc87a8a2f207ca"}
Aug 05 18:28:38.255327 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:38.255293    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="267d1e55-15fa-4532-94be-1f177e2ba63c" path="/var/lib/kubelet/pods/267d1e55-15fa-4532-94be-1f177e2ba63c/volumes"
Aug 05 18:28:39.188766 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:39.188743    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7578-140464051935248"
Aug 05 18:28:39.210852 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:39.210828    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7578-140464051935248_b1918a84-98e1-4a53-8c11-ee72af4b38f0/test-curl-7578-140464051935248/0.log"
Aug 05 18:28:39.234739 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:39.234712    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7578-140464051935248"]
Aug 05 18:28:39.238157 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:39.238135    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7578-140464051935248"]
Aug 05 18:28:39.319680 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:39.319601    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n87fq\" (UniqueName: \"kubernetes.io/projected/b1918a84-98e1-4a53-8c11-ee72af4b38f0-kube-api-access-n87fq\") pod \"b1918a84-98e1-4a53-8c11-ee72af4b38f0\" (UID: \"b1918a84-98e1-4a53-8c11-ee72af4b38f0\") "
Aug 05 18:28:39.321796 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:39.321766    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1918a84-98e1-4a53-8c11-ee72af4b38f0-kube-api-access-n87fq" (OuterVolumeSpecName: "kube-api-access-n87fq") pod "b1918a84-98e1-4a53-8c11-ee72af4b38f0" (UID: "b1918a84-98e1-4a53-8c11-ee72af4b38f0"). InnerVolumeSpecName "kube-api-access-n87fq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 18:28:39.347260 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:39.347213    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7578-140464048080912"]
Aug 05 18:28:39.347685 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:39.347666    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1918a84-98e1-4a53-8c11-ee72af4b38f0" containerName="test-curl-7578-140464051935248"
Aug 05 18:28:39.347762 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:39.347688    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1918a84-98e1-4a53-8c11-ee72af4b38f0" containerName="test-curl-7578-140464051935248"
Aug 05 18:28:39.347826 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:39.347812    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1918a84-98e1-4a53-8c11-ee72af4b38f0" containerName="test-curl-7578-140464051935248"
Aug 05 18:28:39.350889 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:39.350871    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7578-140464048080912"
Aug 05 18:28:39.358344 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:39.358317    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7578-140464048080912"]
Aug 05 18:28:39.421233 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:39.421196    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxc8k\" (UniqueName: \"kubernetes.io/projected/73c6b1ec-431d-48e6-b52e-2ecc13bf1459-kube-api-access-kxc8k\") pod \"test-curl-7578-140464048080912\" (UID: \"73c6b1ec-431d-48e6-b52e-2ecc13bf1459\") " pod="opendatahub/test-curl-7578-140464048080912"
Aug 05 18:28:39.421411 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:39.421356    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n87fq\" (UniqueName: \"kubernetes.io/projected/b1918a84-98e1-4a53-8c11-ee72af4b38f0-kube-api-access-n87fq\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:28:39.522728 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:39.522685    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxc8k\" (UniqueName: \"kubernetes.io/projected/73c6b1ec-431d-48e6-b52e-2ecc13bf1459-kube-api-access-kxc8k\") pod \"test-curl-7578-140464048080912\" (UID: \"73c6b1ec-431d-48e6-b52e-2ecc13bf1459\") " pod="opendatahub/test-curl-7578-140464048080912"
Aug 05 18:28:39.532355 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:39.532323    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxc8k\" (UniqueName: \"kubernetes.io/projected/73c6b1ec-431d-48e6-b52e-2ecc13bf1459-kube-api-access-kxc8k\") pod \"test-curl-7578-140464048080912\" (UID: \"73c6b1ec-431d-48e6-b52e-2ecc13bf1459\") " pod="opendatahub/test-curl-7578-140464048080912"
Aug 05 18:28:39.661751 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:39.661722    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7578-140464048080912"
Aug 05 18:28:39.797757 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:39.797731    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7578-140464048080912"]
Aug 05 18:28:39.798328 ip-10-0-129-136 kubenswrapper[2558]: W0805 18:28:39.798299    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod73c6b1ec_431d_48e6_b52e_2ecc13bf1459.slice/crio-8aa3f1e8ffc7889d7cad28083f151e026e9e650e1e2c20a665cd50ff42af89f4 WatchSource:0}: Error finding container 8aa3f1e8ffc7889d7cad28083f151e026e9e650e1e2c20a665cd50ff42af89f4: Status 404 returned error can't find the container with id 8aa3f1e8ffc7889d7cad28083f151e026e9e650e1e2c20a665cd50ff42af89f4
Aug 05 18:28:40.056576 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:40.056481    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7578-140464051935248"
Aug 05 18:28:40.056576 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:40.056529    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d26995cf641e617a923f34967efd0b78a69aa09c12a82f7023d3d169338cc2f"
Aug 05 18:28:40.057830 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:40.057801    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7578-140464048080912" event={"ID":"73c6b1ec-431d-48e6-b52e-2ecc13bf1459","Type":"ContainerStarted","Data":"8aa3f1e8ffc7889d7cad28083f151e026e9e650e1e2c20a665cd50ff42af89f4"}
Aug 05 18:28:40.067675 ip-10-0-129-136 kubenswrapper[2558]: E0805 18:28:40.067645    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7578-140464051935248\" is forbidden: User \"system:node:ip-10-0-129-136.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-129-136.ec2.internal' and this object" podUID="b1918a84-98e1-4a53-8c11-ee72af4b38f0" pod="opendatahub/test-curl-7578-140464051935248"
Aug 05 18:28:40.255035 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:40.255004    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1918a84-98e1-4a53-8c11-ee72af4b38f0" path="/var/lib/kubelet/pods/b1918a84-98e1-4a53-8c11-ee72af4b38f0/volumes"
Aug 05 18:28:41.064270 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:41.064210    2558 generic.go:356] "Generic (PLEG): container finished" podID="73c6b1ec-431d-48e6-b52e-2ecc13bf1459" containerID="67d0f668bd6d19d49f89ac62f4f212a7cc40a818af0e71a80cf0c30218084f54" exitCode=0
Aug 05 18:28:41.064439 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:41.064287    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7578-140464048080912" event={"ID":"73c6b1ec-431d-48e6-b52e-2ecc13bf1459","Type":"ContainerDied","Data":"67d0f668bd6d19d49f89ac62f4f212a7cc40a818af0e71a80cf0c30218084f54"}
Aug 05 18:28:42.209122 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:42.209096    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7578-140464048080912"
Aug 05 18:28:42.232010 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:42.231984    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7578-140464048080912_73c6b1ec-431d-48e6-b52e-2ecc13bf1459/test-curl-7578-140464048080912/0.log"
Aug 05 18:28:42.256930 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:42.256905    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7578-140464048080912"]
Aug 05 18:28:42.259122 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:42.259097    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7578-140464048080912"]
Aug 05 18:28:42.355546 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:42.355465    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxc8k\" (UniqueName: \"kubernetes.io/projected/73c6b1ec-431d-48e6-b52e-2ecc13bf1459-kube-api-access-kxc8k\") pod \"73c6b1ec-431d-48e6-b52e-2ecc13bf1459\" (UID: \"73c6b1ec-431d-48e6-b52e-2ecc13bf1459\") "
Aug 05 18:28:42.357694 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:42.357661    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73c6b1ec-431d-48e6-b52e-2ecc13bf1459-kube-api-access-kxc8k" (OuterVolumeSpecName: "kube-api-access-kxc8k") pod "73c6b1ec-431d-48e6-b52e-2ecc13bf1459" (UID: "73c6b1ec-431d-48e6-b52e-2ecc13bf1459"). InnerVolumeSpecName "kube-api-access-kxc8k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 18:28:42.371094 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:42.371073    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7578-140464048080912"]
Aug 05 18:28:42.371505 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:42.371490    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73c6b1ec-431d-48e6-b52e-2ecc13bf1459" containerName="test-curl-7578-140464048080912"
Aug 05 18:28:42.371555 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:42.371507    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="73c6b1ec-431d-48e6-b52e-2ecc13bf1459" containerName="test-curl-7578-140464048080912"
Aug 05 18:28:42.371591 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:42.371583    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="73c6b1ec-431d-48e6-b52e-2ecc13bf1459" containerName="test-curl-7578-140464048080912"
Aug 05 18:28:42.374566 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:42.374550    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7578-140464048080912"
Aug 05 18:28:42.382857 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:42.382837    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7578-140464048080912"]
Aug 05 18:28:42.456589 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:42.456563    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrdxn\" (UniqueName: \"kubernetes.io/projected/affa5841-7a4c-46b4-8405-6b31f609a3f8-kube-api-access-mrdxn\") pod \"test-curl-7578-140464048080912\" (UID: \"affa5841-7a4c-46b4-8405-6b31f609a3f8\") " pod="opendatahub/test-curl-7578-140464048080912"
Aug 05 18:28:42.456704 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:42.456615    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxc8k\" (UniqueName: \"kubernetes.io/projected/73c6b1ec-431d-48e6-b52e-2ecc13bf1459-kube-api-access-kxc8k\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:28:42.557710 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:42.557676    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrdxn\" (UniqueName: \"kubernetes.io/projected/affa5841-7a4c-46b4-8405-6b31f609a3f8-kube-api-access-mrdxn\") pod \"test-curl-7578-140464048080912\" (UID: \"affa5841-7a4c-46b4-8405-6b31f609a3f8\") " pod="opendatahub/test-curl-7578-140464048080912"
Aug 05 18:28:42.567394 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:42.567367    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrdxn\" (UniqueName: \"kubernetes.io/projected/affa5841-7a4c-46b4-8405-6b31f609a3f8-kube-api-access-mrdxn\") pod \"test-curl-7578-140464048080912\" (UID: \"affa5841-7a4c-46b4-8405-6b31f609a3f8\") " pod="opendatahub/test-curl-7578-140464048080912"
Aug 05 18:28:42.683802 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:42.683766    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7578-140464048080912"
Aug 05 18:28:42.827640 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:42.827612    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7578-140464048080912"]
Aug 05 18:28:42.828567 ip-10-0-129-136 kubenswrapper[2558]: W0805 18:28:42.828543    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaffa5841_7a4c_46b4_8405_6b31f609a3f8.slice/crio-c7096cd9e98dc3114c6b722fd8858239dd44cbaea93e8a11aca41723984f1531 WatchSource:0}: Error finding container c7096cd9e98dc3114c6b722fd8858239dd44cbaea93e8a11aca41723984f1531: Status 404 returned error can't find the container with id c7096cd9e98dc3114c6b722fd8858239dd44cbaea93e8a11aca41723984f1531
Aug 05 18:28:43.077029 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:43.076949    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7578-140464048080912" event={"ID":"affa5841-7a4c-46b4-8405-6b31f609a3f8","Type":"ContainerStarted","Data":"c7096cd9e98dc3114c6b722fd8858239dd44cbaea93e8a11aca41723984f1531"}
Aug 05 18:28:43.078425 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:43.078400    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7578-140464048080912"
Aug 05 18:28:43.078425 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:43.078409    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8aa3f1e8ffc7889d7cad28083f151e026e9e650e1e2c20a665cd50ff42af89f4"
Aug 05 18:28:43.098559 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:43.098522    2558 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7578-140464048080912" oldPodUID="73c6b1ec-431d-48e6-b52e-2ecc13bf1459" podUID="affa5841-7a4c-46b4-8405-6b31f609a3f8"
Aug 05 18:28:44.086403 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:44.086361    2558 generic.go:356] "Generic (PLEG): container finished" podID="affa5841-7a4c-46b4-8405-6b31f609a3f8" containerID="407b839d045acc2317b27d424bf45523f81aac307acf86543b7fc7efbed3172a" exitCode=0
Aug 05 18:28:44.086793 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:44.086456    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7578-140464048080912" event={"ID":"affa5841-7a4c-46b4-8405-6b31f609a3f8","Type":"ContainerDied","Data":"407b839d045acc2317b27d424bf45523f81aac307acf86543b7fc7efbed3172a"}
Aug 05 18:28:44.262409 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:44.262368    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73c6b1ec-431d-48e6-b52e-2ecc13bf1459" path="/var/lib/kubelet/pods/73c6b1ec-431d-48e6-b52e-2ecc13bf1459/volumes"
Aug 05 18:28:45.237135 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:45.237114    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7578-140464048080912"
Aug 05 18:28:45.259424 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:45.259393    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7578-140464048080912_affa5841-7a4c-46b4-8405-6b31f609a3f8/test-curl-7578-140464048080912/0.log"
Aug 05 18:28:45.283990 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:45.283964    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7578-140464048080912"]
Aug 05 18:28:45.287922 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:45.287900    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7578-140464048080912"]
Aug 05 18:28:45.385167 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:45.385073    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrdxn\" (UniqueName: \"kubernetes.io/projected/affa5841-7a4c-46b4-8405-6b31f609a3f8-kube-api-access-mrdxn\") pod \"affa5841-7a4c-46b4-8405-6b31f609a3f8\" (UID: \"affa5841-7a4c-46b4-8405-6b31f609a3f8\") "
Aug 05 18:28:45.387239 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:45.387200    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/affa5841-7a4c-46b4-8405-6b31f609a3f8-kube-api-access-mrdxn" (OuterVolumeSpecName: "kube-api-access-mrdxn") pod "affa5841-7a4c-46b4-8405-6b31f609a3f8" (UID: "affa5841-7a4c-46b4-8405-6b31f609a3f8"). InnerVolumeSpecName "kube-api-access-mrdxn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 18:28:45.486310 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:45.486278    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrdxn\" (UniqueName: \"kubernetes.io/projected/affa5841-7a4c-46b4-8405-6b31f609a3f8-kube-api-access-mrdxn\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:28:46.100055 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:46.100022    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7578-140464048080912"
Aug 05 18:28:46.100055 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:46.100058    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c7096cd9e98dc3114c6b722fd8858239dd44cbaea93e8a11aca41723984f1531"
Aug 05 18:28:46.110536 ip-10-0-129-136 kubenswrapper[2558]: E0805 18:28:46.110503    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7578-140464048080912\" is forbidden: User \"system:node:ip-10-0-129-136.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-129-136.ec2.internal' and this object" podUID="affa5841-7a4c-46b4-8405-6b31f609a3f8" pod="opendatahub/test-curl-7578-140464048080912"
Aug 05 18:28:46.256092 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:46.256059    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="affa5841-7a4c-46b4-8405-6b31f609a3f8" path="/var/lib/kubelet/pods/affa5841-7a4c-46b4-8405-6b31f609a3f8/volumes"
Aug 05 18:28:49.906955 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:49.906917    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b5b093-55b58cb9f7-9czvm"]
Aug 05 18:28:49.907575 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:49.907557    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="affa5841-7a4c-46b4-8405-6b31f609a3f8" containerName="test-curl-7578-140464048080912"
Aug 05 18:28:49.907619 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:49.907579    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="affa5841-7a4c-46b4-8405-6b31f609a3f8" containerName="test-curl-7578-140464048080912"
Aug 05 18:28:49.907690 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:49.907679    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="affa5841-7a4c-46b4-8405-6b31f609a3f8" containerName="test-curl-7578-140464048080912"
Aug 05 18:28:49.911192 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:49.911175    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b5b093-55b58cb9f7-9czvm"
Aug 05 18:28:49.915033 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:49.915017    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-b5b093-serving-cert\""
Aug 05 18:28:49.915171 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:49.915153    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-jdhhr\""
Aug 05 18:28:49.925965 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:49.925940    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b5b093-55b58cb9f7-9czvm"]
Aug 05 18:28:50.025817 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:50.025775    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83bff7aa-50c9-445a-a074-822ef1b531c9-maas-api-tls\") pod \"maas-api-e2e-ipp-a-b5b093-55b58cb9f7-9czvm\" (UID: \"83bff7aa-50c9-445a-a074-822ef1b531c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b5b093-55b58cb9f7-9czvm"
Aug 05 18:28:50.026000 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:50.025822    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks4z2\" (UniqueName: \"kubernetes.io/projected/83bff7aa-50c9-445a-a074-822ef1b531c9-kube-api-access-ks4z2\") pod \"maas-api-e2e-ipp-a-b5b093-55b58cb9f7-9czvm\" (UID: \"83bff7aa-50c9-445a-a074-822ef1b531c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b5b093-55b58cb9f7-9czvm"
Aug 05 18:28:50.026000 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:50.025926    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83bff7aa-50c9-445a-a074-822ef1b531c9-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-b5b093-55b58cb9f7-9czvm\" (UID: \"83bff7aa-50c9-445a-a074-822ef1b531c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b5b093-55b58cb9f7-9czvm"
Aug 05 18:28:50.126838 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:50.126802    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83bff7aa-50c9-445a-a074-822ef1b531c9-maas-api-tls\") pod \"maas-api-e2e-ipp-a-b5b093-55b58cb9f7-9czvm\" (UID: \"83bff7aa-50c9-445a-a074-822ef1b531c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b5b093-55b58cb9f7-9czvm"
Aug 05 18:28:50.127008 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:50.126848    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ks4z2\" (UniqueName: \"kubernetes.io/projected/83bff7aa-50c9-445a-a074-822ef1b531c9-kube-api-access-ks4z2\") pod \"maas-api-e2e-ipp-a-b5b093-55b58cb9f7-9czvm\" (UID: \"83bff7aa-50c9-445a-a074-822ef1b531c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b5b093-55b58cb9f7-9czvm"
Aug 05 18:28:50.127008 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:50.126899    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83bff7aa-50c9-445a-a074-822ef1b531c9-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-b5b093-55b58cb9f7-9czvm\" (UID: \"83bff7aa-50c9-445a-a074-822ef1b531c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b5b093-55b58cb9f7-9czvm"
Aug 05 18:28:50.127008 ip-10-0-129-136 kubenswrapper[2558]: E0805 18:28:50.126961    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-b5b093-serving-cert: secret "maas-api-e2e-ipp-a-b5b093-serving-cert" not found
Aug 05 18:28:50.127209 ip-10-0-129-136 kubenswrapper[2558]: E0805 18:28:50.127037    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83bff7aa-50c9-445a-a074-822ef1b531c9-maas-api-tls podName:83bff7aa-50c9-445a-a074-822ef1b531c9 nodeName:}" failed. No retries permitted until 2026-08-05 18:28:50.627015827 +0000 UTC m=+3356.939867188 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/83bff7aa-50c9-445a-a074-822ef1b531c9-maas-api-tls") pod "maas-api-e2e-ipp-a-b5b093-55b58cb9f7-9czvm" (UID: "83bff7aa-50c9-445a-a074-822ef1b531c9") : secret "maas-api-e2e-ipp-a-b5b093-serving-cert" not found
Aug 05 18:28:50.127680 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:50.127660    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83bff7aa-50c9-445a-a074-822ef1b531c9-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-b5b093-55b58cb9f7-9czvm\" (UID: \"83bff7aa-50c9-445a-a074-822ef1b531c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b5b093-55b58cb9f7-9czvm"
Aug 05 18:28:50.137106 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:50.137078    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks4z2\" (UniqueName: \"kubernetes.io/projected/83bff7aa-50c9-445a-a074-822ef1b531c9-kube-api-access-ks4z2\") pod \"maas-api-e2e-ipp-a-b5b093-55b58cb9f7-9czvm\" (UID: \"83bff7aa-50c9-445a-a074-822ef1b531c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b5b093-55b58cb9f7-9czvm"
Aug 05 18:28:50.632136 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:50.632101    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83bff7aa-50c9-445a-a074-822ef1b531c9-maas-api-tls\") pod \"maas-api-e2e-ipp-a-b5b093-55b58cb9f7-9czvm\" (UID: \"83bff7aa-50c9-445a-a074-822ef1b531c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b5b093-55b58cb9f7-9czvm"
Aug 05 18:28:50.634889 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:50.634854    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83bff7aa-50c9-445a-a074-822ef1b531c9-maas-api-tls\") pod \"maas-api-e2e-ipp-a-b5b093-55b58cb9f7-9czvm\" (UID: \"83bff7aa-50c9-445a-a074-822ef1b531c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b5b093-55b58cb9f7-9czvm"
Aug 05 18:28:50.730153 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:50.730124    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b5b093-55c9bf7bfb-5d7cv"]
Aug 05 18:28:50.733963 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:50.733948    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b5b093-55c9bf7bfb-5d7cv"
Aug 05 18:28:50.736961 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:50.736925    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-b5b093\""
Aug 05 18:28:50.736961 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:50.736953    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-b5b093-dockercfg-lhrbz\""
Aug 05 18:28:50.745279 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:50.745261    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b5b093-55c9bf7bfb-5d7cv"]
Aug 05 18:28:50.822192 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:50.822163    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b5b093-55b58cb9f7-9czvm"
Aug 05 18:28:50.833733 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:50.833628    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjjb7\" (UniqueName: \"kubernetes.io/projected/edb48a0b-aa3f-45ff-9654-ed608b9d4730-kube-api-access-vjjb7\") pod \"payload-pre-processing-e2e-ipp-a-b5b093-55c9bf7bfb-5d7cv\" (UID: \"edb48a0b-aa3f-45ff-9654-ed608b9d4730\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b5b093-55c9bf7bfb-5d7cv"
Aug 05 18:28:50.833804 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:50.833780    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/edb48a0b-aa3f-45ff-9654-ed608b9d4730-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-b5b093-55c9bf7bfb-5d7cv\" (UID: \"edb48a0b-aa3f-45ff-9654-ed608b9d4730\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b5b093-55c9bf7bfb-5d7cv"
Aug 05 18:28:50.934608 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:50.934575    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjjb7\" (UniqueName: \"kubernetes.io/projected/edb48a0b-aa3f-45ff-9654-ed608b9d4730-kube-api-access-vjjb7\") pod \"payload-pre-processing-e2e-ipp-a-b5b093-55c9bf7bfb-5d7cv\" (UID: \"edb48a0b-aa3f-45ff-9654-ed608b9d4730\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b5b093-55c9bf7bfb-5d7cv"
Aug 05 18:28:50.934981 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:50.934675    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/edb48a0b-aa3f-45ff-9654-ed608b9d4730-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-b5b093-55c9bf7bfb-5d7cv\" (UID: \"edb48a0b-aa3f-45ff-9654-ed608b9d4730\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b5b093-55c9bf7bfb-5d7cv"
Aug 05 18:28:50.935433 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:50.935415    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/edb48a0b-aa3f-45ff-9654-ed608b9d4730-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-b5b093-55c9bf7bfb-5d7cv\" (UID: \"edb48a0b-aa3f-45ff-9654-ed608b9d4730\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b5b093-55c9bf7bfb-5d7cv"
Aug 05 18:28:50.943186 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:50.943159    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjjb7\" (UniqueName: \"kubernetes.io/projected/edb48a0b-aa3f-45ff-9654-ed608b9d4730-kube-api-access-vjjb7\") pod \"payload-pre-processing-e2e-ipp-a-b5b093-55c9bf7bfb-5d7cv\" (UID: \"edb48a0b-aa3f-45ff-9654-ed608b9d4730\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b5b093-55c9bf7bfb-5d7cv"
Aug 05 18:28:50.958475 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:50.958449    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b5b093-55b58cb9f7-9czvm"]
Aug 05 18:28:50.959738 ip-10-0-129-136 kubenswrapper[2558]: W0805 18:28:50.959714    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83bff7aa_50c9_445a_a074_822ef1b531c9.slice/crio-2733d32769dfc5083d0aa8a2e894ebf77a232707a70b6c7534fccb30fde2ce66 WatchSource:0}: Error finding container 2733d32769dfc5083d0aa8a2e894ebf77a232707a70b6c7534fccb30fde2ce66: Status 404 returned error can't find the container with id 2733d32769dfc5083d0aa8a2e894ebf77a232707a70b6c7534fccb30fde2ce66
Aug 05 18:28:51.045504 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:51.045480    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b5b093-55c9bf7bfb-5d7cv"
Aug 05 18:28:51.129551 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:51.129511    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b5b093-55b58cb9f7-9czvm" event={"ID":"83bff7aa-50c9-445a-a074-822ef1b531c9","Type":"ContainerStarted","Data":"2733d32769dfc5083d0aa8a2e894ebf77a232707a70b6c7534fccb30fde2ce66"}
Aug 05 18:28:51.193606 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:51.193580    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b5b093-55c9bf7bfb-5d7cv"]
Aug 05 18:28:51.195875 ip-10-0-129-136 kubenswrapper[2558]: W0805 18:28:51.195845    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedb48a0b_aa3f_45ff_9654_ed608b9d4730.slice/crio-30b2d414a849a33f59f361afeb8336f3ce727c9ed7f376953ffd1436046f97e0 WatchSource:0}: Error finding container 30b2d414a849a33f59f361afeb8336f3ce727c9ed7f376953ffd1436046f97e0: Status 404 returned error can't find the container with id 30b2d414a849a33f59f361afeb8336f3ce727c9ed7f376953ffd1436046f97e0
Aug 05 18:28:52.136086 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:52.136041    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b5b093-55b58cb9f7-9czvm" event={"ID":"83bff7aa-50c9-445a-a074-822ef1b531c9","Type":"ContainerStarted","Data":"7044f3de0b48ea82f3cb087ae4f009bc6fbf4abfc2bd0d4687f8e9f0bc96a721"}
Aug 05 18:28:52.136548 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:52.136233    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b5b093-55b58cb9f7-9czvm"
Aug 05 18:28:52.137524 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:52.137498    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b5b093-55c9bf7bfb-5d7cv" event={"ID":"edb48a0b-aa3f-45ff-9654-ed608b9d4730","Type":"ContainerStarted","Data":"68c6cdd31eb9231be2ddfcef94b2b4f0ee795d6fb9bfb2a672b1a756375304f3"}
Aug 05 18:28:52.137678 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:52.137545    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b5b093-55c9bf7bfb-5d7cv" event={"ID":"edb48a0b-aa3f-45ff-9654-ed608b9d4730","Type":"ContainerStarted","Data":"30b2d414a849a33f59f361afeb8336f3ce727c9ed7f376953ffd1436046f97e0"}
Aug 05 18:28:52.137678 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:52.137574    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b5b093-55c9bf7bfb-5d7cv"
Aug 05 18:28:52.162656 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:52.162613    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b5b093-55b58cb9f7-9czvm" podStartSLOduration=2.704318562 podStartE2EDuration="3.162600465s" totalImagesPullingTime="458.281903ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:28:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:28:52.160009818 +0000 UTC m=+3358.472861192" watchObservedRunningTime="2026-08-05 18:28:52.162600465 +0000 UTC m=+3358.475451827"
Aug 05 18:28:52.179570 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:52.179532    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b5b093-55c9bf7bfb-5d7cv" podStartSLOduration=2.179520547 podStartE2EDuration="2.179520547s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:28:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:28:52.178093092 +0000 UTC m=+3358.490944454" watchObservedRunningTime="2026-08-05 18:28:52.179520547 +0000 UTC m=+3358.492371910"
Aug 05 18:28:58.149092 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:28:58.149062    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b5b093-55b58cb9f7-9czvm"
Aug 05 18:29:03.145428 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:29:03.145385    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b5b093-55c9bf7bfb-5d7cv"
Aug 05 18:29:19.693426 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:29:19.693379    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-cea6f9-7bcb778f56-nd5dc"]
Aug 05 18:29:19.699846 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:29:19.698324    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-cea6f9-7bcb778f56-nd5dc"
Aug 05 18:29:19.699846 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:29:19.699290    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-cea6f9-647cd8d9b8-pfvzw"]
Aug 05 18:29:19.702874 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:29:19.702844    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-cea6f9-dockercfg-5tjrg\""
Aug 05 18:29:19.703004 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:29:19.702964    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-cea6f9\""
Aug 05 18:29:19.704656 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:29:19.704628    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cea6f9-647cd8d9b8-pfvzw"
Aug 05 18:29:19.711368 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:29:19.711344    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-cea6f9-7bcb778f56-nd5dc"]
Aug 05 18:29:19.716902 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:29:19.716879    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-cea6f9-647cd8d9b8-pfvzw"]
Aug 05 18:29:19.805204 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:29:19.805166    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2eb6a348-d6b1-4384-b76b-ffccf166f167-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-cea6f9-7bcb778f56-nd5dc\" (UID: \"2eb6a348-d6b1-4384-b76b-ffccf166f167\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-cea6f9-7bcb778f56-nd5dc"
Aug 05 18:29:19.805404 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:29:19.805248    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9gd6\" (UniqueName: \"kubernetes.io/projected/2eb6a348-d6b1-4384-b76b-ffccf166f167-kube-api-access-f9gd6\") pod \"payload-processing-e2e-ipp-b-cea6f9-7bcb778f56-nd5dc\" (UID: \"2eb6a348-d6b1-4384-b76b-ffccf166f167\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-cea6f9-7bcb778f56-nd5dc"
Aug 05 18:29:19.805404 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:29:19.805306    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrb99\" (UniqueName: \"kubernetes.io/projected/d3ed19f0-546a-45ab-abc5-3fec84e93726-kube-api-access-lrb99\") pod \"payload-pre-processing-e2e-ipp-b-cea6f9-647cd8d9b8-pfvzw\" (UID: \"d3ed19f0-546a-45ab-abc5-3fec84e93726\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cea6f9-647cd8d9b8-pfvzw"
Aug 05 18:29:19.805486 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:29:19.805405    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3ed19f0-546a-45ab-abc5-3fec84e93726-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-cea6f9-647cd8d9b8-pfvzw\" (UID: \"d3ed19f0-546a-45ab-abc5-3fec84e93726\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cea6f9-647cd8d9b8-pfvzw"
Aug 05 18:29:19.906420 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:29:19.906387    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3ed19f0-546a-45ab-abc5-3fec84e93726-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-cea6f9-647cd8d9b8-pfvzw\" (UID: \"d3ed19f0-546a-45ab-abc5-3fec84e93726\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cea6f9-647cd8d9b8-pfvzw"
Aug 05 18:29:19.906594 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:29:19.906453    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2eb6a348-d6b1-4384-b76b-ffccf166f167-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-cea6f9-7bcb778f56-nd5dc\" (UID: \"2eb6a348-d6b1-4384-b76b-ffccf166f167\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-cea6f9-7bcb778f56-nd5dc"
Aug 05 18:29:19.906594 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:29:19.906485    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9gd6\" (UniqueName: \"kubernetes.io/projected/2eb6a348-d6b1-4384-b76b-ffccf166f167-kube-api-access-f9gd6\") pod \"payload-processing-e2e-ipp-b-cea6f9-7bcb778f56-nd5dc\" (UID: \"2eb6a348-d6b1-4384-b76b-ffccf166f167\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-cea6f9-7bcb778f56-nd5dc"
Aug 05 18:29:19.906594 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:29:19.906507    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrb99\" (UniqueName: \"kubernetes.io/projected/d3ed19f0-546a-45ab-abc5-3fec84e93726-kube-api-access-lrb99\") pod \"payload-pre-processing-e2e-ipp-b-cea6f9-647cd8d9b8-pfvzw\" (UID: \"d3ed19f0-546a-45ab-abc5-3fec84e93726\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cea6f9-647cd8d9b8-pfvzw"
Aug 05 18:29:19.907378 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:29:19.907354    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2eb6a348-d6b1-4384-b76b-ffccf166f167-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-cea6f9-7bcb778f56-nd5dc\" (UID: \"2eb6a348-d6b1-4384-b76b-ffccf166f167\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-cea6f9-7bcb778f56-nd5dc"
Aug 05 18:29:19.907422 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:29:19.907354    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3ed19f0-546a-45ab-abc5-3fec84e93726-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-cea6f9-647cd8d9b8-pfvzw\" (UID: \"d3ed19f0-546a-45ab-abc5-3fec84e93726\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cea6f9-647cd8d9b8-pfvzw"
Aug 05 18:29:19.915404 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:29:19.915382    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrb99\" (UniqueName: \"kubernetes.io/projected/d3ed19f0-546a-45ab-abc5-3fec84e93726-kube-api-access-lrb99\") pod \"payload-pre-processing-e2e-ipp-b-cea6f9-647cd8d9b8-pfvzw\" (UID: \"d3ed19f0-546a-45ab-abc5-3fec84e93726\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cea6f9-647cd8d9b8-pfvzw"
Aug 05 18:29:19.915528 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:29:19.915478    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9gd6\" (UniqueName: \"kubernetes.io/projected/2eb6a348-d6b1-4384-b76b-ffccf166f167-kube-api-access-f9gd6\") pod \"payload-processing-e2e-ipp-b-cea6f9-7bcb778f56-nd5dc\" (UID: \"2eb6a348-d6b1-4384-b76b-ffccf166f167\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-cea6f9-7bcb778f56-nd5dc"
Aug 05 18:29:20.017817 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:29:20.017720    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-cea6f9-7bcb778f56-nd5dc"
Aug 05 18:29:20.025197 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:29:20.025171    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cea6f9-647cd8d9b8-pfvzw"
Aug 05 18:29:20.195971 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:29:20.195792    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-cea6f9-647cd8d9b8-pfvzw"]
Aug 05 18:29:20.198383 ip-10-0-129-136 kubenswrapper[2558]: W0805 18:29:20.198343    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3ed19f0_546a_45ab_abc5_3fec84e93726.slice/crio-2cc0318f1174db0a786d79fea597d56c31fe3a706a3aadd19195116749f04db9 WatchSource:0}: Error finding container 2cc0318f1174db0a786d79fea597d56c31fe3a706a3aadd19195116749f04db9: Status 404 returned error can't find the container with id 2cc0318f1174db0a786d79fea597d56c31fe3a706a3aadd19195116749f04db9
Aug 05 18:29:20.301993 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:29:20.301911    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cea6f9-647cd8d9b8-pfvzw" event={"ID":"d3ed19f0-546a-45ab-abc5-3fec84e93726","Type":"ContainerStarted","Data":"b1d13183edf17c6b8828de421b20c799e16568436c4001c54e241f193b8b342f"}
Aug 05 18:29:20.301993 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:29:20.301961    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cea6f9-647cd8d9b8-pfvzw" event={"ID":"d3ed19f0-546a-45ab-abc5-3fec84e93726","Type":"ContainerStarted","Data":"2cc0318f1174db0a786d79fea597d56c31fe3a706a3aadd19195116749f04db9"}
Aug 05 18:29:20.302173 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:29:20.302013    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cea6f9-647cd8d9b8-pfvzw"
Aug 05 18:29:20.319669 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:29:20.319622    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cea6f9-647cd8d9b8-pfvzw" podStartSLOduration=1.319607949 podStartE2EDuration="1.319607949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:29:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:29:20.318671076 +0000 UTC m=+3386.631522440" watchObservedRunningTime="2026-08-05 18:29:20.319607949 +0000 UTC m=+3386.632459353"
Aug 05 18:29:20.378587 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:29:20.378559    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-cea6f9-7bcb778f56-nd5dc"]
Aug 05 18:29:20.380149 ip-10-0-129-136 kubenswrapper[2558]: W0805 18:29:20.380122    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eb6a348_d6b1_4384_b76b_ffccf166f167.slice/crio-38b5b77daa004b7433e1bad0aca13cc383666ac5505c5eb0e3bdab80d1e69101 WatchSource:0}: Error finding container 38b5b77daa004b7433e1bad0aca13cc383666ac5505c5eb0e3bdab80d1e69101: Status 404 returned error can't find the container with id 38b5b77daa004b7433e1bad0aca13cc383666ac5505c5eb0e3bdab80d1e69101
Aug 05 18:29:21.311282 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:29:21.311245    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-cea6f9-7bcb778f56-nd5dc" event={"ID":"2eb6a348-d6b1-4384-b76b-ffccf166f167","Type":"ContainerStarted","Data":"c509bd33649e5ad89ec91cce9a153d66d912857f841f1081cc9491aed592a0ff"}
Aug 05 18:29:21.311732 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:29:21.311310    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-cea6f9-7bcb778f56-nd5dc" event={"ID":"2eb6a348-d6b1-4384-b76b-ffccf166f167","Type":"ContainerStarted","Data":"38b5b77daa004b7433e1bad0aca13cc383666ac5505c5eb0e3bdab80d1e69101"}
Aug 05 18:29:21.331679 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:29:21.331632    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-cea6f9-7bcb778f56-nd5dc" podStartSLOduration=2.331619109 podStartE2EDuration="2.331619109s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:29:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:29:21.329762523 +0000 UTC m=+3387.642613885" watchObservedRunningTime="2026-08-05 18:29:21.331619109 +0000 UTC m=+3387.644470472"
Aug 05 18:29:22.317700 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:29:22.317669    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-cea6f9-7bcb778f56-nd5dc"
Aug 05 18:29:31.314394 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:29:31.314352    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cea6f9-647cd8d9b8-pfvzw"
Aug 05 18:29:33.326341 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:29:33.326310    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-cea6f9-7bcb778f56-nd5dc"
Aug 05 18:29:49.713100 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:29:49.713067    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-cea6f9-7bcb778f56-nd5dc_2eb6a348-d6b1-4384-b76b-ffccf166f167/payload-processing/0.log"
Aug 05 18:30:00.150831 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:00.150798    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-70b4a4-29765910-l625p"]
Aug 05 18:30:00.154905 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:00.154877    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-70b4a4-29765910-l625p"
Aug 05 18:30:00.155951 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:00.155920    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765910-4cs8g"]
Aug 05 18:30:00.157435 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:00.157415    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xn2vw\""
Aug 05 18:30:00.159447 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:00.159430    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-cea6f9-29765910-nlgbv"]
Aug 05 18:30:00.159554 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:00.159542    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765910-4cs8g"
Aug 05 18:30:00.163020 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:00.163001    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6fb560-29765910-kc2jt"]
Aug 05 18:30:00.163120 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:00.163103    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-cea6f9-29765910-nlgbv"
Aug 05 18:30:00.167422 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:00.167396    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-70b4a4-29765910-l625p"
Aug 05 18:30:00.168163 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:00.168089    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-b5b093-29765910-2xqhh"]
Aug 05 18:30:00.170115 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:00.170090    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6fb560-29765910-kc2jt"
Aug 05 18:30:00.177132 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:00.176433    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-70b4a4-29765910-l625p"]
Aug 05 18:30:00.177132 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:00.176550    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-b5b093-29765910-2xqhh"
Aug 05 18:30:00.178262 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:00.178177    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765910-4cs8g"]
Aug 05 18:30:00.183492 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:00.183455    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-b5b093-29765910-2xqhh"]
Aug 05 18:30:00.183679 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:00.183661    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765910-4cs8g"
Aug 05 18:30:00.189168 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:00.187435    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-cea6f9-29765910-nlgbv"]
Aug 05 18:30:00.195103 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:00.195081    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6fb560-29765910-kc2jt"]
Aug 05 18:30:00.229771 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:00.229559    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-cea6f9-29765910-nlgbv"
Aug 05 18:30:00.241972 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:00.241297    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6fb560-29765910-kc2jt"
Aug 05 18:30:00.285131 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:00.285073    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-b5b093-29765910-2xqhh"
Aug 05 18:30:00.495788 ip-10-0-129-136 kubenswrapper[2558]: W0805 18:30:00.486743    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0196d5f_ce85_417f_8830_884db588cf88.slice/crio-229ade879e5a999c69590e7fff97f0040add5831d0c542ae18578c7491531d0e WatchSource:0}: Error finding container 229ade879e5a999c69590e7fff97f0040add5831d0c542ae18578c7491531d0e: Status 404 returned error can't find the container with id 229ade879e5a999c69590e7fff97f0040add5831d0c542ae18578c7491531d0e
Aug 05 18:30:00.495788 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:00.489328    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-cea6f9-29765910-nlgbv"]
Aug 05 18:30:00.508633 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:00.508610    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-b5b093-29765910-2xqhh"]
Aug 05 18:30:00.512646 ip-10-0-129-136 kubenswrapper[2558]: W0805 18:30:00.512619    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f549205_7efd_48af_8d1d_455049725870.slice/crio-6278791409cf19b5c99fd54325d9d6a965d8912f56e49aad438394ba55aa74b4 WatchSource:0}: Error finding container 6278791409cf19b5c99fd54325d9d6a965d8912f56e49aad438394ba55aa74b4: Status 404 returned error can't find the container with id 6278791409cf19b5c99fd54325d9d6a965d8912f56e49aad438394ba55aa74b4
Aug 05 18:30:00.549800 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:00.549771    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-b5b093-29765910-2xqhh" event={"ID":"6f549205-7efd-48af-8d1d-455049725870","Type":"ContainerStarted","Data":"6278791409cf19b5c99fd54325d9d6a965d8912f56e49aad438394ba55aa74b4"}
Aug 05 18:30:00.551012 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:00.550986    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-cea6f9-29765910-nlgbv" event={"ID":"a0196d5f-ce85-417f-8830-884db588cf88","Type":"ContainerStarted","Data":"229ade879e5a999c69590e7fff97f0040add5831d0c542ae18578c7491531d0e"}
Aug 05 18:30:00.585933 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:00.585908    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-70b4a4-29765910-l625p"]
Aug 05 18:30:00.588449 ip-10-0-129-136 kubenswrapper[2558]: W0805 18:30:00.588421    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd47ba5ac_571d_45de_ab6b_90c88d42c294.slice/crio-339da10458be994bce195a8587279cf97c6c17fa1e1c48860146da7e7237c9a3 WatchSource:0}: Error finding container 339da10458be994bce195a8587279cf97c6c17fa1e1c48860146da7e7237c9a3: Status 404 returned error can't find the container with id 339da10458be994bce195a8587279cf97c6c17fa1e1c48860146da7e7237c9a3
Aug 05 18:30:00.620559 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:00.620535    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765910-4cs8g"]
Aug 05 18:30:00.625427 ip-10-0-129-136 kubenswrapper[2558]: W0805 18:30:00.625402    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61cc6ed9_ae7c_4d8f_be54_2c2eff6b06cf.slice/crio-b557612020e0557720518a80e529fafd0c3ba3c7ba33e036972f97c13d8c5b8e WatchSource:0}: Error finding container b557612020e0557720518a80e529fafd0c3ba3c7ba33e036972f97c13d8c5b8e: Status 404 returned error can't find the container with id b557612020e0557720518a80e529fafd0c3ba3c7ba33e036972f97c13d8c5b8e
Aug 05 18:30:00.664461 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:00.664432    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6fb560-29765910-kc2jt"]
Aug 05 18:30:00.665606 ip-10-0-129-136 kubenswrapper[2558]: W0805 18:30:00.665583    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd79bda56_f9ed_44cb_9366_ef8592d9182d.slice/crio-27337610ddc66b71980b1e34dffcca80dce5b6d03a255d6882bfc44e7e66a562 WatchSource:0}: Error finding container 27337610ddc66b71980b1e34dffcca80dce5b6d03a255d6882bfc44e7e66a562: Status 404 returned error can't find the container with id 27337610ddc66b71980b1e34dffcca80dce5b6d03a255d6882bfc44e7e66a562
Aug 05 18:30:01.559178 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:01.559139    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-70b4a4-29765910-l625p" event={"ID":"d47ba5ac-571d-45de-ab6b-90c88d42c294","Type":"ContainerStarted","Data":"0fc36dd9d7817b73a4f018fc2b99d058ed166a1315f464dcba0ca3fc69ed6368"}
Aug 05 18:30:01.559684 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:01.559211    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-70b4a4-29765910-l625p" event={"ID":"d47ba5ac-571d-45de-ab6b-90c88d42c294","Type":"ContainerStarted","Data":"339da10458be994bce195a8587279cf97c6c17fa1e1c48860146da7e7237c9a3"}
Aug 05 18:30:01.560761 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:01.560735    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-b5b093-29765910-2xqhh" event={"ID":"6f549205-7efd-48af-8d1d-455049725870","Type":"ContainerStarted","Data":"692b922bac08a419a487f3500fd008725bf45f235d7764bb952728bc176538e1"}
Aug 05 18:30:01.562384 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:01.562345    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-cea6f9-29765910-nlgbv" event={"ID":"a0196d5f-ce85-417f-8830-884db588cf88","Type":"ContainerStarted","Data":"14622f48d80df8ab51215061c3f7c9f4561d4aa9a226fa4865cd1fd3c0ad8ea8"}
Aug 05 18:30:01.564056 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:01.564033    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6fb560-29765910-kc2jt" event={"ID":"d79bda56-f9ed-44cb-9366-ef8592d9182d","Type":"ContainerStarted","Data":"f7d496076aaaccb2e84fde4cfd1e35b209c3c2c359dd39f79a89009810fa81ed"}
Aug 05 18:30:01.564164 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:01.564075    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6fb560-29765910-kc2jt" event={"ID":"d79bda56-f9ed-44cb-9366-ef8592d9182d","Type":"ContainerStarted","Data":"27337610ddc66b71980b1e34dffcca80dce5b6d03a255d6882bfc44e7e66a562"}
Aug 05 18:30:01.565604 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:01.565582    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765910-4cs8g" event={"ID":"61cc6ed9-ae7c-4d8f-be54-2c2eff6b06cf","Type":"ContainerStarted","Data":"7d452ccab172c743a9aed5ae8d14a4b87f34c24f48ca2ef6ee9ec895716d6469"}
Aug 05 18:30:01.565693 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:01.565624    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765910-4cs8g" event={"ID":"61cc6ed9-ae7c-4d8f-be54-2c2eff6b06cf","Type":"ContainerStarted","Data":"b557612020e0557720518a80e529fafd0c3ba3c7ba33e036972f97c13d8c5b8e"}
Aug 05 18:30:01.576825 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:01.576635    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-70b4a4-29765910-l625p" podStartSLOduration=1.576611685 podStartE2EDuration="1.576611685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:30:01.576273842 +0000 UTC m=+3427.889125205" watchObservedRunningTime="2026-08-05 18:30:01.576611685 +0000 UTC m=+3427.889463052"
Aug 05 18:30:01.592646 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:01.592575    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-cea6f9-29765910-nlgbv" podStartSLOduration=1.592552134 podStartE2EDuration="1.592552134s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:30:01.592097473 +0000 UTC m=+3427.904948831" watchObservedRunningTime="2026-08-05 18:30:01.592552134 +0000 UTC m=+3427.905403498"
Aug 05 18:30:01.608576 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:01.608515    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6fb560-29765910-kc2jt" podStartSLOduration=1.608499792 podStartE2EDuration="1.608499792s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:30:01.60808519 +0000 UTC m=+3427.920936626" watchObservedRunningTime="2026-08-05 18:30:01.608499792 +0000 UTC m=+3427.921351155"
Aug 05 18:30:01.624993 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:01.624937    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765910-4cs8g" podStartSLOduration=1.624921525 podStartE2EDuration="1.624921525s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:30:01.624321493 +0000 UTC m=+3427.937172860" watchObservedRunningTime="2026-08-05 18:30:01.624921525 +0000 UTC m=+3427.937772928"
Aug 05 18:30:01.641990 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:01.641931    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-b5b093-29765910-2xqhh" podStartSLOduration=1.6419123070000001 podStartE2EDuration="1.641912307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:30:01.640680693 +0000 UTC m=+3427.953532079" watchObservedRunningTime="2026-08-05 18:30:01.641912307 +0000 UTC m=+3427.954763669"
Aug 05 18:30:02.574289 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:02.574185    2558 generic.go:356] "Generic (PLEG): container finished" podID="d79bda56-f9ed-44cb-9366-ef8592d9182d" containerID="f7d496076aaaccb2e84fde4cfd1e35b209c3c2c359dd39f79a89009810fa81ed" exitCode=0
Aug 05 18:30:02.574289 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:02.574275    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6fb560-29765910-kc2jt" event={"ID":"d79bda56-f9ed-44cb-9366-ef8592d9182d","Type":"ContainerDied","Data":"f7d496076aaaccb2e84fde4cfd1e35b209c3c2c359dd39f79a89009810fa81ed"}
Aug 05 18:30:02.575951 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:02.575920    2558 generic.go:356] "Generic (PLEG): container finished" podID="61cc6ed9-ae7c-4d8f-be54-2c2eff6b06cf" containerID="7d452ccab172c743a9aed5ae8d14a4b87f34c24f48ca2ef6ee9ec895716d6469" exitCode=0
Aug 05 18:30:02.576118 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:02.575998    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765910-4cs8g" event={"ID":"61cc6ed9-ae7c-4d8f-be54-2c2eff6b06cf","Type":"ContainerDied","Data":"7d452ccab172c743a9aed5ae8d14a4b87f34c24f48ca2ef6ee9ec895716d6469"}
Aug 05 18:30:02.577607 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:02.577580    2558 generic.go:356] "Generic (PLEG): container finished" podID="d47ba5ac-571d-45de-ab6b-90c88d42c294" containerID="0fc36dd9d7817b73a4f018fc2b99d058ed166a1315f464dcba0ca3fc69ed6368" exitCode=0
Aug 05 18:30:02.577736 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:02.577661    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-70b4a4-29765910-l625p" event={"ID":"d47ba5ac-571d-45de-ab6b-90c88d42c294","Type":"ContainerDied","Data":"0fc36dd9d7817b73a4f018fc2b99d058ed166a1315f464dcba0ca3fc69ed6368"}
Aug 05 18:30:02.579119 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:02.579099    2558 generic.go:356] "Generic (PLEG): container finished" podID="6f549205-7efd-48af-8d1d-455049725870" containerID="692b922bac08a419a487f3500fd008725bf45f235d7764bb952728bc176538e1" exitCode=0
Aug 05 18:30:02.579243 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:02.579164    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-b5b093-29765910-2xqhh" event={"ID":"6f549205-7efd-48af-8d1d-455049725870","Type":"ContainerDied","Data":"692b922bac08a419a487f3500fd008725bf45f235d7764bb952728bc176538e1"}
Aug 05 18:30:02.580690 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:02.580669    2558 generic.go:356] "Generic (PLEG): container finished" podID="a0196d5f-ce85-417f-8830-884db588cf88" containerID="14622f48d80df8ab51215061c3f7c9f4561d4aa9a226fa4865cd1fd3c0ad8ea8" exitCode=0
Aug 05 18:30:02.580785 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:02.580739    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-cea6f9-29765910-nlgbv" event={"ID":"a0196d5f-ce85-417f-8830-884db588cf88","Type":"ContainerDied","Data":"14622f48d80df8ab51215061c3f7c9f4561d4aa9a226fa4865cd1fd3c0ad8ea8"}
Aug 05 18:30:03.785258 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:03.784760    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-70b4a4-29765910-l625p"
Aug 05 18:30:03.791871 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:03.791759    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-b5b093-29765910-2xqhh"
Aug 05 18:30:03.848799 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:03.848702    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6fb560-29765910-kc2jt"
Aug 05 18:30:03.852010 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:03.851988    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765910-4cs8g"
Aug 05 18:30:03.855584 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:03.855565    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-cea6f9-29765910-nlgbv"
Aug 05 18:30:04.594922 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:04.594830    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-cea6f9-29765910-nlgbv"
Aug 05 18:30:04.594922 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:04.594866    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-cea6f9-29765910-nlgbv" event={"ID":"a0196d5f-ce85-417f-8830-884db588cf88","Type":"ContainerDied","Data":"229ade879e5a999c69590e7fff97f0040add5831d0c542ae18578c7491531d0e"}
Aug 05 18:30:04.595112 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:04.594924    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="229ade879e5a999c69590e7fff97f0040add5831d0c542ae18578c7491531d0e"
Aug 05 18:30:04.596215 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:04.596198    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6fb560-29765910-kc2jt"
Aug 05 18:30:04.596337 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:04.596240    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6fb560-29765910-kc2jt" event={"ID":"d79bda56-f9ed-44cb-9366-ef8592d9182d","Type":"ContainerDied","Data":"27337610ddc66b71980b1e34dffcca80dce5b6d03a255d6882bfc44e7e66a562"}
Aug 05 18:30:04.596337 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:04.596277    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="27337610ddc66b71980b1e34dffcca80dce5b6d03a255d6882bfc44e7e66a562"
Aug 05 18:30:04.597647 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:04.597631    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765910-4cs8g"
Aug 05 18:30:04.597739 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:04.597660    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765910-4cs8g" event={"ID":"61cc6ed9-ae7c-4d8f-be54-2c2eff6b06cf","Type":"ContainerDied","Data":"b557612020e0557720518a80e529fafd0c3ba3c7ba33e036972f97c13d8c5b8e"}
Aug 05 18:30:04.597739 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:04.597699    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b557612020e0557720518a80e529fafd0c3ba3c7ba33e036972f97c13d8c5b8e"
Aug 05 18:30:04.599329 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:04.599311    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-70b4a4-29765910-l625p"
Aug 05 18:30:04.599444 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:04.599339    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-70b4a4-29765910-l625p" event={"ID":"d47ba5ac-571d-45de-ab6b-90c88d42c294","Type":"ContainerDied","Data":"339da10458be994bce195a8587279cf97c6c17fa1e1c48860146da7e7237c9a3"}
Aug 05 18:30:04.599444 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:04.599383    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="339da10458be994bce195a8587279cf97c6c17fa1e1c48860146da7e7237c9a3"
Aug 05 18:30:04.600747 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:04.600729    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-b5b093-29765910-2xqhh"
Aug 05 18:30:04.600849 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:04.600729    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-b5b093-29765910-2xqhh" event={"ID":"6f549205-7efd-48af-8d1d-455049725870","Type":"ContainerDied","Data":"6278791409cf19b5c99fd54325d9d6a965d8912f56e49aad438394ba55aa74b4"}
Aug 05 18:30:04.600849 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:04.600835    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6278791409cf19b5c99fd54325d9d6a965d8912f56e49aad438394ba55aa74b4"
Aug 05 18:30:34.730402 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:34.730365    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-cea6f9-7bcb778f56-nd5dc_2eb6a348-d6b1-4384-b76b-ffccf166f167/payload-processing/0.log"
Aug 05 18:30:35.329687 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.329653    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"]
Aug 05 18:30:35.330135 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.330118    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d79bda56-f9ed-44cb-9366-ef8592d9182d" containerName="cleanup"
Aug 05 18:30:35.330201 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.330138    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d79bda56-f9ed-44cb-9366-ef8592d9182d" containerName="cleanup"
Aug 05 18:30:35.330201 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.330154    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f549205-7efd-48af-8d1d-455049725870" containerName="cleanup"
Aug 05 18:30:35.330201 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.330161    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f549205-7efd-48af-8d1d-455049725870" containerName="cleanup"
Aug 05 18:30:35.330201 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.330171    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61cc6ed9-ae7c-4d8f-be54-2c2eff6b06cf" containerName="cleanup"
Aug 05 18:30:35.330201 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.330177    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="61cc6ed9-ae7c-4d8f-be54-2c2eff6b06cf" containerName="cleanup"
Aug 05 18:30:35.330201 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.330191    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0196d5f-ce85-417f-8830-884db588cf88" containerName="cleanup"
Aug 05 18:30:35.330201 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.330196    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0196d5f-ce85-417f-8830-884db588cf88" containerName="cleanup"
Aug 05 18:30:35.330489 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.330205    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d47ba5ac-571d-45de-ab6b-90c88d42c294" containerName="cleanup"
Aug 05 18:30:35.330489 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.330210    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d47ba5ac-571d-45de-ab6b-90c88d42c294" containerName="cleanup"
Aug 05 18:30:35.330489 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.330302    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d79bda56-f9ed-44cb-9366-ef8592d9182d" containerName="cleanup"
Aug 05 18:30:35.330489 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.330311    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="61cc6ed9-ae7c-4d8f-be54-2c2eff6b06cf" containerName="cleanup"
Aug 05 18:30:35.330489 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.330317    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d47ba5ac-571d-45de-ab6b-90c88d42c294" containerName="cleanup"
Aug 05 18:30:35.330489 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.330323    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f549205-7efd-48af-8d1d-455049725870" containerName="cleanup"
Aug 05 18:30:35.330489 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.330329    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0196d5f-ce85-417f-8830-884db588cf88" containerName="cleanup"
Aug 05 18:30:35.335093 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.335070    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"
Aug 05 18:30:35.337902 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.337881    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-eef9c6-openshift-default-dockercfg-qff9m\""
Aug 05 18:30:35.349813 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.349788    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"]
Aug 05 18:30:35.432597 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.432563    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-istio-data\") pod \"e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b\" (UID: \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"
Aug 05 18:30:35.432783 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.432616    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-workload-certs\") pod \"e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b\" (UID: \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"
Aug 05 18:30:35.432783 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.432645    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-istio-token\") pod \"e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b\" (UID: \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"
Aug 05 18:30:35.432783 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.432740    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-istio-podinfo\") pod \"e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b\" (UID: \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"
Aug 05 18:30:35.432913 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.432784    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvnd6\" (UniqueName: \"kubernetes.io/projected/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-kube-api-access-zvnd6\") pod \"e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b\" (UID: \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"
Aug 05 18:30:35.432913 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.432887    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-credential-socket\") pod \"e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b\" (UID: \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"
Aug 05 18:30:35.432991 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.432923    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-workload-socket\") pod \"e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b\" (UID: \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"
Aug 05 18:30:35.432991 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.432949    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-istiod-ca-cert\") pod \"e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b\" (UID: \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"
Aug 05 18:30:35.433078 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.433010    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-istio-envoy\") pod \"e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b\" (UID: \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"
Aug 05 18:30:35.534071 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.534031    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-credential-socket\") pod \"e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b\" (UID: \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"
Aug 05 18:30:35.534301 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.534082    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-workload-socket\") pod \"e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b\" (UID: \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"
Aug 05 18:30:35.534301 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.534179    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-istiod-ca-cert\") pod \"e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b\" (UID: \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"
Aug 05 18:30:35.534301 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.534254    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-istio-envoy\") pod \"e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b\" (UID: \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"
Aug 05 18:30:35.534301 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.534288    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-istio-data\") pod \"e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b\" (UID: \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"
Aug 05 18:30:35.534567 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.534325    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-workload-certs\") pod \"e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b\" (UID: \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"
Aug 05 18:30:35.534567 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.534347    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-istio-token\") pod \"e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b\" (UID: \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"
Aug 05 18:30:35.534567 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.534390    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-istio-podinfo\") pod \"e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b\" (UID: \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"
Aug 05 18:30:35.534567 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.534421    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvnd6\" (UniqueName: \"kubernetes.io/projected/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-kube-api-access-zvnd6\") pod \"e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b\" (UID: \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"
Aug 05 18:30:35.534771 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.534570    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-credential-socket\") pod \"e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b\" (UID: \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"
Aug 05 18:30:35.534771 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.534601    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-workload-socket\") pod \"e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b\" (UID: \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"
Aug 05 18:30:35.534771 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.534680    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-istio-data\") pod \"e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b\" (UID: \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"
Aug 05 18:30:35.534975 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.534953    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-istiod-ca-cert\") pod \"e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b\" (UID: \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"
Aug 05 18:30:35.535044 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.534976    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-workload-certs\") pod \"e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b\" (UID: \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"
Aug 05 18:30:35.536997 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.536978    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-istio-podinfo\") pod \"e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b\" (UID: \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"
Aug 05 18:30:35.537097 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.537027    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-istio-envoy\") pod \"e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b\" (UID: \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"
Aug 05 18:30:35.543535 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.543501    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-istio-token\") pod \"e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b\" (UID: \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"
Aug 05 18:30:35.543814 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.543796    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvnd6\" (UniqueName: \"kubernetes.io/projected/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-kube-api-access-zvnd6\") pod \"e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b\" (UID: \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"
Aug 05 18:30:35.646502 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.646407    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"
Aug 05 18:30:35.797288 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.797260    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"]
Aug 05 18:30:35.798283 ip-10-0-129-136 kubenswrapper[2558]: W0805 18:30:35.798262    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb614fd31_3265_458b_95ab_cbdd6d0c8ceb.slice/crio-4b6b83f66f31abeca1cc2ea8550ca8b61d07644a1a142ade45631870dcde12a7 WatchSource:0}: Error finding container 4b6b83f66f31abeca1cc2ea8550ca8b61d07644a1a142ade45631870dcde12a7: Status 404 returned error can't find the container with id 4b6b83f66f31abeca1cc2ea8550ca8b61d07644a1a142ade45631870dcde12a7
Aug 05 18:30:35.800498 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.800468    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 05 18:30:35.800577 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.800532    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 05 18:30:35.800619 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:35.800575    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 05 18:30:36.799346 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:36.799302    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b" event={"ID":"b614fd31-3265-458b-95ab-cbdd6d0c8ceb","Type":"ContainerStarted","Data":"03072fd8ad0b14e1ce9373b2eb89377c881f5ce82ea9f46a909a9f4d55458f8b"}
Aug 05 18:30:36.799812 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:36.799372    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b" event={"ID":"b614fd31-3265-458b-95ab-cbdd6d0c8ceb","Type":"ContainerStarted","Data":"4b6b83f66f31abeca1cc2ea8550ca8b61d07644a1a142ade45631870dcde12a7"}
Aug 05 18:30:36.825828 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:36.825767    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b" podStartSLOduration=1.825750802 podStartE2EDuration="1.825750802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:30:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:30:36.822288195 +0000 UTC m=+3463.135139557" watchObservedRunningTime="2026-08-05 18:30:36.825750802 +0000 UTC m=+3463.138602164"
Aug 05 18:30:37.646696 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:37.646665    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"
Aug 05 18:30:37.651878 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:37.651848    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"
Aug 05 18:30:37.806015 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:37.805979    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"
Aug 05 18:30:37.806947 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:37.806929    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"
Aug 05 18:30:40.621283 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:40.621248    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eef9c6-5b978fbd68-4c4zm"]
Aug 05 18:30:40.624874 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:40.624858    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eef9c6-5b978fbd68-4c4zm"
Aug 05 18:30:40.628440 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:40.628417    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-eef9c6-dockercfg-n6h2h\""
Aug 05 18:30:40.628440 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:40.628432    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-eef9c6\""
Aug 05 18:30:40.637328 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:40.637284    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eef9c6-5b978fbd68-4c4zm"]
Aug 05 18:30:40.647177 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:40.647151    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-eef9c6-6847cfdc5b-4g5k6"]
Aug 05 18:30:40.650840 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:40.650821    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-eef9c6-6847cfdc5b-4g5k6"
Aug 05 18:30:40.664882 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:40.664853    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-eef9c6-6847cfdc5b-4g5k6"]
Aug 05 18:30:40.686089 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:40.686059    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3eb1556c-d44e-4194-98ac-9aa64e2b523b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-eef9c6-5b978fbd68-4c4zm\" (UID: \"3eb1556c-d44e-4194-98ac-9aa64e2b523b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eef9c6-5b978fbd68-4c4zm"
Aug 05 18:30:40.686249 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:40.686104    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx55l\" (UniqueName: \"kubernetes.io/projected/3eb1556c-d44e-4194-98ac-9aa64e2b523b-kube-api-access-zx55l\") pod \"payload-pre-processing-e2e-ipp-cleanup-eef9c6-5b978fbd68-4c4zm\" (UID: \"3eb1556c-d44e-4194-98ac-9aa64e2b523b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eef9c6-5b978fbd68-4c4zm"
Aug 05 18:30:40.787522 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:40.787481    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3eb1556c-d44e-4194-98ac-9aa64e2b523b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-eef9c6-5b978fbd68-4c4zm\" (UID: \"3eb1556c-d44e-4194-98ac-9aa64e2b523b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eef9c6-5b978fbd68-4c4zm"
Aug 05 18:30:40.787692 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:40.787533    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx55l\" (UniqueName: \"kubernetes.io/projected/3eb1556c-d44e-4194-98ac-9aa64e2b523b-kube-api-access-zx55l\") pod \"payload-pre-processing-e2e-ipp-cleanup-eef9c6-5b978fbd68-4c4zm\" (UID: \"3eb1556c-d44e-4194-98ac-9aa64e2b523b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eef9c6-5b978fbd68-4c4zm"
Aug 05 18:30:40.787692 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:40.787591    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvmms\" (UniqueName: \"kubernetes.io/projected/345dd446-3209-4807-ba87-e8aa359eb747-kube-api-access-xvmms\") pod \"payload-processing-e2e-ipp-cleanup-eef9c6-6847cfdc5b-4g5k6\" (UID: \"345dd446-3209-4807-ba87-e8aa359eb747\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-eef9c6-6847cfdc5b-4g5k6"
Aug 05 18:30:40.787692 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:40.787622    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/345dd446-3209-4807-ba87-e8aa359eb747-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-eef9c6-6847cfdc5b-4g5k6\" (UID: \"345dd446-3209-4807-ba87-e8aa359eb747\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-eef9c6-6847cfdc5b-4g5k6"
Aug 05 18:30:40.788304 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:40.788283    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3eb1556c-d44e-4194-98ac-9aa64e2b523b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-eef9c6-5b978fbd68-4c4zm\" (UID: \"3eb1556c-d44e-4194-98ac-9aa64e2b523b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eef9c6-5b978fbd68-4c4zm"
Aug 05 18:30:40.797734 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:40.797708    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx55l\" (UniqueName: \"kubernetes.io/projected/3eb1556c-d44e-4194-98ac-9aa64e2b523b-kube-api-access-zx55l\") pod \"payload-pre-processing-e2e-ipp-cleanup-eef9c6-5b978fbd68-4c4zm\" (UID: \"3eb1556c-d44e-4194-98ac-9aa64e2b523b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eef9c6-5b978fbd68-4c4zm"
Aug 05 18:30:40.889289 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:40.889167    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvmms\" (UniqueName: \"kubernetes.io/projected/345dd446-3209-4807-ba87-e8aa359eb747-kube-api-access-xvmms\") pod \"payload-processing-e2e-ipp-cleanup-eef9c6-6847cfdc5b-4g5k6\" (UID: \"345dd446-3209-4807-ba87-e8aa359eb747\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-eef9c6-6847cfdc5b-4g5k6"
Aug 05 18:30:40.889289 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:40.889205    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/345dd446-3209-4807-ba87-e8aa359eb747-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-eef9c6-6847cfdc5b-4g5k6\" (UID: \"345dd446-3209-4807-ba87-e8aa359eb747\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-eef9c6-6847cfdc5b-4g5k6"
Aug 05 18:30:40.889872 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:40.889853    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/345dd446-3209-4807-ba87-e8aa359eb747-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-eef9c6-6847cfdc5b-4g5k6\" (UID: \"345dd446-3209-4807-ba87-e8aa359eb747\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-eef9c6-6847cfdc5b-4g5k6"
Aug 05 18:30:40.899886 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:40.899860    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvmms\" (UniqueName: \"kubernetes.io/projected/345dd446-3209-4807-ba87-e8aa359eb747-kube-api-access-xvmms\") pod \"payload-processing-e2e-ipp-cleanup-eef9c6-6847cfdc5b-4g5k6\" (UID: \"345dd446-3209-4807-ba87-e8aa359eb747\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-eef9c6-6847cfdc5b-4g5k6"
Aug 05 18:30:40.937766 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:40.937734    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eef9c6-5b978fbd68-4c4zm"
Aug 05 18:30:40.962962 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:40.962933    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-eef9c6-6847cfdc5b-4g5k6"
Aug 05 18:30:41.106209 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:41.106177    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eef9c6-5b978fbd68-4c4zm"]
Aug 05 18:30:41.134248 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:41.134204    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-eef9c6-6847cfdc5b-4g5k6"]
Aug 05 18:30:41.137590 ip-10-0-129-136 kubenswrapper[2558]: W0805 18:30:41.137566    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod345dd446_3209_4807_ba87_e8aa359eb747.slice/crio-f76e2bc91dd581dca2220f1acb8e3c7a63c5779c9644a04e25d341a81cba25a5 WatchSource:0}: Error finding container f76e2bc91dd581dca2220f1acb8e3c7a63c5779c9644a04e25d341a81cba25a5: Status 404 returned error can't find the container with id f76e2bc91dd581dca2220f1acb8e3c7a63c5779c9644a04e25d341a81cba25a5
Aug 05 18:30:41.832620 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:41.832586    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eef9c6-5b978fbd68-4c4zm" event={"ID":"3eb1556c-d44e-4194-98ac-9aa64e2b523b","Type":"ContainerStarted","Data":"ecbb2c1c0ab6966ec80cfb956c47b22f2896760185b4c93c2a508f8ea001537c"}
Aug 05 18:30:41.833088 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:41.832639    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eef9c6-5b978fbd68-4c4zm" event={"ID":"3eb1556c-d44e-4194-98ac-9aa64e2b523b","Type":"ContainerStarted","Data":"2ed037c4eae6aa6d16152e5926cf34457f2564ab7d4362cff95ebfea4fcd5d1e"}
Aug 05 18:30:41.833088 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:41.832792    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eef9c6-5b978fbd68-4c4zm"
Aug 05 18:30:41.834209 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:41.834182    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-eef9c6-6847cfdc5b-4g5k6" event={"ID":"345dd446-3209-4807-ba87-e8aa359eb747","Type":"ContainerStarted","Data":"8d341a95e4f110c55ada602df9c875a956baa02bbfc35845fc78be895e978250"}
Aug 05 18:30:41.834336 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:41.834256    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-eef9c6-6847cfdc5b-4g5k6" event={"ID":"345dd446-3209-4807-ba87-e8aa359eb747","Type":"ContainerStarted","Data":"f76e2bc91dd581dca2220f1acb8e3c7a63c5779c9644a04e25d341a81cba25a5"}
Aug 05 18:30:41.834336 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:41.834288    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-eef9c6-6847cfdc5b-4g5k6"
Aug 05 18:30:41.855705 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:41.855659    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eef9c6-5b978fbd68-4c4zm" podStartSLOduration=1.855645634 podStartE2EDuration="1.855645634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:30:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:30:41.853318075 +0000 UTC m=+3468.166169439" watchObservedRunningTime="2026-08-05 18:30:41.855645634 +0000 UTC m=+3468.168496997"
Aug 05 18:30:41.871429 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:41.871366    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-eef9c6-6847cfdc5b-4g5k6" podStartSLOduration=1.871347173 podStartE2EDuration="1.871347173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:30:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:30:41.871214404 +0000 UTC m=+3468.184065769" watchObservedRunningTime="2026-08-05 18:30:41.871347173 +0000 UTC m=+3468.184198535"
Aug 05 18:30:52.844172 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:52.844142    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-eef9c6-6847cfdc5b-4g5k6"
Aug 05 18:30:52.844843 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:52.844246    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eef9c6-5b978fbd68-4c4zm"
Aug 05 18:30:56.952776 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:56.952742    2558 generic.go:356] "Generic (PLEG): container finished" podID="b614fd31-3265-458b-95ab-cbdd6d0c8ceb" containerID="03072fd8ad0b14e1ce9373b2eb89377c881f5ce82ea9f46a909a9f4d55458f8b" exitCode=0
Aug 05 18:30:56.953195 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:56.952812    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b" event={"ID":"b614fd31-3265-458b-95ab-cbdd6d0c8ceb","Type":"ContainerDied","Data":"03072fd8ad0b14e1ce9373b2eb89377c881f5ce82ea9f46a909a9f4d55458f8b"}
Aug 05 18:30:56.953290 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:56.953258    2558 scope.go:117] "RemoveContainer" containerID="03072fd8ad0b14e1ce9373b2eb89377c881f5ce82ea9f46a909a9f4d55458f8b"
Aug 05 18:30:56.954384 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:56.954343    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 05 18:30:56.954452 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:56.954429    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 05 18:30:56.954491 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:56.954461    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 05 18:30:57.960372 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:57.960338    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b" event={"ID":"b614fd31-3265-458b-95ab-cbdd6d0c8ceb","Type":"ContainerStarted","Data":"8ac72706d5b3faeef0d3870def0e1aff27b8957d19c07883746926d7befd5619"}
Aug 05 18:30:58.647545 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:58.647511    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"
Aug 05 18:30:58.647740 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:58.647718    2558 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Aug 05 18:30:58.647788 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:58.647765    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b" podUID="b614fd31-3265-458b-95ab-cbdd6d0c8ceb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Aug 05 18:30:59.647685 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:59.647648    2558 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Aug 05 18:30:59.648144 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:30:59.647710    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b" podUID="b614fd31-3265-458b-95ab-cbdd6d0c8ceb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Aug 05 18:31:00.646983 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:00.646951    2558 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Aug 05 18:31:00.647152 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:00.647014    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b" podUID="b614fd31-3265-458b-95ab-cbdd6d0c8ceb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Aug 05 18:31:01.647559 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:01.647512    2558 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Aug 05 18:31:01.648051 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:01.647579    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b" podUID="b614fd31-3265-458b-95ab-cbdd6d0c8ceb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Aug 05 18:31:02.647586 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:02.647542    2558 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Aug 05 18:31:02.648059 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:02.647603    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b" podUID="b614fd31-3265-458b-95ab-cbdd6d0c8ceb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Aug 05 18:31:03.651799 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:03.651764    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"
Aug 05 18:31:03.652198 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:03.652180    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"
Aug 05 18:31:03.652952 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:03.652930    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"
Aug 05 18:31:10.593384 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:10.593343    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-eef9c6-6847cfdc5b-4g5k6"]
Aug 05 18:31:10.593902 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:10.593619    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-eef9c6-6847cfdc5b-4g5k6" podUID="345dd446-3209-4807-ba87-e8aa359eb747" containerName="payload-processing" containerID="cri-o://8d341a95e4f110c55ada602df9c875a956baa02bbfc35845fc78be895e978250" gracePeriod=30
Aug 05 18:31:10.600716 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:10.600681    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eef9c6-5b978fbd68-4c4zm"]
Aug 05 18:31:10.601380 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:10.601325    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eef9c6-5b978fbd68-4c4zm" podUID="3eb1556c-d44e-4194-98ac-9aa64e2b523b" containerName="payload-pre-processing" containerID="cri-o://ecbb2c1c0ab6966ec80cfb956c47b22f2896760185b4c93c2a508f8ea001537c" gracePeriod=30
Aug 05 18:31:10.875669 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:10.875639    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-eef9c6-6847cfdc5b-4g5k6"
Aug 05 18:31:10.900496 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:10.900301    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvmms\" (UniqueName: \"kubernetes.io/projected/345dd446-3209-4807-ba87-e8aa359eb747-kube-api-access-xvmms\") pod \"345dd446-3209-4807-ba87-e8aa359eb747\" (UID: \"345dd446-3209-4807-ba87-e8aa359eb747\") "
Aug 05 18:31:10.900677 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:10.900648    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/345dd446-3209-4807-ba87-e8aa359eb747-plugins-config-volume\") pod \"345dd446-3209-4807-ba87-e8aa359eb747\" (UID: \"345dd446-3209-4807-ba87-e8aa359eb747\") "
Aug 05 18:31:10.901381 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:10.901350    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/345dd446-3209-4807-ba87-e8aa359eb747-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "345dd446-3209-4807-ba87-e8aa359eb747" (UID: "345dd446-3209-4807-ba87-e8aa359eb747"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 18:31:10.904123 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:10.904083    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/345dd446-3209-4807-ba87-e8aa359eb747-kube-api-access-xvmms" (OuterVolumeSpecName: "kube-api-access-xvmms") pod "345dd446-3209-4807-ba87-e8aa359eb747" (UID: "345dd446-3209-4807-ba87-e8aa359eb747"). InnerVolumeSpecName "kube-api-access-xvmms". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 18:31:10.915536 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:10.915508    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eef9c6-5b978fbd68-4c4zm"
Aug 05 18:31:11.001562 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:11.001510    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zx55l\" (UniqueName: \"kubernetes.io/projected/3eb1556c-d44e-4194-98ac-9aa64e2b523b-kube-api-access-zx55l\") pod \"3eb1556c-d44e-4194-98ac-9aa64e2b523b\" (UID: \"3eb1556c-d44e-4194-98ac-9aa64e2b523b\") "
Aug 05 18:31:11.001781 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:11.001642    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3eb1556c-d44e-4194-98ac-9aa64e2b523b-plugins-config-volume\") pod \"3eb1556c-d44e-4194-98ac-9aa64e2b523b\" (UID: \"3eb1556c-d44e-4194-98ac-9aa64e2b523b\") "
Aug 05 18:31:11.001851 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:11.001797    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/345dd446-3209-4807-ba87-e8aa359eb747-plugins-config-volume\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:31:11.001851 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:11.001807    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvmms\" (UniqueName: \"kubernetes.io/projected/345dd446-3209-4807-ba87-e8aa359eb747-kube-api-access-xvmms\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:31:11.002008 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:11.001971    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3eb1556c-d44e-4194-98ac-9aa64e2b523b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3eb1556c-d44e-4194-98ac-9aa64e2b523b" (UID: "3eb1556c-d44e-4194-98ac-9aa64e2b523b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 18:31:11.003867 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:11.003842    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3eb1556c-d44e-4194-98ac-9aa64e2b523b-kube-api-access-zx55l" (OuterVolumeSpecName: "kube-api-access-zx55l") pod "3eb1556c-d44e-4194-98ac-9aa64e2b523b" (UID: "3eb1556c-d44e-4194-98ac-9aa64e2b523b"). InnerVolumeSpecName "kube-api-access-zx55l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 18:31:11.053896 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:11.053852    2558 generic.go:356] "Generic (PLEG): container finished" podID="3eb1556c-d44e-4194-98ac-9aa64e2b523b" containerID="ecbb2c1c0ab6966ec80cfb956c47b22f2896760185b4c93c2a508f8ea001537c" exitCode=0
Aug 05 18:31:11.054095 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:11.053899    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eef9c6-5b978fbd68-4c4zm"
Aug 05 18:31:11.054095 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:11.053931    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eef9c6-5b978fbd68-4c4zm" event={"ID":"3eb1556c-d44e-4194-98ac-9aa64e2b523b","Type":"ContainerDied","Data":"ecbb2c1c0ab6966ec80cfb956c47b22f2896760185b4c93c2a508f8ea001537c"}
Aug 05 18:31:11.054095 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:11.054000    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eef9c6-5b978fbd68-4c4zm" event={"ID":"3eb1556c-d44e-4194-98ac-9aa64e2b523b","Type":"ContainerDied","Data":"2ed037c4eae6aa6d16152e5926cf34457f2564ab7d4362cff95ebfea4fcd5d1e"}
Aug 05 18:31:11.054095 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:11.054033    2558 scope.go:117] "RemoveContainer" containerID="ecbb2c1c0ab6966ec80cfb956c47b22f2896760185b4c93c2a508f8ea001537c"
Aug 05 18:31:11.055663 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:11.055595    2558 generic.go:356] "Generic (PLEG): container finished" podID="345dd446-3209-4807-ba87-e8aa359eb747" containerID="8d341a95e4f110c55ada602df9c875a956baa02bbfc35845fc78be895e978250" exitCode=0
Aug 05 18:31:11.055791 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:11.055640    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-eef9c6-6847cfdc5b-4g5k6"
Aug 05 18:31:11.055855 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:11.055655    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-eef9c6-6847cfdc5b-4g5k6" event={"ID":"345dd446-3209-4807-ba87-e8aa359eb747","Type":"ContainerDied","Data":"8d341a95e4f110c55ada602df9c875a956baa02bbfc35845fc78be895e978250"}
Aug 05 18:31:11.055915 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:11.055870    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-eef9c6-6847cfdc5b-4g5k6" event={"ID":"345dd446-3209-4807-ba87-e8aa359eb747","Type":"ContainerDied","Data":"f76e2bc91dd581dca2220f1acb8e3c7a63c5779c9644a04e25d341a81cba25a5"}
Aug 05 18:31:11.064667 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:11.064646    2558 scope.go:117] "RemoveContainer" containerID="ecbb2c1c0ab6966ec80cfb956c47b22f2896760185b4c93c2a508f8ea001537c"
Aug 05 18:31:11.064967 ip-10-0-129-136 kubenswrapper[2558]: E0805 18:31:11.064941    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecbb2c1c0ab6966ec80cfb956c47b22f2896760185b4c93c2a508f8ea001537c\": container with ID starting with ecbb2c1c0ab6966ec80cfb956c47b22f2896760185b4c93c2a508f8ea001537c not found: ID does not exist" containerID="ecbb2c1c0ab6966ec80cfb956c47b22f2896760185b4c93c2a508f8ea001537c"
Aug 05 18:31:11.065053 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:11.064980    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecbb2c1c0ab6966ec80cfb956c47b22f2896760185b4c93c2a508f8ea001537c"} err="failed to get container status \"ecbb2c1c0ab6966ec80cfb956c47b22f2896760185b4c93c2a508f8ea001537c\": rpc error: code = NotFound desc = could not find container \"ecbb2c1c0ab6966ec80cfb956c47b22f2896760185b4c93c2a508f8ea001537c\": container with ID starting with ecbb2c1c0ab6966ec80cfb956c47b22f2896760185b4c93c2a508f8ea001537c not found: ID does not exist"
Aug 05 18:31:11.065053 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:11.065004    2558 scope.go:117] "RemoveContainer" containerID="8d341a95e4f110c55ada602df9c875a956baa02bbfc35845fc78be895e978250"
Aug 05 18:31:11.074540 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:11.074522    2558 scope.go:117] "RemoveContainer" containerID="8d341a95e4f110c55ada602df9c875a956baa02bbfc35845fc78be895e978250"
Aug 05 18:31:11.074789 ip-10-0-129-136 kubenswrapper[2558]: E0805 18:31:11.074770    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d341a95e4f110c55ada602df9c875a956baa02bbfc35845fc78be895e978250\": container with ID starting with 8d341a95e4f110c55ada602df9c875a956baa02bbfc35845fc78be895e978250 not found: ID does not exist" containerID="8d341a95e4f110c55ada602df9c875a956baa02bbfc35845fc78be895e978250"
Aug 05 18:31:11.074841 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:11.074796    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d341a95e4f110c55ada602df9c875a956baa02bbfc35845fc78be895e978250"} err="failed to get container status \"8d341a95e4f110c55ada602df9c875a956baa02bbfc35845fc78be895e978250\": rpc error: code = NotFound desc = could not find container \"8d341a95e4f110c55ada602df9c875a956baa02bbfc35845fc78be895e978250\": container with ID starting with 8d341a95e4f110c55ada602df9c875a956baa02bbfc35845fc78be895e978250 not found: ID does not exist"
Aug 05 18:31:11.080830 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:11.080804    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-eef9c6-6847cfdc5b-4g5k6"]
Aug 05 18:31:11.083803 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:11.083769    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-eef9c6-6847cfdc5b-4g5k6"]
Aug 05 18:31:11.095251 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:11.095210    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eef9c6-5b978fbd68-4c4zm"]
Aug 05 18:31:11.098682 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:11.098645    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eef9c6-5b978fbd68-4c4zm"]
Aug 05 18:31:11.102419 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:11.102363    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zx55l\" (UniqueName: \"kubernetes.io/projected/3eb1556c-d44e-4194-98ac-9aa64e2b523b-kube-api-access-zx55l\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:31:11.102419 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:11.102392    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3eb1556c-d44e-4194-98ac-9aa64e2b523b-plugins-config-volume\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:31:12.255665 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:12.255631    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="345dd446-3209-4807-ba87-e8aa359eb747" path="/var/lib/kubelet/pods/345dd446-3209-4807-ba87-e8aa359eb747/volumes"
Aug 05 18:31:12.256186 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:12.256126    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3eb1556c-d44e-4194-98ac-9aa64e2b523b" path="/var/lib/kubelet/pods/3eb1556c-d44e-4194-98ac-9aa64e2b523b/volumes"
Aug 05 18:31:17.517355 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:17.517276    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"]
Aug 05 18:31:17.517772 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:17.517505    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b" podUID="b614fd31-3265-458b-95ab-cbdd6d0c8ceb" containerName="istio-proxy" containerID="cri-o://8ac72706d5b3faeef0d3870def0e1aff27b8957d19c07883746926d7befd5619" gracePeriod=30
Aug 05 18:31:18.654951 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:18.654913    2558 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 05 18:31:18.655416 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:18.654982    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b" podUID="b614fd31-3265-458b-95ab-cbdd6d0c8ceb" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 05 18:31:22.773313 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:22.773286    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"
Aug 05 18:31:22.920634 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:22.920584    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-istio-envoy\") pod \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\" (UID: \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\") "
Aug 05 18:31:22.920634 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:22.920638    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-istio-data\") pod \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\" (UID: \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\") "
Aug 05 18:31:22.920887 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:22.920686    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-istiod-ca-cert\") pod \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\" (UID: \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\") "
Aug 05 18:31:22.920887 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:22.920790    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-istio-podinfo\") pod \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\" (UID: \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\") "
Aug 05 18:31:22.920887 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:22.920846    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-credential-socket\") pod \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\" (UID: \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\") "
Aug 05 18:31:22.920887 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:22.920887    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvnd6\" (UniqueName: \"kubernetes.io/projected/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-kube-api-access-zvnd6\") pod \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\" (UID: \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\") "
Aug 05 18:31:22.921110 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:22.920919    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-workload-certs\") pod \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\" (UID: \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\") "
Aug 05 18:31:22.921110 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:22.920956    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-workload-socket\") pod \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\" (UID: \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\") "
Aug 05 18:31:22.921110 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:22.920981    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-istio-token\") pod \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\" (UID: \"b614fd31-3265-458b-95ab-cbdd6d0c8ceb\") "
Aug 05 18:31:22.921110 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:22.920977    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-istio-data" (OuterVolumeSpecName: "istio-data") pod "b614fd31-3265-458b-95ab-cbdd6d0c8ceb" (UID: "b614fd31-3265-458b-95ab-cbdd6d0c8ceb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:31:22.921352 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:22.921208    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b614fd31-3265-458b-95ab-cbdd6d0c8ceb" (UID: "b614fd31-3265-458b-95ab-cbdd6d0c8ceb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:31:22.921352 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:22.921290    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b614fd31-3265-458b-95ab-cbdd6d0c8ceb" (UID: "b614fd31-3265-458b-95ab-cbdd6d0c8ceb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 18:31:22.921352 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:22.921346    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-istio-data\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:31:22.921520 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:22.921365    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-workload-certs\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:31:22.921752 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:22.921716    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b614fd31-3265-458b-95ab-cbdd6d0c8ceb" (UID: "b614fd31-3265-458b-95ab-cbdd6d0c8ceb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:31:22.921847 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:22.921760    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b614fd31-3265-458b-95ab-cbdd6d0c8ceb" (UID: "b614fd31-3265-458b-95ab-cbdd6d0c8ceb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:31:22.923058 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:22.923032    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b614fd31-3265-458b-95ab-cbdd6d0c8ceb" (UID: "b614fd31-3265-458b-95ab-cbdd6d0c8ceb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 18:31:22.923203 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:22.923184    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-kube-api-access-zvnd6" (OuterVolumeSpecName: "kube-api-access-zvnd6") pod "b614fd31-3265-458b-95ab-cbdd6d0c8ceb" (UID: "b614fd31-3265-458b-95ab-cbdd6d0c8ceb"). InnerVolumeSpecName "kube-api-access-zvnd6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 18:31:22.923418 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:22.923392    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b614fd31-3265-458b-95ab-cbdd6d0c8ceb" (UID: "b614fd31-3265-458b-95ab-cbdd6d0c8ceb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 05 18:31:22.923574 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:22.923555    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-istio-token" (OuterVolumeSpecName: "istio-token") pod "b614fd31-3265-458b-95ab-cbdd6d0c8ceb" (UID: "b614fd31-3265-458b-95ab-cbdd6d0c8ceb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 18:31:23.022362 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:23.022326    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-istiod-ca-cert\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:31:23.022362 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:23.022355    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-istio-podinfo\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:31:23.022362 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:23.022370    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-credential-socket\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:31:23.022584 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:23.022384    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvnd6\" (UniqueName: \"kubernetes.io/projected/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-kube-api-access-zvnd6\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:31:23.022584 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:23.022392    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-workload-socket\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:31:23.022584 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:23.022402    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-istio-token\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:31:23.022584 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:23.022411    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b614fd31-3265-458b-95ab-cbdd6d0c8ceb-istio-envoy\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:31:23.149261 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:23.149202    2558 generic.go:356] "Generic (PLEG): container finished" podID="b614fd31-3265-458b-95ab-cbdd6d0c8ceb" containerID="8ac72706d5b3faeef0d3870def0e1aff27b8957d19c07883746926d7befd5619" exitCode=0
Aug 05 18:31:23.149444 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:23.149259    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b" event={"ID":"b614fd31-3265-458b-95ab-cbdd6d0c8ceb","Type":"ContainerDied","Data":"8ac72706d5b3faeef0d3870def0e1aff27b8957d19c07883746926d7befd5619"}
Aug 05 18:31:23.149444 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:23.149328    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b" event={"ID":"b614fd31-3265-458b-95ab-cbdd6d0c8ceb","Type":"ContainerDied","Data":"4b6b83f66f31abeca1cc2ea8550ca8b61d07644a1a142ade45631870dcde12a7"}
Aug 05 18:31:23.149444 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:23.149272    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"
Aug 05 18:31:23.149444 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:23.149359    2558 scope.go:117] "RemoveContainer" containerID="8ac72706d5b3faeef0d3870def0e1aff27b8957d19c07883746926d7befd5619"
Aug 05 18:31:23.159557 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:23.159540    2558 scope.go:117] "RemoveContainer" containerID="03072fd8ad0b14e1ce9373b2eb89377c881f5ce82ea9f46a909a9f4d55458f8b"
Aug 05 18:31:23.168251 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:23.168232    2558 scope.go:117] "RemoveContainer" containerID="8ac72706d5b3faeef0d3870def0e1aff27b8957d19c07883746926d7befd5619"
Aug 05 18:31:23.168515 ip-10-0-129-136 kubenswrapper[2558]: E0805 18:31:23.168496    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ac72706d5b3faeef0d3870def0e1aff27b8957d19c07883746926d7befd5619\": container with ID starting with 8ac72706d5b3faeef0d3870def0e1aff27b8957d19c07883746926d7befd5619 not found: ID does not exist" containerID="8ac72706d5b3faeef0d3870def0e1aff27b8957d19c07883746926d7befd5619"
Aug 05 18:31:23.168570 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:23.168522    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ac72706d5b3faeef0d3870def0e1aff27b8957d19c07883746926d7befd5619"} err="failed to get container status \"8ac72706d5b3faeef0d3870def0e1aff27b8957d19c07883746926d7befd5619\": rpc error: code = NotFound desc = could not find container \"8ac72706d5b3faeef0d3870def0e1aff27b8957d19c07883746926d7befd5619\": container with ID starting with 8ac72706d5b3faeef0d3870def0e1aff27b8957d19c07883746926d7befd5619 not found: ID does not exist"
Aug 05 18:31:23.168570 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:23.168538    2558 scope.go:117] "RemoveContainer" containerID="03072fd8ad0b14e1ce9373b2eb89377c881f5ce82ea9f46a909a9f4d55458f8b"
Aug 05 18:31:23.168750 ip-10-0-129-136 kubenswrapper[2558]: E0805 18:31:23.168732    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03072fd8ad0b14e1ce9373b2eb89377c881f5ce82ea9f46a909a9f4d55458f8b\": container with ID starting with 03072fd8ad0b14e1ce9373b2eb89377c881f5ce82ea9f46a909a9f4d55458f8b not found: ID does not exist" containerID="03072fd8ad0b14e1ce9373b2eb89377c881f5ce82ea9f46a909a9f4d55458f8b"
Aug 05 18:31:23.168789 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:23.168757    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03072fd8ad0b14e1ce9373b2eb89377c881f5ce82ea9f46a909a9f4d55458f8b"} err="failed to get container status \"03072fd8ad0b14e1ce9373b2eb89377c881f5ce82ea9f46a909a9f4d55458f8b\": rpc error: code = NotFound desc = could not find container \"03072fd8ad0b14e1ce9373b2eb89377c881f5ce82ea9f46a909a9f4d55458f8b\": container with ID starting with 03072fd8ad0b14e1ce9373b2eb89377c881f5ce82ea9f46a909a9f4d55458f8b not found: ID does not exist"
Aug 05 18:31:23.176037 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:23.175987    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"]
Aug 05 18:31:23.185347 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:23.185323    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-eef9c6-openshift-default-576846fd5b-62b6b"]
Aug 05 18:31:24.255324 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:24.255292    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b614fd31-3265-458b-95ab-cbdd6d0c8ceb" path="/var/lib/kubelet/pods/b614fd31-3265-458b-95ab-cbdd6d0c8ceb/volumes"
Aug 05 18:31:36.618988 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:36.618955    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b5b093-55b58cb9f7-9czvm"]
Aug 05 18:31:36.619414 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:36.619170    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b5b093-55b58cb9f7-9czvm" podUID="83bff7aa-50c9-445a-a074-822ef1b531c9" containerName="maas-api" containerID="cri-o://7044f3de0b48ea82f3cb087ae4f009bc6fbf4abfc2bd0d4687f8e9f0bc96a721" gracePeriod=30
Aug 05 18:31:36.632177 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:36.632148    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-b5b093-29765910-2xqhh"]
Aug 05 18:31:36.636386 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:36.636367    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-b5b093-29765910-2xqhh"]
Aug 05 18:31:36.674822 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:36.674788    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b5b093-55c9bf7bfb-5d7cv"]
Aug 05 18:31:36.675061 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:36.675006    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b5b093-55c9bf7bfb-5d7cv" podUID="edb48a0b-aa3f-45ff-9654-ed608b9d4730" containerName="payload-pre-processing" containerID="cri-o://68c6cdd31eb9231be2ddfcef94b2b4f0ee795d6fb9bfb2a672b1a756375304f3" gracePeriod=30
Aug 05 18:31:36.931396 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:36.931363    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b5b093-55b58cb9f7-9czvm"
Aug 05 18:31:36.971376 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:36.971352    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b5b093-55c9bf7bfb-5d7cv"
Aug 05 18:31:37.060143 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:37.060112    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83bff7aa-50c9-445a-a074-822ef1b531c9-openshift-service-ca\") pod \"83bff7aa-50c9-445a-a074-822ef1b531c9\" (UID: \"83bff7aa-50c9-445a-a074-822ef1b531c9\") "
Aug 05 18:31:37.060362 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:37.060169    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ks4z2\" (UniqueName: \"kubernetes.io/projected/83bff7aa-50c9-445a-a074-822ef1b531c9-kube-api-access-ks4z2\") pod \"83bff7aa-50c9-445a-a074-822ef1b531c9\" (UID: \"83bff7aa-50c9-445a-a074-822ef1b531c9\") "
Aug 05 18:31:37.060362 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:37.060212    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83bff7aa-50c9-445a-a074-822ef1b531c9-maas-api-tls\") pod \"83bff7aa-50c9-445a-a074-822ef1b531c9\" (UID: \"83bff7aa-50c9-445a-a074-822ef1b531c9\") "
Aug 05 18:31:37.060613 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:37.060577    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83bff7aa-50c9-445a-a074-822ef1b531c9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "83bff7aa-50c9-445a-a074-822ef1b531c9" (UID: "83bff7aa-50c9-445a-a074-822ef1b531c9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 18:31:37.062434 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:37.062415    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83bff7aa-50c9-445a-a074-822ef1b531c9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "83bff7aa-50c9-445a-a074-822ef1b531c9" (UID: "83bff7aa-50c9-445a-a074-822ef1b531c9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 18:31:37.062508 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:37.062471    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83bff7aa-50c9-445a-a074-822ef1b531c9-kube-api-access-ks4z2" (OuterVolumeSpecName: "kube-api-access-ks4z2") pod "83bff7aa-50c9-445a-a074-822ef1b531c9" (UID: "83bff7aa-50c9-445a-a074-822ef1b531c9"). InnerVolumeSpecName "kube-api-access-ks4z2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 18:31:37.161435 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:37.161405    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjjb7\" (UniqueName: \"kubernetes.io/projected/edb48a0b-aa3f-45ff-9654-ed608b9d4730-kube-api-access-vjjb7\") pod \"edb48a0b-aa3f-45ff-9654-ed608b9d4730\" (UID: \"edb48a0b-aa3f-45ff-9654-ed608b9d4730\") "
Aug 05 18:31:37.161614 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:37.161487    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/edb48a0b-aa3f-45ff-9654-ed608b9d4730-plugins-config-volume\") pod \"edb48a0b-aa3f-45ff-9654-ed608b9d4730\" (UID: \"edb48a0b-aa3f-45ff-9654-ed608b9d4730\") "
Aug 05 18:31:37.161764 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:37.161748    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83bff7aa-50c9-445a-a074-822ef1b531c9-maas-api-tls\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:31:37.161842 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:37.161767    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83bff7aa-50c9-445a-a074-822ef1b531c9-openshift-service-ca\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:31:37.161842 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:37.161777    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ks4z2\" (UniqueName: \"kubernetes.io/projected/83bff7aa-50c9-445a-a074-822ef1b531c9-kube-api-access-ks4z2\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:31:37.161943 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:37.161887    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edb48a0b-aa3f-45ff-9654-ed608b9d4730-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "edb48a0b-aa3f-45ff-9654-ed608b9d4730" (UID: "edb48a0b-aa3f-45ff-9654-ed608b9d4730"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 18:31:37.163598 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:37.163578    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edb48a0b-aa3f-45ff-9654-ed608b9d4730-kube-api-access-vjjb7" (OuterVolumeSpecName: "kube-api-access-vjjb7") pod "edb48a0b-aa3f-45ff-9654-ed608b9d4730" (UID: "edb48a0b-aa3f-45ff-9654-ed608b9d4730"). InnerVolumeSpecName "kube-api-access-vjjb7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 18:31:37.247890 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:37.247850    2558 generic.go:356] "Generic (PLEG): container finished" podID="83bff7aa-50c9-445a-a074-822ef1b531c9" containerID="7044f3de0b48ea82f3cb087ae4f009bc6fbf4abfc2bd0d4687f8e9f0bc96a721" exitCode=0
Aug 05 18:31:37.248079 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:37.247897    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b5b093-55b58cb9f7-9czvm"
Aug 05 18:31:37.248079 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:37.247941    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b5b093-55b58cb9f7-9czvm" event={"ID":"83bff7aa-50c9-445a-a074-822ef1b531c9","Type":"ContainerDied","Data":"7044f3de0b48ea82f3cb087ae4f009bc6fbf4abfc2bd0d4687f8e9f0bc96a721"}
Aug 05 18:31:37.248079 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:37.247995    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-b5b093-55b58cb9f7-9czvm" event={"ID":"83bff7aa-50c9-445a-a074-822ef1b531c9","Type":"ContainerDied","Data":"2733d32769dfc5083d0aa8a2e894ebf77a232707a70b6c7534fccb30fde2ce66"}
Aug 05 18:31:37.248079 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:37.248011    2558 scope.go:117] "RemoveContainer" containerID="7044f3de0b48ea82f3cb087ae4f009bc6fbf4abfc2bd0d4687f8e9f0bc96a721"
Aug 05 18:31:37.249470 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:37.249446    2558 generic.go:356] "Generic (PLEG): container finished" podID="edb48a0b-aa3f-45ff-9654-ed608b9d4730" containerID="68c6cdd31eb9231be2ddfcef94b2b4f0ee795d6fb9bfb2a672b1a756375304f3" exitCode=0
Aug 05 18:31:37.249559 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:37.249474    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b5b093-55c9bf7bfb-5d7cv"
Aug 05 18:31:37.249559 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:37.249483    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b5b093-55c9bf7bfb-5d7cv" event={"ID":"edb48a0b-aa3f-45ff-9654-ed608b9d4730","Type":"ContainerDied","Data":"68c6cdd31eb9231be2ddfcef94b2b4f0ee795d6fb9bfb2a672b1a756375304f3"}
Aug 05 18:31:37.249559 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:37.249523    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b5b093-55c9bf7bfb-5d7cv" event={"ID":"edb48a0b-aa3f-45ff-9654-ed608b9d4730","Type":"ContainerDied","Data":"30b2d414a849a33f59f361afeb8336f3ce727c9ed7f376953ffd1436046f97e0"}
Aug 05 18:31:37.259410 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:37.259392    2558 scope.go:117] "RemoveContainer" containerID="7044f3de0b48ea82f3cb087ae4f009bc6fbf4abfc2bd0d4687f8e9f0bc96a721"
Aug 05 18:31:37.259699 ip-10-0-129-136 kubenswrapper[2558]: E0805 18:31:37.259679    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7044f3de0b48ea82f3cb087ae4f009bc6fbf4abfc2bd0d4687f8e9f0bc96a721\": container with ID starting with 7044f3de0b48ea82f3cb087ae4f009bc6fbf4abfc2bd0d4687f8e9f0bc96a721 not found: ID does not exist" containerID="7044f3de0b48ea82f3cb087ae4f009bc6fbf4abfc2bd0d4687f8e9f0bc96a721"
Aug 05 18:31:37.259754 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:37.259708    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7044f3de0b48ea82f3cb087ae4f009bc6fbf4abfc2bd0d4687f8e9f0bc96a721"} err="failed to get container status \"7044f3de0b48ea82f3cb087ae4f009bc6fbf4abfc2bd0d4687f8e9f0bc96a721\": rpc error: code = NotFound desc = could not find container \"7044f3de0b48ea82f3cb087ae4f009bc6fbf4abfc2bd0d4687f8e9f0bc96a721\": container with ID starting with 7044f3de0b48ea82f3cb087ae4f009bc6fbf4abfc2bd0d4687f8e9f0bc96a721 not found: ID does not exist"
Aug 05 18:31:37.259754 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:37.259724    2558 scope.go:117] "RemoveContainer" containerID="68c6cdd31eb9231be2ddfcef94b2b4f0ee795d6fb9bfb2a672b1a756375304f3"
Aug 05 18:31:37.263056 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:37.263037    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjjb7\" (UniqueName: \"kubernetes.io/projected/edb48a0b-aa3f-45ff-9654-ed608b9d4730-kube-api-access-vjjb7\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:31:37.263125 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:37.263058    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/edb48a0b-aa3f-45ff-9654-ed608b9d4730-plugins-config-volume\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:31:37.268431 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:37.268411    2558 scope.go:117] "RemoveContainer" containerID="68c6cdd31eb9231be2ddfcef94b2b4f0ee795d6fb9bfb2a672b1a756375304f3"
Aug 05 18:31:37.268716 ip-10-0-129-136 kubenswrapper[2558]: E0805 18:31:37.268695    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68c6cdd31eb9231be2ddfcef94b2b4f0ee795d6fb9bfb2a672b1a756375304f3\": container with ID starting with 68c6cdd31eb9231be2ddfcef94b2b4f0ee795d6fb9bfb2a672b1a756375304f3 not found: ID does not exist" containerID="68c6cdd31eb9231be2ddfcef94b2b4f0ee795d6fb9bfb2a672b1a756375304f3"
Aug 05 18:31:37.268770 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:37.268726    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68c6cdd31eb9231be2ddfcef94b2b4f0ee795d6fb9bfb2a672b1a756375304f3"} err="failed to get container status \"68c6cdd31eb9231be2ddfcef94b2b4f0ee795d6fb9bfb2a672b1a756375304f3\": rpc error: code = NotFound desc = could not find container \"68c6cdd31eb9231be2ddfcef94b2b4f0ee795d6fb9bfb2a672b1a756375304f3\": container with ID starting with 68c6cdd31eb9231be2ddfcef94b2b4f0ee795d6fb9bfb2a672b1a756375304f3 not found: ID does not exist"
Aug 05 18:31:37.274864 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:37.274842    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b5b093-55b58cb9f7-9czvm"]
Aug 05 18:31:37.279251 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:37.279212    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-b5b093-55b58cb9f7-9czvm"]
Aug 05 18:31:37.291733 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:37.291713    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b5b093-55c9bf7bfb-5d7cv"]
Aug 05 18:31:37.295411 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:37.295387    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b5b093-55c9bf7bfb-5d7cv"]
Aug 05 18:31:38.262792 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:38.262753    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f549205-7efd-48af-8d1d-455049725870" path="/var/lib/kubelet/pods/6f549205-7efd-48af-8d1d-455049725870/volumes"
Aug 05 18:31:38.263288 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:38.263269    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83bff7aa-50c9-445a-a074-822ef1b531c9" path="/var/lib/kubelet/pods/83bff7aa-50c9-445a-a074-822ef1b531c9/volumes"
Aug 05 18:31:38.263700 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:31:38.263683    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edb48a0b-aa3f-45ff-9654-ed608b9d4730" path="/var/lib/kubelet/pods/edb48a0b-aa3f-45ff-9654-ed608b9d4730/volumes"
Aug 05 18:32:27.463654 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:27.463609    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cea6f9-9ghx4"]
Aug 05 18:32:27.464128 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:27.464045    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="345dd446-3209-4807-ba87-e8aa359eb747" containerName="payload-processing"
Aug 05 18:32:27.464128 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:27.464059    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="345dd446-3209-4807-ba87-e8aa359eb747" containerName="payload-processing"
Aug 05 18:32:27.464128 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:27.464078    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83bff7aa-50c9-445a-a074-822ef1b531c9" containerName="maas-api"
Aug 05 18:32:27.464128 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:27.464084    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="83bff7aa-50c9-445a-a074-822ef1b531c9" containerName="maas-api"
Aug 05 18:32:27.464128 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:27.464091    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3eb1556c-d44e-4194-98ac-9aa64e2b523b" containerName="payload-pre-processing"
Aug 05 18:32:27.464128 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:27.464096    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3eb1556c-d44e-4194-98ac-9aa64e2b523b" containerName="payload-pre-processing"
Aug 05 18:32:27.464128 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:27.464110    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edb48a0b-aa3f-45ff-9654-ed608b9d4730" containerName="payload-pre-processing"
Aug 05 18:32:27.464128 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:27.464115    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="edb48a0b-aa3f-45ff-9654-ed608b9d4730" containerName="payload-pre-processing"
Aug 05 18:32:27.464128 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:27.464123    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b614fd31-3265-458b-95ab-cbdd6d0c8ceb" containerName="istio-proxy"
Aug 05 18:32:27.464128 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:27.464128    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b614fd31-3265-458b-95ab-cbdd6d0c8ceb" containerName="istio-proxy"
Aug 05 18:32:27.464462 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:27.464200    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b614fd31-3265-458b-95ab-cbdd6d0c8ceb" containerName="istio-proxy"
Aug 05 18:32:27.464462 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:27.464210    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3eb1556c-d44e-4194-98ac-9aa64e2b523b" containerName="payload-pre-processing"
Aug 05 18:32:27.464462 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:27.464230    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="345dd446-3209-4807-ba87-e8aa359eb747" containerName="payload-processing"
Aug 05 18:32:27.464462 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:27.464242    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="83bff7aa-50c9-445a-a074-822ef1b531c9" containerName="maas-api"
Aug 05 18:32:27.464462 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:27.464251    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b614fd31-3265-458b-95ab-cbdd6d0c8ceb" containerName="istio-proxy"
Aug 05 18:32:27.464462 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:27.464260    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="edb48a0b-aa3f-45ff-9654-ed608b9d4730" containerName="payload-pre-processing"
Aug 05 18:32:27.467451 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:27.467435    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cea6f9-9ghx4"
Aug 05 18:32:27.470423 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:27.470402    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xn2vw\""
Aug 05 18:32:27.479585 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:27.479556    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cea6f9-9ghx4"]
Aug 05 18:32:27.525297 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:27.525267    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/481bb090-ecd3-424d-bcbc-d378cdf21a65-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-cea6f9-9ghx4\" (UID: \"481bb090-ecd3-424d-bcbc-d378cdf21a65\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cea6f9-9ghx4"
Aug 05 18:32:27.626546 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:27.626513    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/481bb090-ecd3-424d-bcbc-d378cdf21a65-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-cea6f9-9ghx4\" (UID: \"481bb090-ecd3-424d-bcbc-d378cdf21a65\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cea6f9-9ghx4"
Aug 05 18:32:27.627176 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:27.627156    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/481bb090-ecd3-424d-bcbc-d378cdf21a65-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-cea6f9-9ghx4\" (UID: \"481bb090-ecd3-424d-bcbc-d378cdf21a65\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cea6f9-9ghx4"
Aug 05 18:32:27.787922 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:27.787818    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cea6f9-9ghx4"
Aug 05 18:32:27.934011 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:27.933983    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cea6f9-9ghx4"]
Aug 05 18:32:27.936337 ip-10-0-129-136 kubenswrapper[2558]: W0805 18:32:27.936305    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod481bb090_ecd3_424d_bcbc_d378cdf21a65.slice/crio-df51fd4dfe3bb48b13354b8ea450226661a65a7915f584c2582ebc2dea9c06f0 WatchSource:0}: Error finding container df51fd4dfe3bb48b13354b8ea450226661a65a7915f584c2582ebc2dea9c06f0: Status 404 returned error can't find the container with id df51fd4dfe3bb48b13354b8ea450226661a65a7915f584c2582ebc2dea9c06f0
Aug 05 18:32:28.561577 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:28.561539    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cea6f9-9ghx4" event={"ID":"481bb090-ecd3-424d-bcbc-d378cdf21a65","Type":"ContainerStarted","Data":"42b491a734c7fafb4735ed9fbbc2e4ad8223293e3daf130aaf18351bb6891767"}
Aug 05 18:32:28.561995 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:28.561594    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cea6f9-9ghx4" event={"ID":"481bb090-ecd3-424d-bcbc-d378cdf21a65","Type":"ContainerStarted","Data":"df51fd4dfe3bb48b13354b8ea450226661a65a7915f584c2582ebc2dea9c06f0"}
Aug 05 18:32:28.587085 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:28.587032    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cea6f9-9ghx4" podStartSLOduration=1.587017656 podStartE2EDuration="1.587017656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:32:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:32:28.585514368 +0000 UTC m=+3574.898365731" watchObservedRunningTime="2026-08-05 18:32:28.587017656 +0000 UTC m=+3574.899869019"
Aug 05 18:32:29.569168 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:29.569130    2558 generic.go:356] "Generic (PLEG): container finished" podID="481bb090-ecd3-424d-bcbc-d378cdf21a65" containerID="42b491a734c7fafb4735ed9fbbc2e4ad8223293e3daf130aaf18351bb6891767" exitCode=0
Aug 05 18:32:29.569563 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:29.569243    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cea6f9-9ghx4" event={"ID":"481bb090-ecd3-424d-bcbc-d378cdf21a65","Type":"ContainerDied","Data":"42b491a734c7fafb4735ed9fbbc2e4ad8223293e3daf130aaf18351bb6891767"}
Aug 05 18:32:30.714916 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:30.714893    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cea6f9-9ghx4"
Aug 05 18:32:30.757114 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:30.757091    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/481bb090-ecd3-424d-bcbc-d378cdf21a65-maas-api-service-ca\") pod \"481bb090-ecd3-424d-bcbc-d378cdf21a65\" (UID: \"481bb090-ecd3-424d-bcbc-d378cdf21a65\") "
Aug 05 18:32:30.757452 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:30.757429    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/481bb090-ecd3-424d-bcbc-d378cdf21a65-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "481bb090-ecd3-424d-bcbc-d378cdf21a65" (UID: "481bb090-ecd3-424d-bcbc-d378cdf21a65"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 18:32:30.858066 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:30.857999    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/481bb090-ecd3-424d-bcbc-d378cdf21a65-maas-api-service-ca\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:32:31.582388 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:31.582350    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cea6f9-9ghx4"
Aug 05 18:32:31.582541 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:31.582346    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cea6f9-9ghx4" event={"ID":"481bb090-ecd3-424d-bcbc-d378cdf21a65","Type":"ContainerDied","Data":"df51fd4dfe3bb48b13354b8ea450226661a65a7915f584c2582ebc2dea9c06f0"}
Aug 05 18:32:31.582541 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:31.582477    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="df51fd4dfe3bb48b13354b8ea450226661a65a7915f584c2582ebc2dea9c06f0"
Aug 05 18:32:38.000614 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:38.000579    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-cea6f9-29765910-nlgbv"]
Aug 05 18:32:38.003098 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:38.003074    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-cea6f9-29765910-nlgbv"]
Aug 05 18:32:38.036819 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:38.036788    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-cea6f9-7bcb778f56-nd5dc"]
Aug 05 18:32:38.037093 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:38.037042    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-cea6f9-7bcb778f56-nd5dc" podUID="2eb6a348-d6b1-4384-b76b-ffccf166f167" containerName="payload-processing" containerID="cri-o://c509bd33649e5ad89ec91cce9a153d66d912857f841f1081cc9491aed592a0ff" gracePeriod=30
Aug 05 18:32:38.045383 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:38.045354    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-cea6f9-647cd8d9b8-pfvzw"]
Aug 05 18:32:38.046257 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:38.046192    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cea6f9-647cd8d9b8-pfvzw" podUID="d3ed19f0-546a-45ab-abc5-3fec84e93726" containerName="payload-pre-processing" containerID="cri-o://b1d13183edf17c6b8828de421b20c799e16568436c4001c54e241f193b8b342f" gracePeriod=30
Aug 05 18:32:38.195813 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:38.195748    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cea6f9-9ghx4"]
Aug 05 18:32:38.199159 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:38.199135    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cea6f9-9ghx4"]
Aug 05 18:32:38.269282 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:38.269250    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="481bb090-ecd3-424d-bcbc-d378cdf21a65" path="/var/lib/kubelet/pods/481bb090-ecd3-424d-bcbc-d378cdf21a65/volumes"
Aug 05 18:32:38.269722 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:38.269693    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0196d5f-ce85-417f-8830-884db588cf88" path="/var/lib/kubelet/pods/a0196d5f-ce85-417f-8830-884db588cf88/volumes"
Aug 05 18:32:38.321427 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:38.321407    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-cea6f9-7bcb778f56-nd5dc"
Aug 05 18:32:38.340062 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:38.340036    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cea6f9-647cd8d9b8-pfvzw"
Aug 05 18:32:38.426972 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:38.426941    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrb99\" (UniqueName: \"kubernetes.io/projected/d3ed19f0-546a-45ab-abc5-3fec84e93726-kube-api-access-lrb99\") pod \"d3ed19f0-546a-45ab-abc5-3fec84e93726\" (UID: \"d3ed19f0-546a-45ab-abc5-3fec84e93726\") "
Aug 05 18:32:38.427159 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:38.426978    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2eb6a348-d6b1-4384-b76b-ffccf166f167-plugins-config-volume\") pod \"2eb6a348-d6b1-4384-b76b-ffccf166f167\" (UID: \"2eb6a348-d6b1-4384-b76b-ffccf166f167\") "
Aug 05 18:32:38.427159 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:38.427007    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3ed19f0-546a-45ab-abc5-3fec84e93726-plugins-config-volume\") pod \"d3ed19f0-546a-45ab-abc5-3fec84e93726\" (UID: \"d3ed19f0-546a-45ab-abc5-3fec84e93726\") "
Aug 05 18:32:38.427159 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:38.427049    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9gd6\" (UniqueName: \"kubernetes.io/projected/2eb6a348-d6b1-4384-b76b-ffccf166f167-kube-api-access-f9gd6\") pod \"2eb6a348-d6b1-4384-b76b-ffccf166f167\" (UID: \"2eb6a348-d6b1-4384-b76b-ffccf166f167\") "
Aug 05 18:32:38.427437 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:38.427403    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2eb6a348-d6b1-4384-b76b-ffccf166f167-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2eb6a348-d6b1-4384-b76b-ffccf166f167" (UID: "2eb6a348-d6b1-4384-b76b-ffccf166f167"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 18:32:38.427547 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:38.427450    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3ed19f0-546a-45ab-abc5-3fec84e93726-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d3ed19f0-546a-45ab-abc5-3fec84e93726" (UID: "d3ed19f0-546a-45ab-abc5-3fec84e93726"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 18:32:38.429293 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:38.429270    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3ed19f0-546a-45ab-abc5-3fec84e93726-kube-api-access-lrb99" (OuterVolumeSpecName: "kube-api-access-lrb99") pod "d3ed19f0-546a-45ab-abc5-3fec84e93726" (UID: "d3ed19f0-546a-45ab-abc5-3fec84e93726"). InnerVolumeSpecName "kube-api-access-lrb99". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 18:32:38.429293 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:38.429279    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2eb6a348-d6b1-4384-b76b-ffccf166f167-kube-api-access-f9gd6" (OuterVolumeSpecName: "kube-api-access-f9gd6") pod "2eb6a348-d6b1-4384-b76b-ffccf166f167" (UID: "2eb6a348-d6b1-4384-b76b-ffccf166f167"). InnerVolumeSpecName "kube-api-access-f9gd6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 18:32:38.528464 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:38.528393    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrb99\" (UniqueName: \"kubernetes.io/projected/d3ed19f0-546a-45ab-abc5-3fec84e93726-kube-api-access-lrb99\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:32:38.528464 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:38.528418    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2eb6a348-d6b1-4384-b76b-ffccf166f167-plugins-config-volume\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:32:38.528464 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:38.528428    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3ed19f0-546a-45ab-abc5-3fec84e93726-plugins-config-volume\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:32:38.528464 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:38.528436    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9gd6\" (UniqueName: \"kubernetes.io/projected/2eb6a348-d6b1-4384-b76b-ffccf166f167-kube-api-access-f9gd6\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:32:38.625050 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:38.625012    2558 generic.go:356] "Generic (PLEG): container finished" podID="d3ed19f0-546a-45ab-abc5-3fec84e93726" containerID="b1d13183edf17c6b8828de421b20c799e16568436c4001c54e241f193b8b342f" exitCode=0
Aug 05 18:32:38.625277 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:38.625095    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cea6f9-647cd8d9b8-pfvzw"
Aug 05 18:32:38.625277 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:38.625136    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cea6f9-647cd8d9b8-pfvzw" event={"ID":"d3ed19f0-546a-45ab-abc5-3fec84e93726","Type":"ContainerDied","Data":"b1d13183edf17c6b8828de421b20c799e16568436c4001c54e241f193b8b342f"}
Aug 05 18:32:38.625277 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:38.625191    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-cea6f9-647cd8d9b8-pfvzw" event={"ID":"d3ed19f0-546a-45ab-abc5-3fec84e93726","Type":"ContainerDied","Data":"2cc0318f1174db0a786d79fea597d56c31fe3a706a3aadd19195116749f04db9"}
Aug 05 18:32:38.625277 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:38.625248    2558 scope.go:117] "RemoveContainer" containerID="b1d13183edf17c6b8828de421b20c799e16568436c4001c54e241f193b8b342f"
Aug 05 18:32:38.626487 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:38.626466    2558 generic.go:356] "Generic (PLEG): container finished" podID="2eb6a348-d6b1-4384-b76b-ffccf166f167" containerID="c509bd33649e5ad89ec91cce9a153d66d912857f841f1081cc9491aed592a0ff" exitCode=0
Aug 05 18:32:38.626572 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:38.626508    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-cea6f9-7bcb778f56-nd5dc"
Aug 05 18:32:38.626572 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:38.626514    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-cea6f9-7bcb778f56-nd5dc" event={"ID":"2eb6a348-d6b1-4384-b76b-ffccf166f167","Type":"ContainerDied","Data":"c509bd33649e5ad89ec91cce9a153d66d912857f841f1081cc9491aed592a0ff"}
Aug 05 18:32:38.626572 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:38.626566    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-cea6f9-7bcb778f56-nd5dc" event={"ID":"2eb6a348-d6b1-4384-b76b-ffccf166f167","Type":"ContainerDied","Data":"38b5b77daa004b7433e1bad0aca13cc383666ac5505c5eb0e3bdab80d1e69101"}
Aug 05 18:32:38.638447 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:38.638423    2558 scope.go:117] "RemoveContainer" containerID="b1d13183edf17c6b8828de421b20c799e16568436c4001c54e241f193b8b342f"
Aug 05 18:32:38.638764 ip-10-0-129-136 kubenswrapper[2558]: E0805 18:32:38.638737    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1d13183edf17c6b8828de421b20c799e16568436c4001c54e241f193b8b342f\": container with ID starting with b1d13183edf17c6b8828de421b20c799e16568436c4001c54e241f193b8b342f not found: ID does not exist" containerID="b1d13183edf17c6b8828de421b20c799e16568436c4001c54e241f193b8b342f"
Aug 05 18:32:38.638858 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:38.638770    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1d13183edf17c6b8828de421b20c799e16568436c4001c54e241f193b8b342f"} err="failed to get container status \"b1d13183edf17c6b8828de421b20c799e16568436c4001c54e241f193b8b342f\": rpc error: code = NotFound desc = could not find container \"b1d13183edf17c6b8828de421b20c799e16568436c4001c54e241f193b8b342f\": container with ID starting with b1d13183edf17c6b8828de421b20c799e16568436c4001c54e241f193b8b342f not found: ID does not exist"
Aug 05 18:32:38.638858 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:38.638791    2558 scope.go:117] "RemoveContainer" containerID="c509bd33649e5ad89ec91cce9a153d66d912857f841f1081cc9491aed592a0ff"
Aug 05 18:32:38.647305 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:38.647288    2558 scope.go:117] "RemoveContainer" containerID="c509bd33649e5ad89ec91cce9a153d66d912857f841f1081cc9491aed592a0ff"
Aug 05 18:32:38.647568 ip-10-0-129-136 kubenswrapper[2558]: E0805 18:32:38.647551    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c509bd33649e5ad89ec91cce9a153d66d912857f841f1081cc9491aed592a0ff\": container with ID starting with c509bd33649e5ad89ec91cce9a153d66d912857f841f1081cc9491aed592a0ff not found: ID does not exist" containerID="c509bd33649e5ad89ec91cce9a153d66d912857f841f1081cc9491aed592a0ff"
Aug 05 18:32:38.647614 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:38.647575    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c509bd33649e5ad89ec91cce9a153d66d912857f841f1081cc9491aed592a0ff"} err="failed to get container status \"c509bd33649e5ad89ec91cce9a153d66d912857f841f1081cc9491aed592a0ff\": rpc error: code = NotFound desc = could not find container \"c509bd33649e5ad89ec91cce9a153d66d912857f841f1081cc9491aed592a0ff\": container with ID starting with c509bd33649e5ad89ec91cce9a153d66d912857f841f1081cc9491aed592a0ff not found: ID does not exist"
Aug 05 18:32:38.660742 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:38.660713    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-cea6f9-647cd8d9b8-pfvzw"]
Aug 05 18:32:38.670491 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:38.670467    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-cea6f9-647cd8d9b8-pfvzw"]
Aug 05 18:32:38.689294 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:38.689272    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-cea6f9-7bcb778f56-nd5dc"]
Aug 05 18:32:38.691484 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:38.691464    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-cea6f9-7bcb778f56-nd5dc"]
Aug 05 18:32:40.255293 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:40.255254    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2eb6a348-d6b1-4384-b76b-ffccf166f167" path="/var/lib/kubelet/pods/2eb6a348-d6b1-4384-b76b-ffccf166f167/volumes"
Aug 05 18:32:40.255788 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:40.255764    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3ed19f0-546a-45ab-abc5-3fec84e93726" path="/var/lib/kubelet/pods/d3ed19f0-546a-45ab-abc5-3fec84e93726/volumes"
Aug 05 18:32:45.802729 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:45.802692    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-70b4a4-tw7s7"]
Aug 05 18:32:45.803127 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:45.803112    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="481bb090-ecd3-424d-bcbc-d378cdf21a65" containerName="revoke-keys"
Aug 05 18:32:45.803174 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:45.803129    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="481bb090-ecd3-424d-bcbc-d378cdf21a65" containerName="revoke-keys"
Aug 05 18:32:45.803174 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:45.803139    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b614fd31-3265-458b-95ab-cbdd6d0c8ceb" containerName="istio-proxy"
Aug 05 18:32:45.803174 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:45.803144    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b614fd31-3265-458b-95ab-cbdd6d0c8ceb" containerName="istio-proxy"
Aug 05 18:32:45.803174 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:45.803160    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3ed19f0-546a-45ab-abc5-3fec84e93726" containerName="payload-pre-processing"
Aug 05 18:32:45.803174 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:45.803165    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3ed19f0-546a-45ab-abc5-3fec84e93726" containerName="payload-pre-processing"
Aug 05 18:32:45.803353 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:45.803178    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2eb6a348-d6b1-4384-b76b-ffccf166f167" containerName="payload-processing"
Aug 05 18:32:45.803353 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:45.803184    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2eb6a348-d6b1-4384-b76b-ffccf166f167" containerName="payload-processing"
Aug 05 18:32:45.803353 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:45.803259    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3ed19f0-546a-45ab-abc5-3fec84e93726" containerName="payload-pre-processing"
Aug 05 18:32:45.803353 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:45.803269    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2eb6a348-d6b1-4384-b76b-ffccf166f167" containerName="payload-processing"
Aug 05 18:32:45.803353 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:45.803277    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="481bb090-ecd3-424d-bcbc-d378cdf21a65" containerName="revoke-keys"
Aug 05 18:32:45.807739 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:45.807723    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-70b4a4-tw7s7"
Aug 05 18:32:45.811001 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:45.810984    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xn2vw\""
Aug 05 18:32:45.822747 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:45.822724    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-70b4a4-tw7s7"]
Aug 05 18:32:45.895502 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:45.895460    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f89e46a-e837-476d-97a0-17469be593f9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-70b4a4-tw7s7\" (UID: \"4f89e46a-e837-476d-97a0-17469be593f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-70b4a4-tw7s7"
Aug 05 18:32:45.996588 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:45.996550    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f89e46a-e837-476d-97a0-17469be593f9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-70b4a4-tw7s7\" (UID: \"4f89e46a-e837-476d-97a0-17469be593f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-70b4a4-tw7s7"
Aug 05 18:32:45.997153 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:45.997132    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f89e46a-e837-476d-97a0-17469be593f9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-70b4a4-tw7s7\" (UID: \"4f89e46a-e837-476d-97a0-17469be593f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-70b4a4-tw7s7"
Aug 05 18:32:46.117726 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:46.117643    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-70b4a4-tw7s7"
Aug 05 18:32:46.258577 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:46.258543    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-70b4a4-tw7s7"]
Aug 05 18:32:46.259773 ip-10-0-129-136 kubenswrapper[2558]: W0805 18:32:46.259751    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f89e46a_e837_476d_97a0_17469be593f9.slice/crio-8663b0ab665b0df06eee0d510bc22ecee739db398ff4d3af595a4c6ba2ef5689 WatchSource:0}: Error finding container 8663b0ab665b0df06eee0d510bc22ecee739db398ff4d3af595a4c6ba2ef5689: Status 404 returned error can't find the container with id 8663b0ab665b0df06eee0d510bc22ecee739db398ff4d3af595a4c6ba2ef5689
Aug 05 18:32:46.675167 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:46.675123    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-70b4a4-tw7s7" event={"ID":"4f89e46a-e837-476d-97a0-17469be593f9","Type":"ContainerStarted","Data":"6e7afcf00d7a2151b80a6a2ffeb8d4e5392e493287197f5104fee35ffbe96f42"}
Aug 05 18:32:46.675354 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:46.675187    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-70b4a4-tw7s7" event={"ID":"4f89e46a-e837-476d-97a0-17469be593f9","Type":"ContainerStarted","Data":"8663b0ab665b0df06eee0d510bc22ecee739db398ff4d3af595a4c6ba2ef5689"}
Aug 05 18:32:46.695275 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:46.695211    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-70b4a4-tw7s7" podStartSLOduration=1.695196743 podStartE2EDuration="1.695196743s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:32:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:32:46.692840111 +0000 UTC m=+3593.005691474" watchObservedRunningTime="2026-08-05 18:32:46.695196743 +0000 UTC m=+3593.008048113"
Aug 05 18:32:47.682620 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:47.682585    2558 generic.go:356] "Generic (PLEG): container finished" podID="4f89e46a-e837-476d-97a0-17469be593f9" containerID="6e7afcf00d7a2151b80a6a2ffeb8d4e5392e493287197f5104fee35ffbe96f42" exitCode=0
Aug 05 18:32:47.683070 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:47.682695    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-70b4a4-tw7s7" event={"ID":"4f89e46a-e837-476d-97a0-17469be593f9","Type":"ContainerDied","Data":"6e7afcf00d7a2151b80a6a2ffeb8d4e5392e493287197f5104fee35ffbe96f42"}
Aug 05 18:32:48.826957 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:48.826929    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-70b4a4-tw7s7"
Aug 05 18:32:48.923780 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:48.923746    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f89e46a-e837-476d-97a0-17469be593f9-maas-api-service-ca\") pod \"4f89e46a-e837-476d-97a0-17469be593f9\" (UID: \"4f89e46a-e837-476d-97a0-17469be593f9\") "
Aug 05 18:32:48.924115 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:48.924089    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f89e46a-e837-476d-97a0-17469be593f9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4f89e46a-e837-476d-97a0-17469be593f9" (UID: "4f89e46a-e837-476d-97a0-17469be593f9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 18:32:49.025276 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:49.025162    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f89e46a-e837-476d-97a0-17469be593f9-maas-api-service-ca\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:32:49.696811 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:49.696777    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-70b4a4-tw7s7"
Aug 05 18:32:49.696811 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:49.696784    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-70b4a4-tw7s7" event={"ID":"4f89e46a-e837-476d-97a0-17469be593f9","Type":"ContainerDied","Data":"8663b0ab665b0df06eee0d510bc22ecee739db398ff4d3af595a4c6ba2ef5689"}
Aug 05 18:32:49.697063 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:49.696856    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8663b0ab665b0df06eee0d510bc22ecee739db398ff4d3af595a4c6ba2ef5689"
Aug 05 18:32:56.318287 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:56.318248    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-70b4a4-29765910-l625p"]
Aug 05 18:32:56.321646 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:56.321618    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-70b4a4-29765910-l625p"]
Aug 05 18:32:56.494077 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:56.494041    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-70b4a4-tw7s7"]
Aug 05 18:32:56.496491 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:56.496471    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-70b4a4-tw7s7"]
Aug 05 18:32:58.255308 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:58.255273    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f89e46a-e837-476d-97a0-17469be593f9" path="/var/lib/kubelet/pods/4f89e46a-e837-476d-97a0-17469be593f9/volumes"
Aug 05 18:32:58.255732 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:32:58.255588    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d47ba5ac-571d-45de-ab6b-90c88d42c294" path="/var/lib/kubelet/pods/d47ba5ac-571d-45de-ab6b-90c88d42c294/volumes"
Aug 05 18:33:04.260849 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:04.260816    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6fb560-4pnr8"]
Aug 05 18:33:04.261283 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:04.261198    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f89e46a-e837-476d-97a0-17469be593f9" containerName="revoke-keys"
Aug 05 18:33:04.261283 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:04.261209    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f89e46a-e837-476d-97a0-17469be593f9" containerName="revoke-keys"
Aug 05 18:33:04.261361 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:04.261317    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f89e46a-e837-476d-97a0-17469be593f9" containerName="revoke-keys"
Aug 05 18:33:04.265886 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:04.265869    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6fb560-4pnr8"
Aug 05 18:33:04.269760 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:04.269736    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xn2vw\""
Aug 05 18:33:04.275678 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:04.275651    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6fb560-4pnr8"]
Aug 05 18:33:04.370819 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:04.370776    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f0fdd87-47db-48d6-9d2c-9c60030a74fb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-6fb560-4pnr8\" (UID: \"3f0fdd87-47db-48d6-9d2c-9c60030a74fb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6fb560-4pnr8"
Aug 05 18:33:04.471931 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:04.471897    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f0fdd87-47db-48d6-9d2c-9c60030a74fb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-6fb560-4pnr8\" (UID: \"3f0fdd87-47db-48d6-9d2c-9c60030a74fb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6fb560-4pnr8"
Aug 05 18:33:04.472495 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:04.472477    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f0fdd87-47db-48d6-9d2c-9c60030a74fb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-6fb560-4pnr8\" (UID: \"3f0fdd87-47db-48d6-9d2c-9c60030a74fb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6fb560-4pnr8"
Aug 05 18:33:04.577899 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:04.577810    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6fb560-4pnr8"
Aug 05 18:33:04.715724 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:04.715699    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6fb560-4pnr8"]
Aug 05 18:33:04.717422 ip-10-0-129-136 kubenswrapper[2558]: W0805 18:33:04.717394    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f0fdd87_47db_48d6_9d2c_9c60030a74fb.slice/crio-d8957ca24eb909453a1feafe7c003fc020e0875ff7cea01d2668cf87466fac84 WatchSource:0}: Error finding container d8957ca24eb909453a1feafe7c003fc020e0875ff7cea01d2668cf87466fac84: Status 404 returned error can't find the container with id d8957ca24eb909453a1feafe7c003fc020e0875ff7cea01d2668cf87466fac84
Aug 05 18:33:04.793807 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:04.793765    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6fb560-4pnr8" event={"ID":"3f0fdd87-47db-48d6-9d2c-9c60030a74fb","Type":"ContainerStarted","Data":"d8957ca24eb909453a1feafe7c003fc020e0875ff7cea01d2668cf87466fac84"}
Aug 05 18:33:05.801861 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:05.801824    2558 generic.go:356] "Generic (PLEG): container finished" podID="3f0fdd87-47db-48d6-9d2c-9c60030a74fb" containerID="2d4e327615b096a211a6bb7117a36a64fea28b2479091c53b92703149dc5d5d4" exitCode=0
Aug 05 18:33:05.802265 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:05.801912    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6fb560-4pnr8" event={"ID":"3f0fdd87-47db-48d6-9d2c-9c60030a74fb","Type":"ContainerDied","Data":"2d4e327615b096a211a6bb7117a36a64fea28b2479091c53b92703149dc5d5d4"}
Aug 05 18:33:06.947103 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:06.947074    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6fb560-4pnr8"
Aug 05 18:33:07.096482 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:07.096402    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f0fdd87-47db-48d6-9d2c-9c60030a74fb-maas-api-service-ca\") pod \"3f0fdd87-47db-48d6-9d2c-9c60030a74fb\" (UID: \"3f0fdd87-47db-48d6-9d2c-9c60030a74fb\") "
Aug 05 18:33:07.096736 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:07.096713    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f0fdd87-47db-48d6-9d2c-9c60030a74fb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3f0fdd87-47db-48d6-9d2c-9c60030a74fb" (UID: "3f0fdd87-47db-48d6-9d2c-9c60030a74fb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 18:33:07.197038 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:07.197008    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f0fdd87-47db-48d6-9d2c-9c60030a74fb-maas-api-service-ca\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:33:07.815320 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:07.815291    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6fb560-4pnr8"
Aug 05 18:33:07.815500 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:07.815332    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6fb560-4pnr8" event={"ID":"3f0fdd87-47db-48d6-9d2c-9c60030a74fb","Type":"ContainerDied","Data":"d8957ca24eb909453a1feafe7c003fc020e0875ff7cea01d2668cf87466fac84"}
Aug 05 18:33:07.815500 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:07.815382    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d8957ca24eb909453a1feafe7c003fc020e0875ff7cea01d2668cf87466fac84"
Aug 05 18:33:15.029966 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:15.029929    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6fb560-29765910-kc2jt"]
Aug 05 18:33:15.032426 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:15.032397    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-6fb560-29765910-kc2jt"]
Aug 05 18:33:15.057790 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:15.057756    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-6fb560-876f85946-svpbk"]
Aug 05 18:33:15.057991 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:15.057966    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-6fb560-876f85946-svpbk" podUID="6df7fef8-f524-48a8-989b-e94f732352de" containerName="payload-processing" containerID="cri-o://46b2eb6e622cd43c52450a262549bb50b37535126c77b29714ad90dad1b3f898" gracePeriod=30
Aug 05 18:33:15.215323 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:15.215278    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6fb560-4pnr8"]
Aug 05 18:33:15.221032 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:15.221007    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6fb560-4pnr8"]
Aug 05 18:33:15.335281 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:15.335257    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-6fb560-876f85946-svpbk"
Aug 05 18:33:15.382272 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:15.382244    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gsx7g\" (UniqueName: \"kubernetes.io/projected/6df7fef8-f524-48a8-989b-e94f732352de-kube-api-access-gsx7g\") pod \"6df7fef8-f524-48a8-989b-e94f732352de\" (UID: \"6df7fef8-f524-48a8-989b-e94f732352de\") "
Aug 05 18:33:15.382446 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:15.382289    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6df7fef8-f524-48a8-989b-e94f732352de-plugins-config-volume\") pod \"6df7fef8-f524-48a8-989b-e94f732352de\" (UID: \"6df7fef8-f524-48a8-989b-e94f732352de\") "
Aug 05 18:33:15.382800 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:15.382765    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6df7fef8-f524-48a8-989b-e94f732352de-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6df7fef8-f524-48a8-989b-e94f732352de" (UID: "6df7fef8-f524-48a8-989b-e94f732352de"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 18:33:15.384652 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:15.384624    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6df7fef8-f524-48a8-989b-e94f732352de-kube-api-access-gsx7g" (OuterVolumeSpecName: "kube-api-access-gsx7g") pod "6df7fef8-f524-48a8-989b-e94f732352de" (UID: "6df7fef8-f524-48a8-989b-e94f732352de"). InnerVolumeSpecName "kube-api-access-gsx7g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 18:33:15.483752 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:15.483719    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gsx7g\" (UniqueName: \"kubernetes.io/projected/6df7fef8-f524-48a8-989b-e94f732352de-kube-api-access-gsx7g\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:33:15.483752 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:15.483751    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6df7fef8-f524-48a8-989b-e94f732352de-plugins-config-volume\") on node \"ip-10-0-129-136.ec2.internal\" DevicePath \"\""
Aug 05 18:33:15.864449 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:15.864416    2558 generic.go:356] "Generic (PLEG): container finished" podID="6df7fef8-f524-48a8-989b-e94f732352de" containerID="46b2eb6e622cd43c52450a262549bb50b37535126c77b29714ad90dad1b3f898" exitCode=0
Aug 05 18:33:15.864621 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:15.864463    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-6fb560-876f85946-svpbk"
Aug 05 18:33:15.864621 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:15.864500    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-6fb560-876f85946-svpbk" event={"ID":"6df7fef8-f524-48a8-989b-e94f732352de","Type":"ContainerDied","Data":"46b2eb6e622cd43c52450a262549bb50b37535126c77b29714ad90dad1b3f898"}
Aug 05 18:33:15.864621 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:15.864543    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-6fb560-876f85946-svpbk" event={"ID":"6df7fef8-f524-48a8-989b-e94f732352de","Type":"ContainerDied","Data":"993f8ffef109e9acb4fff5fe97e3d81efbf2e86c5b208d7f18177a1c8074051e"}
Aug 05 18:33:15.864621 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:15.864566    2558 scope.go:117] "RemoveContainer" containerID="46b2eb6e622cd43c52450a262549bb50b37535126c77b29714ad90dad1b3f898"
Aug 05 18:33:15.874930 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:15.874905    2558 scope.go:117] "RemoveContainer" containerID="46b2eb6e622cd43c52450a262549bb50b37535126c77b29714ad90dad1b3f898"
Aug 05 18:33:15.875184 ip-10-0-129-136 kubenswrapper[2558]: E0805 18:33:15.875165    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46b2eb6e622cd43c52450a262549bb50b37535126c77b29714ad90dad1b3f898\": container with ID starting with 46b2eb6e622cd43c52450a262549bb50b37535126c77b29714ad90dad1b3f898 not found: ID does not exist" containerID="46b2eb6e622cd43c52450a262549bb50b37535126c77b29714ad90dad1b3f898"
Aug 05 18:33:15.875244 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:15.875192    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46b2eb6e622cd43c52450a262549bb50b37535126c77b29714ad90dad1b3f898"} err="failed to get container status \"46b2eb6e622cd43c52450a262549bb50b37535126c77b29714ad90dad1b3f898\": rpc error: code = NotFound desc = could not find container \"46b2eb6e622cd43c52450a262549bb50b37535126c77b29714ad90dad1b3f898\": container with ID starting with 46b2eb6e622cd43c52450a262549bb50b37535126c77b29714ad90dad1b3f898 not found: ID does not exist"
Aug 05 18:33:15.887462 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:15.887438    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-6fb560-876f85946-svpbk"]
Aug 05 18:33:15.891391 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:15.891370    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-6fb560-876f85946-svpbk"]
Aug 05 18:33:16.255047 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:16.255016    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f0fdd87-47db-48d6-9d2c-9c60030a74fb" path="/var/lib/kubelet/pods/3f0fdd87-47db-48d6-9d2c-9c60030a74fb/volumes"
Aug 05 18:33:16.255445 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:16.255381    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6df7fef8-f524-48a8-989b-e94f732352de" path="/var/lib/kubelet/pods/6df7fef8-f524-48a8-989b-e94f732352de/volumes"
Aug 05 18:33:16.255624 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:16.255611    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d79bda56-f9ed-44cb-9366-ef8592d9182d" path="/var/lib/kubelet/pods/d79bda56-f9ed-44cb-9366-ef8592d9182d/volumes"
Aug 05 18:33:28.593346 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:28.593312    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-xzf7w_f365d586-28c7-416b-92cb-0f7df80abaa9/manager/0.log"
Aug 05 18:33:28.713457 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:28.713424    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-qr69q_69d8e66b-b6d9-4ff6-92a5-5de71aa13d1e/manager/0.log"
Aug 05 18:33:28.943365 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:28.943339    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-zpn52_82c5c71e-9b28-4dd7-9048-2c50db39791b/server/0.log"
Aug 05 18:33:29.067826 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:29.067790    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-pkqgh_d1d22d83-ab2e-42c8-8ccf-6833b79b95f5/manager/0.log"
Aug 05 18:33:29.174316 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:29.174289    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-856dccdfcf-2xgt8_c995a756-05ef-4947-90b4-74d4559c7b7a/copy-manifests/0.log"
Aug 05 18:33:29.192479 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:29.192452    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-856dccdfcf-2xgt8_c995a756-05ef-4947-90b4-74d4559c7b7a/manager/0.log"
Aug 05 18:33:30.129884 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:30.129853    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29765910-4cs8g_61cc6ed9-ae7c-4d8f-be54-2c2eff6b06cf/cleanup/0.log"
Aug 05 18:33:30.239919 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:30.239887    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-cq6kp_fe514b61-fcfc-47a1-a77b-1a6bf1985b62/postgres/0.log"
Aug 05 18:33:31.104942 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:31.104891    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-76c6h_e4c51705-69ca-4bdf-8ea1-ac673019c877/manager/0.log"
Aug 05 18:33:31.322646 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:31.322614    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-j2z9l_f8b745e5-e2da-4453-bbdc-6fe0304abbab/kuadrant-console-plugin/0.log"
Aug 05 18:33:31.675716 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:31.675684    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-txv6b_ced5df6b-25c4-4fcb-8f2b-1ac65335989c/manager/0.log"
Aug 05 18:33:32.016385 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:32.016296    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d_2d6c6c86-3828-429b-9c43-fc6727894e36/istio-proxy/0.log"
Aug 05 18:33:32.364833 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:32.364751    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57558c7678-t6dn8_973aa2f2-95d7-4e1b-928a-6ca453988c91/kube-auth-proxy/0.log"
Aug 05 18:33:32.490628 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:32.490588    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-kfjgh_7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce/istio-proxy/1.log"
Aug 05 18:33:33.167896 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:33.167870    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-vm9n2_d0627bfa-bc3b-47f3-8df3-0753dca9a192/main/0.log"
Aug 05 18:33:33.290659 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:33.290626    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-bxk4t_0338a0db-59ea-44c3-a578-7665fc6e5ce7/main/0.log"
Aug 05 18:33:33.625844 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:33.625756    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-7mnqk_8a06cd0b-435f-43fa-bb63-4d4a5e3ffc0e/main/0.log"
Aug 05 18:33:38.711239 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:38.711195    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rl9xm/must-gather-f9cnh"]
Aug 05 18:33:38.711801 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:38.711780    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f0fdd87-47db-48d6-9d2c-9c60030a74fb" containerName="revoke-keys"
Aug 05 18:33:38.711893 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:38.711806    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f0fdd87-47db-48d6-9d2c-9c60030a74fb" containerName="revoke-keys"
Aug 05 18:33:38.711893 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:38.711843    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6df7fef8-f524-48a8-989b-e94f732352de" containerName="payload-processing"
Aug 05 18:33:38.711893 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:38.711853    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6df7fef8-f524-48a8-989b-e94f732352de" containerName="payload-processing"
Aug 05 18:33:38.712060 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:38.711958    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f0fdd87-47db-48d6-9d2c-9c60030a74fb" containerName="revoke-keys"
Aug 05 18:33:38.712060 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:38.711978    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6df7fef8-f524-48a8-989b-e94f732352de" containerName="payload-processing"
Aug 05 18:33:38.715048 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:38.715026    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rl9xm/must-gather-f9cnh"
Aug 05 18:33:38.717876 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:38.717851    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rl9xm\"/\"kube-root-ca.crt\""
Aug 05 18:33:38.717982 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:38.717892    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rl9xm\"/\"default-dockercfg-62k6z\""
Aug 05 18:33:38.717982 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:38.717902    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rl9xm\"/\"openshift-service-ca.crt\""
Aug 05 18:33:38.726896 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:38.726877    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rl9xm/must-gather-f9cnh"]
Aug 05 18:33:38.807699 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:38.807668    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/88ba3026-a896-47f1-b9f7-ea885121a855-must-gather-output\") pod \"must-gather-f9cnh\" (UID: \"88ba3026-a896-47f1-b9f7-ea885121a855\") " pod="openshift-must-gather-rl9xm/must-gather-f9cnh"
Aug 05 18:33:38.807863 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:38.807705    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28k4k\" (UniqueName: \"kubernetes.io/projected/88ba3026-a896-47f1-b9f7-ea885121a855-kube-api-access-28k4k\") pod \"must-gather-f9cnh\" (UID: \"88ba3026-a896-47f1-b9f7-ea885121a855\") " pod="openshift-must-gather-rl9xm/must-gather-f9cnh"
Aug 05 18:33:38.909115 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:38.909067    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/88ba3026-a896-47f1-b9f7-ea885121a855-must-gather-output\") pod \"must-gather-f9cnh\" (UID: \"88ba3026-a896-47f1-b9f7-ea885121a855\") " pod="openshift-must-gather-rl9xm/must-gather-f9cnh"
Aug 05 18:33:38.909115 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:38.909118    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28k4k\" (UniqueName: \"kubernetes.io/projected/88ba3026-a896-47f1-b9f7-ea885121a855-kube-api-access-28k4k\") pod \"must-gather-f9cnh\" (UID: \"88ba3026-a896-47f1-b9f7-ea885121a855\") " pod="openshift-must-gather-rl9xm/must-gather-f9cnh"
Aug 05 18:33:38.909438 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:38.909420    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/88ba3026-a896-47f1-b9f7-ea885121a855-must-gather-output\") pod \"must-gather-f9cnh\" (UID: \"88ba3026-a896-47f1-b9f7-ea885121a855\") " pod="openshift-must-gather-rl9xm/must-gather-f9cnh"
Aug 05 18:33:38.919887 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:38.919859    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28k4k\" (UniqueName: \"kubernetes.io/projected/88ba3026-a896-47f1-b9f7-ea885121a855-kube-api-access-28k4k\") pod \"must-gather-f9cnh\" (UID: \"88ba3026-a896-47f1-b9f7-ea885121a855\") " pod="openshift-must-gather-rl9xm/must-gather-f9cnh"
Aug 05 18:33:39.024493 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:39.024404    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rl9xm/must-gather-f9cnh"
Aug 05 18:33:39.163094 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:39.163062    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rl9xm/must-gather-f9cnh"]
Aug 05 18:33:39.164785 ip-10-0-129-136 kubenswrapper[2558]: W0805 18:33:39.164756    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88ba3026_a896_47f1_b9f7_ea885121a855.slice/crio-45c19563ddfe17a1c58feabdd5264e8d41c3737c02aae11bb7a74268bf0125ae WatchSource:0}: Error finding container 45c19563ddfe17a1c58feabdd5264e8d41c3737c02aae11bb7a74268bf0125ae: Status 404 returned error can't find the container with id 45c19563ddfe17a1c58feabdd5264e8d41c3737c02aae11bb7a74268bf0125ae
Aug 05 18:33:39.167032 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:39.167015    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 18:33:40.017611 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:40.017574    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rl9xm/must-gather-f9cnh" event={"ID":"88ba3026-a896-47f1-b9f7-ea885121a855","Type":"ContainerStarted","Data":"14de9a0114afe8f2c35fb6baef72f98118e09b115aeb1caa97ac82912c632236"}
Aug 05 18:33:40.018065 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:40.017626    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rl9xm/must-gather-f9cnh" event={"ID":"88ba3026-a896-47f1-b9f7-ea885121a855","Type":"ContainerStarted","Data":"45c19563ddfe17a1c58feabdd5264e8d41c3737c02aae11bb7a74268bf0125ae"}
Aug 05 18:33:41.026940 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:41.026901    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rl9xm/must-gather-f9cnh" event={"ID":"88ba3026-a896-47f1-b9f7-ea885121a855","Type":"ContainerStarted","Data":"1fd65deed1314fc2e42efefd75c9d24e2ecc259f7bee9e522c23986865bcfdd2"}
Aug 05 18:33:41.047737 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:41.047685    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rl9xm/must-gather-f9cnh" podStartSLOduration=2.350079063 podStartE2EDuration="3.0476681s" totalImagesPullingTime="697.589037ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:33:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:33:41.043871838 +0000 UTC m=+3647.356723204" watchObservedRunningTime="2026-08-05 18:33:41.0476681 +0000 UTC m=+3647.360519470"
Aug 05 18:33:41.657252 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:41.657187    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vth7m_d79df3a4-4b86-4acd-9884-c9d745b6b79b/global-pull-secret-syncer/0.log"
Aug 05 18:33:41.798833 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:41.798793    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nqss6_6d395bda-7395-40e9-b0cc-1195e1d656d1/konnectivity-agent/0.log"
Aug 05 18:33:41.824490 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:41.824453    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-136.ec2.internal_1afd46020d6263e2760b405ad0307aa7/haproxy/0.log"
Aug 05 18:33:47.287600 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:47.287572    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-76c6h_e4c51705-69ca-4bdf-8ea1-ac673019c877/manager/0.log"
Aug 05 18:33:47.358998 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:47.358964    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-j2z9l_f8b745e5-e2da-4453-bbdc-6fe0304abbab/kuadrant-console-plugin/0.log"
Aug 05 18:33:47.592709 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:47.592561    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-txv6b_ced5df6b-25c4-4fcb-8f2b-1ac65335989c/manager/0.log"
Aug 05 18:33:49.315585 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:49.315550    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-js46d_234a7600-2e87-4367-a77f-cb2b59ee4b3f/cluster-monitoring-operator/0.log"
Aug 05 18:33:49.582966 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:49.582872    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pvsdv_fea7f803-b3c1-49ba-9f5e-6827ee10c813/node-exporter/0.log"
Aug 05 18:33:49.606760 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:49.606736    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pvsdv_fea7f803-b3c1-49ba-9f5e-6827ee10c813/kube-rbac-proxy/0.log"
Aug 05 18:33:49.634761 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:49.634716    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pvsdv_fea7f803-b3c1-49ba-9f5e-6827ee10c813/init-textfile/0.log"
Aug 05 18:33:50.170256 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:50.170205    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-697f7486dc-ctxw8_3fd11c9f-fb19-4e92-9bce-71c111824bec/telemeter-client/0.log"
Aug 05 18:33:50.196488 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:50.196462    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-697f7486dc-ctxw8_3fd11c9f-fb19-4e92-9bce-71c111824bec/reload/0.log"
Aug 05 18:33:50.221236 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:50.221190    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-697f7486dc-ctxw8_3fd11c9f-fb19-4e92-9bce-71c111824bec/kube-rbac-proxy/0.log"
Aug 05 18:33:51.465109 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:51.465061    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rl9xm/perf-node-gather-daemonset-78gx5"]
Aug 05 18:33:51.469841 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:51.469813    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rl9xm/perf-node-gather-daemonset-78gx5"
Aug 05 18:33:51.481055 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:51.481032    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rl9xm/perf-node-gather-daemonset-78gx5"]
Aug 05 18:33:51.562608 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:51.562560    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/03dbe6cd-bb17-43dc-b250-d7a00c0bcebf-proc\") pod \"perf-node-gather-daemonset-78gx5\" (UID: \"03dbe6cd-bb17-43dc-b250-d7a00c0bcebf\") " pod="openshift-must-gather-rl9xm/perf-node-gather-daemonset-78gx5"
Aug 05 18:33:51.562805 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:51.562630    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/03dbe6cd-bb17-43dc-b250-d7a00c0bcebf-podres\") pod \"perf-node-gather-daemonset-78gx5\" (UID: \"03dbe6cd-bb17-43dc-b250-d7a00c0bcebf\") " pod="openshift-must-gather-rl9xm/perf-node-gather-daemonset-78gx5"
Aug 05 18:33:51.562805 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:51.562689    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/03dbe6cd-bb17-43dc-b250-d7a00c0bcebf-lib-modules\") pod \"perf-node-gather-daemonset-78gx5\" (UID: \"03dbe6cd-bb17-43dc-b250-d7a00c0bcebf\") " pod="openshift-must-gather-rl9xm/perf-node-gather-daemonset-78gx5"
Aug 05 18:33:51.562805 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:51.562719    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03dbe6cd-bb17-43dc-b250-d7a00c0bcebf-sys\") pod \"perf-node-gather-daemonset-78gx5\" (UID: \"03dbe6cd-bb17-43dc-b250-d7a00c0bcebf\") " pod="openshift-must-gather-rl9xm/perf-node-gather-daemonset-78gx5"
Aug 05 18:33:51.562805 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:51.562778    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff48q\" (UniqueName: \"kubernetes.io/projected/03dbe6cd-bb17-43dc-b250-d7a00c0bcebf-kube-api-access-ff48q\") pod \"perf-node-gather-daemonset-78gx5\" (UID: \"03dbe6cd-bb17-43dc-b250-d7a00c0bcebf\") " pod="openshift-must-gather-rl9xm/perf-node-gather-daemonset-78gx5"
Aug 05 18:33:51.614741 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:51.614709    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-f77f48c6d-st5bm_604187ee-64f0-4d2f-8a2c-15995ec0c181/networking-console-plugin/0.log"
Aug 05 18:33:51.664288 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:51.664245    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/03dbe6cd-bb17-43dc-b250-d7a00c0bcebf-lib-modules\") pod \"perf-node-gather-daemonset-78gx5\" (UID: \"03dbe6cd-bb17-43dc-b250-d7a00c0bcebf\") " pod="openshift-must-gather-rl9xm/perf-node-gather-daemonset-78gx5"
Aug 05 18:33:51.664475 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:51.664305    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03dbe6cd-bb17-43dc-b250-d7a00c0bcebf-sys\") pod \"perf-node-gather-daemonset-78gx5\" (UID: \"03dbe6cd-bb17-43dc-b250-d7a00c0bcebf\") " pod="openshift-must-gather-rl9xm/perf-node-gather-daemonset-78gx5"
Aug 05 18:33:51.664475 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:51.664396    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff48q\" (UniqueName: \"kubernetes.io/projected/03dbe6cd-bb17-43dc-b250-d7a00c0bcebf-kube-api-access-ff48q\") pod \"perf-node-gather-daemonset-78gx5\" (UID: \"03dbe6cd-bb17-43dc-b250-d7a00c0bcebf\") " pod="openshift-must-gather-rl9xm/perf-node-gather-daemonset-78gx5"
Aug 05 18:33:51.664475 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:51.664407    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/03dbe6cd-bb17-43dc-b250-d7a00c0bcebf-lib-modules\") pod \"perf-node-gather-daemonset-78gx5\" (UID: \"03dbe6cd-bb17-43dc-b250-d7a00c0bcebf\") " pod="openshift-must-gather-rl9xm/perf-node-gather-daemonset-78gx5"
Aug 05 18:33:51.664475 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:51.664435    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03dbe6cd-bb17-43dc-b250-d7a00c0bcebf-sys\") pod \"perf-node-gather-daemonset-78gx5\" (UID: \"03dbe6cd-bb17-43dc-b250-d7a00c0bcebf\") " pod="openshift-must-gather-rl9xm/perf-node-gather-daemonset-78gx5"
Aug 05 18:33:51.664720 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:51.664534    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/03dbe6cd-bb17-43dc-b250-d7a00c0bcebf-proc\") pod \"perf-node-gather-daemonset-78gx5\" (UID: \"03dbe6cd-bb17-43dc-b250-d7a00c0bcebf\") " pod="openshift-must-gather-rl9xm/perf-node-gather-daemonset-78gx5"
Aug 05 18:33:51.664720 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:51.664575    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/03dbe6cd-bb17-43dc-b250-d7a00c0bcebf-podres\") pod \"perf-node-gather-daemonset-78gx5\" (UID: \"03dbe6cd-bb17-43dc-b250-d7a00c0bcebf\") " pod="openshift-must-gather-rl9xm/perf-node-gather-daemonset-78gx5"
Aug 05 18:33:51.664829 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:51.664748    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/03dbe6cd-bb17-43dc-b250-d7a00c0bcebf-proc\") pod \"perf-node-gather-daemonset-78gx5\" (UID: \"03dbe6cd-bb17-43dc-b250-d7a00c0bcebf\") " pod="openshift-must-gather-rl9xm/perf-node-gather-daemonset-78gx5"
Aug 05 18:33:51.664829 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:51.664775    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/03dbe6cd-bb17-43dc-b250-d7a00c0bcebf-podres\") pod \"perf-node-gather-daemonset-78gx5\" (UID: \"03dbe6cd-bb17-43dc-b250-d7a00c0bcebf\") " pod="openshift-must-gather-rl9xm/perf-node-gather-daemonset-78gx5"
Aug 05 18:33:51.678366 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:51.678332    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff48q\" (UniqueName: \"kubernetes.io/projected/03dbe6cd-bb17-43dc-b250-d7a00c0bcebf-kube-api-access-ff48q\") pod \"perf-node-gather-daemonset-78gx5\" (UID: \"03dbe6cd-bb17-43dc-b250-d7a00c0bcebf\") " pod="openshift-must-gather-rl9xm/perf-node-gather-daemonset-78gx5"
Aug 05 18:33:51.785328 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:51.785242    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rl9xm/perf-node-gather-daemonset-78gx5"
Aug 05 18:33:51.993712 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:51.993642    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rl9xm/perf-node-gather-daemonset-78gx5"]
Aug 05 18:33:51.996413 ip-10-0-129-136 kubenswrapper[2558]: W0805 18:33:51.996383    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod03dbe6cd_bb17_43dc_b250_d7a00c0bcebf.slice/crio-1131e20c056ef27c2738d430ec855291012ef450b49e85e440eba0ea1106af62 WatchSource:0}: Error finding container 1131e20c056ef27c2738d430ec855291012ef450b49e85e440eba0ea1106af62: Status 404 returned error can't find the container with id 1131e20c056ef27c2738d430ec855291012ef450b49e85e440eba0ea1106af62
Aug 05 18:33:52.143842 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:52.143807    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rl9xm/perf-node-gather-daemonset-78gx5" event={"ID":"03dbe6cd-bb17-43dc-b250-d7a00c0bcebf","Type":"ContainerStarted","Data":"4ccaa3ea34949310107997b69345891fd40566c0fee154a5040b07a6bf45c470"}
Aug 05 18:33:52.144033 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:52.143860    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rl9xm/perf-node-gather-daemonset-78gx5" event={"ID":"03dbe6cd-bb17-43dc-b250-d7a00c0bcebf","Type":"ContainerStarted","Data":"1131e20c056ef27c2738d430ec855291012ef450b49e85e440eba0ea1106af62"}
Aug 05 18:33:52.144033 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:52.143921    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rl9xm/perf-node-gather-daemonset-78gx5"
Aug 05 18:33:52.174482 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:52.174426    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rl9xm/perf-node-gather-daemonset-78gx5" podStartSLOduration=1.174408664 podStartE2EDuration="1.174408664s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 18:33:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:33:52.173627499 +0000 UTC m=+3658.486478864" watchObservedRunningTime="2026-08-05 18:33:52.174408664 +0000 UTC m=+3658.487260026"
Aug 05 18:33:52.922959 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:52.922922    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-77c974ffcf-cqxb5_737b8b76-932b-4c5c-9e50-98731d108570/download-server/0.log"
Aug 05 18:33:53.573494 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:53.573469    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5b8776669-jkg89_cae69257-293c-4fcd-a177-ff098d535a99/volume-data-source-validator/0.log"
Aug 05 18:33:54.716298 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:54.716261    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nldnk_20a85ae0-3338-4063-923a-3f69efab43ff/dns/0.log"
Aug 05 18:33:54.740626 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:54.740592    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nldnk_20a85ae0-3338-4063-923a-3f69efab43ff/kube-rbac-proxy/0.log"
Aug 05 18:33:54.870179 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:54.870152    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jmdlw_795a8ab5-035a-4295-a4ea-e7d44991562d/dns-node-resolver/0.log"
Aug 05 18:33:55.559907 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:55.559866    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6bc9d45fc9-ggtj6_88df594f-dffc-4de0-be71-135cb8d646a3/registry/0.log"
Aug 05 18:33:55.621479 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:55.621447    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ddzbb_2c932fc3-5567-4183-97ee-36f5359a9a64/node-ca/0.log"
Aug 05 18:33:56.745428 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:56.745394    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d_2d6c6c86-3828-429b-9c43-fc6727894e36/istio-proxy/0.log"
Aug 05 18:33:56.976548 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:56.976511    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57558c7678-t6dn8_973aa2f2-95d7-4e1b-928a-6ca453988c91/kube-auth-proxy/0.log"
Aug 05 18:33:57.006605 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:57.006516    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-kfjgh_7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce/istio-proxy/0.log"
Aug 05 18:33:57.017933 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:57.017906    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-kfjgh_7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce/istio-proxy/1.log"
Aug 05 18:33:58.039361 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:58.039329    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ll8qf_43fc005c-77a6-4226-8938-b8f123e9dae6/serve-healthcheck-canary/0.log"
Aug 05 18:33:58.166493 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:58.166454    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rl9xm/perf-node-gather-daemonset-78gx5"
Aug 05 18:33:58.630799 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:58.630769    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-56tqj_af7ba770-5123-4eb7-a8f8-c023fdf96fad/insights-operator/0.log"
Aug 05 18:33:58.632669 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:58.632636    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-56tqj_af7ba770-5123-4eb7-a8f8-c023fdf96fad/insights-operator/1.log"
Aug 05 18:33:58.806161 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:58.806131    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s8g9k_b03322eb-ca70-4709-b434-905903f18686/kube-rbac-proxy/0.log"
Aug 05 18:33:58.834931 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:58.834906    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s8g9k_b03322eb-ca70-4709-b434-905903f18686/exporter/0.log"
Aug 05 18:33:58.858667 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:33:58.858639    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s8g9k_b03322eb-ca70-4709-b434-905903f18686/extractor/0.log"
Aug 05 18:34:01.524786 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:34:01.524746    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-xzf7w_f365d586-28c7-416b-92cb-0f7df80abaa9/manager/0.log"
Aug 05 18:34:01.977163 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:34:01.977078    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-qr69q_69d8e66b-b6d9-4ff6-92a5-5de71aa13d1e/manager/0.log"
Aug 05 18:34:02.192102 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:34:02.192073    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-zpn52_82c5c71e-9b28-4dd7-9048-2c50db39791b/server/0.log"
Aug 05 18:34:02.216197 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:34:02.216165    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d_2d6c6c86-3828-429b-9c43-fc6727894e36/istio-proxy/0.log"
Aug 05 18:34:02.335890 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:34:02.335803    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-pkqgh_d1d22d83-ab2e-42c8-8ccf-6833b79b95f5/manager/0.log"
Aug 05 18:34:02.417413 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:34:02.417379    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57558c7678-t6dn8_973aa2f2-95d7-4e1b-928a-6ca453988c91/kube-auth-proxy/0.log"
Aug 05 18:34:02.450557 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:34:02.450502    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-kfjgh_7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce/istio-proxy/0.log"
Aug 05 18:34:02.472369 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:34:02.472333    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-kfjgh_7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce/istio-proxy/1.log"
Aug 05 18:34:02.541349 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:34:02.541289    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-856dccdfcf-2xgt8_c995a756-05ef-4947-90b4-74d4559c7b7a/manager/0.log"
Aug 05 18:34:02.578568 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:34:02.578529    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-856dccdfcf-2xgt8_c995a756-05ef-4947-90b4-74d4559c7b7a/copy-manifests/0.log"
Aug 05 18:34:04.016889 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:34:04.016851    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cqqz5d_2d6c6c86-3828-429b-9c43-fc6727894e36/istio-proxy/0.log"
Aug 05 18:34:04.119593 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:34:04.119564    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-mntxn_57824f95-97b1-4ca7-b06d-1e754cc116bb/openshift-lws-operator/0.log"
Aug 05 18:34:04.257972 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:34:04.257942    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57558c7678-t6dn8_973aa2f2-95d7-4e1b-928a-6ca453988c91/kube-auth-proxy/0.log"
Aug 05 18:34:04.292438 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:34:04.292352    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-kfjgh_7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce/istio-proxy/0.log"
Aug 05 18:34:04.305637 ip-10-0-129-136 kubenswrapper[2558]: I0805 18:34:04.305607    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-kfjgh_7e4f2053-c2dc-4f1e-9769-9046ce9bb3ce/istio-proxy/1.log"